ModernBERT-BizClassifier - Business Relevance Classifier
📌 Overview
ModernBERT-BizClassifier is a fine-tuned ModernBERT model that classifies text from any source (social media, news, reports, etc.) and determines whether it is useful for businesses.
The model distinguishes between:
- Business_Action_Direct: Clearly relevant business information (e.g., financial reports, earnings, funding rounds).
- Business_Intelligence_Indirect: Text that implies business relevance (e.g., regulatory news, economic trends, emerging markets).
- Not_Business_Relevant: Text that contains no useful business insights.
🛠 Model Details
| Hyperparameter | Value |
|---|---|
| Base Model | ModernBERT-base |
| Max Context Length | 8192 tokens |
| Batch Size | 32 |
| Learning Rate | 1e-5 |
| Weight Decay | 0.005 |
| Epochs | 2.0 |
| Warmup Ratio | 0.1 |
| Precision Used | BF16 if CUDA available |
| Problem Type | Multi-label classification |
📊 Evaluation Results
| Metric | Score |
|---|---|
| Final Validation Loss | 0.2940 |
| Micro F1 Score | 0.8049 |
| Macro F1 Score | 0.8042 |
| Evaluation Runtime | 3.48 seconds |
| Samples Processed Per Second | 239.09 |
| Steps Processed Per Second | 7.48 |
🏗 Model Card
- Tags:
business-classification,BERT,financial-analysis,text-classification
{
1: "Business_Action_Direct",
2: "Business_Intelligence_Indirect",
3: "Not_Business_Relevant"
}