File size: 1,682 Bytes
795f606 d2b5259 795f606 4f75132 795f606 4f75132 795f606 4f75132 795f606 4f75132 795f606 4f75132 795f606 4f75132 795f606 4f75132 795f606 1ac8d2f cedf059 adb7a32 1ac8d2f adb7a32 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 |
---
library_name: transformers
license: apache-2.0
language:
- en
pipeline_tag: text-classification
---
# Fine-tuned LoRA Classifier on MobileBERT
This is a fine-tuned LoRA (Low-Rank Adaptation) classifier on MobileBERT, designed for intent classification across multiple categories. MobileBERT is a compact and efficient version of BERT_LARGE, optimized for resource-constrained devices while maintaining robust performance. The model has been fine-tuned to classify intents such as information queries, navigation, purchase, and more.
## Model Details
### Model Description
This model is based on MobileBERT (uncased_L-24_H-128_B-512_A-4_F-4_OPT) and fine-tuned using LoRA for intent classification. The fine-tuning process adapts the model to predict intents across 8 categories:
- **information_intent**
- **yelp_intent**
- **navigation_intent**
- **travel_intent**
- **purchase_intent**
- **weather_intent**
- **translation_intent**
- **unknown**
---
- **Developed by:** Mozilla
- **Language(s):** English (`en`)
- **License:** Apache-2.0
- **Fine-tuned from:** [google/mobilebert-uncased](https://huggingface.co/google/mobilebert-uncased)
### Model Sources
- **Repository:** [Mozilla Smart Intent Project](https://github.com/mozilla/smart_intent)
- **Demo:** https://huggingface.co/spaces/chidamnat2002/intent_classifier
## Citation
If you use this model, please cite it as:
```
@misc{mozilla_mobilebert_lora_intent,
title = {Fine-tuned LoRA Classifier on MobileBERT},
author = {Mozilla},
year = {2024},
url = {https://huggingface.co/Mozilla/mobilebert-uncased-finetuned-LoRA-intent-classifier},
license = {Apache-2.0}
}
```
|