|
--- |
|
library_name: transformers |
|
license: apache-2.0 |
|
language: |
|
- en |
|
pipeline_tag: text-classification |
|
--- |
|
|
|
# Fine-tuned LoRA Classifier on MobileBERT |
|
|
|
This is a fine-tuned LoRA (Low-Rank Adaptation) classifier on MobileBERT, designed for intent classification across multiple categories. MobileBERT is a compact and efficient version of BERT_LARGE, optimized for resource-constrained devices while maintaining robust performance. The model has been fine-tuned to classify intents such as information queries, navigation, purchase, and more. |
|
|
|
## Model Details |
|
|
|
### Model Description |
|
|
|
This model is based on MobileBERT (uncased_L-24_H-128_B-512_A-4_F-4_OPT) and fine-tuned using LoRA for intent classification. The fine-tuning process adapts the model to predict intents across 8 categories: |
|
|
|
- **information_intent** |
|
- **yelp_intent** |
|
- **navigation_intent** |
|
- **travel_intent** |
|
- **purchase_intent** |
|
- **weather_intent** |
|
- **translation_intent** |
|
- **unknown** |
|
--- |
|
|
|
|
|
- **Developed by:** Mozilla |
|
- **Language(s):** English (`en`) |
|
- **License:** Apache-2.0 |
|
- **Fine-tuned from:** [google/mobilebert-uncased](https://huggingface.co/google/mobilebert-uncased) |
|
|
|
### Model Sources |
|
|
|
- **Repository:** [Mozilla Smart Intent Project](https://github.com/mozilla/smart_intent) |
|
- **Demo:** https://huggingface.co/spaces/chidamnat2002/intent_classifier |
|
|
|
## Citation |
|
If you use this model, please cite it as: |
|
``` |
|
@misc{mozilla_mobilebert_lora_intent, |
|
title = {Fine-tuned LoRA Classifier on MobileBERT}, |
|
author = {Mozilla}, |
|
year = {2024}, |
|
url = {https://huggingface.co/Mozilla/mobilebert-uncased-finetuned-LoRA-intent-classifier}, |
|
license = {Apache-2.0} |
|
} |
|
``` |
|
|
