library_name: transformers
license: apache-2.0
language:
- en
pipeline_tag: text-classification
Fine-tuned LoRA Classifier on MobileBERT
This is a fine-tuned LoRA (Low-Rank Adaptation) classifier on MobileBERT, designed for intent classification across multiple categories. MobileBERT is a compact and efficient version of BERT_LARGE, optimized for resource-constrained devices while maintaining robust performance. The model has been fine-tuned to classify intents such as information queries, navigation, purchase, and more.
Model Details
Model Description
This model is based on MobileBERT (uncased_L-24_H-128_B-512_A-4_F-4_OPT) and fine-tuned using LoRA for intent classification. The fine-tuning process adapts the model to predict intents across 8 categories:
- information_intent
- yelp_intent
- navigation_intent
- travel_intent
- purchase_intent
- weather_intent
- translation_intent
- unknown
- Developed by: Mozilla
- Language(s): English (
en) - License: Apache-2.0
- Fine-tuned from: google/mobilebert-uncased
Model Sources
- Repository: Mozilla Smart Intent Project
- Demo: https://huggingface.co/spaces/chidamnat2002/intent_classifier
Citation
If you use this model, please cite it as: @misc{mozilla_mobilebert_lora_intent, title={Fine-tuned LoRA Classifier on MobileBERT}, author={Mozilla}, year={2024}, url={https://huggingface.co/Mozilla/mobilebert-uncased-finetuned-LoRA-intent-classifier}, license={Apache-2.0} }