metadata

library_name: transformers
license: apache-2.0
language:
  - en
pipeline_tag: text-classification

Fine-tuned LoRA Classifier on MobileBERT

This is a fine-tuned LoRA (Low-Rank Adaptation) classifier on MobileBERT, designed for intent classification across multiple categories. MobileBERT is a compact and efficient version of BERT_LARGE, optimized for resource-constrained devices while maintaining robust performance. The model has been fine-tuned to classify intents such as information queries, navigation, purchase, and more.

Model Details

Model Description

This model is based on MobileBERT (uncased_L-24_H-128_B-512_A-4_F-4_OPT) and fine-tuned using LoRA for intent classification. The fine-tuning process adapts the model to predict intents across 8 categories:

information_intent
yelp_intent
navigation_intent
travel_intent
purchase_intent
weather_intent
translation_intent
unknown

Developed by: Mozilla
Language(s): English (en)
License: Apache-2.0
Fine-tuned from: google/mobilebert-uncased

Model Sources

Repository: Mozilla Smart Intent Project
Demo: https://huggingface.co/spaces/chidamnat2002/intent_classifier

Citation

If you use this model, please cite it as:

@misc{mozilla_mobilebert_lora_intent,
  title       = {Fine-tuned LoRA Classifier on MobileBERT},
  author      = {Mozilla},
  year        = {2024},
  url         = {https://huggingface.co/Mozilla/mobilebert-uncased-finetuned-LoRA-intent-classifier},
  license     = {Apache-2.0}
}