Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up
huggingface 's Collections
DistilBERT release

DistilBERT release

updated Apr 17, 2024

Original DistilBERT model, checkpoints obtained from using teacher-student learning from the original BERT checkpoints.

Upvote
36

  • distilbert/distilbert-base-cased

    Fill-Mask • 65.8M • Updated May 6, 2024 • 137k • • 57

  • distilbert/distilbert-base-uncased

    Fill-Mask • 67M • Updated May 6, 2024 • 5.95M • • 830

  • distilbert/distilbert-base-multilingual-cased

    Fill-Mask • 0.1B • Updated May 6, 2024 • 1.11M • • 230

  • distilbert/distilbert-base-uncased-finetuned-sst-2-english

    Text Classification • 67M • Updated Dec 19, 2023 • 4.17M • • 872

  • distilbert/distilbert-base-uncased-distilled-squad

    Question Answering • 66.4M • Updated May 6, 2024 • 35.3k • • 119

  • distilbert/distilbert-base-cased-distilled-squad

    Question Answering • 65.2M • Updated May 6, 2024 • 187k • • 266
Upvote
36
  • Collection guide
  • Browse collections
Company
TOS Privacy About Careers
Website
Models Datasets Spaces Pricing Docs