johnamcruz's picture
Create README.md
02cc37d
|
raw
history blame
251 Bytes

CoreML for MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices

MobileBERT is a thin version of BERT_LARGE, while equipped with bottleneck structures and a carefully designed balance between self-attentions and feed-forward networks.