Edit model card

RemoteSensing Distilbert

alt text

The field of earth observation is increasingly growing. More and more data scientists are interested about this domain, and they're developing computer vision applications that do amazing things, while NLP doesn't seem to be given much consideration in this area That's why I posted Chramer/remote-sensing-distilbert-cased. This is masked language model trained on a corpus of technical information about space missions, instruments, and sensors.

The model is based on distilbert-base-cased, but I didn't have the chance to play with the hyperparameters of the model because of the limited computational capabilities I have. So there's a lot to improve! ๐Ÿ˜†

It was fun to publish my first model on hugging face! ๐Ÿคฉ

Author: Marcello Politi (Twitter ๐Ÿฆ ,LinkedIn ๐Ÿ’ผ).

Perplexity

Test set: 4.5k sentences about technical space stuff.

Model Perplexity
remote-sensing-distilbert-cased 6.45
distilbert-base-cased 33.77

Usage

from transformers import AutoModel, AutoTokenizer
model_name = "Chramer/remote-sensing-distilbert-cased"
tokenizer = AutoTokenizer.from_pretrained(model_name)
model = AutoModel.from_pretrained(model_name)
Downloads last month
3
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.