GPT-2, But With Mistral's Tokenizer

Finally, an answer to one of the biggest open questions in NLP:

Q: Wouldn't it be messed up if someone grafted the tokenizer from Mistral 7B onto GPT-2?
A: Ya :)

Downloads last month: 22

Safetensors

Model size

110M params

Tensor type

F32

Inference Examples

Text Generation

This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for chargoddard/gpt2-mistral-tokenizer

Base model

openai-community/gpt2

Finetuned

(1264)

this model