Quite suprised I did not upload the gpt2. I must have gotten it confused with another one. It was the same size I think as smpanaro's gpt2 and it was like why? If its two different methods of converting? Anyways here is the code repo: https://github.com/antmikinka/StatefulGPT2CoreML
Inference Providers
NEW
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API:
The model has no library tag.
Model tree for anthonymikinka/gpt2_coreml_kv_cache_try1
Base model
openai-community/gpt2