distilvit

This model is a work in progress. Fine-tuned version of those base models:

This model was trained on:

You can get that checkpoint using the 3083a3cef6e3c8dd90df3f088074bbe836b0f403 commit.

It was then further fine-tuned on :

You can find the code used to create the model here: https://github.com/mozilla/distilvit

Framework versions

  • Transformers 4.40.2
  • Pytorch 2.3.0+cu121
  • Datasets 2.19.1
  • Tokenizers 0.19.1
Downloads last month
6
Inference Examples
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social visibility and check back later, or deploy to Inference Endpoints (dedicated) instead.

Model tree for tarekziade/test-push

Quantized
(8)
this model

Dataset used to train tarekziade/test-push

Evaluation results