README.md · echarlaix/distilgpt2-openvino at main

metadata

base_model: distilbert/distilgpt2
datasets:
  - openwebtext
language: en
license: apache-2.0
pipeline_tag: text-generation
tags:
  - exbert
  - openvino
  - openvino-export
co2_eq_emissions: 149200
model-index:
  - name: distilgpt2
    results:
      - task:
          type: text-generation
          name: Text Generation
        dataset:
          name: WikiText-103
          type: wikitext
        metrics:
          - type: perplexity
            value: 21.1
            name: Perplexity

This model was converted to OpenVINO from distilbert/distilgpt2 using optimum-intel via the export space.

First make sure you have optimum-intel installed:

pip install optimum[openvino]

To load your model you can do as follows:

from optimum.intel import OVModelForCausalLM

model_id = "echarlaix/distilgpt2-openvino"
model = OVModelForCausalLM.from_pretrained(model_id)