Pereki
/

autotrain-a6i98-d578q

Text Generation

text-classification

Trained with AutoTrain

Inference Endpoints

Model card Files Files and versions Metrics Training metrics Community

Pereki commited on Mar 23

Commit

b82ae24

•

1 Parent(s): 69894e7

Update handler.py

Files changed (1) hide show

handler.py +1 -1

handler.py CHANGED Viewed

@@ -9,7 +9,7 @@ class EndpointHandler():
  tokenizer = AutoTokenizer.from_pretrained(path)
  model = AutoModelForCausalLM.from_pretrained(
  path,
- quantization_config=quantization_config
  device_map="auto",
  torch_dtype='auto'
  ).eval()

  tokenizer = AutoTokenizer.from_pretrained(path)
  model = AutoModelForCausalLM.from_pretrained(
  path,
+ quantization_config=quantization_config,
  device_map="auto",
  torch_dtype='auto'
  ).eval()