lucadiliello
/

opt-30b-deepspeed-inference-fp16-shard-8

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (0)

The conversion script to 8 shards and 8 tensor parrallels

#1 opened over 1 year ago by