Lorenzo Cevolani's picture

10

Lorenzo Cevolani

LorenzoCevolaniAXA

·

AI & ML interests

NLP, Transformers, GNN and many more!

Organizations

LorenzoCevolaniAXA's activity

New activity in neuralmagic/Meta-Llama-3.1-405B-Instruct-quantized.w4a16 4 months ago

weights does not exist when trying to deploy in sagemaker endpoint

#1 opened 4 months ago by

LorenzoCevolaniAXA

New activity in mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit 8 months ago

error in sagemaker deployement

#2 opened 8 months ago by

LorenzoCevolaniAXA

New activity in text-generation-inference/Mixtral-8x7B-Instruct-v0.1-medusa 8 months ago

What about latencies

#3 opened 8 months ago by

LorenzoCevolaniAXA

New activity in ybelkada/Mixtral-8x7B-Instruct-v0.1-AWQ 8 months ago

latency is slower than standard model, is it normal?

#5 opened 8 months ago by

LorenzoCevolaniAXA

New activity in text-generation-inference/Mixtral-8x7B-Instruct-v0.1-medusa 9 months ago

how to use this model on sagemaker endpoints

#1 opened 10 months ago by

LorenzoCevolaniAXA

New activity in CohereForAI/c4ai-command-r-v01 10 months ago

Error "sharded is not supported for AutoModel" when deploying on sagemaker endpoint

#22 opened 10 months ago by

LorenzoCevolaniAXA

New activity in CohereForAI/aya-101 10 months ago

Correct machine to deploy the model on AWS Sagemaker

#11 opened 10 months ago by

LorenzoCevolaniAXA

New activity in mistralai/Mixtral-8x7B-Instruct-v0.1 about 1 year ago

SageMaker Deployment Error

#53 opened about 1 year ago by

New activity in intfloat/multilingual-e5-large about 1 year ago

Sagemaker Instance suggestion for Inference

#18 opened about 1 year ago by

LorenzoCevolaniAXA

New activity in DAMO-NLP-MT/polylm-chat-13b over 1 year ago

protoc error while deploying the model into SM instance

#1 opened over 1 year ago by

LorenzoCevolaniAXA