TheBloke

/

Guanaco-7B-Uncensored-GGUF

like 14

this LLM is very nice.
I wanna use this model, So, wanna deploy to AWS
but, I can't deploy it as aws sagemaker endpoint.
isn't GGUF model available in AWS?
If so, how to use this model efficiently?