Simple example to use on a web page

#2
by industrialpoet - opened

Is there a simple way to load and call this from a web page I create. Then make regular LLM calls like an HTTP_Request to the API from JavaScript.

Check out this section and let me know if this is what you are looking for ๐Ÿค—
https://huggingface.co/blog/llama32#mlcai-web-llm

This looks like what I need. I will play with it in the next few days. Thankx!

sweet, we plan to release a template to make it easier to build with webllm, will lyk when it's out :).

Also be sure to check out MLCs official examples here.

cfahlgren1 changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment