DevQuasar/arcee-ai.Virtuoso-Small-v2-GGUF
Text Generation
•
Updated
Csaba Kecskemeti PRO
csabakecskemeti
AI & ML interests
None yet
Recent Activity
updated
a model
20 minutes ago
DevQuasar/arcee-ai.Virtuoso-Small-v2-GGUF
updated
a model
about 1 hour ago
DevQuasar/allenai.Llama-3.1-Tulu-3-405B-GGUF
replied to
their
post
about 4 hours ago
Check out my idea:
LLmaaS - Local LLM as a Service
With LLmaaS, I propose leveraging locally running LLMs as a service, providing a standardized way for websites to access and utilize them for LLM-powered operations directly on the user’s device.
Demo, code, more detailed description.
https://devquasar.com/llmaas/
https://github.com/csabakecskemeti/LLmaaS
https://youtu.be/OOWGr8jcP5Q
Call for contributors
Join me a develop the LLmaaS proxy to make this a generic purpose tool to leverage local LLMs on web. Build in security measures.
I'm looking for help to make the proxy more generic support multiple local LLM services without any change on the HTML side.
Also looking for ideas how to make the HTML par more modular and easy to use.
Organizations
csabakecskemeti's activity
updated
a
model
20 minutes ago
updated
a
model
about 1 hour ago
replied to
their
post
about 4 hours ago
This is obviously a prototype.
Security is a big concern here, but is believe it’s possible to put together a proxy that is safe and does not allow anything else than forward generate requests between browser and local llm.
updated
a
model
about 4 hours ago
updated
a
model
about 5 hours ago
updated
a
model
about 15 hours ago
published
a
model
about 15 hours ago
published
2
models
about 17 hours ago
published
a
model
about 19 hours ago
updated
a
collection
about 19 hours ago
updated
a
model
about 19 hours ago
published
a
model
about 22 hours ago
posted
an
update
1 day ago
Post
843
Check out my idea:
LLmaaS - Local LLM as a Service
With LLmaaS, I propose leveraging locally running LLMs as a service, providing a standardized way for websites to access and utilize them for LLM-powered operations directly on the user’s device.
Demo, code, more detailed description.
https://devquasar.com/llmaas/
https://github.com/csabakecskemeti/LLmaaS
https://youtu.be/OOWGr8jcP5Q
Call for contributors
Join me a develop the LLmaaS proxy to make this a generic purpose tool to leverage local LLMs on web. Build in security measures.
I'm looking for help to make the proxy more generic support multiple local LLM services without any change on the HTML side.
Also looking for ideas how to make the HTML par more modular and easy to use.
LLmaaS - Local LLM as a Service
With LLmaaS, I propose leveraging locally running LLMs as a service, providing a standardized way for websites to access and utilize them for LLM-powered operations directly on the user’s device.
Demo, code, more detailed description.
https://devquasar.com/llmaas/
https://github.com/csabakecskemeti/LLmaaS
https://youtu.be/OOWGr8jcP5Q
Call for contributors
Join me a develop the LLmaaS proxy to make this a generic purpose tool to leverage local LLMs on web. Build in security measures.
I'm looking for help to make the proxy more generic support multiple local LLM services without any change on the HTML side.
Also looking for ideas how to make the HTML par more modular and easy to use.
-
- 1 reply
updated
a
model
1 day ago
updated
a
model
2 days ago
updated
3
datasets
2 days ago