Join the conversation

Join the community of Machine Learners and AI enthusiasts.

Sign Up
as-cle-bertΒ 
posted an update 2 days ago
Post
538
I heard someone saying π˜ƒπ—Όπ—Άπ—°π—² assistants are the future, and someone else that 𝗠𝗖𝗣 will rule the AI world... So I decided to combine both!πŸš€

Meet 𝐓𝐲𝐒𝐕𝐀 (π—§π˜†pe𝗦cript 𝗩oice 𝗔ssistant, https://github.com/AstraBert/TySVA), your (speaking) AI companion for everyday TypeScript programming tasks!πŸŽ™οΈ

TySVA is a skilled TypeScript expert and, to provide accurate and up-to-date responses, she leverages the following workflow:
πŸ—£οΈ If you talk to her, she converts the audio into a textual prompt, and use it a starting point to answer your questions (if you send a message, she'll use directly thatπŸ’¬)
🧠 She can solve your questions by (deep)searching the web and/or by retrieving relevant information from a vector database containing TypeScript documentation. If the answer is simple, she can also reply directly (no tools needed!)
πŸ›œ To ease her life, TySVA has all the tools she needs available through Model Context Protocol (MCP)
πŸ”Š Once she's done, she returns her answer to you, along with a voice summary of what she did and what solution she found

But how does she do that? What are her components?🀨

πŸ“– Qdrant + HuggingFace give her the documentation knowledge, providing the vector database and the embeddings
🌐 Linkup provides her with up-to-date, grounded answers, connecting her to the web
πŸ¦™ LlamaIndex makes up her brain, with the whole agentic architecture
🎀 ElevenLabs gives her ears and mouth, transcribing and producing voice inputs and outoputs
πŸ“œ Groq provides her with speech, being the LLM provider behind TySVA
🎨 Gradio+FastAPI make up her face and fibers, providing a seamless backend-to-frontend integration

If you're now curious of trying her, you can easily do that by spinning her up locally (and with Docker!πŸ‹) from the GitHub repo ➑️ https://github.com/AstraBert/TySVA

And feel free to leave any feedback!✨