mohammed arbi

Goodnight7

mohammed-arbi-nsibi-584a43241

AI & ML interests

None yet

Recent Activity

reacted to as-cle-bert's post with ❤️ 4 days ago

I just released a fully automated evaluation framework for your RAG applications!📈 GitHub 👉 https://github.com/AstraBert/diRAGnosis PyPi 👉 https://pypi.org/project/diragnosis/ It's called 𝐝𝐢𝐑𝐀𝐆𝐧𝐨𝐬𝐢𝐬 and is a lightweight framework that helps you 𝗱𝗶𝗮𝗴𝗻𝗼𝘀𝗲 𝘁𝗵𝗲 𝗽𝗲𝗿𝗳𝗼𝗿𝗺𝗮𝗻𝗰𝗲 𝗼𝗳 𝗟𝗟𝗠𝘀 𝗮𝗻𝗱 𝗿𝗲𝘁𝗿𝗶𝗲𝘃𝗮𝗹 𝗺𝗼𝗱𝗲𝗹𝘀 𝗶𝗻 𝗥𝗔𝗚 𝗮𝗽𝗽𝗹𝗶𝗰𝗮𝘁𝗶𝗼𝗻𝘀. You can launch it as an application locally (it's Docker-ready!🐋) or, if you want more flexibility, you can integrate it in your code as a python package📦 The workflow is simple: 🧠 You choose your favorite LLM provider and model (supported, for now, are Mistral AI, Groq, Anthropic, OpenAI and Cohere) 🧠 You pick the embedding models provider and the embedding model you prefer (supported, for now, are Mistral AI, Hugging Face, Cohere and OpenAI) 📄 You prepare and provide your documents ⚙️ Documents are ingested into a Qdrant vector database and transformed into a synthetic question dataset with the help of LlamaIndex 📊 The LLM is evaluated for the faithfulness and relevancy of its retrieval-augmented answer to the questions 📊 The embedding model is evaluated for hit rate and mean reciprocal ranking (MRR) of the retrieved documents And the cool thing is that all of this is 𝗶𝗻𝘁𝘂𝗶𝘁𝗶𝘃𝗲 𝗮𝗻𝗱 𝗰𝗼𝗺𝗽𝗹𝗲𝘁𝗲𝗹𝘆 𝗮𝘂𝘁𝗼𝗺𝗮𝘁𝗲𝗱: you plug it in, and it works!🔌⚡ Even cooler? This is all built on top of LlamaIndex and its integrations: no need for tons of dependencies or fancy workarounds🦙 And if you're a UI lover, Gradio and FastAPI are there to provide you a seamless backend-to-frontend experience🕶️ So now it's your turn: you can either get diRAGnosis from GitHub 👉 https://github.com/AstraBert/diRAGnosis or just run a quick and painless: ```bash uv pip install diragnosis ``` To get the package installed (lightning-fast) in your environment🏃‍♀️ Have fun and feel free to leave feedback and feature/integrations requests on GitHub issues✨

liked a Space 23 days ago

ngxson/kokoro-podcast-generator

upvoted a collection 28 days ago

Tools for learning AI

View all activity

Organizations

Goodnight7's activity

upvoted a collection 28 days ago

Tools for learning AI

Collection

This is a collection of tools on the hub that teachers and students can use to learn AI! • 9 items • Updated 16 days ago • 66

upvoted 2 articles about 2 months ago

Article

PyTorchModelHubMixin: Bridging the Gap for Custom AI Models on Hugging Face

and 1 other •

Nov 11, 2024

• 16

Article

Mastering Tensor Dimensions in Transformers

•

Jan 12

• 49

upvoted an article 5 months ago

Article

How to build a custom text classifier without days of human labeling

and 4 others •

Oct 17, 2024

• 55

upvoted an article 6 months ago

Article

RAG using huggingface tools

•

Jul 7, 2024

• 81

upvoted an article 11 months ago

Article

Custom architectures with HuggingFace 🤗

•

Apr 22, 2024

• 26