Jesse's picture

4 18 9

Jesse

jessepisel

·

jessepisel

AI & ML interests

computer vision, generative ai, agentic

Recent Activity

reacted to clem's post with 🔥 1 day ago

Llama models (arguably the most successful open AI models of all times) just represented 3% of total model downloads on Hugging Face in March. People and media like stories of winner takes all & one model/company to rule them all but the reality is much more nuanced than this! Kudos to all the small AI builders out there!

liked a Space 3 days ago

yourbench/demo

reacted to fdaudens's post with 🔥 3 days ago

Did we just drop personalized AI evaluation?! This tool auto-generates custom benchmarks on your docs to test which models are the best. Most benchmarks test general capabilities, but what matters is how models handle your data and tasks. YourBench helps answer critical questions like: - Do you really need a hundreds-of-billions-parameter model sledgehammer to crack a nut? - Could a smaller, fine-tuned model work better? - How well do different models understand your domain? Some cool features: 📚 Generates custom benchmarks from your own documents (PDFs, Word, HTML) 🎯 Tests models on real tasks, not just general capabilities 🔄 Supports multiple models for different pipeline stages 🧠 Generate both single-hop and multi-hop questions 🔍 Evaluate top models and deploy leaderboards instantly 💰 Full cost analysis to optimize for your budget 🛠️ Fully configurable via a single YAML file 26 SOTA models tested for question generation. Interesting finding: Qwen2.5 32B leads in question diversity, while smaller Qwen models and Gemini 2.0 Flash offer great value for cost. You can also run it locally on any models you want. I'm impressed. Try it out: https://huggingface.co/spaces/yourbench/demo

View all activity

Organizations

models

None public yet

datasets

None public yet