Raj Mehta

rjmehta

AI & ML interests

None yet

Recent Activity

reacted to rajistics's post with 👍 7 days ago

Having some fun with long context benchmarks (watch the video!!) NoLiMA: https://huggingface.co/papers/2502.05167 Fiction LiveBench: https://fiction.live/stories/Fiction-liveBench-Mar-25-2025/oQdzQvKHw8JyXbN87 Michalenglo: https://deepmind.google/research/publications/117639/ LongGenBench: https://huggingface.co/papers/2409.02076 NeedleBench: https://huggingface.co/papers/2407.11963 RULER: https://huggingface.co/papers/2404.06654 For more: https://www.reddit.com/r/rajistics/comments/1jxwk29/long_context_llm_benchmarks_video/ let me know if you like these posts

new activity 3 months ago

deepseek-ai/DeepSeek-R1-Distill-Qwen-32B:YaRN block required?

new activity 3 months ago

HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1:What's the instruction you added for each task in training?

View all activity

Organizations

None yet

rjmehta's activity

reacted to rajistics's post with 👍 7 days ago

Post

3369

Having some fun with long context benchmarks (watch the video!!)

NoLiMA: NoLiMa: Long-Context Evaluation Beyond Literal Matching (2502.05167)
Fiction LiveBench: https://fiction.live/stories/Fiction-liveBench-Mar-25-2025/oQdzQvKHw8JyXbN87
Michalenglo: https://deepmind.google/research/publications/117639/
LongGenBench: Spinning the Golden Thread: Benchmarking Long-Form Generation in Language Models (2409.02076)
NeedleBench: NeedleBench: Can LLMs Do Retrieval and Reasoning in 1 Million Context Window? (2407.11963)
RULER: RULER: What's the Real Context Size of Your Long-Context Language Models? (2404.06654)

For more: https://www.reddit.com/r/rajistics/comments/1jxwk29/long_context_llm_benchmarks_video/

let me know if you like these posts

New activity in deepseek-ai/DeepSeek-R1-Distill-Qwen-32B 3 months ago

YaRN block required?

#5 opened 3 months ago by

robbiemu

New activity in HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1 3 months ago

What's the instruction you added for each task in training?

#3 opened 4 months ago by

nachtsky1077

Model weights release?

#1 opened 6 months ago by

rbhatia46

New activity in upstage/solar-pro-preview-instruct 7 months ago

i tested the q8 in lm studio( getting wrong output)

#9 opened 7 months ago by

gopi87

There really seems to be some problem with the tokenizer or the ggufs

#12 opened 7 months ago by

Smorty100

New activity in iiiorg/piiranha-v1-detect-personal-information 7 months ago

License

#1 opened 7 months ago by

rjmehta

reacted to m-ric's post with 🚀 9 months ago

Post

2315

𝗔𝗴𝗲𝗻𝘁𝗶𝗰 𝗗𝗮𝘁𝗮 𝗮𝗻𝗮𝗹𝘆𝘀𝘁: 𝗱𝗿𝗼𝗽 𝘆𝗼𝘂𝗿 𝗱𝗮𝘁𝗮 𝗳𝗶𝗹𝗲, 𝗹𝗲𝘁 𝘁𝗵𝗲 𝗟𝗟𝗠 𝗱𝗼 𝘁𝗵𝗲 𝗮𝗻𝗮𝗹𝘆𝘀𝗶𝘀 📊⚙️

Need to make quick exploratory data analysis? ➡️ Get help from an agent.

I was impressed by Llama-3.1's capacity to derive insights from data. Given a csv file, it makes quick work of exploratory data analysis and can derive interesting insights.

On the data from the Kaggle titanic challenge, that records which passengers survived the Titanic wreckage, it was able by itself to derive interesting trends like "passengers that paid higher fares were more likely to survive" or "survival rate was much higher for women than men".

The cookbook even lets the agent built its own submission to the challenge, and it ranks under 3,000 out of 17,000 submissions: 👏 not bad at all!

Try it for yourself in this Space demo 👉 m-ric/agent-data-analyst