Jay P

jayomb's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes

upvoted a paper 19 days ago

Were RNNs All We Needed?

Paper • 2410.01201 • Published Oct 2, 2024 • 51

upvoted a collection 8 months ago

abliterated-v3

Collection

Latest gen of the abliterated models I've produced • 17 items • Updated Jun 3, 2024 • 106

upvoted a paper 8 months ago

LoRA Learns Less and Forgets Less

Paper • 2405.09673 • Published May 15, 2024 • 88

upvoted a paper 9 months ago

Piccolo2: General Text Embedding with Multi-task Hybrid Loss Training

Paper • 2405.06932 • Published May 11, 2024 • 18

upvoted an article 9 months ago

view article

Article

Fine-tune Llama 3 with ORPO

By •

Apr 22, 2024

• 233

upvoted a paper 9 months ago

Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck

Paper • 2404.07647 • Published Apr 11, 2024 • 4

upvoted a paper 10 months ago

Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence

Paper • 2404.05892 • Published Apr 8, 2024 • 33

upvoted a collection 10 months ago

OpenCulture

Collection

A multilingual dataset of public domain books and newspapers. • 27 items • Updated Nov 6, 2024 • 123

upvoted 2 papers 11 months ago

Knowledge Fusion of Large Language Models

Paper • 2401.10491 • Published Jan 19, 2024 • 4

StructLM: Towards Building Generalist Models for Structured Knowledge Grounding

Paper • 2402.16671 • Published Feb 26, 2024 • 27