FC's picture

7 1 16

FC

i4never

·

i4never

AI & ML interests

None yet

Recent Activity

liked a model 7 days ago

BlinkDL/temp-latest-training-models

reacted to BlinkDL's post with 🔥 about 1 month ago

RWKV-6-world-v3 (+3.1T tokens) is our best multilingual 7B model as of now: https://huggingface.co/BlinkDL/rwkv-6-world It's 100% RNN and attention-free. MMLU 54.2% (previous world-v2.1 = 47.9%. note: without eval-boosting tricks such as annealing). RWKV-7-world-v4 soon :)

View all activity

Organizations

i4never's activity

upvoted an article 6 months ago

Article

The Technology Behind BLOOM Training

Jul 14, 2022

• 21