FC's picture

7 1 16

FC

i4never

·

i4never

AI & ML interests

None yet

Recent Activity

liked a model about 2 months ago

BlinkDL/temp-latest-training-models

reacted to BlinkDL's post with 🔥 2 months ago

RWKV-6-world-v3 (+3.1T tokens) is our best multilingual 7B model as of now: https://huggingface.co/BlinkDL/rwkv-6-world It's 100% RNN and attention-free. MMLU 54.2% (previous world-v2.1 = 47.9%. note: without eval-boosting tricks such as annealing). RWKV-7-world-v4 soon :)

upvoted an article 7 months ago

The Technology Behind BLOOM Training

View all activity

Organizations

None yet

models

None public yet

datasets

None public yet