ct2's picture

ct2

ct-2

·

AI & ML interests

None yet

Recent Activity

upvoted a paper 3 days ago

BitNet b1.58 2B4T Technical Report

upvoted a collection 5 days ago

liked a model 5 days ago

microsoft/bitnet-b1.58-2B-4T

View all activity

Organizations

None yet

ct-2's activity

upvoted a paper 3 days ago

BitNet b1.58 2B4T Technical Report

Paper • 2504.12285 • Published 4 days ago • 53

upvoted a collection 5 days ago

BitNet

🔥BitNet family of large language models (1-bit LLMs). • 6 items • Updated 2 days ago • 24

upvoted a paper 13 days ago

TransMamba: Flexibly Switching between Transformer and Mamba

Paper • 2503.24067 • Published 20 days ago • 17

upvoted 2 papers about 2 months ago

MutaGReP: Execution-Free Repository-Grounded Plan Search for Code-Use

Paper • 2502.15872 • Published Feb 21 • 5

Stable-SPAM: How to Train in 4-Bit More Stably than 16-Bit Adam

Paper • 2502.17055 • Published Feb 24 • 17

upvoted a collection about 2 months ago

Slam

All resources for SpeechLMs from "Slamming: Training a Speech Language Model on One GPU in a Day". We provide tokeniser, lm, and datasets • 6 items • Updated Feb 25 • 13

upvoted a paper about 2 months ago

Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization

Paper • 2502.19261 • Published Feb 26 • 7

upvoted a collection about 2 months ago

Drop-Upcycling

31 items • Updated 19 days ago • 2

upvoted a paper about 2 months ago

Continual Quantization-Aware Pre-Training: When to transition from 16-bit to 1.58-bit pre-training for BitNet language models?

Paper • 2502.11895 • Published Feb 17 • 1

upvoted a collection 2 months ago

Hamanasu

A brand new series of Models from yours truly, Designed for Intelligence, Creativity and Roleplay - R/Locallama keeps DELETING MY GODDAMN COMMENTS • 31 items • Updated 13 days ago • 8

upvoted 3 papers 2 months ago

ParetoQ: Scaling Laws in Extremely Low-bit LLM Quantization

Paper • 2502.02631 • Published Feb 4 • 3

Unlocking Efficient Large Inference Models: One-Bit Unrolling Tips the Scales

Paper • 2502.01908 • Published Feb 4 • 1

QuEST: Stable Training of LLMs with 1-Bit Weights and Activations

Paper • 2502.05003 • Published Feb 7 • 44

upvoted 2 papers 6 months ago

Why Does the Effective Context Length of LLMs Fall Short?

Paper • 2410.18745 • Published Oct 24, 2024 • 18

Unbounded: A Generative Infinite Game of Character Life Simulation

Paper • 2410.18975 • Published Oct 24, 2024 • 38