Mamba-Shedder: Post-Transformer Compression for Efficient Selective Structured State Space Models Paper • 2501.17088 • Published Jan 28 • 2
Low-Rank Adapters Meet Neural Architecture Search for LLM Compression Paper • 2501.16372 • Published Jan 23 • 9
Shears Collection Shears Models (Shears: Unstructured Sparsity with Neural Low-rank Adapter Search) • 15 items • Updated Feb 13 • 2
SQFT Collection SQFT Models (SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models) • 57 items • Updated Feb 13 • 2
SQFT: Low-cost Model Adaptation in Low-precision Sparse Foundation Models Paper • 2410.03750 • Published Oct 1, 2024 • 2