FlatQuant: Flatness Matters for LLM Quantization
Paper
•
2410.09426
•
Published
•
15
Stephen
smpanaro
AI & ML interests
Apple Neural Engine, Quantization
Recent Activity
new activity
12 days ago
smpanaro/Llama-3.2-1B-Instruct-CoreML:Context length
updated
a model
20 days ago
smpanaro/Llama3.1-8B-Instruct-LeanQuant-kmeans1d
published
a model
20 days ago
smpanaro/Llama3.1-8B-Instruct-LeanQuant-kmeans1d
Organizations
