Hugging Face's logo

Neural Magic

company
Verified
https://neuralmagic.com/
neuralmagic
neuralmagic
Activity Feed

AI & ML interests

LLMs, optimization, compression, sparsification, quantization, pruning, distillation, NLP, CV

Recent Activity

mgoin  updated a model 6 days ago
neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-FP8-dynamic
mgoin  updated a model 6 days ago
neuralmagic/Sparse-Llama-3.1-8B-evolcodealpaca-2of4-FP8-dynamic
mgoin  updated a model 6 days ago
neuralmagic/Sparse-Llama-3.1-8B-gsm8k-2of4-FP8-dynamic
View all activity

neuralmagic's activity

mgoin 
updated 3 models 6 days ago
nm-research 
updated 6 models 6 days ago
dsikka 
in neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4-quantized.w4a16 7 days ago

Model only outputs "!!!!!!!!!!"

1
#1 opened 8 days ago by
mrhendrey
markurtz 
in neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8-dynamic 7 days ago

What is the difference between this and "neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8"

1
#1 opened 7 days ago by
RonanMcGovern
nm-research 
updated a model 8 days ago
mgoin 
in neuralmagic/Llama-3.2-90B-Vision-Instruct-FP8-dynamic 8 days ago

Model does not run with VLLM

2
#3 opened 8 days ago by
aswad546
nm-research 
updated a collection 8 days ago
mgoin 
in neuralmagic/Llama-3.2-11B-Vision-Instruct-FP8-dynamic 9 days ago

Thanks!
#2 opened 17 days ago by
Jindows
nm-research 
updated a model 9 days ago
robertgshaw2 
in neuralmagic/Sparse-Llama-3.1-8B-2of4 12 days ago

Can I apply a LoRA?

2
#1 opened 12 days ago by
RonanMcGovern
d-alistarh 
authored a paper 16 days ago