xmadai
/

Llama-3.2-3B-Instruct-xMADai-INT4

Text Generation

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

JonahYixMAD commited on about 1 month ago

Commit

729b1b2

•

1 Parent(s): 30d9f5f

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -57,7 +57,7 @@ Model | GPU Memory Requirement
 --- | ---
 Llama-3.2-3B-Instruct-xMADai-4bit | 6.5 GB → 3.5 GB
 Llama-3.2-1B-Instruct-xMADai-4bit | 2.5 → 2 GB
-Llama-3.1-405B-Instruct-xMADai-4bit | 258.14 GB → 250 GB
 Llama-3.1-8B-Instruct-xMADai-4bit | 16 → 7 GB
 For additional xMADified models, access to fine-tuning, and general questions, please contact us at [email protected] and join our waiting list.

 --- | ---
 Llama-3.2-3B-Instruct-xMADai-4bit | 6.5 GB → 3.5 GB
 Llama-3.2-1B-Instruct-xMADai-4bit | 2.5 → 2 GB
+Llama-3.1-405B-Instruct-xMADai-4bit | 800 GB (16 H100s) → 250 GB (8 V100)
 Llama-3.1-8B-Instruct-xMADai-4bit | 16 → 7 GB
 For additional xMADified models, access to fine-tuning, and general questions, please contact us at [email protected] and join our waiting list.