allenai
/

OLMoE-1B-7B-0125-GGUF

Model card Files Files and versions Community

GGUF version of https://huggingface.co/allenai/OLMoE-1B-7B-0125

Downloads last month: 812

GGUF

Model size

6.92B params

Architecture

olmoe

Hardware compatibility

Log In to view the estimation

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for allenai/OLMoE-1B-7B-0125-GGUF

Base model

allenai/OLMoE-1B-7B-0125

Quantized

(6)

this model

Collection including allenai/OLMoE-1B-7B-0125-GGUF

OLMoE (January 2025)

Improved OLMoE for iOS app. Read more: https://allenai.org/blog/olmoe-app • 10 items • Updated 24 days ago • 12