mradermacher
/

bigstral-12b-32k-8xMoE-GGUF

Inference Endpoints

Model card Files Files and versions Community

bigstral-12b-32k-8xMoE-GGUF

1 contributor

History: 10 commits

mradermacher's picture

uploaded from nethype/nico1

482ea58 verified 3 months ago

.gitattributes

2.18 kB

uploaded from nethype/nico1 3 months ago
README.md

222 Bytes

uploaded from nethype/nico1 3 months ago
bigstral-12b-32k-8xMoE.Q2_K.gguf

30.2 GB
LFS

uploaded from nethype/nico1 3 months ago
bigstral-12b-32k-8xMoE.Q3_K_L.gguf

42.2 GB
LFS

uploaded from nethype/nico1 3 months ago
bigstral-12b-32k-8xMoE.Q3_K_M.gguf

39.3 GB
LFS

uploaded from nethype/nico1 3 months ago
bigstral-12b-32k-8xMoE.Q3_K_S.gguf

35.6 GB
LFS

uploaded from nethype/nico1 3 months ago
bigstral-12b-32k-8xMoE.Q4_K_S.gguf

46.7 GB
LFS

uploaded from nethype/nico1 3 months ago
bigstral-12b-32k-8xMoE.Q6_K.gguf.part1of2

34.4 GB
LFS

uploaded from nethype/nico1 3 months ago
bigstral-12b-32k-8xMoE.Q6_K.gguf.part2of2

32.6 GB
LFS

uploaded from nethype/nico1 3 months ago
bigstral-12b-32k-8xMoE.Q8_0.gguf.part1of2

44 GB
LFS

uploaded from nethype/nico1 3 months ago
bigstral-12b-32k-8xMoE.Q8_0.gguf.part2of2

42.6 GB
LFS

uploaded from nethype/nico1 3 months ago