Hugging Face's logo

l3utterfly
/
tinyllama-1.1b-layla-v4-gguf

GGUF
Inference Endpoints
Model card Files Community
l3utterfly commited on
Commit
14dead2
•
1 Parent(s): e917c93

Add quantised GGUF files

Browse files
Files changed (8) hide show
  1. tinyllama-1.1b-layla-v4-Q2_K.gguf +3 -0
  2. tinyllama-1.1b-layla-v4-Q4_0_4_4.gguf +3 -0
  3. tinyllama-1.1b-layla-v4-Q4_0_4_8.gguf +3 -0
  4. tinyllama-1.1b-layla-v4-Q4_0_8_8.gguf +3 -0
  5. tinyllama-1.1b-layla-v4-Q4_K_M.gguf +3 -0
  6. tinyllama-1.1b-layla-v4-Q6_K.gguf +3 -0
  7. tinyllama-1.1b-layla-v4-Q8_0.gguf +3 -0
  8. tinyllama-1.1b-layla-v4-f16.gguf +3 -0
tinyllama-1.1b-layla-v4-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:507432dc7dccb76502c9e8ffec8a9533d625b3ad9ca395562eb8b2fe8e0b737d
3
+ size 432131200
tinyllama-1.1b-layla-v4-Q4_0_4_4.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75dc946f02ce1a9545e4a85d89ceeda6b55cf73c1d95c957c55a0b099e99e851
3
+ size 636726400
tinyllama-1.1b-layla-v4-Q4_0_4_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cacee1f83af6177b18a80e3789aadc985a712de9d45a663251ae16ada2dc95e8
3
+ size 636726400
tinyllama-1.1b-layla-v4-Q4_0_8_8.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0a30847da16cfc60226582b794756cbd55e7112bfd0484b379200f97e3160281
3
+ size 636726400
tinyllama-1.1b-layla-v4-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:83d07453e73d10999dc2225e5cc507e0412db0fda4dc9048ba23e13020119bd6
3
+ size 667815040
tinyllama-1.1b-layla-v4-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:78515dfe805bbcc621a23e06d983a4d53c5183f64afb94c2031e2d9092dc66e2
3
+ size 903412864
tinyllama-1.1b-layla-v4-Q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f8f0a24f35f6cda66face76f07931f99c9cb37c085d749437b2635f5d028e873
3
+ size 1169808512
tinyllama-1.1b-layla-v4-f16.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6507b72bf7ebded9b22a655b6cd31776f4fe9a97da0fc56a380433d9a51bf014
3
+ size 2201017472