Hugging Face's logo

c01zaut
/
gemma-2-2b-it-RK3588-1.1.4

Text Generation
Transformers
Safetensors
gemma2
conversational
text-generation-inference
Inference Endpoints
Model card Files Community
c01zaut commited on
Commit
ed7a1f0
·
verified ·
1 Parent(s): 7d8f32b

Upload folder using huggingface_hub

Browse files
Files changed (20) hide show
  1. .gitattributes +12 -0
  2. README.md +1 -1
  3. gemma-2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-0.0.rkllm +1 -1
  4. gemma-2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-0.5.rkllm +1 -1
  5. gemma-2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm +1 -1
  6. gemma-2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm +1 -1
  7. gemma-2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm +1 -1
  8. gemma-2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm +1 -1
  9. gemma-2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm +3 -0
  10. gemma-2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm +3 -0
  11. gemma-2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm +3 -0
  12. gemma-2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm +3 -0
  13. gemma-2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm +3 -0
  14. gemma-2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm +3 -0
  15. gemma-2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm +3 -0
  16. gemma-2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm +3 -0
  17. gemma-2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm +3 -0
  18. gemma-2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm +3 -0
  19. gemma-2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm +3 -0
  20. gemma-2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm +3 -0
.gitattributes CHANGED
@@ -40,3 +40,15 @@ gemma-2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge
40
  gemma-2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
41
  gemma-2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
42
  gemma-2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
 
 
 
 
 
 
40
  gemma-2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
41
  gemma-2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
42
  gemma-2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
43
+ gemma-2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
44
+ gemma-2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
45
+ gemma-2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
46
+ gemma-2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
47
+ gemma-2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
48
+ gemma-2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
49
+ gemma-2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
50
+ gemma-2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
51
+ gemma-2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
52
+ gemma-2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm filter=lfs diff=lfs merge=lfs -text
53
+ gemma-2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm filter=lfs diff=lfs merge=lfs -text
54
+ gemma-2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm filter=lfs diff=lfs merge=lfs -text
README.md CHANGED
@@ -13,7 +13,7 @@ extra_gated_button_content: Acknowledge license
13
  ---
14
  # gemma-2-2b-it-RK3588-1.1.2
15
 
16
- This version of gemma-2-2b-it has been converted to run on the RK3588 NPU using ['w8a8'] quantization.
17
  This model has been optimized with the following LoRA:
18
 
19
  Compatible with RKLLM version: 1.1.2
 
13
  ---
14
  # gemma-2-2b-it-RK3588-1.1.2
15
 
16
+ This version of gemma-2-2b-it has been converted to run on the RK3588 NPU using ['w8a8', 'w8a8_g128', 'w8a8_g256', 'w8a8_g512'] quantization.
17
  This model has been optimized with the following LoRA:
18
 
19
  Compatible with RKLLM version: 1.1.2
gemma-2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-0.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d8c702683ff15d17a684023e6e2e68989150a736d1356b40a367ff5345185f8b
3
  size 3820727524
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d699450be7c78603d18d6225a7496cdafbc7d10dc31100e3156215f68942772
3
  size 3820727524
gemma-2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-0.5.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d8c702683ff15d17a684023e6e2e68989150a736d1356b40a367ff5345185f8b
3
  size 3820727524
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d699450be7c78603d18d6225a7496cdafbc7d10dc31100e3156215f68942772
3
  size 3820727524
gemma-2-2b-it-rk3588-w8a8-opt-0-hybrid-ratio-1.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:d8c702683ff15d17a684023e6e2e68989150a736d1356b40a367ff5345185f8b
3
  size 3820727524
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9d699450be7c78603d18d6225a7496cdafbc7d10dc31100e3156215f68942772
3
  size 3820727524
gemma-2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f15ab5c70955681ee9891e1f41dc7cecec7b51998efcfd63c81f77f6054ff21f
3
  size 3820727524
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2d9a781f608652ea77e206e086f9b37ccec0e25674ca5746235a01fe2089c18
3
  size 3820727524
gemma-2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-0.5.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f15ab5c70955681ee9891e1f41dc7cecec7b51998efcfd63c81f77f6054ff21f
3
  size 3820727524
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2d9a781f608652ea77e206e086f9b37ccec0e25674ca5746235a01fe2089c18
3
  size 3820727524
gemma-2-2b-it-rk3588-w8a8-opt-1-hybrid-ratio-1.0.rkllm CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:f15ab5c70955681ee9891e1f41dc7cecec7b51998efcfd63c81f77f6054ff21f
3
  size 3820727524
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d2d9a781f608652ea77e206e086f9b37ccec0e25674ca5746235a01fe2089c18
3
  size 3820727524
gemma-2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:678653eef64345a3af3a4f88e5ccd88e753445929837c78277f1b8eb5b582208
3
+ size 4010359980
gemma-2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:678653eef64345a3af3a4f88e5ccd88e753445929837c78277f1b8eb5b582208
3
+ size 4010359980
gemma-2-2b-it-rk3588-w8a8_g128-opt-0-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:678653eef64345a3af3a4f88e5ccd88e753445929837c78277f1b8eb5b582208
3
+ size 4010359980
gemma-2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af17659bab3b31e83bd340fdf5315e6b7a2356e384c60d0edc45bd8e905be10d
3
+ size 3974081724
gemma-2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af17659bab3b31e83bd340fdf5315e6b7a2356e384c60d0edc45bd8e905be10d
3
+ size 3974081724
gemma-2-2b-it-rk3588-w8a8_g128-opt-1-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:af17659bab3b31e83bd340fdf5315e6b7a2356e384c60d0edc45bd8e905be10d
3
+ size 3974081724
gemma-2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5114790db76f3f3b4a63daa1abf98658d7269dcbed2497614491a5f6b8ffc291
3
+ size 3911797116
gemma-2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5114790db76f3f3b4a63daa1abf98658d7269dcbed2497614491a5f6b8ffc291
3
+ size 3911797116
gemma-2-2b-it-rk3588-w8a8_g256-opt-0-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5114790db76f3f3b4a63daa1abf98658d7269dcbed2497614491a5f6b8ffc291
3
+ size 3911797116
gemma-2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b38171329e4ff5ccdee09c14a3d958acd398c1b3d1dbaeab516450c88fe7ca6
3
+ size 3894717660
gemma-2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-0.5.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b38171329e4ff5ccdee09c14a3d958acd398c1b3d1dbaeab516450c88fe7ca6
3
+ size 3894717660
gemma-2-2b-it-rk3588-w8a8_g256-opt-1-hybrid-ratio-1.0.rkllm ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5b38171329e4ff5ccdee09c14a3d958acd398c1b3d1dbaeab516450c88fe7ca6
3
+ size 3894717660