Novaciano commited on
Commit
4d0d8ca
·
verified ·
1 Parent(s): 3526d1a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +9 -44
README.md CHANGED
@@ -6,55 +6,20 @@ tags:
6
  - axolotl
7
  - OpenHermes
8
  - llama-cpp
9
- - gguf-my-repo
 
10
  datasets:
11
  - diabolic6045/OpenHermes-2.5_alpaca_10
 
12
  pipeline_tag: text-generation
13
  model-index:
14
  - name: open-llama-Instruct
15
  results: []
 
 
 
 
 
16
  ---
17
 
18
- # Novaciano/open-llama-3.2-1B-Instruct-Q4_K_M-GGUF
19
- This model was converted to GGUF format from [`diabolic6045/open-llama-3.2-1B-Instruct`](https://huggingface.co/diabolic6045/open-llama-3.2-1B-Instruct) using llama.cpp via the ggml.ai's [GGUF-my-repo](https://huggingface.co/spaces/ggml-org/gguf-my-repo) space.
20
- Refer to the [original model card](https://huggingface.co/diabolic6045/open-llama-3.2-1B-Instruct) for more details on the model.
21
-
22
- ## Use with llama.cpp
23
- Install llama.cpp through brew (works on Mac and Linux)
24
-
25
- ```bash
26
- brew install llama.cpp
27
-
28
- ```
29
- Invoke the llama.cpp server or the CLI.
30
-
31
- ### CLI:
32
- ```bash
33
- llama-cli --hf-repo Novaciano/open-llama-3.2-1B-Instruct-Q4_K_M-GGUF --hf-file open-llama-3.2-1b-instruct-q4_k_m-imat.gguf -p "The meaning to life and the universe is"
34
- ```
35
-
36
- ### Server:
37
- ```bash
38
- llama-server --hf-repo Novaciano/open-llama-3.2-1B-Instruct-Q4_K_M-GGUF --hf-file open-llama-3.2-1b-instruct-q4_k_m-imat.gguf -c 2048
39
- ```
40
-
41
- Note: You can also use this checkpoint directly through the [usage steps](https://github.com/ggerganov/llama.cpp?tab=readme-ov-file#usage) listed in the Llama.cpp repo as well.
42
-
43
- Step 1: Clone llama.cpp from GitHub.
44
- ```
45
- git clone https://github.com/ggerganov/llama.cpp
46
- ```
47
-
48
- Step 2: Move into the llama.cpp folder and build it with `LLAMA_CURL=1` flag along with other hardware-specific flags (for ex: LLAMA_CUDA=1 for Nvidia GPUs on Linux).
49
- ```
50
- cd llama.cpp && LLAMA_CURL=1 make
51
- ```
52
-
53
- Step 3: Run inference through the main binary.
54
- ```
55
- ./llama-cli --hf-repo Novaciano/open-llama-3.2-1B-Instruct-Q4_K_M-GGUF --hf-file open-llama-3.2-1b-instruct-q4_k_m-imat.gguf -p "The meaning to life and the universe is"
56
- ```
57
- or
58
- ```
59
- ./llama-server --hf-repo Novaciano/open-llama-3.2-1B-Instruct-Q4_K_M-GGUF --hf-file open-llama-3.2-1b-instruct-q4_k_m-imat.gguf -c 2048
60
- ```
 
6
  - axolotl
7
  - OpenHermes
8
  - llama-cpp
9
+ - nsfw
10
+ - not-for-all-audiences
11
  datasets:
12
  - diabolic6045/OpenHermes-2.5_alpaca_10
13
+ - openerotica/erotiquant3
14
  pipeline_tag: text-generation
15
  model-index:
16
  - name: open-llama-Instruct
17
  results: []
18
+ language:
19
+ - en
20
+ - es
21
+ metrics:
22
+ - accuracy
23
  ---
24
 
25
+ # Llama 3.2 1B - NSFW Open Erotic