Update README.md
Browse files
README.md
CHANGED
@@ -51,6 +51,31 @@ The most important ones for using this model are
|
|
51 |
* there does not seem to be a specific prompt structure - just provide the text
|
52 |
you want to be completed
|
53 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
54 |
## License ##
|
55 |
|
56 |
The original "_Model checkpoints are licensed under the Creative Commons license
|
|
|
51 |
* there does not seem to be a specific prompt structure - just provide the text
|
52 |
you want to be completed
|
53 |
|
54 |
+
### Text Completion with LLaMA.cpp ###
|
55 |
+
|
56 |
+
For simple inferencing, use a command like
|
57 |
+
|
58 |
+
```
|
59 |
+
./main -m stablelm-3b-4e1t-Q8_0.bin --temp 0 --top-k 4 --prompt "who was Joseph Weizenbaum?"
|
60 |
+
```
|
61 |
+
|
62 |
+
### Text Tokenization with LLaMA.cpp ###
|
63 |
+
|
64 |
+
To get a list of tokens, use a command like
|
65 |
+
|
66 |
+
```
|
67 |
+
./tokenization -m stablelm-3b-4e1t-Q8_0.bin --prompt "who was Joseph Weizenbaum?"
|
68 |
+
```
|
69 |
+
|
70 |
+
### Embeddings Calculation with LLaMA.cpp ###
|
71 |
+
|
72 |
+
Text embeddings are calculated with a command like
|
73 |
+
|
74 |
+
```
|
75 |
+
./embedding -m stablelm-3b-4e1t-Q8_0.bin --prompt "who was Joseph Weizenbaum?"
|
76 |
+
```
|
77 |
+
|
78 |
+
|
79 |
## License ##
|
80 |
|
81 |
The original "_Model checkpoints are licensed under the Creative Commons license
|