rozek commited on
Commit
1de194a
·
1 Parent(s): 2e12631

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -0
README.md CHANGED
@@ -51,6 +51,31 @@ The most important ones for using this model are
51
  * there does not seem to be a specific prompt structure - just provide the text
52
  you want to be completed
53
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
54
  ## License ##
55
 
56
  The original "_Model checkpoints are licensed under the Creative Commons license
 
51
  * there does not seem to be a specific prompt structure - just provide the text
52
  you want to be completed
53
 
54
+ ### Text Completion with LLaMA.cpp ###
55
+
56
+ For simple inferencing, use a command like
57
+
58
+ ```
59
+ ./main -m stablelm-3b-4e1t-Q8_0.bin --temp 0 --top-k 4 --prompt "who was Joseph Weizenbaum?"
60
+ ```
61
+
62
+ ### Text Tokenization with LLaMA.cpp ###
63
+
64
+ To get a list of tokens, use a command like
65
+
66
+ ```
67
+ ./tokenization -m stablelm-3b-4e1t-Q8_0.bin --prompt "who was Joseph Weizenbaum?"
68
+ ```
69
+
70
+ ### Embeddings Calculation with LLaMA.cpp ###
71
+
72
+ Text embeddings are calculated with a command like
73
+
74
+ ```
75
+ ./embedding -m stablelm-3b-4e1t-Q8_0.bin --prompt "who was Joseph Weizenbaum?"
76
+ ```
77
+
78
+
79
  ## License ##
80
 
81
  The original "_Model checkpoints are licensed under the Creative Commons license