marquesafonso commited on
Commit
873ff7a
·
verified ·
1 Parent(s): 7b45c55

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +28 -0
README.md ADDED
@@ -0,0 +1,28 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: numind/NuExtract
3
+ language:
4
+ - en
5
+ license: mit
6
+ tags:
7
+ - openvino
8
+ - nncf
9
+ - 8-bit
10
+ new_version: numind/NuExtract-v1.5
11
+ ---
12
+
13
+ This model is a quantized version of [`numind/NuExtract`](https://huggingface.co/numind/NuExtract) and is converted to the OpenVINO format. This model was obtained via the [nncf-quantization](https://huggingface.co/spaces/echarlaix/nncf-quantization) space with [optimum-intel](https://github.com/huggingface/optimum-intel).
14
+
15
+ First make sure you have `optimum-intel` installed:
16
+
17
+ ```bash
18
+ pip install optimum[openvino]
19
+ ```
20
+
21
+ To load your model you can do as follows:
22
+
23
+ ```python
24
+ from optimum.intel import OVModelForCausalLM
25
+
26
+ model_id = "marquesafonso/NuExtract-openvino-8bit"
27
+ model = OVModelForCausalLM.from_pretrained(model_id)
28
+ ```