bokesyo commited on
Commit
14fb892
1 Parent(s): 322ce14

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -3
README.md CHANGED
@@ -10,9 +10,9 @@ metrics:
10
  pipeline_tag: feature-extraction
11
  ---
12
 
13
- # MiniCPM-Visual-Embedding: An OCR-free Visual-Based Document Embedding Model Based on MiniCPM-V-2.0 as Your Personal Librarian
14
 
15
- With MiniCPM-Visual-Embedding, it is possible to directly build knowledge base with raw PDF/Book/Document without any OCR technique nor OCR pipeline. The model only takes images as document-side inputs and produce vectors representing document pages.
16
 
17
  [Github Repo](https://github.com/bokesyo/minicpm-visual-embedding)
18
 
@@ -101,4 +101,8 @@ print(scores)
101
 
102
  # tensor([[0.6506, 4.9630, 3.8614]], device='cuda:0')
103
 
104
- ```
 
 
 
 
 
10
  pipeline_tag: feature-extraction
11
  ---
12
 
13
+ # An OCR-free Visual-Based Document Embedding Model Based on MiniCPM-V-2.0 as Your Personal Librarian
14
 
15
+ With MiniCPM-Visual-Embedding, it is possible to directly build knowledge base with raw PDF/Book/Document without any OCR technique nor OCR pipeline. The model only takes images as document-side inputs and produce vectors representing document pages. minicpm-visual-embedding-v0 is trained with over 30k paired query - visual document pages, including textual document, visual document, arxiv figures, industry documents, textbooks, ebooks, etc. The performance of minicpm-visual-embedding-v0 is on a par with a text embedding on text-oriented documents, and an advantages on visually-intensive documents.
16
 
17
  [Github Repo](https://github.com/bokesyo/minicpm-visual-embedding)
18
 
 
101
 
102
  # tensor([[0.6506, 4.9630, 3.8614]], device='cuda:0')
103
 
104
+ ```
105
+
106
+ # Limitations
107
+
108
+ Currently, please ensure that dpi of input images be a high value like `300` dpi, a lower dpi like `100` may cause the model performance degrade. We will augment data and fix this in our latest version.