Update README.md
Browse files
README.md
CHANGED
@@ -1,122 +1,124 @@
|
|
1 |
-
---
|
2 |
-
library_name: transformers
|
3 |
-
license: cc-by-nc-4.0
|
4 |
-
tags:
|
5 |
-
- xlm-roberta
|
6 |
-
- eva02
|
7 |
-
- clip
|
8 |
-
- feature-extraction
|
9 |
-
- sentence-similarity
|
10 |
-
- retrieval
|
11 |
-
- multimodal
|
12 |
-
- multi-modal
|
13 |
-
- crossmodal
|
14 |
-
- cross-modal
|
15 |
-
- mteb
|
16 |
-
- clip-benchmark
|
17 |
-
- vidore
|
18 |
-
- transformers
|
19 |
-
- sentence-transformers
|
20 |
-
- onnx
|
21 |
-
- safetensors
|
22 |
-
- transformers.js
|
23 |
-
language:
|
24 |
-
|
25 |
-
|
26 |
-
|
27 |
-
|
28 |
-
|
29 |
-
|
30 |
-
|
31 |
-
|
32 |
-
|
33 |
-
|
34 |
-
|
35 |
-
|
36 |
-
|
37 |
-
|
38 |
-
|
39 |
-
|
40 |
-
|
41 |
-
|
42 |
-
|
43 |
-
|
44 |
-
|
45 |
-
|
46 |
-
|
47 |
-
|
48 |
-
|
49 |
-
|
50 |
-
|
51 |
-
|
52 |
-
|
53 |
-
|
54 |
-
|
55 |
-
|
56 |
-
|
57 |
-
|
58 |
-
|
59 |
-
|
60 |
-
|
61 |
-
|
62 |
-
|
63 |
-
|
64 |
-
|
65 |
-
|
66 |
-
|
67 |
-
|
68 |
-
|
69 |
-
|
70 |
-
|
71 |
-
|
72 |
-
|
73 |
-
|
74 |
-
|
75 |
-
|
76 |
-
|
77 |
-
|
78 |
-
|
79 |
-
|
80 |
-
|
81 |
-
|
82 |
-
|
83 |
-
|
84 |
-
|
85 |
-
|
86 |
-
|
87 |
-
|
88 |
-
|
89 |
-
|
90 |
-
|
91 |
-
|
92 |
-
|
93 |
-
|
94 |
-
|
95 |
-
|
96 |
-
|
97 |
-
|
98 |
-
|
99 |
-
|
100 |
-
|
101 |
-
|
102 |
-
|
103 |
-
|
104 |
-
|
105 |
-
|
106 |
-
|
107 |
-
|
108 |
-
|
109 |
-
|
110 |
-
|
111 |
-
|
112 |
-
|
113 |
-
|
114 |
-
|
115 |
-
|
116 |
-
|
117 |
-
|
118 |
-
inference: false
|
119 |
-
|
|
|
|
|
120 |
|
121 |
<br><br>
|
122 |
|
@@ -136,7 +138,7 @@ inference: false
|
|
136 |
|
137 |
## Quick Start
|
138 |
|
139 |
-
[Blog](https://jina.ai/news/jina-clip-v2-multilingual-multimodal-embeddings-for-text-and-images) | [Azure](https://azuremarketplace.microsoft.com/en-gb/marketplace/apps/jinaai.jina-clip-v2-vm?tab=Overview) | [AWS SageMaker](https://aws.amazon.com/marketplace/pp/prodview-bfbctuqmky676) | [Google Cloud Platform](https://console.cloud.google.com/marketplace/browse?hl=en&inv=1&invt=AbiD-g&q=jina) | [API](https://jina.ai/embeddings)
|
140 |
|
141 |
|
142 |
## Intended Usage & Model Info
|
@@ -177,7 +179,9 @@ CLIP-like models have established themselves as the backbone for general-purpose
|
|
177 |
|
178 |
## Training, Data, Parameters
|
179 |
|
180 |
-
|
|
|
|
|
181 |
|
182 |
## Faster Inference: FA2, XFormers and bf16
|
183 |
|
@@ -474,10 +478,13 @@ Join our [Discord community](https://discord.jina.ai) and chat with other commun
|
|
474 |
If you find `jina-clip-v2` useful in your research, please cite the following paper:
|
475 |
|
476 |
```bibtex
|
477 |
-
@misc{
|
478 |
-
|
479 |
-
|
480 |
-
|
481 |
-
|
|
|
|
|
|
|
482 |
}
|
483 |
```
|
|
|
1 |
+
---
|
2 |
+
library_name: transformers
|
3 |
+
license: cc-by-nc-4.0
|
4 |
+
tags:
|
5 |
+
- xlm-roberta
|
6 |
+
- eva02
|
7 |
+
- clip
|
8 |
+
- feature-extraction
|
9 |
+
- sentence-similarity
|
10 |
+
- retrieval
|
11 |
+
- multimodal
|
12 |
+
- multi-modal
|
13 |
+
- crossmodal
|
14 |
+
- cross-modal
|
15 |
+
- mteb
|
16 |
+
- clip-benchmark
|
17 |
+
- vidore
|
18 |
+
- transformers
|
19 |
+
- sentence-transformers
|
20 |
+
- onnx
|
21 |
+
- safetensors
|
22 |
+
- transformers.js
|
23 |
+
language:
|
24 |
+
- multilingual
|
25 |
+
- af
|
26 |
+
- am
|
27 |
+
- ar
|
28 |
+
- as
|
29 |
+
- az
|
30 |
+
- be
|
31 |
+
- bg
|
32 |
+
- bn
|
33 |
+
- br
|
34 |
+
- bs
|
35 |
+
- ca
|
36 |
+
- cs
|
37 |
+
- cy
|
38 |
+
- da
|
39 |
+
- de
|
40 |
+
- el
|
41 |
+
- en
|
42 |
+
- eo
|
43 |
+
- es
|
44 |
+
- et
|
45 |
+
- eu
|
46 |
+
- fa
|
47 |
+
- fi
|
48 |
+
- fr
|
49 |
+
- fy
|
50 |
+
- ga
|
51 |
+
- gd
|
52 |
+
- gl
|
53 |
+
- gu
|
54 |
+
- ha
|
55 |
+
- he
|
56 |
+
- hi
|
57 |
+
- hr
|
58 |
+
- hu
|
59 |
+
- hy
|
60 |
+
- id
|
61 |
+
- is
|
62 |
+
- it
|
63 |
+
- ja
|
64 |
+
- jv
|
65 |
+
- ka
|
66 |
+
- kk
|
67 |
+
- km
|
68 |
+
- kn
|
69 |
+
- ko
|
70 |
+
- ku
|
71 |
+
- ky
|
72 |
+
- la
|
73 |
+
- lo
|
74 |
+
- lt
|
75 |
+
- lv
|
76 |
+
- mg
|
77 |
+
- mk
|
78 |
+
- ml
|
79 |
+
- mn
|
80 |
+
- mr
|
81 |
+
- ms
|
82 |
+
- my
|
83 |
+
- ne
|
84 |
+
- nl
|
85 |
+
- 'no'
|
86 |
+
- om
|
87 |
+
- or
|
88 |
+
- pa
|
89 |
+
- pl
|
90 |
+
- ps
|
91 |
+
- pt
|
92 |
+
- ro
|
93 |
+
- ru
|
94 |
+
- sa
|
95 |
+
- sd
|
96 |
+
- si
|
97 |
+
- sk
|
98 |
+
- sl
|
99 |
+
- so
|
100 |
+
- sq
|
101 |
+
- sr
|
102 |
+
- su
|
103 |
+
- sv
|
104 |
+
- sw
|
105 |
+
- ta
|
106 |
+
- te
|
107 |
+
- th
|
108 |
+
- tl
|
109 |
+
- tr
|
110 |
+
- ug
|
111 |
+
- uk
|
112 |
+
- ur
|
113 |
+
- uz
|
114 |
+
- vi
|
115 |
+
- xh
|
116 |
+
- yi
|
117 |
+
- zh
|
118 |
+
inference: false
|
119 |
+
base_model:
|
120 |
+
- jinaai/xlm-roberta-flash-implementation
|
121 |
+
---
|
122 |
|
123 |
<br><br>
|
124 |
|
|
|
138 |
|
139 |
## Quick Start
|
140 |
|
141 |
+
[Blog](https://jina.ai/news/jina-clip-v2-multilingual-multimodal-embeddings-for-text-and-images) | [Technical Report](https://arxiv.org/abs/2412.08802) | [Azure](https://azuremarketplace.microsoft.com/en-gb/marketplace/apps/jinaai.jina-clip-v2-vm?tab=Overview) | [AWS SageMaker](https://aws.amazon.com/marketplace/pp/prodview-bfbctuqmky676) | [Google Cloud Platform](https://console.cloud.google.com/marketplace/browse?hl=en&inv=1&invt=AbiD-g&q=jina) | [API](https://jina.ai/embeddings)
|
142 |
|
143 |
|
144 |
## Intended Usage & Model Info
|
|
|
179 |
|
180 |
## Training, Data, Parameters
|
181 |
|
182 |
+
Please refer to our [technical report of jina-clip-v2](https://arxiv.org/abs/2412.08802) for he details of model and training procedure.
|
183 |
+
|
184 |
+
[technical report of jina-clip-v1](https://arxiv.org/abs/2405.20204)
|
185 |
|
186 |
## Faster Inference: FA2, XFormers and bf16
|
187 |
|
|
|
478 |
If you find `jina-clip-v2` useful in your research, please cite the following paper:
|
479 |
|
480 |
```bibtex
|
481 |
+
@misc{koukounas2024jinaclipv2multilingualmultimodalembeddings,
|
482 |
+
title={jina-clip-v2: Multilingual Multimodal Embeddings for Text and Images},
|
483 |
+
author={Andreas Koukounas and Georgios Mastrapas and Bo Wang and Mohammad Kalim Akram and Sedigheh Eslami and Michael Günther and Isabelle Mohr and Saba Sturua and Scott Martens and Nan Wang and Han Xiao},
|
484 |
+
year={2024},
|
485 |
+
eprint={2412.08802},
|
486 |
+
archivePrefix={arXiv},
|
487 |
+
primaryClass={cs.CL},
|
488 |
+
url={https://arxiv.org/abs/2412.08802},
|
489 |
}
|
490 |
```
|