Introducing Synthetic Data Workshop: Your Gateway to Easy Synthetic Dataset Creation
•
12
Daniel van Strien PRO
davanstrien
AI & ML interests
Machine Learning Librarian
Articles
Organizations
Posts
32
Post
550
ColPali is an exciting new approach to multimodal document retrieval, but some doubt its practical use with existing vector DBs.
It turns out it's super easy to use Qdrant to index and search ColPali embeddings efficiently.
Blog post here: https://danielvanstrien.xyz/posts/post-with-code/colpali-qdrant/2024-10-02_using_colpali_with_qdrant.html
Very silly demo: davanstrien/ufo-ColPali-Search
It turns out it's super easy to use Qdrant to index and search ColPali embeddings efficiently.
Blog post here: https://danielvanstrien.xyz/posts/post-with-code/colpali-qdrant/2024-10-02_using_colpali_with_qdrant.html
Very silly demo: davanstrien/ufo-ColPali-Search
Post
1952
Yesterday, I shared a blog post on generating data for fine-tuning ColPali using the
Qwen/Qwen2-VL-7B-Instruct model.
To simplify testing this approach, I created a Space that lets you generate queries from an input document page image: davanstrien/ColPali-Query-Generator
I think there is much room for improvement, but I'm excited about the potential for relatively small VLMs to create synthetic data.
You can read the original blog post that goes into more detail here: https://danielvanstrien.xyz/posts/post-with-code/colpali/2024-09-23-generate_colpali_dataset.html
To simplify testing this approach, I created a Space that lets you generate queries from an input document page image: davanstrien/ColPali-Query-Generator
I think there is much room for improvement, but I'm excited about the potential for relatively small VLMs to create synthetic data.
You can read the original blog post that goes into more detail here: https://danielvanstrien.xyz/posts/post-with-code/colpali/2024-09-23-generate_colpali_dataset.html
Collections
20
spaces
46
models
127
davanstrien/Molmo-7B-D-0924
Image-Text-to-Text
•
Updated
davanstrien/finetune_colpali_v1_2-ufo-4bit
Updated
•
8
•
5
davanstrien/Florence-2-FT-QueryGen2
Updated
davanstrien/colpali-query-gen
Image-Text-to-Text
•
Updated
•
29
davanstrien/copa3
Image-Text-to-Text
•
Updated
•
29
davanstrien/copa
Updated
davanstrien/contrastive-bert-base-uncased
Sentence Similarity
•
Updated
•
15
davanstrien/query-to-dataset-viewer-descriptions
Sentence Similarity
•
Updated
•
53
•
1
davanstrien/dataset-viewer-descriptions-processed-st
Feature Extraction
•
Updated
•
165
davanstrien/nasa_concept_art-flux-lora
Text-to-Image
•
Updated
•
421
•
•
10
datasets
279
davanstrien/would-you-read-it
Viewer
•
Updated
•
262
•
2
•
4
davanstrien/magpie-preference
Viewer
•
Updated
•
476
•
2
•
10
davanstrien/foodfactstest
Viewer
•
Updated
•
1
davanstrien/loc-nineteenth-century-song-sheets
Viewer
•
Updated
•
4.29k
•
52
davanstrien/loc-nineteenth-century-song-sheets-folder
Preview
•
Updated
davanstrien/loc-baseball-cards-folder
Viewer
•
Updated
•
2.12k
•
1
davanstrien/ufo-ColPali
Viewer
•
Updated
•
2.24k
•
65
•
16
davanstrien/cosplit
Viewer
•
Updated
•
10k
davanstrien/ufo
Viewer
•
Updated
•
212
•
88
davanstrien/pdftest
Viewer
•
Updated
•
18