Filippo B

Filippo
Β·

AI & ML interests

GenAI, LLMs, VLMs, accelerated computing, information retrieval, workflows orchestration

Recent Activity

updated a Space 13 days ago
Filippo/First_agent_template
updated a collection 22 days ago
LLMs and such
liked a Space about 1 month ago
nanotron/ultrascale-playbook
View all activity

Organizations

Squirro's profile picture Hugging Face Discord Community's profile picture Nerdy Face's profile picture Serendipyty's profile picture

Filippo's activity

reacted to merve's post with πŸ”₯ 6 months ago
view post
Post
5636
I have put together a notebook on Multimodal RAG, where we do not process the documents with hefty pipelines but natively use:
- vidore/colpali for retrieval πŸ“– it doesn't need indexing with image-text pairs but just images!
- Qwen/Qwen2-VL-2B-Instruct for generation πŸ’¬ directly feed images as is to a vision language model with no processing to text!
I used ColPali implementation of the new 🐭 Byaldi library by @bclavie πŸ€—
https://github.com/answerdotai/byaldi
Link to notebook: https://github.com/merveenoyan/smol-vision/blob/main/ColPali_%2B_Qwen2_VL.ipynb