manycore-research/SpatialLM-Llama-1B
Text Generation
•
Updated
•
14.3k
•
901
Orkut Murat Yılmaz
orkut
AI & ML interests
Geo Sciences, Free Software
Recent Activity
liked
a model
13 days ago
manycore-research/SpatialLM-Llama-1B
liked
a dataset
22 days ago
alibayram/yapay_zeka_turkce_mmlu_model_cevaplari
liked
a model
22 days ago
TencentARC/InstantMesh
Organizations
orkut's activity
liked
a
model
13 days ago
liked
a
dataset
22 days ago
liked
3
models
22 days ago
liked
a
Space
25 days ago
liked
a
model
about 1 month ago
liked
a
Space
about 1 month ago
liked
a
dataset
about 2 months ago
upvoted
an
article
about 2 months ago
Article
Open-source DeepResearch – Freeing our search agents
•
1.21k
liked
a
model
2 months ago
liked
a
model
3 months ago
liked
2
models
4 months ago
liked
a
Space
4 months ago
liked
a
model
5 months ago
reacted to
merve's
post with 🔥
8 months ago
Post
2293
We have recently merged Video-LLaVA to transformers! 🤗🎞️
What makes this model different?
Demo: llava-hf/video-llava
Model: LanguageBind/Video-LLaVA-7B-hf
Compared to other models that take image and video input and either project them separately or downsampling video and projecting selected frames, Video-LLaVA is converting images and videos to unified representation and project them using a shared projection layer.
It uses Vicuna 1.5 as the language model and LanguageBind's own encoders that's based on OpenCLIP, these encoders project the modalities to an unified representation before passing to projection layer.
I feel like one of the coolest features of this model is the joint understanding which is also introduced recently with many models
It's a relatively older model but ahead of it's time and works very well! Which means, e.g. you can pass model an image of a cat and a video of a cat and ask questions like whether the cat in the image exists in video or not 🤩
What makes this model different?
Demo: llava-hf/video-llava
Model: LanguageBind/Video-LLaVA-7B-hf
Compared to other models that take image and video input and either project them separately or downsampling video and projecting selected frames, Video-LLaVA is converting images and videos to unified representation and project them using a shared projection layer.
It uses Vicuna 1.5 as the language model and LanguageBind's own encoders that's based on OpenCLIP, these encoders project the modalities to an unified representation before passing to projection layer.
I feel like one of the coolest features of this model is the joint understanding which is also introduced recently with many models
It's a relatively older model but ahead of it's time and works very well! Which means, e.g. you can pass model an image of a cat and a video of a cat and ask questions like whether the cat in the image exists in video or not 🤩
liked
a
model
10 months ago
liked
a
Space
10 months ago
liked
a
model
10 months ago
