Hugging Face's logo
zhang's picture
7 535

zhang PRO

gotomypc
shangke571's profile picture kangsangzhaxi's profile picture asigalov61's profile picture
·

AI & ML interests

ASR, Audio Denoise and Natural Language Processing

Recent Activity

reacted to Kseniase's post with 🔥 3 days ago
7 Open-source Methods to Improve Video Generation and Understanding AI community is making great strides toward achieving the full potential of multimodality in video generation and understanding. Last week studies showed that working with videos is now one of the main focuses for improving AI models. Another highlight of the week is that open source, once again, proves its value. For those who were impressed by DeepSeek-R1, we’re with you! Today, we’re combining these two key focuses and bringing you a list of open-source methods for better video generation and understanding: 1. VideoLLaMA 3 model: Excels in various video and image tasks thanks to vision-centric training approach. https://huggingface.co/papers/2501.13106 2. FILMAGENT framework assigns roles to multiple AI agents, like a director, screenwriter, actor, and cinematographer, to automate the filmmaking process in 3D virtual environments. https://huggingface.co/papers/2501.12909 3. https://huggingface.co/papers/2501.13918 proposes a new VideoReward Model and approach that uses human feedback to refine video generation models. 4. DiffuEraser video inpainting model, based on stable diffusion, is designed to fill in missing areas with detailed, realistic content and to ensure consistent structures across frames. https://huggingface.co/papers/2501.10018 5. MAGI is a hybrid video gen model that combines masked and casual modeling. Its key innovation, Complete Teacher Forcing (CTF), conditions masked frames on fully visible frames. https://huggingface.co/papers/2501.12389 6. https://huggingface.co/papers/2501.08331 proposes motion control, allowing users to guide how objects or the camera move in generated videos. Its noise warping algorithm replaces random noise in videos with structured noise based on motion info. 7. Video Depth Anything model estimates depth consistently in super-long videos (several minutes or more) without sacrificing quality or speed. https://huggingface.co/papers/2501.12375
reacted to Kseniase's post with 🚀 3 days ago
7 Open-source Methods to Improve Video Generation and Understanding AI community is making great strides toward achieving the full potential of multimodality in video generation and understanding. Last week studies showed that working with videos is now one of the main focuses for improving AI models. Another highlight of the week is that open source, once again, proves its value. For those who were impressed by DeepSeek-R1, we’re with you! Today, we’re combining these two key focuses and bringing you a list of open-source methods for better video generation and understanding: 1. VideoLLaMA 3 model: Excels in various video and image tasks thanks to vision-centric training approach. https://huggingface.co/papers/2501.13106 2. FILMAGENT framework assigns roles to multiple AI agents, like a director, screenwriter, actor, and cinematographer, to automate the filmmaking process in 3D virtual environments. https://huggingface.co/papers/2501.12909 3. https://huggingface.co/papers/2501.13918 proposes a new VideoReward Model and approach that uses human feedback to refine video generation models. 4. DiffuEraser video inpainting model, based on stable diffusion, is designed to fill in missing areas with detailed, realistic content and to ensure consistent structures across frames. https://huggingface.co/papers/2501.10018 5. MAGI is a hybrid video gen model that combines masked and casual modeling. Its key innovation, Complete Teacher Forcing (CTF), conditions masked frames on fully visible frames. https://huggingface.co/papers/2501.12389 6. https://huggingface.co/papers/2501.08331 proposes motion control, allowing users to guide how objects or the camera move in generated videos. Its noise warping algorithm replaces random noise in videos with structured noise based on motion info. 7. Video Depth Anything model estimates depth consistently in super-long videos (several minutes or more) without sacrificing quality or speed. https://huggingface.co/papers/2501.12375
reacted to Kseniase's post with 👍 3 days ago
7 Open-source Methods to Improve Video Generation and Understanding AI community is making great strides toward achieving the full potential of multimodality in video generation and understanding. Last week studies showed that working with videos is now one of the main focuses for improving AI models. Another highlight of the week is that open source, once again, proves its value. For those who were impressed by DeepSeek-R1, we’re with you! Today, we’re combining these two key focuses and bringing you a list of open-source methods for better video generation and understanding: 1. VideoLLaMA 3 model: Excels in various video and image tasks thanks to vision-centric training approach. https://huggingface.co/papers/2501.13106 2. FILMAGENT framework assigns roles to multiple AI agents, like a director, screenwriter, actor, and cinematographer, to automate the filmmaking process in 3D virtual environments. https://huggingface.co/papers/2501.12909 3. https://huggingface.co/papers/2501.13918 proposes a new VideoReward Model and approach that uses human feedback to refine video generation models. 4. DiffuEraser video inpainting model, based on stable diffusion, is designed to fill in missing areas with detailed, realistic content and to ensure consistent structures across frames. https://huggingface.co/papers/2501.10018 5. MAGI is a hybrid video gen model that combines masked and casual modeling. Its key innovation, Complete Teacher Forcing (CTF), conditions masked frames on fully visible frames. https://huggingface.co/papers/2501.12389 6. https://huggingface.co/papers/2501.08331 proposes motion control, allowing users to guide how objects or the camera move in generated videos. Its noise warping algorithm replaces random noise in videos with structured noise based on motion info. 7. Video Depth Anything model estimates depth consistently in super-long videos (several minutes or more) without sacrificing quality or speed. https://huggingface.co/papers/2501.12375
View all activity

Organizations

yixiu inc.'s profile picture ONNX Community's profile picture