John Johnson

jjokah

AI & ML interests

Natural Language Processing

Recent Activity

View all activity

Organizations

Blog-explorers's profile picture Magnisale's profile picture Cohere Labs Community's profile picture Hugging Face Discord Community's profile picture

Posts 4

view post
Post
2304
# Video Tokenization โ€” for efficient AI video processing

Meet ๐•๐ข๐๐“๐จ๐ค, a new open-source video tokenization technique developed by Microsoft Research to address the computational challenges of processing large volumes of video data. The core problem VidTok tackles is the inefficiency caused by redundant information in raw video pixels.

VidTok converts complex video footage into compact, structured units called tokens, making it easier and more efficient for AI systems to analyze, understand, and generate video content.

Research Paper: https://arxiv.org/abs/2412.13061
VidTok Code: https://github.com/microsoft/VidTok

Articles 1

Article
22

Small Language Models (SLM): A Comprehensive Overview

models

None public yet

datasets

None public yet