Gresekxnol commited on
Commit
2af77c6
Β·
verified Β·
1 Parent(s): 1a87e0b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +107 -12
README.md CHANGED
@@ -1,14 +1,109 @@
1
- ---
2
- title: Clipyr
3
- emoji: 🌍
4
- colorFrom: gray
5
- colorTo: yellow
6
- sdk: gradio
7
- sdk_version: 5.42.0
8
- app_file: app.py
9
- pinned: false
10
- license: mit
11
- short_description: clipper
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
12
  ---
13
 
14
- Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference
 
1
+ # 🎬 AI Video Clipper
2
+
3
+ Transform your long-form videos into viral short clips automatically using AI! This application mimics the core functionality of OpusClip with open-source technologies.
4
+
5
+ ## ✨ Features
6
+
7
+ ### πŸ€– AI-Powered Analysis
8
+ - **Smart Moment Detection**: Uses advanced NLP to identify the most engaging parts of your video
9
+ - **Virality Scoring**: Predicts which clips have the highest potential for social media success
10
+ - **Multi-Modal Analysis**: Combines audio features, sentiment analysis, and content understanding
11
+
12
+ ### πŸ“± Social Media Optimization
13
+ - **Auto 9:16 Conversion**: Automatically converts to vertical format perfect for TikTok, Instagram Reels, YouTube Shorts
14
+ - **Smart Cropping**: Intelligently crops and scales video content
15
+ - **Background Blur**: Creates cinematic background when needed
16
+
17
+ ### πŸ“ Auto-Captioning
18
+ - **High-Accuracy Transcription**: Uses OpenAI Whisper for precise speech-to-text
19
+ - **Emoji Enhancement**: Automatically adds relevant emojis to increase engagement
20
+ - **Multi-Language Support**: Works with videos in multiple languages
21
+
22
+ ### 🎯 Content Intelligence
23
+ - **Hook Detection**: Identifies compelling opening statements and cliffhangers
24
+ - **Emotional Analysis**: Detects high-engagement emotional moments
25
+ - **Keyword Optimization**: Recognizes viral keywords and phrases
26
+
27
+ ## πŸš€ How It Works
28
+
29
+ 1. **Upload**: Drop your video file (MP4, AVI, MOV, MKV, WebM)
30
+ 2. **Configure**: Set clip duration (15-90 seconds) and number of clips (1-5)
31
+ 3. **Process**: AI analyzes your video for the best moments
32
+ 4. **Download**: Get optimized clips ready for social media
33
+
34
+ ## πŸ“Š Virality Scoring Algorithm
35
+
36
+ The AI evaluates clips based on:
37
+ - **Sentiment Analysis**: Positive/negative emotional impact
38
+ - **Emotional Intensity**: Surprise, excitement, engagement levels
39
+ - **Viral Keywords**: Money, secrets, transformations, reactions
40
+ - **Hook Patterns**: "You won't believe", "This will change", etc.
41
+ - **Audio Features**: Tempo, energy, vocal dynamics
42
+ - **Optimal Length**: 30-60 second sweet spot for maximum retention
43
+
44
+ ## πŸŽ₯ Best Practices
45
+
46
+ ### Ideal Content Types:
47
+ - **Podcasts & Interviews**: Great for extracting key insights and memorable quotes
48
+ - **Educational Content**: Tutorial highlights and "aha moments"
49
+ - **Webinars & Presentations**: Key takeaways and surprising statistics
50
+ - **Product Reviews**: Before/after comparisons and reactions
51
+ - **Storytelling**: Climactic moments and emotional peaks
52
+
53
+ ### Tips for Best Results:
54
+ - βœ… Upload videos with clear, audible speech
55
+ - βœ… Longer videos (5+ minutes) provide more clip opportunities
56
+ - βœ… Content with emotional moments scores higher
57
+ - βœ… Good lighting and stable footage improve final quality
58
+ - ❌ Avoid videos with background music louder than speech
59
+ - ❌ Very quiet or poor audio quality may affect transcription
60
+
61
+ ## πŸ”§ Technical Details
62
+
63
+ ### AI Models Used:
64
+ - **Whisper Base**: For speech transcription and timestamp alignment
65
+ - **RoBERTa Sentiment**: For emotional analysis and engagement prediction
66
+ - **DistilRoBERTa Emotion**: For detecting surprise, excitement, and other high-engagement emotions
67
+
68
+ ### Processing Pipeline:
69
+ 1. **Audio Extraction**: Separates audio track for analysis
70
+ 2. **Transcription**: Generates timestamped text with word-level precision
71
+ 3. **Feature Analysis**: Extracts tempo, energy, and acoustic features
72
+ 4. **Content Scoring**: Evaluates each segment for viral potential
73
+ 5. **Clip Generation**: Creates optimized vertical videos with subtitles
74
+ 6. **Quality Enhancement**: Applies blur backgrounds and text styling
75
+
76
+ ## πŸ“ˆ Performance Optimizations
77
+
78
+ - **Efficient Processing**: Uses base models optimized for speed
79
+ - **Smart Batching**: Processes multiple segments simultaneously
80
+ - **Memory Management**: Automatic cleanup prevents memory leaks
81
+ - **Fast Encoding**: Uses ultrafast presets for quick turnaround
82
+
83
+ ## 🎨 Customization Options
84
+
85
+ - **Clip Duration**: 15-90 seconds (30-60s recommended)
86
+ - **Number of Clips**: 1-5 clips per video
87
+ - **Subtitle Toggle**: Enable/disable auto-generated captions
88
+ - **Emoji Integration**: Automatic contextual emoji insertion
89
+
90
+ ## πŸ”’ Privacy & Security
91
+
92
+ - **No Data Storage**: Videos are processed temporarily and automatically deleted
93
+ - **Local Processing**: All AI analysis happens on the server without external API calls
94
+ - **Secure Upload**: Files are handled securely with temporary storage only
95
+
96
+ ## πŸš€ Getting Started
97
+
98
+ This application is designed to run on Hugging Face Spaces with the free tier. Simply upload your video and let the AI work its magic!
99
+
100
+ Perfect for:
101
+ - πŸ“± Content creators looking to repurpose long-form content
102
+ - 🎬 Marketers creating social media campaigns
103
+ - πŸŽ“ Educators extracting key teaching moments
104
+ - πŸ’Ό Businesses showcasing product highlights
105
+ - πŸŽ™οΈ Podcasters creating promotional clips
106
+
107
  ---
108
 
109
+ *Built with ❀️ using open-source AI technologies. Transform your content strategy today!*