CoRal-project/coral
Viewer • Updated • 239k • 159 • 20
How to use rasgaard/whisper-tiny.da with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("automatic-speech-recognition", model="rasgaard/whisper-tiny.da") # Load model directly
from transformers import AutoProcessor, AutoModelForSpeechSeq2Seq
processor = AutoProcessor.from_pretrained("rasgaard/whisper-tiny.da")
model = AutoModelForSpeechSeq2Seq.from_pretrained("rasgaard/whisper-tiny.da")A small hobby project trained in a Kaggle notebook using their free P100 GPUs. Was curious about if you could train whisper-tiny to perform decently if you specialized it for a single language, i.e. danish in this case. The TL;DR is that the results are not great :)
from transformers import pipeline
pipe = pipeline("automatic-speech-recognition",
model="rasgaard/whisper-tiny.da")
Base model
openai/whisper-tiny