- cross-posted to:
- news@lemmy.linuxuserspace.show
- technology@lemmit.online
- cross-posted to:
- news@lemmy.linuxuserspace.show
- technology@lemmit.online
cross-posted from: https://lemmy.ca/post/37011397
The popular open-source VLC video player was demonstrated on the floor of CES 2025 with automatic AI subtitling and translation, generated locally and offline in real time. Parent organization VideoLAN shared a video on Tuesday in which president Jean-Baptiste Kempf shows off the new feature, which uses open-source AI models to generate subtitles for videos in several languages.
As vlc is open source, can we expect this technology to also be available for, say, jellyfin, so that I can for once and for all have subtitles.done right?
Edit: I think it’s great that vlc has this, but this sounds like something many other apps could benefit from
It’s already available for anyone to use. https://github.com/openai/whisper
They’re using OpenAI’s Whisper model for this: https://code.videolan.org/videolan/vlc/-/merge_requests/5155
Has there been any estimated minimal system requirements for this yet, since it runs locally?
It’s actually using whisper.cpp
From the README:
Memory usage Model Disk Mem tiny 75 MiB ~273 MB base 142 MiB ~388 MB small 466 MiB ~852 MB medium 1.5 GiB ~2.1 GB large 2.9 GiB ~3.9 GiB
Those are the model sizes
Oh wow those pretty tiny memory requirements for a decent modern system! That’s actually very impressive! :D
Many people can probably even run this on older media servers or even just a plain NAS! That’s awesome! :D
Note that openai’s original whisper models are pretty slow; in my experience the distil-whisper project (via a tool like whisperx) is more than 10x faster.
deleted by creator
That explains why their subtitles have seemed worse to me lately. Every now and then I see something obviously wrong and wonder how it got by anyone who looked at it. Now I know why. No one looked at it.
deleted by creator
Malevolent Kitchen Intensifies
I hope it’s available for Stash App. I wanna know what this JAV girls are saying.
( ͡° ͜ʖ ͡°)
Ooooh I like this