this post was submitted on 09 Jan 2025
478 points (99.2% liked)

Opensource

1655 readers
140 users here now

A community for discussion about open source software! Ask questions, share knowledge, share news, or post interesting stuff related to it!

CreditsIcon base by Lorc under CC BY 3.0 with modifications to add a gradient



founded 1 year ago
MODERATORS
(page 2) 50 comments
sorted by: hot top controversial new old
[–] [email protected] 9 points 6 days ago (1 children)
[–] [email protected] -4 points 6 days ago (1 children)

Existed for a while without much fanfare. VLC doesn't innovate. And it's basically dead on Linux.

https://github.com/GhostNaN/whisper-subs

[–] [email protected] 19 points 6 days ago (1 children)

VLC doesn't innovate. And it's basically dead on Linux.

Afaik it's false. It had a major update recently and it's installed on a lot of Linux systems.

[–] [email protected] 6 points 6 days ago (5 children)

This is great timing considering the recent Open Subtitles fiasco.

load more comments (5 replies)
[–] [email protected] 21 points 6 days ago (1 children)
[–] [email protected] 5 points 6 days ago

Thank you for your service

[–] [email protected] 0 points 6 days ago

This what be news good is for now

[–] [email protected] 13 points 6 days ago (2 children)

I don't mind the idea, but I would be curious where the training data comes from. You can't just train them off of the user's (unsubtitled) videos, because you need subtitles to know if the output is right or wrong. I checked their twitter post, but it didn't seem to help.

[–] [email protected] 17 points 6 days ago (1 children)

subtitles aren't a unique dataset it's just audio to text

[–] [email protected] 12 points 6 days ago (2 children)

They may have to give it some special training to be able to understand audio mixed by the Chris Nolan school of wtf are they saying.

load more comments (2 replies)
[–] [email protected] 9 points 6 days ago

I hope they're using Open Subtitles, or one of the many academic Speech To Text datasets that exist.

[–] [email protected] 22 points 6 days ago (1 children)

And yet they still can't seek backwards

[–] [email protected] 28 points 6 days ago (2 children)

Iirc this is because of how they've optimized the file reading process; it genuinely might be more work to add efficient frame-by-frame backwards seeking than this AI subtitle feature.

That said, jfc please just add backwards seeking. It is so painful to use VLC for reviewing footage. I don't care how "inefficient" it is, my computer can handle any operation on a 100mb file.

[–] [email protected] 1 points 6 days ago

You can easily write a video reader using openCV that would be able to read backward using cache

[–] [email protected] 11 points 6 days ago (1 children)

If you have time to read the issue thread about it, it's infuriating. There are multiple viable suggestions that are dismissed because they don't work in certain edge cases where it would be impossible for any method at all to work, and which they could simply fail gracefully for.

[–] [email protected] 7 points 6 days ago (2 children)

That kind of attitude in development drives me absolutely insane. See also: support for DHCPv6 in Android. There's a thread that has been raging for I think over a decade now

[–] [email protected] 3 points 6 days ago

Same for simply allowing to pause on click... Luckily extension exists but it's sad that you need one.

load more comments (1 replies)
[–] [email protected] 32 points 6 days ago (1 children)

My experience with generated subtitles is that they're awful. Hopefully these are better, but I wish human beings with brains would make them.

[–] [email protected] 26 points 6 days ago (4 children)

subtitling by hand takes sooooo fucking long :( people who do it really are heroes. i did community subs on youtube when that was a thing and subtitling + timing a 20 minute video took me six or seven hours, even with tools that suggested text and helped align it to sound. your brain instantly notices something is off if the subs are unaligned.

[–] [email protected] 15 points 6 days ago (1 children)

Oh shit, I knew it was tedious but it sounds like I seriously underestimated how long it takes. Good to know, and thanks for all you've done.

Sounds to me like big YouTubers should pay subtitlers, but that's still a small fraction of audio/video content in existence. So yeah, I guess a better wish would be for the tech to improve. Hopefully it's on the right track.

[–] [email protected] 5 points 6 days ago

i just did it for one video :P it really is tedious and thankless though so it would be a great application of ml.

[–] [email protected] 5 points 6 days ago

I did this for a couple videos too. It's actually still a thing, it was just so time consuming for no pay that almost nobody did it, so creators don't check the box to allow people to contribute subs

load more comments (2 replies)
[–] [email protected] 22 points 6 days ago

It's nice to see a good application of ai. I hope my low end stuff will be able to run it.

[–] [email protected] 6 points 6 days ago

this is great news.

load more comments
view more: ‹ prev next ›