this post was submitted on 16 Feb 2024
786 points (98.5% liked)

Technology

59118 readers
3266 users here now

This is a most excellent place for technology news and articles.


Our Rules


  1. Follow the lemmy.world rules.
  2. Only tech related content.
  3. Be excellent to each another!
  4. Mod approved content bots can post up to 10 articles per day.
  5. Threads asking for personal tech support may be deleted.
  6. Politics threads may be removed.
  7. No memes allowed as posts, OK to post as comments.
  8. Only approved bots from the list below, to ask if your bot can be added please contact us.
  9. Check for duplicates before posting, duplicates may be removed

Approved Bots


founded 1 year ago
MODERATORS
 

They frame it as though it's for user content, more likely it's to train AI, but in fact it gives them the right to do almost anything they want - up to (but not including) stealing the content outright.

you are viewing a single comment's thread
view the rest of the comments
[–] [email protected] 4 points 8 months ago

This is a much better take.

Intonation is huge, and something general models tend to have trouble with - especially with something like an audiobook, which is narration - it's very contextual in a way not found in almost any other form of communication. It even encapsulates every other form of context through dialogue.

And not only that - a lot of audiobooks have versions by multiple voice actors. And they might change a word here or there, but it's highly structured data - it's truly a treasure trove

I'd go a step further and say they really want access to the dataset - not just for audiobooks, but because this is a fantastic dataset to train very context aware (and silky smooth) text to voice.

Spotify probably doesn't have the chops to do this, but they might be trying to leverage the dataset - I'm not sure if they could sell it wholesale or not, but if nothing else they could "partner" with Microsoft or Google to train VTT capabilities into multi-modal LLMs (a pitch with all the buzzwords to make investors need to change their underwear)