this post was submitted on 16 Feb 2024
250 points (83.6% liked)
Technology
59405 readers
2952 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
It could go both ways: similar software could “compress” video (especially AI-generated video) into text prompts that could then re-create it without needing to store it. (Currently, of course, the processing cost would be higher than the storage cost for the raw video—but the scenario in which we’re cranking out excessive amounts of AI-generated content implies that the high processing costs have been eliminated.) That would also have the side effect of making it easier to find and organize videos based on their “meaning”.
I think the idea of using natural language to generate video is flawed for the vast majority of applications we want. Imagine you could give a script to one of these models and have it output a TV show episode. While we can make these models deterministic it seems like the vast majority of generative content with some amount of quality requires the addition of random noise through the process. Should we want TV episodes whose visual quality and little details shift from model to model? Why not store a plain text description infered by some model and store the video component in a medium less prone to misinterpretation? We may use deep learning compression for videos and audio in the future if there are significant advancements but I doubt the compression will be to English.