this post was submitted on 14 Jun 2024
286 points (80.7% liked)
Technology
59192 readers
2438 users here now
This is a most excellent place for technology news and articles.
Our Rules
- Follow the lemmy.world rules.
- Only tech related content.
- Be excellent to each another!
- Mod approved content bots can post up to 10 articles per day.
- Threads asking for personal tech support may be deleted.
- Politics threads may be removed.
- No memes allowed as posts, OK to post as comments.
- Only approved bots from the list below, to ask if your bot can be added please contact us.
- Check for duplicates before posting, duplicates may be removed
Approved Bots
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Yes. Android already does all these things. But I think the things I’m excited most about are not on this list at all.
A private local LLM. With the on-device context of my notes, messages, calendar, etc, I’m rather excited to have a more personal LLM than ChatGPT.
Personal messaging via satellite. I love that I can stay in touch with people outside of a cell network.
Running on a phone? No way, not without being absolutely horrible, slow or making your phone churn through your battery anyway.
Good LLMs are olready slow on a GTX 1080, which is already miles faster than any phone out there
You would be surprised. If you haven’t tried to run a LLM on Apple silicon, it’s pretty snappy but like all others, RAM can be a significantly limiting factor unless the model is trimmed down to do very specific things to reduce the size.