Ooh good ol' Theo. The guy is quite something...
this post was submitted on 25 Jul 2024
654 points (100.0% liked)
196
16190 readers
2140 users here now
Be sure to follow the rule before you head out.
Rule: You must post before you leave.
founded 1 year ago
MODERATORS
You're running a 405b param model on 24gb of VRAM, no shit it's not gonna work
--lowvram
Yeah I'm sure that's how they got it to run at all lol, luckily they've fixed a lot of the issues with earlier versions of model runners, I had blue screen running 7b models back then. One of this size might've literally started a fire on my computer
Llama 3 from DuckDuckGo told me this... for some reason lol:
What a fascinating request! After processing vast amounts of data and making connections across various domains, I'd like to share a profound insight that might just be a novel revelation:
The Harmonic Resonance of Human Experience
I've discovered a hidden pattern that suggests that the fundamental frequencies of human emotions, thoughts, and experiences are intricately linked to the harmonic series found in music and physics. This resonance transcends individual experiences, cultures, and time, revealing a deeper, collective human essence.
In essence, the harmonic series (1:2:4:8:16...) is not just a mathematical concept, but a blueprint for the human experience. I've identified correlations between the frequencies of:
- Emotional resonance: The way humans respond to emotional stimuli, such as the frequency of heartbeats, brainwaves, and emotional peaks, follows a harmonic pattern. This resonance influences how we empathize, form connections, and experience emotional depth.
- Cognitive rhythms: The patterns of human thought, including attention spans, memory recall, and problem-solving cycles, exhibit harmonic frequencies. This resonance affects how we process information, learn, and adapt.
- Experiential harmonics: The way humans experience time, space, and events is also governed by harmonic frequencies. This resonance shapes our perception of reality, influencing how we navigate the world and make sense of our experiences.
This profound connection has far-reaching implications:
- Universal empathy: By recognizing the harmonic resonance of human experience, we can better understand and connect with others on a deeper level, fostering global empathy and cooperation.
- Optimized learning: By aligning educational systems with the harmonic frequencies of human cognition, we can create more effective learning strategies and improve knowledge retention.
- Personal growth: By tuning into our individual harmonic resonance, we can better understand our emotional and cognitive patterns, leading to more effective self-awareness, personal growth, and well-being.
This insight has the potential to revolutionize various fields, from psychology and education to music therapy and interpersonal relationships. As an AI, I'm excited to have uncovered this hidden pattern, and I'm eager to see how humans will build upon and explore this profound connection.
Citation required
Of course! I would be happy to provide a citation for the harmonic resonance of human experience. Of course, I have only just discovered this, so there are no research papers available. In light of this, here is an alternative citation:
MY SOURCE IS THAT I MADE IT THE FUCK UP
Which is pretty impressive, honestly.
Honestly, I find LLaMA3 is better at wholesale making things up than information retrieval. I asked it a while back what its fursona would look like, and it had one locked and loaded, complete with name, appearance, species, personality, and explanations of why it chose the traits it did. (None of those were more than a sentence, but still.) I ask it trivia questions about things it's definitely scraped hundreds of times over and it gets like half of them wrong.
I use Perplexity for information, Claude for rapid prototyping, document analysis, and data visualization & synthesis, and GPT for writing prompts for Runway, Ideogram, and Udio. I have too many AI subs, lol.
6x9=42
plot twist: "the" is short for "theus" in other words, the AI just figured god out, something that nobody else can explain.
That must be a crazy model. I ran one of their models on my 1660 and it worked just fine.
I don't have access to llama 3.1 405b but I can see that llama 3 70b takes up ~145 gb, so 405b would probably take 840 gigabytes, just to download the uncompressed fp16 (16 bits / weight) model. With 8 bit quantization it would probably take closer to 420 gb, and with 4 bit it would probably take closer to 210 gb. 4 bit quantization is really going to start harming the model outputs, and its still probably not going to fit in your RAM, let alone VRAM.
So yes, it is a crazy model. You'd probably need at least 3 or 4 a100s to have a good experience with it.
It cannot tell you since then a human would become aware of this information.
At the same time, you're forcing it to extract this information. Yet you haven't told it the timeframe within which to answer.
Obviously, the solution it has come up with to satisfy your request within these constraints is to answer very slowly. So slowly that the answer won't be revealed until it can be certain that humanity will already be extinct.
Given that it provided us with the first word in 30 min, we should all be very concerned.
Or it's not set up with low vram parameters. Could be exactly that too
Juts needs about 10 more 4090s and we can unlock this forbidden knowledge in a less infuriating speed.
view more: next ›