LocalLLaMA

2965 readers

11 users here now

Welcome to LocalLLaMA! Here we discuss running and developing machine learning models at home. Lets explore cutting edge open source neural network technology together.

Get support from the community! Ask questions, share prompts, discuss benchmarks, get hyped at the latest and greatest model releases! Enjoy talking about our awesome hobby.

As ambassadors of the self-hosting machine learning community, we strive to support each other and share our enthusiasm in a positive constructive way.

founded 2 years ago

MODERATORS

[email protected]

What model to grade practice test? (sh.itjust.works)

submitted 6 days ago by [email protected] to c/[email protected]

13 comments fedilink hide all child comments

I took a practice test (math) and would like to have it be graded by a LLM since I can't find the key online. I have 20GB VRAM, but I'm on intel Arc so I can't do gemma3. I would prefer models from ollama.com 'cause I'm not deep enough down the rabbit hole to try huggingface stuff yet and don't have time to right now.

you are viewing a single comment's thread
view the rest of the comments

[–] [email protected] 6 points 6 days ago* (last edited 6 days ago) (1 children)

I don't have any good recommendations. I just upload such one-off requests to AIstudio, ChatGPT and the like. But keep in mind AI isn't perfect at math. They sure make a lot of mistakes with my assignments. I don't know what level your maths test was, AI does an acceptable job at elementary school maths. With higher level maths, it'll give both correct and wrong results by chance. Might be good enough, I don't really know.

I'd recommend Wolfram Alpha. That's not local, nor is it AI. But it solves equations, calculates and transforms and draws graphs with precision and there isn't any guessing involved.

[–] [email protected] 3 points 5 days ago* (last edited 5 days ago) (1 children)

Wolfam alpha actually has an LLM api so your local models can call its factual database for information when doing calculations through tool calling. I thought you might find that cool. Its a shame there is no open alternative to WA they know their dataset is one of a kind and worth its weight in gold. Maybe ond day a hero will leak it 🤪

[–] [email protected] 1 points 1 day ago (1 children)

Considering that digital bights aren't really physical and therefore don't weigh anything "worth there weight in gold" doesn't really make sense here. Sorry, I know it's a metaphor but I just had to.

[–] [email protected] 1 points 19 hours ago* (last edited 19 hours ago)

No worries I have my achthually... Moments as well. Though here's a counter perspective. The bytes have to be pulled out of abstraction space and actually mapped to a physical medium capable of storing huge amounts of informational states like a hard drive. It takes genius STEM engineer level human cognition and lots of compute power to create a dataset like WA. This makes the physical devices housing the database unique almost one of a kind objects with immense potential value from a business and consumer use. How much would a wealthy competing business owner pay for a drive containing such lucrative trade secrets assuming its not leaked? Probably more than a comparative weighed brick of gold, but that's just fun speculation.