4
How to jailbreak ChatGPT: get it to really do what you want | Digital Trends
(www.digitaltrends.com)
this post was submitted on 13 Mar 2024
4 points (83.3% liked)
ChatGPT
8935 readers
1 users here now
Unofficial ChatGPT community to discuss anything ChatGPT
founded 1 year ago
MODERATORS
you are viewing a single comment's thread
view the rest of the comments
view the rest of the comments
Tip: try Oobabooga's Text Generation WebUI with one of the WizardLM Uncensored models from HuggingFace in GGML or GGUF format.
The GGML and GGUF formats perform very well with CPU inference when using LLamaCPP as the engine. My 10 years old 2.8 GHz CPUs generate about 2 words per second. Slightly below reading speed, but pretty solid. Just make sure to keep to the 7B models if you have 16 GiB of memory and 13B models if you have 32 GiB of memory.
Super useful! Thanks! I installed the oobabooga stugg. The http://localhost:7860/?__theme=dark open fine. But then nothing works. how do I train the model with that 8gb .kbin file I downloaded? There are so much option, and I dont even know what I'm doing
There's a "models" directory inside the directory where you installed the webui. This is where the model files should go, but they also have supporting files (.yaml or .json) with important metadata about the model.
The easiest way to install a model is to let the webui download the model itself:
And after it finishes downloading, just load it into memory by clicking the refresh button, selecting it, choosing llama.cpp and then load (perhaps tick the 'CPU' box, but llama.cpp can do mixed CPU/GPU inference, too, if I remember right).
My install is a few months old, I hope the UI hasn't changed to drastically in the meantime :)