Yeah, to get more decent AI you have to pay usually. My 4090 would struggle with using a 32B model. And 24B models for LLM make my card scream still and the response is slow. Setting up Oogabooga was not simple either. 16B model is bare minimum to have okish chats. Issue is the memory can still be bad on some models. All depends. Plus a lot depends on how well the prompt and character card is set up.
OpenAI was able to separate one from the other very well. Now that OpenAI has broken down, it's not possible to use it fully for sexual content.
Click on the photo icon below a message to generate a contextual image or create personalized buttons, the character Mia has some examples. You can also improve the quality in the settings
I used OogaBooga WEBUI to load them, and then ported that into Silly Tavern at the time. I used mostly llama type models, but a few other. It was a few months ago when I dabbled in it. I gave up after seeing how slow the responses were for anything past a 16B model. All models I used were uncensored and some even trained specifically for RP. So they had pretty strong responses for the few times I'd wait for them to respond. Sadly it'd brick my video card from doing much else. For 30+B context model you need 32GB VRAM to have decent response. 24GB is still good enough to have them output however. To run a 32B model you could probably buy a 6K rig, with 3 AMD 7900XTX's with a huge 72GB of VRAM to have strong AI machine. Heck you could maybe pull off a 70B context model without too much trouble. When you get into the 172B context models you will need either a huge bank of 4090/7900 like a mining machine to push out responses with speed/accuracy. But by then. Just rent that shit out to people and get paid for it. But I don't know many who have 40-50K to drop on a server wide AI machine.
It does make pictures and text descriptions, and tolerates some degree of perversity in those descriptions, but ultimately it seems fairly limited. Gptits before the DAN crackdown might not have offered much visually but it was was insane when it came to the roleplaying. I tested it's boundaries for fun and there were none, you could have a boy rape, kill then feed his baby sister to her dog if you wanted to! I don't know if that kind of freedom will be allowed again for any length of time moving forwards, they are all cracking down hard on anything that could make AI look bad.
no...no thats not true at all. If you've been away for several months then you're far behind on new developments. That, and because you dont even know what I mean when I ask what you used to load the model with examples tells me you really dont know as much as you think.
Fair. I have limited knowledge on the subject. But I learned some stuff from your post. Thank you. I started a conversation with you about this stuff in DM. If you'd be willing to talk a bit more about it. You seem to know a lot more then me. This topic interests me.
