Request Tool KoboldAI + Erebus Model for text-based adventure

[Lakius]

Tried out KoboldAI today. The only HUGE gotcha for speed is that you need to lower your GPU layers to leave ~10% VRAM free, and NEVER increase the disk cache bar unless you have no RAM left. There's a third setting which takes the leftover from those two sliders, and tries to load that on RAM. If you use both sliders, you will have a bad time. Leave disk at 0 or pick a smaller model. Seriously, I went from 6s per word to around my comfortable reading speed, even on a 7GB/s drive. CPU usage down from 98% to 4%.

Honestly though, comparing the complexity to StableDiffusion, KoboldAI is leagues simpler to install and use. It even has a desktop shortcut, which sweaty SD guys seem to consider a right of passage to use their version.

As for actual quality of output, you need some good setup or to start small. Turn important stuff into tags and comments in your world info, like character descriptions and motivations. Delete lines that make no sense, make an effort to steer the AI when it gets weird. Laugh off its attempts to plug incest into your story if you're using the erotic fic AI. Switch AI when you want to go back to worldbuilding, or be prepared for a character to start acting super thirsty as soon as it's clear this isn't foreplay.

All that said, I had a lot more fun using KoboldAI than StableDiffusion. Much less creative blue-balling.

 

[fass]

I think that the comments regarding the quality of output from AI are correct. It's still mostly of below average for free lewd/porn writers due to its lack of ability to focus or have common sense or understand timing. It'll rush through a sex scene in a couple of sentences with barely any detail and then have you doing errands at the store for paragraphs. Or it'll forget stuff and start going in loops and being surreal. You've got to wrestle with it to keep it on track constantly. The only reason it is worth doing is either if you are a writer and super stuck for ideas and want to take a shot in the dark with this as you've no one else to bounce ideas off of or you're looking for some fap material like most of us. Not many people are willing to supply a stream of on-demand, possibly niche, fap material when you're feeling horny and do so rapidly. For that kind of thing it's pretty good as if you're feeling horny you'll overlook all but the most absurd, like it writing characters with too many body parts or bizarre mutations or accidental comedy and it might be difficult to correct and get back on track.

There's no doubt that right now the average human writer would make you something vastly better, especially if they had the same or understood your preferences well. Kinks and details are so important in writing lewds but what details you focus on really matter. Do you want detailed information on sweat dripping down abs or the way a pair or breasts heave and jiggle? A good writer and/or one that knows your interests well of course will blow it out of the water, no doubt.

The real story experience in writing actually happens in your head, not the page or screen, which is why it needs to feed the head with the imagery that matters. I'm sure that at some point you'll have easy tags to tell it to expand certain things and have it learn more variety and focus on your interests but so far it's not there yet.

The two things it seems best for is dungeon crawling and adventures or lews. Honestly the latter especially as there's obvious barriers to that with humans, while arranging games of RPGs isn't too difficult and you can schedule that while horniness can be more of an "in the moment" thing. Yet the crazy thing is that they're not all diving more into supporting lewd content and promising privacy, a combination that would drive customer base for sure. The porn/lewd industry is pretty big, after all.

 

[fass]

Tried out KoboldAI today. The only HUGE gotcha for speed is that you need to lower your GPU layers to leave ~10% VRAM free, and NEVER increase the disk cache bar unless you have no RAM left. There's a third setting which takes the leftover from those two sliders, and tries to load that on RAM. If you use both sliders, you will have a bad time. Leave disk at 0 or pick a smaller model. Seriously, I went from 6s per word to around my comfortable reading speed, even on a 7GB/s drive. CPU usage down from 98% to 4%.

Honestly though, comparing the complexity to StableDiffusion, KoboldAI is leagues simpler to install and use. It even has a desktop shortcut, which sweaty SD guys seem to consider a right of passage to use their version.

As for actual quality of output, you need some good setup or to start small. Turn important stuff into tags and comments in your world info, like character descriptions and motivations. Delete lines that make no sense, make an effort to steer the AI when it gets weird. Laugh off its attempts to plug incest into your story if you're using the erotic fic AI. Switch AI when you want to go back to worldbuilding, or be prepared for a character to start acting super thirsty as soon as it's clear this isn't foreplay.

All that said, I had a lot more fun using KoboldAI than StableDiffusion. Much less creative blue-balling.

That sounds like some expert wrangling there. Does it get better over time and learn so you don't have to keep correcting and editing or is it an endless struggle to maintain this?

 

[Lakius]

That sounds like some expert wrangling there. Does it get better over time and learn so you don't have to keep correcting and editing or is it an endless struggle to maintain this?

To preface my answer, I'm about 250 actions deep in my longest session, and I've only been mucking around for a day. My experience is with Erebus 13B, which reportedly has a better time with avoiding weird AI shenanigans than smaller models. YMMV.

Honestly it's not really expert level, but it's a serious edit 1/4 of the time, and a minor edit 1/2. If I see a reply that's 80% right, I'll cut out or edit the 20% to look right. If it's off the walls crazy or less than 50%, I just delete the whole thing and give the AI another go at it, maybe keeping one nice sentence out of 5. I stopped writing new stuff in the actual text box and just add text directly to the story and hit submit, the AI doesn't notice the difference. It has its rough patches where I needed 5+ resubmits until I give it one extra sentence to help guide it, and it has its good patches where I just watch it write a dozen good sentences over 3 submit presses. (though the spacing and formatting can be rough) So yeah, it'll never be automated, you do need to type, and you should to help it "learn" your style and to guide it along. But it does 80% of the typing for me.

It does get better over time, but there are some easy ways to confuse it. I had some real issues with it wanting to declare plot twists which kept making me laugh at how absurd they were, but those stopped once I had set up characters in the world info. As Erebus is an erotic library, it also kept reading that one character had a father in their world info, so it kept wanting to make that plot relevant by describing their incest. Pretty annoying, but a predictable result for a short story trained lewd 'fic AI. Characters having fathers in those stories usually is plot relevant. Pretty big plot elements early on is another thing short stories often have.

It does what I find annoying while writing very good. If I lead up to a character appearing and introducing themselves, the AI will produce me a new character with a physical description. If I need a name, I have another character ask it. If I say the characters enter a stately bedroom, the AI will describe it. If I want to have a better picture on outfits, I describe what they're dressing for, and the AI describes their clothes. It handles pleasantries and surface dialogue for me, which is so awesome. I hate those parts personally when I write, because it takes me out of the action. Sure, sometimes the AI introduces a person with fish limbs ending in tentacles, or adds a big deep voiced muscular dude with tattoos and a cock down to his ankles who immediately demands worship, but the AI wants a story and has the patience of a thousand horny authors trapped in an AI.

Speaking of action, I agree with your earlier point - the AI likes action over description. I'm personally a fan of the purple prose style of writing, where the author describes something down to minute details in a moment, taking a whole damn paragraph or two to do it. It's a crapshoot to get 1 or 3 lines of description from the AI. Sometimes the descriptions are just wrong, but again, edit those. The AI likes things to be over fairly quickly, but you can steer away from that by removing mentions of characters getting close, or explicitly switching positions or something. If you want more description, just start writing more description and see if the AI will add to it.


AI quirks and how to confuse it:

1. The AI is quite literal. I described a character as a male concubine, and since concubine is a female term, their gender flipped around until I added male harem member to their description.
2. I had a 5-some orgy written, and the AI got a little confused over who was in who at what time. Sometimes it had a rough grasp on positions, and I found that when I included those explicitly, it made better assumptions.
3. I introduced a futa character, then had to fight the AI for a dozen or so prompts to make sure no other females spontaneously started using their previously unmentioned dick. By the end of the scene this wasn't an issue.
4. The AI will fixate on some details to grow more details. I had two new characters in a new room. They were first described as staring vacantly at the walls. This turned into them both being drugged slaves when the story got around to describing them after describing the room. I had to go back and remove the vacant stare part that was a few prompts back, and delete that newest prompt.

Cool stuff:

1. One character used a nickname for their lover, which was reasonable and cute. Only once, but still.
2. One character had their wrists bound and immediately broke into erotic RP with a nearby guard. Pretty funny, really good to read actually, unfortunately had to be cut. After I let it play out. They put her in a pillory at the guard barracks. Mmm.
3. One character's eyes apparently turn from green to gold when she gets horny. My setting has magic, and that was pretty random, but kinda fun and interesting to build off of. It was absolutely a random outburst, but it made me think.
4. Genre tags! I haven't looked too close at these, but you can edit your Erebus save directly to add tags to improve results and more naturally ensure your preferences are touched on. (find "anotetemplate": "[Genre: <|>]", in your story's .json) Not sure how to do a blacklist though, and I really want one or I will be forever terrified to have characters enter bathrooms together.

 

[Lakius]

I think that the comments regarding the quality of output from AI are correct. It's still mostly of below average for free lewd/porn writers due to its lack of ability to focus or have common sense or understand timing. It'll rush through a sex scene in a couple of sentences with barely any detail and then have you doing errands at the store for paragraphs. Or it'll forget stuff and start going in loops and being surreal. You've got to wrestle with it to keep it on track constantly. The only reason it is worth doing is either if you are a writer and super stuck for ideas and want to take a shot in the dark with this as you've no one else to bounce ideas off of or you're looking for some fap material like most of us. Not many people are willing to supply a stream of on-demand, possibly niche, fap material when you're feeling horny and do so rapidly. For that kind of thing it's pretty good as if you're feeling horny you'll overlook all but the most absurd, like it writing characters with too many body parts or bizarre mutations or accidental comedy and it might be difficult to correct and get back on track.
...

The real story experience in writing actually happens in your head, not the page or screen, which is why it needs to feed the head with the imagery that matters. I'm sure that at some point you'll have easy tags to tell it to expand certain things and have it learn more variety and focus on your interests but so far it's not there yet.

I mostly agree with this, with a few key points. First, the AI only comprehends what is written. A lot of the incongruities can be corrected by either writing more context, or creating world info entries. We make assumptions on how things should work, the AI is incapable of making coherent, consistent assumptions until they are written down. It works on 1 word at a time. It only "knows" what is behind it.

Quality, yeah, it peaks at 4/5. 5/5 if it hits the right spot, but the rest of the work would pull it back down to 4/5. I've run into very little surrealist stuff once I started using world info to save characters, and filled in some extra motivations and character traits. But it very much feels like dime a dozen fiction, given its inability to focus on larger structure like sections of a chapter. It's very "in the moment" which may just be Erebus showing its short story roots.

The two things it seems best for is dungeon crawling and adventures or lews. Honestly the latter especially as there's obvious barriers to that with humans, while arranging games of RPGs isn't too difficult and you can schedule that while horniness can be more of an "in the moment" thing. Yet the crazy thing is that they're not all diving more into supporting lewd content and promising privacy, a combination that would drive customer base for sure. The porn/lewd industry is pretty big, after all.

NovelAI has a large following, and honestly supporting lewdity and privacy is how they got there. None of their work is original, they just use existing open source models. (This is not an overstatement, even their image AI is just StableDiffusion. You can recreate all of their story writing enhancements with just world info entries on KoboldAI.)

Mainstream has a big distaste for R18 though. CharacterAI in particular has an official post saying they will not allow it, with a quite significant number of likes. Western R18 is pretty much destined to live under the couch cushions for the foreseeable future. It won't ever be a whole couch in this tortured metaphor, unless it's home made.

 

[fass]

Great replies, guys. Some really good info and insights there.

I've mostly been tinkering with Novel as it's semingly set up for noobs like myself and clearly allows for nude and fetish content and sometimes isn't even bad at fetish stuff, surprsingly. It really doesn't like doing the purple prose or at least longer descriptive scenes I prefer. I've had some amazing results at times from my own inexpert fumblings with a variety of themes and scenes but it's so frustating when most the time it feels like trying to get chimps to drive you around town and I feel like I know it can do better. I'll get a rare one in a million freak situation where it describes great detail for the build up, the sex after the typical long build up in the story lasts longer than "they bang in the butt and cum, the end" (which makes it feel like premature ejaculation, story-wise) and even has some sort of post-sex descriptions that are erotic and interesting like describing a lover gently kissing relevant areas that it remembers have been involved in the fun, which is also often missing as it just moves the story on in a hurry or has people acting like they just finished their break at work just drinking coffee and went back on shift. Then I get one where a woman opens a shirt and has hairy breasts (wtf!) or it describes someone as having way too many digits (I stopped the AI when it got to I think two or three extra digits as I was laughing too much, especially as Novel has a commentator excitedly commenting on this too which just made it all even more ridiculous) or limbs, an extra penis appears as the penis is fucking someone and also being blown at the same time, somehow someone whos is being fucked in missionary also experiences that same area in the face at the same time and so on. I guess the understanding of anatomy isn't there yet to stop this. I often find it forgets or gets confused with what people are wearing, if they are naked or not. Clothes appear and then vanish or are replaced by something else and that kind of detail does matter in a story. Sometimes it also gets absolutely obessed with a particular word or situation and repeats every sentence it like someone who has just learned a new thing and is desperate to use it.

I've tried using the memory function to try to guide it but I'm not sure how effective that is or if it truly remembers all that is there as it seems often to be ignored. This may be due to how I write these entries, I'm not sure how clear I have to make it or if it understands natural language in that box.

It's surreal that at the same time we see supposed sexual liberation, removing the shame for talking about sexual issues and kinks or for sex workers and general freedom (and even kids being told how to use sex toys in some schools or taken to strip clubs...) they freak out that adults in the privacy of their own home might by typing something lewd to a non-human in the form of a computer run AI. I can't see anything more harmless than the AI stuff as you can't even argue a human being is "exploited". Steam and other platforms like GOG also shifted over to allow some pretty explicit visual porn to be sold through them, so I'd have thought text-only would be tame by comparison. It's all very contradictory and confusing. Like one half is Victorian prude and at the same time the other half wants to clap at a nude poledancer while downloading hentai VN games and it is the same person or group doing both. I don't understand how we can have all of one thing happening at the same time as it feels we've got some strange other push for prudishness and shutting down any attempts to use tools for some harmless lewd fun.

It does sound like I should learn Kobold but it does have that "here's the cliff, start climbing" feel to like I am going to need to become a professor before I can get any lewd to enjoy. Especially if I want it to be more fetish/kink focused or be consistent. I'll have to try again with some guide to hand hold me (lewd!!). Kobold probably would let me tailor things more to my tastes too. I didn't think I'd need to get a phd to fap.

(I'll make my own lewd AI, with blackjack! And hookers!)

 

[Lakius]

Great replies, guys. Some really good info and insights there.

I've mostly been tinkering with Novel as it's semingly set up for noobs like myself and clearly allows for nude and fetish content and sometimes isn't even bad at fetish stuff, surprsingly. It really doesn't like doing the purple prose or at least longer descriptive scenes I prefer. I've had some amazing results at times from my own inexpert fumblings with a variety of themes and scenes but it's so frustating when most the time it feels like trying to get chimps to drive you around town and I feel like I know it can do better. I'll get a rare one in a million freak situation where it describes great detail for the build up, the sex after the typical long build up in the story lasts longer than "they bang in the butt and cum, the end" (which makes it feel like premature ejaculation, story-wise) and even has some sort of post-sex descriptions that are erotic and interesting like describing a lover gently kissing relevant areas that it remembers have been involved in the fun, which is also often missing as it just moves the story on in a hurry or has people acting like they just finished their break at work just drinking coffee and went back on shift. Then I get one where a woman opens a shirt and has hairy breasts (wtf!) or it describes someone as having way too many digits (I stopped the AI when it got to I think two or three extra digits as I was laughing too much, especially as Novel has a commentator excitedly commenting on this too which just made it all even more ridiculous) or limbs, an extra penis appears as the penis is fucking someone and also being blown at the same time, somehow someone whos is being fucked in missionary also experiences that same area in the face at the same time and so on. I guess the understanding of anatomy isn't there yet to stop this. I often find it forgets or gets confused with what people are wearing, if they are naked or not. Clothes appear and then vanish or are replaced by something else and that kind of detail does matter in a story. Sometimes it also gets absolutely obessed with a particular word or situation and repeats every sentence it like someone who has just learned a new thing and is desperate to use it.

I've tried using the memory function to try to guide it but I'm not sure how effective that is or if it truly remembers all that is there as it seems often to be ignored. This may be due to how I write these entries, I'm not sure how clear I have to make it or if it understands natural language in that box.

It's surreal that at the same time we see supposed sexual liberation, removing the shame for talking about sexual issues and kinks or for sex workers and general freedom (and even kids being told how to use sex toys in some schools or taken to strip clubs...) they freak out that adults in the privacy of their own home might by typing something lewd to a non-human in the form of a computer run AI. I can't see anything more harmless than the AI stuff as you can't even argue a human being is "exploited". Steam and other platforms like GOG also shifted over to allow some pretty explicit visual porn to be sold through them, so I'd have thought text-only would be tame by comparison. It's all very contradictory and confusing. Like one half is Victorian prude and at the same time the other half wants to clap at a nude poledancer while downloading hentai VN games and it is the same person or group doing both. I don't understand how we can have all of one thing happening at the same time as it feels we've got some strange other push for prudishness and shutting down any attempts to use tools for some harmless lewd fun.

It does sound like I should learn Kobold but it does have that "here's the cliff, start climbing" feel to like I am going to need to become a professor before I can get any lewd to enjoy. Especially if I want it to be more fetish/kink focused or be consistent. I'll have to try again with some guide to hand hold me (lewd!!). Kobold probably would let me tailor things more to my tastes too. I didn't think I'd need to get a phd to fap.

(I'll make my own lewd AI, with blackjack! And hookers!)

I've got a fairly passable background in image AI, so I'm already quite biased, so I already expect to need to resubmit 3-5 times. Even with a really good prompt for image AI, you sometimes get fucking weird shit, like at least 1 in every 10 images having some massive, impossible to ignore fuckup like an entire extra torso like some sort of freak snake body. 3/4 odds for something small like an extra breast somewhere, or nipples on elbows, dislocated shoulders and joints, an extra navel, clothing that starts from under an arm, an extra hand or arm emerging from behind something.... Some prompts are stable as hell and always produce someone normal looking, but nudity seems to attract aberrations. So I'm really not surprised when weird freaky shit pops up anymore. People don't share the average result, they share the 1/1000 result.

I've also noticed that Erebus poorly tracks clothing. It's not bad at adding appropriately dressed characters to a scene, but what they're wearing seems to be contextualized with the scene rather than the character's history. As for obsession, if I mention someone has a fetish or behavioral trait, every character seems to get extremely on board and accommodating, or decides they're also special in the same way, which is kinda frustrating. It's less noticeable for my longer session with established characters, but really fucking annoying 15 actions in on a new story. Start small with 2 characters, I guess. And yeah, it has no concept over what position allows what interaction, so I rewrite a lot of mentions of kissing or reaching behind people to grab titties. The AI doesn't care when I do. I don't think I'd ever go from an AI story direct to publishing, because there's a lot of really derpy obvious "Bob leaves the room without anyone noticing or mentioning it, and doesn't come back" unsubtle hints to get the AI to fuck off and stop trying to get Bob to chip in. It's an awful lot like being a GM for DnD.

KoboldAI is really pretty simple to get set up. It got a bad rap in the beginning, but it's very user friendly now. There is one installer at koboldai.org/windows , which creates a desktop shortcut, then it runs an automated first time setup, then you go in and pick your AI model. You need to know your PC to pick the right size model, of course, but then it's up and running. With no $25 USD bill per month. Feel free to PM me if you'd like help (yes, that applies to you as well, dear lurker).

 

[smirk]

It's surreal that at the same time we see supposed sexual liberation, removing the shame for talking about sexual issues and kinks or for sex workers and general freedom (and even kids being told how to use sex toys in some schools or taken to strip clubs...) they freak out that adults in the privacy of their own home might by typing something lewd to a non-human in the form of a computer run AI. I can't see anything more harmless than the AI stuff as you can't even argue a human being is "exploited".

There's a few of reasons for this, one is that this tech is still very new and not well understood by most people yet. But I think the most important reason why people are skittish about allowing AI generated porn is that most of these models will allow you to generate anything you can imagine, and nobody wants to be featured in news headlines like "AI Game lets you rape toddlers!" or some such shit. They want it reigned in and sanitized before letting the unwashed masses at it.

It does sound like I should learn Kobold but it does have that "here's the cliff, start climbing" feel to like I am going to need to become a professor before I can get any lewd to enjoy. Especially if I want it to be more fetish/kink focused or be consistent. I'll have to try again with some guide to hand hold me (lewd!!). Kobold probably would let me tailor things more to my tastes too. I didn't think I'd need to get a phd to fap.

Fetish content can be a bit hit and miss, but I've found that I get best results if I stick with one or two fetishes and put instructions for them in the author's notes. Something along the lines of "Focus on Timmy's exhibitionism and desire for public exposure." or something like that. Enter more details in world info for Timmy to elaborate.

 

[fass]

I can understand and you are probably right about the potential controversy, but of course the same arguments can be made about a penicl! I can grab one and a piece of paper and write or draw whatever. The penicl makers shouldn't be blamed and I've never heard of them being blamed before. As long as people argue their case it's pretty rock solid.

Thanks for the tips too! I'm trying again with Kobold and I'll see about focusing with it. The installer does make things a bit more idiot proof for idiots like me.

 

[fass]

Had a weird error where it worked fine the first time (used the recommended installer) until it hung up eventually during generation, okay these things happen, I guess. I closed it and when I came back to try something the the next day I can't get the thing to open or load at all now. I get "connection error" page notice in the browser and nothing more, which makes no sense to me. Doesn't matter what browser I use. So I can't even get to the interface to do or change anything. Any ideas?

I tried reinstalling and it made no difference. Still can't get the Kobold browser interface to appear now. Tried updating it after installing to see if that fixed anything and I've got an error in the Kobold console read out talking about "pip failed to install packages" when I tried to update it. No idea what it means.

I don't know why it worked the first time flawlessly and now it's broken...

 

[smirk]

Console logs would probably give some hints. The "pip failed to install packages" message is a python/pip error, it's trying to install some dependency but failing for some reason. Do you have multiple Python versions installed, or is Python installed in some place that you don't have write permissions to? I'm not very familiar with Windows but sometimes installing things to places like C:\Program Files can lead to permission issues as users shouldn't normally write things there.

I run KoboldAI by cloning the KoboldAI-Client repo and running ./play.sh (on Linux, on Windows it would be .\play.bat). It should take care of the dependencies for you, provided you have a sane Python3 installation. It will also give you a handy console log with detailed information about what it's doing and a complete stack trace of any errors that occur.

 

[fass]

What I don't get is it was working fine before the first time. I only tried the update after it failed to work no matter what just starting it up with the shortcut it provided from the install. First time it worked fine. Next time it was dead and continues to be dead with the same error in the browser "Unable to connect".

Running it with play.bat the console says all is well ("Webserver started! You may now connect with a browser", etc.) but the browser says it cannot connect when it automatically opens it or when I paste the same link into any other browser. Console output when starting with play.bat consists of this:

Runtime launching in B: drive mode
INIT | Starting | Flask
INIT | OK | Flask
INIT | Starting | Webserver
INIT | Starting | LUA bridge
INIT | OK | LUA bridge
INIT | Starting | LUA Scripts
INIT | OK | LUA Scripts
INIT | OK | Webserver
MESSAGE | Webserver started! You may now connect with a browser at [I cropped the link in case the forum software auto detects the http link as spam but it's the localhost/127.0.0.1 one].

 

[smirk]

Yeah, mine starts at localhost:5000 - if the server starts without issue but you're still not able to connect, I'd suggest looking into your firewall settings or the ms defender thing and see if it's blocking connections to that port or something. "Unable to connect" would indicate that the request is blocked by something, if the server failed to start you would get some error or indication in the console log. Also, if you're using a proxy or a vpn of some sort, you may have to add an exception for localhost/127.0.0.1 so it doesn't try to route those over the proxy. Use 127.0.0.1 instead of localhost, to eliminate any name lookup issues.

One final thing... have you rebooted recently? If not, check if you have any rogue python processes running. If a previous attempt failed and left a zombie process running it could be blocking the port or otherwise screwing with new attempts.

 

[fass]

Your instincts were right, thanks for the advice. I'm pretty sure now it is my internet security. I briefly completely disabled it and koboldai worked fine. I can't sadly leave it that way permamently so now I am baffled as to what I allow or change to make sure that this in particular is no longer blocked.

I'm glad at least one of us has a sharp brain for this puzzle so I don't bang my head against a wall

EDIT:
Okay, I turned the firewall off and the problem stays. If I turn off all security then Kobold works. Now I am confused.

 

[Lakius]

Firewalls frequently block programs from speaking to eachother over the network, even if that "network" is your local PC. Windows Firewall will prompt for a network exception, though it won't for a localhost connection. I needed it for tablet connecting to KoboldAI on PC, but not PC to itself.

In unrelated news, I really have to laugh at some of the shit Erebus pulls. I was not expecting a thirsty elf to start calling the werewolf "sir" but here we are I guess. It also kept trying to insert WoW characters and places, I guess because she's an elf with a name similar to a goddess in WoW. Arthas apparently can't satisfy her in bed anymore lol

 

[fass]

Okay, if I turn off network attack blocking it seems to work. If I try to add an exception for 127.0.0.1 it makes no difference and still doesn't work. Is there something I'm missing? I wish this all wasn't so obtuse and difficult when I KNOW what I want to do (le tthis thing work) but the damn system makes it difficult to find how to do it.

EDIT: I was wrong. It's still not working at all. Can't download any AI models. This is so frustrating and depressing. Why did it work the first time when I installed it flawlessly yet now it is blocked every damn time?

Firewalls frequently block programs from speaking to eachother over the network, even if that "network" is your local PC. Windows Firewall will prompt for a network exception, though it won't for a localhost connection. I needed it for tablet connecting to KoboldAI on PC, but not PC to itself.

In unrelated news, I really have to laugh at some of the shit Erebus pulls. I was not expecting a thirsty elf to start calling the werewolf "sir" but here we are I guess. It also kept trying to insert WoW characters and places, I guess because she's an elf with a name similar to a goddess in WoW. Arthas apparently can't satisfy her in bed anymore lol

Clearly a polite elf raised well by good parents.

 

[Lakius]

Okay, if I turn off network attack blocking it seems to work. If I try to add an exception for 127.0.0.1 it makes no difference and still doesn't work. Is there something I'm missing? I wish this all wasn't so obtuse and difficult when I KNOW what I want to do (le tthis thing work) but the damn system makes it difficult to find how to do it.

EDIT: I was wrong. It's still not working at all. Can't download any AI models. This is so frustrating and depressing. Why did it work the first time when I installed it flawlessly yet now it is blocked every damn time?

Sounds like your antivirus is the "no fun allowed, it might be dangerous" type. You can try running the program as an administrator with a right click. I'm not sure how your AV is set up, but you may be allowed to add an exception for Python in it. You shouldn't need to download the model a second time, it stores them after download in the models folder.

 

[fass]

I feel like I'm going insane. I've tried completely turning off my security and it is still not working. I cannot connect any more to update.

I got this error in the console "FileNotFoundError: [Errno 2] No such file or directory: 'cache\\models--KoboldAI--OPT-2.7B-Erebus\\refs\\main'"

I did a fresh install and tried running it as an admin and it couldn't update during that either when I asked it to. What can possibly be blocking it now? It feels like the software or my PC is just trolling me now.

The fact it worked great the first time is just making it worse and more confusing as I don't know what changed!

 

[Lakius]

Can you run update-koboldai.bat? You may also want to give your PC a reboot and try again. KoboldAI normally launches a browser window when it's done and ready to go, so if it's not doing that it's crashing before it's ready.

 

[smirk]

I feel like I'm going insane. I've tried completely turning off my security and it is still not working. I cannot connect any more to update.

Hrm as I said, I haven't used Windows in a long while but what you're experiencing doesn't sound like standard Windows Firewall / MS Defender behavior to me. Are you running additional security software? What version of Windows? Maybe someone can point you in the right direction with a little more info.

There are a number of things that need to be allowed through the network for KoboldAI to work. First off, you need to be able to access 127.0.0.1 on port 5000 from your own computer. Second, Python needs to be able to download modules from the Pip repositories to install dependencies that KoboldAI require. The exact host is hard to say, as it picks from a pool of mirrors IIRC. Third, Python also needs to be able to access Github in order to download the models.

Is there any way to add exceptions for "Python.exe" to any firewall or security rules? Are there any mentions in your system logs about requests being denied, particularly from "python.exe"?