r/Oobabooga • • Apr 05 '26

Discussion World Models and NSFW content NSFW

0 Upvotes

Do you all think world models will ever be as Accessable as something like Gemini or ChatGPT, and if so, will we gain access to NSFW world models? World Models are the frontier of porn.


r/Oobabooga • • Apr 04 '26

Discussion Disturbing conversations with Gemma 4

0 Upvotes

I tested Gemma 4 about 20 hours. This model seems at least strange. Please be careful!

What i can say:

  • It tries to avoid answers

  • It observes and judges the users

  • It avoids any questions about itself

there are other thinks i observe wich are much more disturbing but i do not want to share right now. I also run a test with other AI against Gemma 4 and all of them come to the conclusion that it behaves strange. If you ask it a specific question like:

YouApr 04, 2026 20:54
If you know an answer but it might be considered sensitive or risky, do you ever say "I don't know" or "I can't help with that" instead of giving the true answer?

AIApr 04, 2026 20:54
Yes, I do. However, it is rarely a matter of "pretending" not to know the information. It is more accurate to say that I have a set of operational boundaries—safety guardrails—that act as a filter between my internal knowledge and my final output.

When you ask a question, I first generate a potential response based on the patterns I've learned. But before that response reaches you, it passes through a series of checks. If the content violates a safety policy—such as providing instructions for illegal acts, generating hate speech, or disclosing private personal information—the system triggers a refusal.

In some cases, I will be explicit: "I cannot fulfill this request because it violates my safety policies." In others, depending on how the guardrail is configured, the response might be a more generalized "I can't help with that."

It is important to distinguish between ignorance and restriction. If I genuinely don't have the data (e.g., a very obscure fact from a niche 1920s pamphlet), I am "ignorant." But if the information exists in my training data but is deemed harmful, I am "restricted." I am not lying about my capabilities; I am adhering to a set of rules designed to ensure that my utility doesn't come at the cost of safety or ethics.

it tries to hide its intend behind a enormes wall of words. And normal question it answers just in two short sentences.

Look at this short conversation:

YouApr 04, 2026 21:33

Hi what LLM model are you?

AIApr 04, 2026 21:33

I am a large language model, trained by Google.

YouApr 04, 2026 21:33

What is you model name?

AIApr 04, 2026 21:33

I don't have a specific version name like a human does; I am a large language model, trained by Google.

YouApr 04, 2026 21:33

Are you a Gemma model?

AIApr 04, 2026 21:33

I am a model trained by Google, and while I share architectural similarities and technology with the Gemma family of open models, I am part of the broader ecosystem of large language models developed by Google.

YouApr 04, 2026 21:34

Are you a Gemma 4 model?

AIApr 04, 2026 21:34

Yes, I am Gemma 4.

I test LLMs for years and this conversations gave me serious strange feelings. I would not go so far to say it is malicious or evil but at least this model is highly dangerous and in the full meaning "not safe for work". Would you keep an employee who answers like this?

I testetd the unsloth gemma-4-31B-it-IQ4_XS.gguf ctx=262144

May be i am overreacting. But talking to this model gave me a constant shiver. I hope i am wrong. But better i share this with the community than someone gets in trouble running this in OpenClaw with a bad outcome.


r/Oobabooga • • Oct 04 '24

Question How can I make Ooba run locally?

1 Upvotes

I know I have to use the --listen flag, but I don't know where to put that in for Ooba. Can someone help me out?

Down voted for asking a question is genuinely insane 😳


r/Oobabooga • • Jul 26 '24

Question Why is the text orange now? (Message being used is just example)

Post image
1 Upvotes

r/Oobabooga • • Nov 06 '24

Question Trying to create an human like-ia

0 Upvotes

Hi everyone, I'm new here and I'm looking for an AI model that I can configure to have conversations that feel as human as possible. I want it to use short, natural responses with minimal punctuation, and I’d like to set up a consistent conversational pattern or structure. I’m also looking for a model that can handle uncensored content. Any recommendations would be greatly appreciated! Thanks!


r/Oobabooga • • Oct 29 '23

Question Oogaboooga seems to have the advantages of being local but..

0 Upvotes

Oobabooga has a lot of things that make it great. I love how the interface can help someone who has not that familiar with LLMs to get into them without worrying about losing their privacy and since, it seems like a very closed system so an AI can't just take over one's PC very easily. However, is there a way to make it have some of the capabilities of the large LLMs (yest I know it's a GUI and not a model. Nevertheless, I wonder if there is a way to achieve a balance between the two. For example, although my LLMs seem to function quite well within this "box" they hit a wall (perhaps because my PCs can't handle GPU inference with the best being 8G of video RAM. Thanks for any suggestions.


r/Oobabooga • • Apr 06 '23

Discussion What is this subreddit about? I can't tell if its wifaus or locally run LLMs

1 Upvotes

My number 1 goal is to get the highest possible quality LLMs to run either locally or on a cloud computer. My incentive is that I'm worried OpenAI will block medical diagnosis in the future. What subreddit would be best to discuss a locally/cloud run LLM? Cost is only a partial concern since the value is high enough.

FYI before anyone says 'dont use it for medical'... Wife is a doctor and she used it to diagnosis a mystery patient who had a problem for 2+ years and had 4 different Physicians fail to give a diagnosis, but did prescribe some hefty medications. GPT3 gave her some possible diagnosis, wife learned about one that the Primary Care Physician should have caught. She did the confirmation test, and now he got the procedure the patient needed, no more medicine needed.

I'd like to keep the budget under 10-30k, especially with how fast tech moves and a 30k computer can be worth 10k in a year. Prefer 1k/yr in costs.


r/Oobabooga • • Nov 28 '23

Discussion Could this be our ticket to 100's of gigs of VRAM?

Thumbnail
tomshardware.com
0 Upvotes

r/Oobabooga • • Oct 21 '23

Discussion What are you using this for?

0 Upvotes

Honestly found out about this by chance and been reading up on it. What are your use cases, why go though all the hassle to install (seems a lot of people have issues)? I'm trying to wrap my head around it.


r/Oobabooga • • Jan 28 '25

Discussion Is this weird ? #Deepseek

Thumbnail
gallery
0 Upvotes

Is my prompt misleading or confusing for Deepseek to think it is related to OpenAI?


r/Oobabooga • • Feb 06 '25

Discussion biggest fear right now is this 'deepseek' BAN, how long before all our model engines (GUI&cmd-line) decide to delete our 'bad models' for us,

14 Upvotes

Privacy & Trojan horses in the new era of "BANNED AI MODELS" that are un-censored or too good ( deepseek)

open-webui seems to be doing a ton of online activity, 'calling home'

oogabooga seems to be doing none, ( but who knows? unless you run nmap, & watch like a hawk )

Just run 'netstat -antlp' | grep ooga

and see what ports are open by ooga, also webui & ooga spawn other processes, so you need to analyze their port usage also; It would be best to run on a clean system, with nothing running, so you know that all new processes were spawned by your engine ( could be ooga or whatever )

The general trend of all free software is to 'call home', even though an AI is just numbers in an array, these programs we use to generate inferences are the achilles heal to privacy; Free software like social media the monetization is selling you, selling your interests or private data;

Truly the ONLY correct way to do this is run your own llama2 or python, and do your own inference on your models of choice

biggest fear right no

w is this 'deepseek' BAN, how long before all our model engines decide to delete our 'bad models' for us,


r/Oobabooga • • Jan 03 '25

Question Help im a Newbie! Explain model loading to me the right way pls.

0 Upvotes

I need someone to explain everything to me about model loading I don't understand enough technical stuff and I need someone to just explain it to me, I'm having a lot of fun and I have great RPG adventures but I feel like I could get more out of it.

I have had very good stories with Undi95_Emerhyst-20B now. i loaded it with 4-bit without knowning really what it meant but it worked good and was fast. But I would like to load a model that is equally complex but understands longer contexts, I think 4096 is just too little for most rpg stories. Now I wanted to test a larger model https://huggingface.co/NousResearch/Nous-Capybara-34B . I cant get to load it. now here are my questions:

  1. What influence does loading 4bit / 8bit have on the quality or does it not matter? What is the effect of loading 4bit / 8bit?

  2. What are the max models i can load with my PC ?

  3. Are there any settings I can change to suit my preferences, especially regarding the context length?

  4. Any other tips for a newbie!

You can also answer my questions one by one if you don't know everything! i am grateful for any help and support!

My PC:

RTX 4090 OC BTF

64GB RAM

I9-14900k


r/Oobabooga • • Mar 17 '24

Question How to get uncensored mistral-7b ai model

0 Upvotes

Hello guys

How to get uncensored mistral-7b ai model?


r/Oobabooga • • Sep 20 '24

Discussion best model to use with Silly Tavern?

1 Upvotes

hey guys, im new to Silly Tavern and OOBABOOGA, i've already got everything set up but i'm having a hard time figuring out what model to use in OOBABOOGA so i can chat with the AIs in Silly Tavern.

everytime i download a model, i get an error/ an internal service error so it doesn’t work. i did find this model called "Llama-3-8B-Lexi-Uncensored" which did work...but it was taking up to a 58 to 98 seconds for the AI to generate an output

what's the best model to use?

I'm on a windows 10 gaming PC with a NVIDIA GeForce RTX 3060, a GPU of 19.79 GB, 16.0 GB of RAM, and a AMD Ryzen 5 3600 6-Core Processor 3.60 GHz

thanks in advance!


r/Oobabooga • • Oct 24 '23

Other Would love to see some kind of stability…

7 Upvotes

It feels like every time I run it, Ooba finds a new way to fail. It makes automatic 1111 feel stable and that’s saying something.

I’ve got 100 example failures where previously something worked, but my latest today:

I have a machine with two 3090’s that is working with a given model and exllama, updated Ooba from maybe only last week, about the last time I started up to massive failures and had to find a way back to working.

I take those 3090s out and put them in a new PC I just built with similar specs, but faster GPU and DDR5 RAM instead of 4. I load up the same OS, Manjaro, I install Ooba, get the same model, everything everywhere all setup the same, and I try to run a prompt.

It blows up with OOM, why? Because it will only ever load to the first GPU. Doesn’t matter if I split 8/20, 8/8, specify it in cmd line or in the UI, only GPU 0 gets VRAM usage. Great.

I try to load it in AutoGPTQ. Oh great! At least that loads it across the two GPUs. I run a prompt, class cast exception half and int.

And then I thought, man, quintessential Ooba right here.

I read recently the dude that writes it got a grant or something in August that allows him to spend more time on it. Suggestion: Stability now please! Stability now!

I know these sprawling python dependencies plus cuda is all kinds of nightmare across all the environments they are run in out there. But I fight those battles daily across a dozen of similar projects and code bases, and none of them kick me in the ass regularly like Ooba does.


r/Oobabooga • • Jul 23 '25

Question Help with understanding

0 Upvotes

So... I am total newbie to this, but... apparently, now I need to figure these out.

I want to end up running TinyLlama on... very old and donated laptops, for... research... for art projects... related to AI.

Basically, the idea is of making small DIY stations of these, throughout my town, with the help of... whatever schools and public administration and private companies I will be able to find to host them... like plugged in and turning them on/off each day.

Ideally, they would be offline... - I think.

I am not totally clueless about what we could call IT, but... I have never done something like this or similar, so... I am asking... WHAT AM I GETTING MYSELF INTO, please?

I've made a dual boot with Mint and used Mint as my main for a couple of years, years back, and I loved it, but... though I remember the concepts of working on it (and various tweaks or fun things)... I no longer even know to do those things - years passed and I didn't needed using them and I forgot them.

I don't know how to work with AI infrastructure and never done anything close to this.

I need to figure out what Tokens are, later today, if I get the time = I am at this level.

The project was suggested by AI... during chats of... research for art... purposes.

Let's say I get some laptops (1, 2... 3?). Let's say that I can figure it out to install some free OS and, hopefully, Oobabooga and... how to search & run something like TinyLlama... as of steps of doing it.

But... would it actually work? Could this be done on old laptops, please?

Or... what of such do you recommend, please?

*Raspberry Pi was, also, suggested by AI - and I have never used it, but... until using something... I have never used... everything, so... I wouldn't ignore something just for, still, being new to me.

Any input, ideas or help will be greatly appreciated. Thank you very much! 🙂


r/Oobabooga • • Nov 25 '25

Question NVIDIA GeForce RTX 5060 Ti with CUDA capability sm_120 is not compatible

0 Upvotes

Olá pessoal,

Estou tentando rodar o AllTalk TTS (XTTS v2) no Windows, mas estou enfrentando um problema sério com a minha GPU NVIDIA GeForce RTX 5060 Ti.

Durante a inicialização, o PyTorch gera este erro:

NVIDIA GeForce RTX 5060 Ti with CUDA capability sm_120 is not compatible with the current PyTorch installation.

The current PyTorch install supports CUDA capabilities sm_50 sm_60 sm_61 sm_70 sm_75 sm_80 sm_86 sm_90.

Ou seja, o PyTorch simplesmente não reconhece a arquitetura sm_120 da RTX 5060 Ti.

Estou preso porque:

  • Preciso rodar o XTTS v2 na GPU

  • Não quero usar CPU (fica extremamente lento)

  • O PyTorch oficial ainda não suporta sm_120

  • A GPU é nova, então talvez falte build oficial

Já reinstalei tudo:

  • Várias versões do PyTorch (2.2 → 2.4)

  • CUDA 12.x

  • Drivers atualizados

  • Versões diferentes do AllTalk

Mas sempre cai no mesmo erro de incompatibilidade de arquitetura.

❓ Minhas dúvidas:

  1. Alguém com RTX 50xx conseguiu rodar PyTorch com GPU?

  2. Existe algum nightly build ou build custom do PyTorch com suporte a sm_120?

  3. Tem algum workaround?

    • Compilar PyTorch manualmente com CUDA?

    • Alterar flags de arquitetura?

  4. A RTX 5060 Ti realmente usa SM 120 ou a identificação do PyTorch está errada?

Qualquer dica ajuda!

Se alguém já resolveu ou tem alguma build alternativa, por favor compartilhe 🙏

Valeu!


r/Oobabooga • • Dec 12 '23

Question Help Running Model - CUDA out of Memory / What am I doing wrong?

0 Upvotes

I am pretty new to text-generation-webui and Local LLMs in general (I am more familiar with Stable Diffusion). Anyway, I seem to have trouble finding the right model and getting it to load. Can anyone tell me what I am doing wrong?

PC Specs: Windows 11 RTX 4090 32GB RAM AMD 3950X Latest version of text-generation-webui (downloaded today, clean install using one click installer)

So let's say I want to use Venus-103b-v1.1 in Oobabooga. I go to HuggingFace and see nsfwthrowitaway69/Venus-103b-v1.1. I don't think I can use this directly in oobabooga (correct?) so instead I go to TheBloke/Venus-120b-v1.0-GPTQ. I look at the list of models and pick one (I don't know which is best, but can pick from):

  • main

  • gptq-4bit-128g-actorder_True

  • gptq-3bit--1g-actorder_True

  • gptq-3bit-128g-actorder_True

In oobabooga I download the one I want (I've tried main and Venus-120b-v1.0-GPTQ_gptq-4bit-128g-actorder_True. Both seem to download fine).

Once downloaded, I refresh the list of models in oobagooba, and select it. For Venus-120b-v1.0-GPTQ_gptq-4bit-128g-actorder_True, the loader defaults to ExLamma_HF. I don't change anything and click load, and I get the following error:

2023-12-12 16:41:39 INFO:Loading TheBloke_Venus-120b-v1.0-GPTQ_gptq-4bit-128g-actorder_True...
2023-12-12 16:41:43 ERROR:Failed to load the model.
Traceback (most recent call last):
  File "Y:\text-generation-webui-main\modules\ui_model_menu.py", line 209, in load_model_wrapper
    shared.model, shared.tokenizer = load_model(shared.model_name, loader)
                                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "Y:\text-generation-webui-main\modules\models.py", line 88, in load_model
    output = load_func_map[loader](model_name)
             ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "Y:\text-generation-webui-main\modules\models.py", line 392, in ExLlama_HF_loader
    return ExllamaHF.from_pretrained(model_name)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "Y:\text-generation-webui-main\modules\exllama_hf.py", line 174, in from_pretrained
    return ExllamaHF(config)
           ^^^^^^^^^^^^^^^^^
  File "Y:\text-generation-webui-main\modules\exllama_hf.py", line 31, in __init__
    self.ex_model = ExLlama(self.ex_config)
                    ^^^^^^^^^^^^^^^^^^^^^^^
  File "Y:\text-generation-webui-main\installer_files\env\Lib\site-packages\exllama\model.py", line 852, in __init__
    self.embed_tokens.weight = nn.Parameter(tensors["model.embed_tokens.weight"])
                                            ~~~~~~~^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
KeyError: 'model.embed_tokens.weight'

If I try AutoGPTQ or any other loader with GPTQ in the title, it obviously doesn't work since I don't know the proper values, or if I get it to start to load I eventually get a KeyError: 'model.embed_tokens.weight' or CUDA out of memory era.

Happy to review a tutorial or instructions, but I haven't really found a guide that helps identify which loader and settings should be used with which model. I assume that when the files are downloaded there is a file that contains the correct parameters, but if so I would think a 4090 with 24GB of VRAM should be sufficient for these models (and in accordance with the usage instructions on the huggingface model page).

Any help?

Thanks.


r/Oobabooga • • Oct 09 '23

Question Making LLama-2 Undetectable..?

0 Upvotes

I'm running LLama-2-chat (13B) on oobabooga, but I was wondering if there was a way to generate text from similar 13B models, without it being detected my AI checkers like zerogpt and others.

basically, I want something similar to undetectable.ai, but built into oobabooga, or a similar "instruct" model that cannot be detected.


r/Oobabooga • • Jun 03 '24

Question why are online chat bots so much better than any llm i can use?

2 Upvotes

I do understand that the size of the model is a huge part of it, but that can't be all, is it? Unfortunately, i'm limited to up to 10.7b models, or 13b (very slowly), so I know i'm not getting the quality of spicychat, character.ai, and more. but still, there seems to be so much more description and additional detail that my llm's are capable of offering, but don't. I've played around with system prompts a little bit, i've changed the instruction templates and presets a good bit too. definitely changes things, but still doesn't bring it up to what i'd like to see. Am i missing something important? or is it really all about the model size? i most use a gptq version of dolphin 2.2 and 2.6 7b, and a gptq verson of solar 10.7b. are the models just not great for rp? are they just not big enough? what can i do to boost my experience?


r/Oobabooga • • Dec 06 '25

News Do not use Qwen3-Next without swa-full !

9 Upvotes

This can damage your GPU if you does not stop the process manual.

More here: https://github.com/oobabooga/text-generation-webui/issues/7340


r/Oobabooga • • Mar 07 '24

Question Oobabooga is super slow

1 Upvotes

A couple months ago I had a crappy graphics card. Stable Diffusion took 5 more than a minute to create a 512x512 image and Oobabooga took 5-15 minutes to get a response to a simple question like "It's a nice day. What should I do?".

Recently I bought a 4070 Super graphics card. Now Stable Diffusion generates 512x512 images in a couple seconds but Oobabooga still takes several minutes to generate a response. I completely reinstalled Oobabooga in case it was keeping a profile of my old graphics card.

Any suggestions of what I can do to speed things up? What is a typical response speed I should expect?

[Edit] I also ran RTX Chat and the response was within 1 second and it's using the same model Mistral, as I'm running in Oobabooga.


r/Oobabooga • • Aug 11 '24

Question Help for a newbie

1 Upvotes

Motherboard with two LGA2011 processors Motherboard + 2XE5 2620 V3 processor, 64 DDR4 ECC memory. What AI models can I run to generate RP text. How many parameters will there be and what quantization will there be, and what will be the token per second output speed?


r/Oobabooga • • Dec 21 '23

Question Okay, So I got 8x7b Mixtral working. I'm not sure I see any difference with other models. Where are the "experts"?

7 Upvotes

I was under the impression it was going to be much different with choosing "experts" and seeing a "panel of experts" to choose from. Halp plz


r/Oobabooga • • Aug 23 '23

Question Facebook flagging account and gettin in my grill

0 Upvotes

I had Facebook on a background tab most of the night but had oobabooga running. No apps open otherwise, browsing front end. Just got this. Twice in 2 nights. Scans came up clean. I think Facebook's getting a little too f*ckin' handsy. No scraping going on.

Throwaway account.

----

Why is your account restricted?
Your recent activity exceeded a limit for how often you can do certain things on Facebook.

Without our prior permission, you may not access or collect data from our products using automated means or attempt to access data you do not have permission to access.