r/KoboldAI • • Mar 18 '26

Fake website thread

46 Upvotes

Here is a post with the current fake websites we know about:

kobold-ai,com: Redirects to a chatbot site called CrushOn that nobody should use, they are notorious for putting up fake websites.
koboldcpp,com: Contains inaccurate information about KoboldCpp and has a fake KoboldCpp download that at the time of writing is a copy of older source code (That may or may not also include malware or altered files) and outright malicious downloads / ads if you don't have adblock. koboldcpp,org: At the time of writing another site with inaccurate information that currently links to the wrong download. koboldcpp,store: Site with wrong information that pretends we are a google play app (We don't have one). Currently the link to the play store app is hallucinated by AI but if you notice someone place a malicious app there please let us know.

Our real websites:
koboldai.com - Our website for information about KoboldAI and its software. We could use help maintaining it, if you'd like to help contribute to GitHub - henk717/koboldai.com: KoboldAI Website · GitHub

koboldai.net - This domain is used for online instances of things, such as KoboldAI Lite (lite.koboldai.net) or community affiliated forks such as esolite.koboldai.net

koboldai.org - Our URL shortlink domain, for example https://koboldai.org/cpp for KoboldCpp downloads, https://koboldai.org/discord for our Discord community and https://koboldai.org/colab for the KoboldCpp colab.

Domains we own (to prevent scam domains) but don't currently use:

koboldcpp.net

kobold-ai.net

kobold-ai.org

koboldcpp.sh

Honorable Mention

kobold.ai - German company with the same name as us. We both started our efforts around the same time and I don't think either one was aware of each other at the time. While they are the only non-malicious one they have nothing to do with us and serve an entirely different purpose.


r/KoboldAI • • Mar 25 '24

KoboldCpp - Downloads and Source Code

Thumbnail
koboldai.org
17 Upvotes

r/KoboldAI • • 18h ago

Crashing after Fresh Windows Install

1 Upvotes

Hello all, as the title suggests, I am struggling to get KoboldCPP to remain stable after reinstalling it on a fresh Windows 11 installation since the old one became corrupted after many years.

Either KoboldCPP crashes, or my graphics card (RTX5090) goes into its safe state where it doesn't transmit to my monitors and the fans whir at full speed. I have never had these problems until now, and I am using the exact same model (a Gemma 4 31B finetune) and settings as I had before my Windows reinstall. I use SillyTavern as my frontend, and it does not crash when KoboldCPP does, nor does anything else. This crash happens after a couple generations or after a hundred.

Attempted fixes: Run as administrator, reverting to previous KoboldCPP versions, reinstalled the graphics driver, reinstalled Visual C++, and changed the number of GPU layers the model uses. I ran Memtest86 on my 64gb of RAM, and it come back clean. SFC /ScanNow, Chkdsk, and DISM all returned clean results. I even swapped power sticks. RAM is not overclocked.


Event viewer gives me information when only the application crashes:

Application error 0xc0000409

Exception code: 0xc0000005

Faulting module name: VCRUNTIME140.dll (OR, because sometimes it says this other one) Faulting module name: ucrtbase.dll


Which seems to point me at Visual C++ and memory issues, but this only began after my Windows reinstall and the computer is otherwise stable under heavy game loads. I'm stumped. Perhaps I'm missing a requirement that KoboldCPP uses?


r/KoboldAI • • 2d ago

First Time using Kobold, what are the best uncensored models?

15 Upvotes

I have an rtx 5080, what are the best uncensored models i can use to get janitorai level responses?


r/KoboldAI • • 2d ago

Cursor Ultra for $18 instead of $200. seriously how?

0 Upvotes

been using it for 3 months, no issues. feels too cheap to be real. if they’re still making money at this price, how are they getting the accounts?


r/KoboldAI • • 6d ago

Should I get 32GB RAM?

8 Upvotes

Hi! I’m currently using my RTX 3060Ti 8GB, and my 16GB DDR4 RAM for local AI with KoboldCPP and SillyTavern. I’ve experimented with different models, and right now I’m using one called Magidonia 24B V4.3 GGUF, quantised to Q4_XS, which just about fits into my VRAM and RAM.

However, would I be able to upgrade to a larger, better model if I get 32GB of RAM, or will my GPU become too much of a bottleneck? What kind of quality difference and speed difference could I expect, and is it even worth it for me to upgrade to more RAM?


r/KoboldAI • • 12d ago

Looking for a small model (3B–8B) that's really good at casual conversation

Thumbnail reddit.com
3 Upvotes

r/KoboldAI • • 13d ago

Server side/shared saves

1 Upvotes

I know the wiki touched on it but for some reason my brain completely fizzled. I'm on windows 10 connecting to my laptop through its hotspot with my phone. How do I get it so that everything is saved on my laptop? Do I just enable "shared multiplayer" in the GUI or is that what RPC mode is? I have no problem connecting to it, it's just annoying to have to keep transferring saves and such when I switch between using my phone and laptop especially when I want to use a different character card but they're all on my laptop.


r/KoboldAI • • 14d ago

How are you bridging uncensored local LLMs with real game state & semantic memory? Built a 100% offline Rust testbed.

Post image
0 Upvotes

Context on the screenshot:

The mission was failing, hull integrity crumbling, and right in front of Escape Pod 04, I decided to test how far the emotional alignment of the local model goes.

(Translation from German)

Commander: "Whatever happens, I want you to know: I love you!"

Trinity: "Oh, Commander... That is so beautiful. I love you too. Whatever happens, we will get through this together."

No moral preaching, no "As an AI, I cannot experience romantic feelings", just raw, contextual narrative immersion.

The actual experiment behind this:

The game itself is just an interactive testbed to solve a deeper architecture problem: How do we cleanly bridge an uncensored local LLM with an active game state machine and persistent semantic memory?

We built the entire stack natively in Rust:

Bi-directional Bridge: The companion isn't just an overlay chat. The cognitive cortex receives the game state via local IPC—current room vectors, inventory weight, vitals, and tactical D20 dice checks (you can see the DC 11 $\rightarrow$ Roll 19 in the log).

Persistent Soul: Epistemic memory and synaptic state are stored locally in SQLite and vector logs. The persona remembers past decisions and trauma across game rounds.

Streaming Voice: Sentence-accumulator pipeline that streams raw tokens directly into an offline TTS engine (Piper ONNX) with low-latency audio output.

Zero-Cloud & Standalone: Runs air-gapped on consumer GPUs (Gemma 2 9B abliterated quantized to Q4_K_M on a local llama-server instance). The whole engine is packaged into a self-contained multi-process distribution. Both the game engine and cognitive runtime are fully bilingual (EN/DE).

Question to the devs here:

How are you handling the latency vs. state-injection bottleneck when feeding real-time game state into local models? Are you relying on JSON schema function-calling, or injecting lightweight state diffs into the system context?


r/KoboldAI • • 16d ago

How to actually load Image models?

6 Upvotes

Why is it that every Text-to-Image model I try to download off of Hugging Face refuses to load, but the model provided in the Getting Started page on the site works just fine?

What the hell am I missing here? I'm not exactly aiming for large models here.


r/KoboldAI • • 16d ago

Message Troubles

Post image
10 Upvotes

I'm so confused what happened, I had used kobold in a browser and this never happened. I accidentally closed the browser and lost what I had (no big deal, woulda downloaded if it was important enough) but I open a new one and now I get this every other message. Disabling "allow multiline responses" makes it happen less but doesn't stop it. And having them retry the message usually works but it's annoying and manual editing would be even more tedious. Is there a way to fix the source of the problem or something?


r/KoboldAI • • 19d ago

KoboldCpp 1.124.2 Patch Release - SheetSage2 Transcription!

24 Upvotes

The koboldcpp 1.124.2 patch release also brings support for SheetSage2 song transcription which YuE2 can use. This allows you to make amazing covers of existing songs. This is cool enough that I thought a post was warranted to explain it.

To try this, setup YuE2 according to the release notes. Then, grab SheetSage2 and load that in as a transcription model (--whispermodel for the cli). Go to http://localhost:5001/musicui and use the Transcribe tab tool to turn your favorite song into a YuE2 ABC song plan.

You can then reuse the song plan in Cover mode to generate a new song cover with your own lyrics!

Here's one I made:

For screenshots, check out https://huggingface.co/koboldcpp/music/discussions/1


r/KoboldAI • • 21d ago

KoboldCpp 1.124 - YuE2, new TTS models, new image gen models and much more

83 Upvotes

koboldcpp-1.124

This is a huge release that brings a ton of new features!

  • NEW! - KoboldCpp has now integrated a small subset of popular models from audio.cpp by @0xShug0! This greatly enhances the available built-in Music Gen and TTS Gen capabilities!

  • NEW! - The latest sd.cpp sync brings some exciting new image generation model support (thanks @wbruna)

  • NEW! - AI Horde now supports Chat Completions workers! This is enabled automatically, simply update to the latest KoboldCpp version. This allows the use of jinja, reasoning, tool calls, streaming and vision over AI Horde - you can enable this by toggling chat completions mode in https://lite.koboldai.net . Special thanks to @tazlin for coordinating this enhancement!

  • Added a /mcp wizard for KoboldCpp Agent, allows setting up custom MCP endpoints. Also fixed a MCP loader race condition.

  • Added /paste mode to KoboldCpp Agent to handle multiline text.

  • Enable CUDA graphs for all architectures, expose upstream lazy loading --lazy-mode and MoE cache --moe-cache-mib, thanks @askmyteapot

  • Added --paralleltotalcontext, which can be used with --parallelrequests. It allows setting the total KV context pool that concurrent requests share. Defaults to contextsize if unset. Increase this if the incoming batched requests are all very large - big requests will queue if they cannot fit.

  • Fixed a CPU flash attention bug triggered by -Ofast, also detect file types by content instead of extension (thanks @wbruna)

  • Now allow a limited amount of cache reuse when in batched (parallel requests) mode

  • Improved SWA handling for Gemma4 models, with corrected warmup. SWA quality should be a lot better and more consistent when rewinding.

  • Fixed a potential buffer overflows on loading for a few legacy models. (Thanks @professor-moody and @UNILESS)

  • Added support for Animated WebP as the default preview for video gen (GIF is still supported, toggle in SDUI settings). AVI remains the default download option.

  • Allow using tokenizers baked into the text encoder llm for image gen models. An explicit tokenizer.json can still be provided in the clip2 slot.

  • Added support for TAEQI-tinier as a baked in VAE for Qwen Image 2.1, thanks @madebyollin

  • Reworked built in WebSearch to give better and longer results in the fetched content

  • Widen tool random id range

  • Allow using RPC host tensor cache directory by @mfrederiksen, trigger with --rpccache

  • Fixed Anthropic api tool handling by @jaeminbird

  • Mask passwords in terminal load logs by @Yuvraj-Dhepe

  • Disable async mode for ancient AMD GCN cards on Vulkan

  • Updated Kobold Lite, multiple fixes and improvements

    • SSE parser improvements, added /v1/responses support, tool call and websearch improvements

  • Merged fixes, new model support, and improvements from upstream, including Nemotron 3.5 Bolt 74BA9B, Mistral Large 4, LFM3, Muse Spark and more.

Download now at https://github.com/LostRuins/koboldcpp/releases/latest

Community Website: https://koboldcpp.net


r/KoboldAI • • 21d ago

Lorebook/World Info and Speed

Thumbnail reddit.com
1 Upvotes

r/KoboldAI • • 22d ago

Any Sparse MOE models suitable for 2070s MAX 8gb Vram? RP related

Thumbnail reddit.com
3 Upvotes

r/KoboldAI • • 22d ago

hey im new

0 Upvotes

as the title suggests, im new to kobold, never used it and want a beginner tutorial, is there anything i need to know about this place?


r/KoboldAI • • 25d ago

If I were to use a Nvidia and a AMD graphics card, is there something I should concerned about?

9 Upvotes

I'm asking this because I've been wondering if could have the fast reading of Nvidia and the amount of Vram of an AMD card at the same time.


r/KoboldAI • • 26d ago

Delete the cloudflared tunnel next to KoboldCpp once

22 Upvotes

Hey everyone,

Quick heads up, Cloudflare sent me an e-mail that they recommend updating cloudflared to the latest version. This isn't because the program itself has an issue, but because of the eMudrha certificates being trusted by it when they shouldn't be (If you missed it those certificates literally had the number 4 as their encryption and are extremely easy to spoof).

While it probably won't impact you at all since KoboldCpp itself doesn't host https by default its still a good idea to delete the outdated CloudflareD just in case if the old versions stop working or get blocked. You can find it next to the KoboldCpp binary if you previously used the remote tunnel option (or your working directory when you use Kobold).

KoboldCpp will then download the latest patched version of their software the next time you use remote tunnel.


r/KoboldAI • • 26d ago

El bot de KoboldCpp no piensa, no actua, ¡AYUDA!.

0 Upvotes

Desde hace un par de dias, llevo intentando hacer que un modelo de gemma(si ocupan el concreto pregunten) corra en el koboldCpp sin embargo cada vez que mando un mensaje para que el bot en SilliTavern me responda pasa 1 de 2 cosas:

1-. O se quede pensando infinitamente y solo muestra la IP. (Imagen 1)
2-. No hace absolutamente nada, se corta inmediatamente el pensamiento y en el PowerShell de ST sale que la solicitud fallo. (Imagen 2)

Ya lo intente con 2 modelos diferentes y nada. ¿Una ayudita?


r/KoboldAI • • 26d ago

Small model recs

6 Upvotes

Curious what people's current recommendation is for smaller models say 5gb and under for role play? I've got a larger moe I've settled (mostly) on for my desktop rig already. However I have a secondary system I run some models on CPU only mostly for non role play. It does decently well for small tool use models or the like but I'm curious how well a tiny well tuned RP model would do. Anyone got a current favorite?

Edit - I realize I should rephrase this: "Are there any small (under 5gb) models that are any good at roleplay?


r/KoboldAI • • 28d ago

Any BEST RP Text Compleation Models that can see and detect images like Gemini, GPT, etc?

Thumbnail reddit.com
2 Upvotes

r/KoboldAI • • 28d ago

Impact of adjusting MoE Experts?

2 Upvotes

So I tried Whittle Qwen 3.8 45B A3B when modifying Envy's AI_RPG frontend and it got stuck almost more than Gemma4 26B A4B does.

But I have often noticed but never tried it, so I wondered what the impact of adjusting it has.
Both potentially on how much VRAM it'll need would increase but also on whether it'd make such project work more 'stable' I guess I could call it. As more of the relevant experts would be usable. When actually using Gemma4 26BA4B and Qwen3.635BA3B models with AI_RPG I have no issues with their output that can't usually be traced back to my own messy modifications.

So say I increase the experts to 5 instead of the default 3, would that then be a good improvement or would it likely just be using more VRAM with little if no benefits?


r/KoboldAI • • Oct 22 '26

Is there proxy harness for realistic character simulation?

Thumbnail reddit.com
4 Upvotes

r/KoboldAI • • Oct 21 '26

Using ram to be able to use bigger models?

13 Upvotes

So my question is:

Can i use any good models with my setup?

I have a 3060ti and 64 gb of ddr3 ram.

I understand that per my vram i am limited to use 8b models. (Which are honestly not impressing me much)

But i read something about offloading to ram?

Since i am very much finding my first steps into this whole topic i am still more or less clueless.

But i would find it very interesting if i can use bigger models like 12b or higher for storytelling / rp?

Using kobold cpp currently but thinking about trying out sillytavern.

I got already some recommedations like using strata. Anybody got experiences with that?

Edit: my mistake its 64gb ddr4 ram


r/KoboldAI • • Oct 19 '26

Model pricing explained

Post image
9 Upvotes

When picking a model I see a input/output token cost per 1M .

I'm using openrouter API, and the price shown is very different.

On glm 5.3,

Output is 1.4$ on koboldai,6$ on openrouter.

Where is the koboldai data coming from? Thought I could test different models,but I can't trust the price shown.