r/StableDiffusion • • 59m ago

Discussion State of the Sub - 1M Members Reached!

14 Upvotes

Howdy! This has been an interesting ride to get to this point over the years. I remember joining really early on when Stable Diffusion was still around releasing models. Then, picked up as a mod, followed by inviting the few great mods we currently have. We even do have some OG mods who peek in every now and then.

I’d like to thank u/mcmonkey4eva and u/HughWattmate9001 for sticking around and trying to keep up with our queue with me. Also, I'd like to thank those who have contributed to the community and kept interesting conversations.

I don't think I've really put an emphases on member count for the sub, but u/HughWattmate9001 pointed out that we were reaching 1M. So, I provided a screenshot below of how this year has gone for the community and mods:

I know we have gone through many different waves/phases both in user post types and different moderating styles over the years. The few of us left as mods have tried to be consistent (when available) in moderating depending on members reports more so than any controlling methods you see in other subs. I hope we continue to remain and grow as the open source sub that we consistently try to be.

Feel free to express how you feel about the sub. Good or bad. Talk about the sub community, 1girls, mods, memes, improvements, events, and/or whatever relevant.

I know I am not as active as I was the first few years with u/mcmonkey4eva and u/HughWattmate9001 passing me in moderation actions. However, I hope I've personally done well enough for my part in keeping this sub up for everyone. Even if I don't respond to each one, I'll more than likely read all the comments throughout the week.

Happy Holidays everyone and I hope yall stick around.


r/StableDiffusion • • 1m ago

News H3 Image - Model Preview Override vae from KJ

Thumbnail
huggingface.co
1 Upvotes

KJ just dropped vae_approx preview for H3 image..


r/StableDiffusion • • 2m ago

Animation - Video LV Better Hire Me After This

1 Upvotes

Happy to answer any questions!


r/StableDiffusion • • 1h ago

Question - Help Is SCAIL-2 still the best for character replacement?

1 Upvotes

r/StableDiffusion • • 1h ago

Resource - Update My OpenFill fork is now OpenFill’s Baby: AI object selection, MiniMax H3 editing/removal, and easier ComfyUI setup

Thumbnail
gallery
1 Upvotes

Following up on my previous post: I’ve added quite a bit to the fork, and it now has its own name—OpenFill’s Baby.

It extends Beckett Harriman’s OpenFill for PhotoCraft, bringing image editing, object removal, and generative fill into the editor through ComfyUI on your computer or another machine on your LAN. You can even use a different machine for select, edit, and remove, if you have a bunch of machines and you don't want to keep unloading and loading models.

The main additions since that post:

  • AI object selection with WeVisOne-VL. Click an object, drag a tight box around it, or describe what you want selected. Add or subtract objects, refine the selection with PhotoCraft’s tools, and grow it by an exact 1–500 pixels. Each Grow has its own Undo step.

  • MiniMax H3 Image support for editing and removal. Edit a selected area or the whole image, with up to four attached reference images. H3 also works in the prompt-free Remove tool.

  • Automatic removal choices. Automatic prefers H3 when it’s available on your selected engine. Otherwise, it examines the surrounding lighting and texture to suggest an available method. You can override it with Local background repair, LaMa, RORem, Qwen Lightning, or FIBO Dev, depending on your setup.

  • Better removal blending and more choices. Repairs preserve feathered selection edges and blend into nearby background. Request 1–5 variations and compare them directly on the canvas before keeping one.

  • Find and save ComfyUI servers. Use one shared engine, or assign separate servers to Select, Edit, and Remove. The panel remembers your choices.

The Qwen Image 2.1 and FIBO reference-editing workflows from the original post are still there (as well as SDXL and Flux).

Removal still needs judgment, especially around hidden lettering or complicated shapes. Include unwanted shadows and reflections in your selection, and check the results.

Download the latest release
Source, screenshots, and setup instructions

Give it a try! I’d especially like feedback on object selection and difficult removal cases because I'm aiming to make it adapt to all the ways you and I want to use it for.


r/StableDiffusion • • 1h ago

Animation - Video Minimax H3 _Ref2VA_2Pass

1 Upvotes

Encontré un workflow compatible con mi rtx 5070 y 32gb de ram. No sé mucho de esto, pero se que funciona. 12 GB de Vram.

Un video de 1344 x 768 de 7 segundos en 10 minutos. Usando un checkpoint modificado de Minimax H3 (10Eros_Max_h3_8stepsTURBO_beta7)

Si, intenté hacer a Ashley. Y las palabras que dice en japonés son el inicio de la canción "Propose".


r/StableDiffusion • • 2h ago

Question - Help Video editor recommendations for quick creation of 15-second clips?

1 Upvotes

Does anyone have any recommendations for a video editor that lets you load a clip and immediately create a clip of a certain length (e.g., 15 seconds for MH3)? I'm using Bandicut at the moment, but I have to manually trim each video I load every time and adjust the time, which is time consuming.


r/StableDiffusion • • 3h ago

Discussion Minimax H3 made on nvidia GeForce RTX 5060 Ti 16gb

0 Upvotes

r/StableDiffusion • • 4h ago

Resource - Update [Release] DiffusionBear v0.5.0 is live — Pure-MLX runtime (-52% .app), 3/4-stage memory lifecycle, Virtual Boxes, Kromoss 5B, RGBA Alpha & Open Agentic REST API

Post image
1 Upvotes

Welcome to the DiffusionBear v0.5.0 release megathread!

Because of the size of this update—removing PyTorch from the packaged runtime, rebuilding generation around a sequential 3-/4-stage MLX pipeline, adding embedded SHA-256 model integrity checks, Kromoss 5B support, RGBA transparency for Qwen-Image 2.1, and opening the Agentic REST API—we jumped directly from v0.4.5 to v0.5.0.

🔗 Quick Links & Downloads

SHA-256 Checksums (packaging/ALL_SHA256SUMS):

  • DiffusionBear-0.5.0-arm64.zip: f2d3bf2865fb53ef215cefcaefb331793ef76119a88cb79dabb7ec38c27a94fa

  • DiffusionBear-0.5.0-arm64.dmg: 4a2ed3eba57378c47a80c4a3b4d15bfa50bc461c8986126c1324d4fd7725ec9b

💻 System Requirements & First-Launch Setup (Read First!)

  • Hardware & OS: Apple Silicon only (M1 / M2 / M3 / M4 / Ultra — no Intel, CUDA, or CPU path). Requires macOS 26.2 or later (derived from the minimum-OS Mach-O load commands of the shipped MLX / libJACCL binaries). 16 GB unified memory recommended.

  • No Python/Node/Homebrew needed for the standalone .app. Model weights are not bundled—they download on first use from Hugging Face or Civitai into ~/Library/Application Support/DiffusionBear (you can point ~/Library/Application Support/DiffusionBear/store_path to an external drive), after which generation works 100% offline.

  • First-Launch Gatekeeper Bypass (Ad-Hoc Signed): Because DiffusionBear is free/open-source without a paid Apple Developer ID certificate, macOS blocks the first double-click:

    1. Unzip and drag DiffusionBear.app into /Applications (don't run from ~/Downloads).

    2. Run xattr -cr /Applications/DiffusionBear.app in Terminal (or click Done → System Settings → Privacy & Security → Open Anyway).

🚀 What's New in v0.5.0

1. Pure-MLX Runtime & Trimmed Binary (-52% .app, -45% .zip)

  • torch, torchvision, torchaudio, diffusers, and accelerate are 100% removed from the packaged .app and default runtime. Built-in engines (mflux, the native MLX SDXL daemon, and dedicated MOSS/Qwen engines) execute purely on Apple MLX, safetensors, NumPy, transformers, tokenizers, and mlx-vlm (--no-deps).

  • Standalone .app shrank from 1.3 GB → 615 MB and the arm64 .zip from 396.7 MB → 217.1 MB with 0 build warnings.

  • (Note: Optional out-of-process conversion of raw single-file Civitai SDXL .safetensors checkpoints still uses external torch/diffusers if installed on your machine; all bundled inference engines run 100% PyTorch-free.)

2. Rebuilt 3-Stage / 4-Stage Sequential Memory Lifecycle

Instead of holding the text encoder, DiT/UNet, and VAE in Unified Memory simultaneously, v0.5.0 runs strict sequential stages and explicitly evicts each heavy model tree (del, gc.collect(), mx.clear_cache()) before loading the next:

  • 3-Stage (Text-to-Image): Encode (Text Encoder → embeddings → evict) → Generate (DiT/UNet → latents → evict) → Decode (VAE / TAESD / TAEF → pixels → evict).

  • 4-Stage (Reference / Img2Img / Edit): Adds Stage 1/4 Reference Encode (VAE / VL encoder → image_latents + image_latent_ids → evict) before prompt encoding, denoising, and final decode.

  • Wired GPU budget auto-tunes to min(68% of unified memory, Apple's recommended working set) (~10.9 GB on a 16 GB Mac), resident pipelines auto-release after 5 minutes idle, and Krea/Qwen/FIBO declare resident-memory estimates so oversized pixel ceilings fail safely before triggering a Metal OOM.

3. Virtual Boxes on the Studio Canvas (Video Demo)

Supported on FLUX.3-klein 5.6B, MOSS-Image SFT / Base 5B, and Kromoss 5B (FLUX.2-klein uses masked generative fill; FIBO 2.0 Edit Turbo uses masked inpainting + up to 4 references):

  • Draw, resize, and toggle color-coded dashed boxes ([ymin, xmin, ymax, xmax]) directly on the Studio Canvas via the SPATIAL BOX panel (Center, Left, Right, Top, Bottom, Full, Compose, JSON).

  • Use Backdrop: Last Result or + Reference to compose over an existing scene—like the demo video's 3-box "BearCoffee" coffee-bag + mug edit (#1 coffee_bag_1, #2 coffee_beans_1, #3 ceramic_cup_1) or 4-box "MAKE IT LOCAL" poster (#1 mountain_1, #2 person_1, #3 fox_1, #4 En_Text_1).

  • Spatial layouts are saved in generation metadata so reusing parameters reproduces the composition.

4. Kromoss 5B + RGBA Alpha Transparency + Canonical Model Families

  • Kromoss 5B (4-bit MLX): Added Ouinche/kromoss-mlx-q4 (Apache 2.0 MOSS distillation) on the pure-MLX MOSS engine with its automatic 8-step DMD2 Accelerator LoRA (129.43 s median at 512×768).

  • RGBA Alpha Transparency (Qwen-Image 2.1 & Turbo): Toggle 4th-channel alpha transparency in Advanced Settings for native transparent cutouts with checkerboard preview across Canvas, Browser, and Image Cards.

  • 9 Canonical Families + Local Qwen 2.5 Prompt Enhancer: sdxl, flux1, flux2, flux3, krea2, z-image, qwen, moss, and fibo2 each get isolated LoRA/metric mappings and dedicated local Qwen 2.5 (0.5B / 1.5B MLX) prompt-enhancer profiles (auto-unloading 1.2 GB before generation).

5. Upgrading from v0.4.x: First-Run SHA-256 Verification & Partial Repair

  • Embedded model_manifests.json inside the binary. On your first launch of v0.5.0, DiffusionBear hashes installed built-in models (leaving custom user models untouched), flags mismatches from legacy upgrades or interrupted downloads, and lets you run shard-level partial repairs or full re-downloads (also accessible anytime on the Models tab).

6. Open Agentic REST API & Remote Browser Access (http://127.0.0.1:8001)

  • Let coding agents (Claude Code, Cursor, Antigravity), scripts, or remote browsers (Safari on Mac/iPhone/iPad including Add to Home Screen, Chrome, Firefox, Opera via Tailscale Serve or LAN) drive any installed model, LoRA, reference image, mask, or spatial_boxes locally with $0 cloud tokens.

  • Secured by dbk_... SHA-256 hashed keys (Authorization: Bearer / X-API-Key), loopback fail-safe, and 429 queue limits.

  • Lockout recovery tip: If you ever enable API mode before saving your key in a browser profile, set "enabled": false in ~/Library/Application Support/DiffusionBear/data/security.json (backend/data/security.json from source) to reopen loopback immediately without losing keys.

📊 Full v0.5.0 Benchmarks (2021 MacBook Pro M1, 16 GB)

20 configs × 11 prompts = 220 runs (10 portrait prompts at 512×768 + 1 icon prompt at 512×512; total wall time 5h 47m 38s; across the 19 matched configs / 209 runs, wall time dropped from 13h 01m 38s → 5h 24m 26s, -58.5% total / -4.7% step-matched):

ModelStepsMedian (512×768)RangeNotes
Juggernaut XL Lightning48.80 s8.66 – 12.14 sNative MLX SDXL, q4 cache + TAESD (warm reload ~3.45 s)
RealVisXL V5.0 Lightning615.23 s13.69 – 24.81 sNative MLX + TAESD
RealVisXL V5.0838.78 s38.73 – 43.82 sHyper-SD 8-step, native MLX (-16.0%)
Juggernaut XI v11841.22 s39.91 – 66.25 sHyper-SD 8-step, native MLX
FLUX.2-klein 4B444.09 s44.07 – 44.31 sCompact 4B (-7.2%)
Qwen-Image 2.1 (2s + DMD2)246.77 s46.32 – 47.93 s7B DiT + 2-step DMD2 (-32.0%)
FLUX.3-klein 5.6B451.38 s51.17 – 51.76 sVirtual Boxes + flow-matching (-3.1%)
FLUX.1-schnell474.22 s74.07 – 75.02 sRectified flow (-16.5%)
MOSS-Image SFT 5B (DMD 4s)483.57 s80.61 – 84.95 sPure MLX + 4-step DMD (-96.7% vs 25s stock)
FLUX.2-klein 4B (8s)889.73 s89.58 – 89.91 sHigh-detail 8-step
Bria FIBO 2.0 Edit Turbo493.68 s92.32 – 95.03 s4.2B DiT + Qwen3-VL 4B (-8.3%)
FLUX.2-klein 9B496.54 s96.34 – 97.04 sFlagship 9B (-8.0%)
FLUX.3-klein 5.6B (8s)898.35 s98.24 – 98.57 sHigh-detail 8-step (-3.3%)
Pony Diffusion V6 XL25104.69 s104.56 – 108.74 sFull 25-step native MLX (-4.9%)
Z-Image Turbo 6B8114.97 s114.86 – 118.35 sSharp geometry 8-step (-1.1%)
Kromoss 5B (DMD2 8s)8129.43 s128.34 – 137.04 sPure MLX + 8-step DMD2 LoRA (new)
Krea 2 Turbo 13B4156.81 s142.20 – 171.97 s13B 4-step distilled (-0.4%)
Qwen-Image 2.1 Turbo8158.64 s158.08 – 162.12 s8-step distilled 7B DiT (-19.4%)
FLUX.2-klein 9B (8s)8191.38 s191.29 – 191.40 sFlagship 9B 8-step (-1.5%)
Krea 2 Turbo 13B (8s)8299.18 s243.57 – 371.42 s13B native 8-step

💬 Share Your Results & Feedback Below!

  • Running on M2 / M3 / M4 / Pro / Max / Ultra? Drop your chip, RAM size, model, and median generation times in the comments—it really helps fellow Mac users know what to expect.

  • Made something cool with Virtual Boxes, RGBA transparency, or the Agentic REST API? Post your outputs or spatial JSON in the sub!

  • Found a bug? Report it in the comments or on GitHub Issues. (For security issues, please use GitHub private vulnerability reporting instead of a public post.)


r/StableDiffusion • • 4h ago

Question - Help Qwen 2.1 massive drifting

Post image
4 Upvotes

I'm finally getting great results with Qwen2.1, but there is still one thing that I can't get over with: the pixel drift. In previous versions of qwen edit, the edited image would usually drift by a few pixels. A tad problematic but not too much of a hassle. In 2.1 however, the drift is massive! Take a look at this picture (not a real person by the way).

I simply changed the clothing. Every seed has this kind of issue it's not a quirk of the randomness, it's a behavior. I've tried being more explicit in the prompt about "preserving the angle, composition, not zooming" etc. but nothing helped.

Could be related to the lightx2v turbo LoRA, but whatever. Just posting here to see if anyone found something that actually combats this behavior to some extent?


r/StableDiffusion • • 5h ago

Animation - Video tides!

4 Upvotes

i wanted to test just how good can minimax h3 water look, so i made this.


r/StableDiffusion • • 5h ago

Tutorial - Guide Free ComfyUI LoRA training tutorial - Part of a 14 weeks lecture - Week 9

Thumbnail
youtu.be
0 Upvotes

r/StableDiffusion • • 5h ago

News I made a party mode where every guest orders a song from their phone - it's all local ComfyUI (Plenio 2.0, free)

2 Upvotes

The film shows one real party run: the host starts a party, a guest's phone orders "a birthday song for Maya, who turns thirty today", the host's ComfyUI makes it (here 185 seconds from the order to the playlist on a 16 GB card), and it plays on the big screen with the lyrics as they are sung while the guests' reactions float up. The film's music is that very song.

Plenio is a song production suite for ComfyUI - YuE2 and MiniMax Music 3, lyrics by a local LLM, mastering, cover art with FLUX.2 Klein. 2.0 adds Setup that plans the models for your card, a Song API with MCP, and the Director for the visuals.

comfy node install comfyui-plenio-music

https://github.com/jplenio/Plenio-Music-Production-System

Here you find some tutorials: https://youtube.com/playlist?list=PLaId01kYGcS0&si=qOLtBE_6LtwEEr7_


r/StableDiffusion • • 5h ago

Discussion As a Moss/Krea2 user I wasn't sold on Minimax Image at first but now it's definitely a model I'll use.

Thumbnail
gallery
225 Upvotes

Will post requested prompts on the thread.


r/StableDiffusion • • 5h ago

Discussion you want perfect hands? no more bad details on mini-max-image?

2 Upvotes

test it, i share a workflow on civit with this, civit are off line now, so im posting here for help the community.

results on comments.


r/StableDiffusion • • 5h ago

Discussion Minimax Image (Edit) - My Early Thoughts

23 Upvotes

Windos 10 | i7 12700K | RTX 3090 TI | 96GB RAM

Workflow I'm using: Reddit | Workflow

I'm a digital artist and professional with several years experience, but my interest in these apps has primarily been playing around with the tech. However, since Minimax dropped, concepts I've had to shelve in the past are looking viable again as potential video shorts, and Minimax image was just the sort of thing I've been looking for as a visual creator to speed up the production pipeline.

I got a chance yesterday afternoon to play around with it on some specific tasks, so here are my results and early thoughts. I've mostly been using the edit capabilities, since that's what I'm most interested in Minimax for, so keep that in mind.

A quick clarification: My editing tests have a narrow scope and I'm sure they don't reflect the full capabilities of the model. My initial intended use for this model was to be able to draft keyframes for film. I'd sketch the composition out, use multiple image references, then generate high resolution keyframes to drive the video. It wasn't until I saw this reddit post that I became aware that H3-Image could be used for drafting concept to realism, so that was an unexpected-but-welcome expansion of my use case. :)

Where Minimax Image (Edit) is strong:

Minimax-Image is really good at generating realism versions of artwork, which typically requires LoRAs for other models. So far, I think this is one of its most impressive features. In my tests it significantly outperformed Nano Banana Flash, but I haven't compared it with the Pro version.

I wasn't necessarily wowed by/the 16MP images. While decent, they looked pretty average to the other AI apps. But as I went higher, the quality really shone through.

Here are some samples where the instructions were to create a realistic version of my artwork and maintain look and pose. I like to choose this image because a lot of models tend to not do well with it. To date, H3-Image is the best of them all.

Examples:

Minimax is also strong at generating realistic designs based on really rough sketches, which impressed me. Here is a rough design of an early draft of a character I designed.

The first image is my sketch, the 2nd is the first attempt, telling it to make a realistic version. It made him look too human, so for the 2nd roll, I just described his skin texture, eyebrows, eyes, chin, lips, and also the jewelry. On the next attempt, it was able to interpolate my rough lines to understand what was meant to be jewelry. On this, it did a FANTASTIC JOB. Again, best model PERIOD, way better than Nano Banana. Literally only took me 2 iterations to go from rough draft to near cinematic concept design.

Also, these images were only 16MP, so I suspect going higher would look even better, as it tends to get insane between 30-50MP. :)

I also tried it with a random AI image I found online and got equally impressive results. These are just the first couple or so rolls, at 16mp:

Where Minimax Image (Edit) is weak:

I tried sketching compositions and then instructing H3 to use that composition to drive the concept art and create original work, primarily realism based. It performed poorly. Here are some examples of what I mean:

Out of over a dozen attempts, this is pretty much the best result I could get.

The prompt stated to use the sketch as reference for the pose, position of the sun, and plants/tress. I colored each element a different color to help guide instructions. I tried many variations of the prompt, but no matter what I did there was always some form of the sketch introduced into the final image. I also tried using natural photo reference, but features of the reference would always make their way into the image. I tried this between 16MP - 50MP, same problem.

Also, the images varied between 2.5/3D, realism, cartoon, and comic book styles and most of the time failed to follow my instructions. I found that realism works best when using a single image as reference, but it seems to collapse on multi-image pipelines.

Final Thoughts

I think H3-Image works great as a concept-to-realism draft model, but it's weak on its multi-ref prompt following. It also needs 16MP before it stretches its legs, but if you have a smaller card, don't get scared away, it's ridiculously optimized/fast despite the size. I get 16Mp in about a minute on my 3090 at 80% power, which is about the same speed as Klein/ZiT/Qwen. (I haven't tested Krea 2/Moss yet, both on my to-do)

That said, 16MP is the minimum I'd recommend, the real magic happens 30MP and up, so if you got the card and the time, results are signficantly better. Around 50MP is the sweet spot imo; details are crisp, hair strands, fingernails, everything looks good.

Also, I wouldn't use the default comfy workflow. Everything I did was w/the workflow above, though I deleted the prompt enhancer, preferring to use regular text.

Anyway, those are my thoughts so far. I'll update w/more results later.

Grunge

P.S. - I'm old-school forum/deviantart gang, so I keep ctrl+biu/shift+l on a swivel and have written bold-flavored posts like this for 20+ years. 100% human written. Receipts at bottom of post if you're interested. Only mentioning it because organization usually brings out the "this is AI-written slop" trolls.


r/StableDiffusion • • 6h ago

Discussion make a old PC game INTRO alive

15 Upvotes

old but gold


r/StableDiffusion • • 6h ago

Animation - Video EVA Soprano Short I Had Fun Making (Trash Quality).

4 Upvotes

r/StableDiffusion • • 8h ago

Workflow Included Seems like I solved Krea 2 Edit pixel drift

Thumbnail
gallery
84 Upvotes

Krea 2 Edit by lbouaraba / conradlocke (the LoRAs, the nodes, the training code) is the reason any of this works, so first: all credit to them:
https://github.com/lbouaraba/comfyui-krea2edit
https://huggingface.co/conradlocke/krea2-identity-edit

I built a small add-on comfyui-krea2edit-advanced fork of their comfyui-krea2edit for one problem I kept running into. The fork stops the drift when you chain several edits. Without it, the parts you didn't touch slowly shift, darken and get grainy. With it they stay put.

It adds a "source hold" that pulls the picture back towards the source while it's being drawn, plus an optional mask for everything outside the area you're editing.

More detailed comparison is here. Same image, same six edits, same seed. Mean pixel drift from the source after 6 edits (lower is better):

  • original nodes: 0.076

  • my fork, no masks: 0.0017 (45 times less than original)

  • my fork, with masks: 0.0008 (95 times less than original)

More detailed information and example workflows are in the repo: https://github.com/FurrySphere/comfyui-krea2edit-advanced


r/StableDiffusion • • 8h ago

News A world model you can run locally as a multiplayer game

Thumbnail
vor.tech
2 Upvotes

We trained a world model on ~4,000 hours of CS:GO gameplay and turned it into a playable multiplayer game. Each player runs the model locally on their GPU, while a lightweight server keeps the game state in sync.

It's still early: one small map, pistols only, some drift over time, and limited fine detail. The beta is free and open to try (RTX 3080+ recommended).

More and the download: https://vor.tech/x/reddit-stable


r/StableDiffusion • • 9h ago

Resource - Update NovaGarb is a companion app/plugin, extending NovaClaw with media capabilities (provides voice/hearing for agents as well as image/audio/video generation/editing). For example, you may ask Nova to create you a virtual gf, who have voice and present herself by means of NovaGarb.

Thumbnail
nancygold.itch.io
0 Upvotes

r/StableDiffusion • • 9h ago

Resource - Update Real-time talking avatar generated locally with SoulX-FlashHead + LFM3-Audio

21 Upvotes

I've been experimenting with real-time talking-head generation using SoulX-FlashHead, combined with local speech models to build an interactive avatar that can listen and respond.

The whole pipeline runs locally, and the demo is available in the audio.cpp v0.9.5 WebUI.

The workflow combines three models:

  • SoulX-FlashHead: Animates a portrait in real time from generated speech.

  • OWSM v4: Transcribes voice input.

  • LFM3-Audio: Handles conversational responses and speech synthesis.

One interesting detail: LFM3-Audio is called twice. Its speech-to-speech path only offers one voice, so we use its TTS capability separately to synthesize responses in a different voice.

Performance and limitations

On an RTX 5090, the latency from submitting a question to the avatar starting to speak is around 850 ms. ASR runs in parallel.

The video generation stage is still GPU-intensive. I'd recommend an RTX 4090 or better for SoulX-FlashHead.

cuDNN is essential for real-time performance in this setup. Without it, inference is about 2× slower and VRAM usage doubles.

This is still a prototype. The extra LFM3-Audio call and WebUI overhead leave room for further latency improvements, particularly in a more optimized native application.


r/StableDiffusion • • 10h ago

Question - Help Minimax H3 video: unrealistic bulge in female underwear

0 Upvotes

I had created a post that was a bit too generic, and i want to focus specifically on Minimax H3.

When making a video of any woman in underwear for any situation, Minimax H3 will almost always add a weird-looking, ugly, unrealistic bulge to female underwear, and that seems to be the averaging of male and female underwear appearance.

Using any alternative base model or LoRAs or any kind of prompting will not solve the issue, and providing pictures of underwear without the bulge only solves it very partially. Adding steps doesn't solve it either.

Am I the only one encountering this? Trying any search engine doesn't return any result. It seems that the entire Internet is ignoring the "Minimax bulge problem" but I don't understand how I can be the only one experiencing this issue or the only one bothered by it.

Any idea how to solve this?


r/StableDiffusion • • 10h ago

Discussion Distilled models are good enough for me as a hobbyist, full models feel like a waste of my GPU time

8 Upvotes

i've been trying distilled versions of a few models and honestly the results for casual stuff are close enough that i don't go back. the few steps mean i can try six ideas in the time a full model does one, and for me the experimenting is the fun part. where i do notice the difference is fine detail like hands and small text, and sometimes the faces look a bit plastic. but i'm just playing around in the evenings. for people who use both, where did you decide the full model was actually worth the wait?


r/StableDiffusion • • 10h ago

Question - Help what image model will run on this specs..

1 Upvotes

what image model will run on this specs..

  • GPU: AMD Radeon RX 6650 XT (8 GB VRAM)

  • CPU: AMD Ryzen 7 5700X (8 Cores, 16 Threads)

  • RAM: 32 GB DDR4

  • OS: Windows