r/QwenAI • • Mar 12 '24

Qwen (Qwen)

Thumbnail
huggingface.co
0 Upvotes

r/QwenAI • • Mar 12 '24

Qwen2

Thumbnail
huggingface.co
0 Upvotes

r/QwenAI • • May 06 '26

Transcribing & Subtitling Audio Containing Multiple Languages

Thumbnail
reddit.com
0 Upvotes

r/QwenAI • • Sep 18 '26

Qwen3.8-Flash-Next (95.5 GiB) on a 64GB Mac at ~27 tok/s, checkpoint + fork

Thumbnail
reddit.com
0 Upvotes

r/QwenAI • • 7d ago

Qwen4 27B Spoiler

Post image
0 Upvotes

r/QwenAI • • Aug 09 '26

когда работаешь с coder от qwen

0 Upvotes

Вот есть такая ситуация. Работаю с coder.qwen.ai а он даже с маленьким чатом выдаёт бредятину которую не остановить даже другой темой тем более тут нет ни одного настоящего файла и он их зачем то придумал.


r/QwenAI • • Feb 10 '26

Qwen Image 2.0 Just Launches – Finally Fixes Text in AI Images and Runs Way Faster

Post image
6 Upvotes

r/QwenAI • • Oct 03 '25

Alibaba is going all in on Qwen…

Thumbnail
youtube.com
1 Upvotes

r/QwenAI • • 5d ago

Did Qwen 4 Max Just DESTROY Claude Fable 5.5 & GPT-6.1?

Thumbnail
youtu.be
0 Upvotes

r/QwenAI • • Oct 19 '26

Speed Demo: Qwen3.8-27B on Cerebras vs GPU inference

3 Upvotes

r/QwenAI • • Feb 04 '25

QWENLLM is also trained on chatgpt.WITH PROOF

3 Upvotes

I was just testing out the code generation of these 2 llms ...Then I saw both of these ai made legit the same website..I just told both to create a simple one but the results are really same

https://ibb.co/Z6mKMt6r

https://ibb.co/hR8zKCks

https://ibb.co/ND9rTHg

https://ibb.co/KxPmn4tK

https://ibb.co/1JMNwSZz


r/QwenAI • • Sep 10 '25

NEWS Open source Image gen and Edit with QwenAI: List of workflows

15 Upvotes

For those who are not aware QwenAI released a Qwen-Image model and an Image-Edit (similar to Kontext and nanobanana) for free some time ago, it is time to get back in line and be updated, I made a list of everything you should know about for now:

  1. Qwen Edit: https://blog.comfy.org/p/qwen-image-edit-comfyui-support

You can expect: Perspective Change, Character Replacement, Image Editing, Object Removal, Change style Text editing .

https://huggingface.co/Comfy-Org/Qwen-Image-Edit_ComfyUI/tree/main/split_files/diffusion_models

2) Qwen ControlNet! https://blog.comfy.org/p/comfyui-now-supports-qwen-image-controlnet

Expect these models: Canny, Depth, and Inpaint

https://huggingface.co/Comfy-Org/Qwen-Image-DiffSynth-ControlNets/tree/main/split_files/model_patches --> to be inserted into a new type of folder under models "model_patches".

Controlnet Unified (for all control net models mentioned and more): https://blog.comfy.org/p/day-1-support-of-qwen-image-instantx (https://huggingface.co/Comfy-Org/Qwen-Image-InstantX-ControlNets/tree/main/split_files/controlnet) --> controlnet folder.

https://huggingface.co/Comfy-Org/Qwen-Image-DiffSynth-ControlNets/tree/main/split_files/loras --> Loras folder.

Other link: https://www.modelscope.cn/models/DiffSynth-Studio/Qwen-Image-In-Context-Control-Union/

3) Qwen Image: https://docs.comfy.org/tutorials/image/qwen/qwen-image

Some diffusion models: https://huggingface.co/Comfy-Org/Qwen-Image_ComfyUI/tree/main/non_official/diffusion_models

https://huggingface.co/Comfy-Org/Qwen-Image_ComfyUI/tree/main/split_files

4) You can expect lightning fast gens with 4 and 8 steps models:

https://huggingface.co/lightx2v/Qwen-Image-Lightning/tree/main

Source: https://github.com/ModelTC/Qwen-Image-Lightning

Add this Lora and select 4 or 8 steps in your sampler (instead of the usual 20 or 25 steps).

5) for LOW VRAM gpus, you can use GGUFs:

https://huggingface.co/QuantStack/Qwen-Image-Edit-GGUF/tree/main

6) Other models used:

https://huggingface.co/Comfy-Org/lotus/tree/main

https://huggingface.co/stabilityai/sd-vae-ft-mse-original/tree/main

7) You also got some interesting loras:

https://civitai.com/models/1940557?modelVersionId=2196307 (Outfit extractor)

https://civitai.com/models/1940532?modelVersionId=2196278 (Try on clothes)

8) You can find more Instructions inside ComfyUI stream videos:

Search for the term Qwen: https://www.youtube.com/@comfyorg/search?query=qwen


r/QwenAI • • Sep 23 '25

🔥 Qwen-Image-Edit-2509 IS LIVE — and it’s a GAME CHANGER. 🔥

Thumbnail
youtube.com
3 Upvotes

r/QwenAI • • Feb 06 '26

I went too far with QWEN3-TTS

13 Upvotes

So ive been playing around with the model and have been having heaps of fun sampling voices, however for some reason today i found a video of my father who passed away a few months ago and thought it would be a good idea try sample his voice.

I sat with my brothers as we made him say things we thought he would have said and moments later we were all in tears and it was such a sad moment where reality had been suspended, feeling like he was there with us followed by the emptiness of realising he wasnt with us anymore.

It was like losing him all over again. Stay safe out there and cherish the moments you share with the ones you love while they are still around.


r/QwenAI • • Sep 10 '26

Qwen3.8-Flash-Next (125B MoE) at 38 t/s on Windows — Strix Halo, working MTP, full guide + tools (MIT)

Thumbnail
reddit.com
2 Upvotes

r/QwenAI • • Sep 09 '26

SpaceX charging more for search tool calls via API - Help

Thumbnail
reddit.com
2 Upvotes

r/QwenAI • • Sep 09 '26

RTX 4090 vs Mac Studio M5 96GB for production AI server? (GLM-OCR + Qwen 27B Q8)

2 Upvotes

We're moving off the Gemini API due to cost and building a local AI server to process ~10 CVs/minute (extracting JSON & matching CVs to JDs). We plan to run GLM-OCR alongside Qwen 27B (Q8).

Our two hardware options:

  1. PC: RTX 4090 (24GB) + Ryzen 9 + 64GB RAM

  2. Mac Studio: M-Ultra, 64-core GPU, 96GB Unified Memory

I prefer the Mac for power efficiency and ease of use, but I've heard Apple Silicon isn't great for production vLLM compared to Nvidia/CUDA. Is that true? Which would you recommend for this workload?


r/QwenAI • • Feb 10 '26

🚀 Introducing Qwen-Image-2.0 — our next-gen image generation model!

Thumbnail
youtube.com
3 Upvotes

r/QwenAI • • Oct 06 '25

NEWS Qwen Image Edit 2509 lightx2v LoRA's just released - 4 or 8 step

Thumbnail reddit.com
2 Upvotes

r/QwenAI • • 5d ago

RX 5700 XT (8GB) Vulkan & 32 GB DDR4 | Qwen3.6-35B-A3B-MTP (Unsloth) | 20 to 35 T/s | Tutorial

1 Upvotes

RX 5700 XT (8GB) Vulkan & 32 GB DDR4 | Qwen3.6-35B-A3B-MTP (Unsloth) | 20 to 35 T/s | Tutorial

System Specs & Software

  • GPU: AMD Radeon RX 5700 XT (8 GB VRAM)

  • CPU & RAM: AMD Ryzen 7 3700X, 32 GB DDR4 RAM

  • Storage & OS: B450 Motherboard with NVMe, Linux Mint Cinnamon

  • Backend: llama.cpp version 0.9.0-dev (build 12283, commit f3b407ca1), compiled with GNU 13.3.0 for Linux x86_64

  • Model: Unsloth Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf with a Q8_0 quantized mmproj file

Setting up the system correctly and using the right model and mmproj quantization is paramount for getting this to run smoothly on an 8 GB RDNA 1 card.

1. Building llama.cpp with Vulkan & OpenBLAS

sudo apt update && sudo apt upgrade -y
sudo apt install -y build-essential git git-lfs curl cmake libopenblas-dev libvulkan-dev vulkan-tools glslc glslang-tools spirv-headers glslang-dev

cd ~
# Correct the URL before running
git clone github dot com/ggml-org/llama.cpp
cd llama.cpp

cmake -B build -DGGML_VULKAN=ON -DGGML_BLAS=ON -DGGML_BLAS_VENDOR=OpenBLAS -DCMAKE_C_FLAGS="-march=native" -DCMAKE_CXX_FLAGS="-march=native"
cmake --build build --config Release -j$(nproc)

2. Increasing Linux GTT Memory Limit (Crucial for Large Contexts)

Because newer versions of llama.cpp use updated memory allocation methods, the Vulkan driver (RADV) tries to map large chunks of system RAM for the GPU via the GTT (Graphics Translation Table) when running large models or long contexts. By default, Linux strictly limits GTT memory to half of your system RAM (so only 16 GB on a 32 GB system).

Open or create the config file:

sudo nano /etc/modprobe.d/amdgpu-gtt.conf

Add the following lines, then save and exit:

# GPU-mappable memory range: 24 GiB = 24 * 262144 pages
options ttm pages_limit=6291456

# GTT size in MiB (24 GiB = 24 * 1024)
options amdgpu gttsize=24576

Update your initramfs so the kernel loads the new limits at boot, then reboot:

sudo update-initramfs -u && sudo reboot

3. Quantizing the Vision File (mmproj)

Place your downloaded model and vision files into ~/models (or adjust the paths below to match your folder). Unsloth downloads via LM Studio include a 1.8 GB 32-bit mmproj-F32.gguf. Quantizing it down to a 614 MB 8-bit file saves VRAM and still works great:

~/llama.cpp/build/bin/llama-quantize \
  ~/models/Qwen3.6-35B-A3B-mmproj-F32.gguf \
  ~/models/Qwen3.6-35B-A3B-mmproj-F8.gguf \
  Q8_0

Note: Loading the model configurations below leaves around 5% free VRAM as a safety buffer.

4. Benchmark 1: Think-Mode Coding (262k Context)

  • WebUI Tip: Disable browser tools in the WebUI (click the + button next to the chat input), otherwise the model might get stuck in a loop. Chromium-based browsers work great for me; Firefox had issues. The WebUI is not a coding tool, btw.

~/llama.cpp/build/bin/llama-server \
  -m ~/models/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf \
  --n-cpu-moe 41 --n-gpu-layers 999 --load-mode mlock \
  --ctx-size 262144 --n-predict -1 --threads 8 \
  --cache-type-k q8_0 --cache-type-v q5_1 --flash-attn on \
  --batch-size 1024 --ubatch-size 256 \
  --host localhost --port 8080 \
  --temp 0.6 --top-p 0.95 --top-k 20 --min-p 0.0 --presence-penalty 0.0 --repeat-penalty 1.0 \
  --spec-type draft-mtp --spec-draft-n-max 3 --parallel 1 \
  --moe-cache-mib 576 --moe-cache-cpu-share 0.75 \
  --mmproj ~/models/Qwen3.6-35B-A3B-mmproj-F8.gguf
  • Results: 25 T/s TG | 125 T/s PP (Subsequent iterations slower: at 90k Tokens context 20 T/s TG | 100 T/s PP)

  • Test Setup & Notes: Tested with a coding task over multiple iterations, including a screenshot showing how the UI layout should look. Running full 262k context forces compromises. Keeping the 41st layer (MTP) in system RAM and using --moe-cache-mib 576 turned out to be slightly faster than setting --n-cpu-moe 40 --moe-cache-mib 0.

5. Benchmark 2: Think-Mode General / PDF & Vision Analysis (49k Context)

~/llama.cpp/build/bin/llama-server \
  -m ~/models/Qwen3.6-35B-A3B-UD-Q4_K_XL.gguf \
  --n-cpu-moe 40 --n-gpu-layers 999 --load-mode mlock \
  --ctx-size 49152 --n-predict -1 --threads 8 \
  --cache-type-k q8_0 --cache-type-v q8_0 --flash-attn on \
  --batch-size 2048 --ubatch-size 512 \
  --host localhost --port 8080 \
  --temp 0.7 --top-p 0.8 --top-k 20 --min-p 0.0 --presence-penalty 1.5 --repeat-penalty 1.0 \
  --spec-type draft-mtp --spec-draft-n-max 3 --parallel 1 \
  --moe-cache-mib 2432 --moe-cache-cpu-share 0.75 \
  --mmproj ~/models/Qwen3.6-35B-A3B-mmproj-F8.gguf
  • Results: ~35 T/s TG | 160+ T/s PP

  • Test Setup & Notes: Tested with a multi-page PDF containing tables, graphs, and images with comprehension questions at the end (pure image recognition is a few T/s slower). By reducing context to 49k, we free up enough VRAM to offload the 41st layer (MTP) onto the GPU, which gives the biggest speed boost. I also tested down to --n-cpu-moe 36 with smaller --moe-cache-mib values, but overall output speed dropped. You can also use a 16-bit mmproj (~900 MB) if you slightly lower the --moe-cache-mib value. For general chat --temp 1.0 works well too.


r/QwenAI • • Aug 17 '26

Why DGX Spark so slow

1 Upvotes

Why DGX Spark so slow? I am using ollama server + vscode copilot. My prompt is : generate a simple RISC-V soft-core CPU and use verilator to test it. I took one hour but still not complete. I am using qwen3.8:27b.

thanks


r/QwenAI • • Sep 18 '26

Qwen3.8-Omni-Flash: Omni Senses. Agentic Delivery.

Thumbnail
qwen.ai
2 Upvotes

r/QwenAI • • Apr 08 '26

Qwen 3.6 Plus: Now Available on just4o.chat | just4o.chat Official Update

Thumbnail
just4o.chat
2 Upvotes