You have to personally contact me to be a part of this version's beta till 1.0; It will not go up on github. Contact me for the current build and to join the tester team. I might ask for videos or logs of things, so beware!.
⚡ Repetere AI (v0.98-Universal_Hybrid_Beta) ⚡
By Nathaniel Richardson Jr.
Official Website: https://www.repetereai.com
Repository: https://github.com/securenrn-del/Repetere-AI_Beta
Binary Distribution: Standalone 1-Click Setup (RepetereAI-Setup-v0.98-Universal_Hybrid_Beta.exe) via GitHub Releases
[!WARNING]
Everything you do runs directly on your machine and will take time. Model weight streaming, prompt ingestion, neural audio synthesis, and image generation are compute-heavy processes.
If the status bar is moving and not throwing an error, IT IS STILL WORKING! Please be patient and allow the generation pipeline to complete.
Compute Sovereignty Restored
Repetere AI is a decentralized, self-hosted Artificial Intelligence ecosystem engineered to restore computing sovereignty, eliminate recurring cloud subscription fees, and provide uncensored, 100% private multimodal generation directly on consumer-grade hardware.
Named after the Latin verb repetere ("to demand back / reclaim" compute sovereignty, and "to repeat / iterate" computational forward loops), this repository houses the native C++ desktop host application for Windows.
[!IMPORTANT] Zero Cloud Telemetry: All inference requests, prompts, code modifications, transcripts, audio arrangements, and image generations execute 100% offline and locally on your host hardware. Built natively on C++, GLFW, and Dear ImGui over OpenGL 3—completely bypassing Electron or Chromium webview wrapper overhead.
⚡ System Requirements
| Component | Minimum Specification (6 GB / APU Tier) | Recommended Specification (Pro Tier) |
|---|
| Operating System | Windows 10 (64-bit) | Windows 11 (64-bit) |
| GPU Acceleration | NVIDIA RTX (6 GB VRAM) / AMD Radeon / Intel Arc / APUs | NVIDIA RTX 40/50-Series (12 GB+ VRAM) |
| Compute Runtime | Universal Vulkan 1.3 / CUDA 12 Runtimes | Dedicated CUDA 12 Runtimes |
| Display Drivers | Latest WHQL Drivers (NVIDIA, AMD Adrenalin, Intel) | Latest NVIDIA Studio Drivers |
| System Memory | 16 GB Physical RAM (Required for Hybrid Mode) | 32 GB Physical RAM |
| Target Storage | 20 GB free space on SSD | 50 GB+ free space on NVMe SSD |
🚀 5-Workspace Multimodal Suite
Repetere AI partitions workflows into five isolated, state-preserved production environments:
1. 💻 CODING Workspace (Interactive IDE)
Engine Target: Qwen 2.5 Coder 7B / 14B / 32B Instruct (Q4_K_M)
Dual-Pane Layout: Integrated split-view engineering studio (38% left agent transcript/prompt queue, 62% right live code canvas).
Synchronized Line-Number Gutters: Real-time dual-column gutter tracking aligned dynamically with the multiline editor buffer.
In-Place AST Diff Parser: Automated parsing for <<<<<<< SEARCH ... ======= ... >>>>>>> REPLACE patch blocks with whitespace and CRLF/LF normalization.
Smart Substitution & Manual Overrides: Smart markdown code-fence fallback that substitutes matching function blocks in place, accompanied by a manual [Apply Response to Editor] toolbar action.
Session Persistence: Full multi-turn context serialization writing to chat_history.json on prompt completion, clear, or application exit.
2. 💬 CHAT Workspace (Conversational Assistant & Embedded App Guide)
Engine Target: Meta Llama 3.1 8B Instruct / Gemma 2 27B Obliterated (Q4_K_M)
Embedded App Self-Awareness: Dedicated zero-token intent detection scanner (SystemPrompts.h) steers queries regarding the workstation, compute modes, and creator identity authoritatively to https://www.repetereai.com.
Dynamic Clickable Hyperlink Parsing: Integrated URL scanner in ChatUI.cpp automatically formats arbitrary https:// and http:// links into interactive Dear ImGui buttons that launch the user's default browser via Win32 ShellExecuteA.
YuE2 Song Formatter & Studio Bridge: Persistent modal querying the warm LLM on port 8080 to parse raw thoughts or lyrics into structured MUSICAL STYLE: and [Verse] / [Chorus] blocks.
Clipboard & Context Actions: Dedicated [ Copy Full Response ] button below every model output, quick snippet copy boxes, and safety-prompted context clears.
3. ✍️ CREATIVE WRITING Workspace (Novelist Studio)
Engine Target: Hermes 3 Llama 3.1 8B (Q4_K_M)
Three-Pane Authoring Studio: Specialized layout featuring a Story Bible drawer, Live Manuscript Canvas, and Directive Console.
Lore Reference Loader: Persistent Story Bible reference loader (.txt, .md) with an autoInjectBible context toggle.
1 MB Manuscript Buffer: Dynamic editor backed by a 30-step undo/redo snapshot ring buffer (PushManuscriptSnapshot).
Narrative AST Scene Diffs: In-place scene diff patcher (ApplyNarrativeDiff) with relaxed spacing and prose rewrite fallbacks.
Directive Presets & Telemetry: Built-in narrative directives (Sensory, Cadence, Dialogue Pass) and live word count, character count, and modified status badges.
4. 🎵 AUDIO (MUSIC) Production Studio
Engine Targets: YuE2 3B Standard (yue2-3b-q4_0.gguf), YuE2 3B Compact (yue2-3b_q2_k_s.gguf), or yue2-3b-q3_k_m.gguf paired with Neural VAE (yue2-vae-f16.gguf)
Low-End & 6 GB Hardware Support: Verified native execution on 4 GB–8 GB cards and handheld APUs using compact quantization with dynamic hardware tier detection.
Vocal & Instrumental Synthesis: 8,192-byte multiline lyrics rack supporting structured section tags ([Verse], [Chorus], [Bridge]) with generation durations up to 360 seconds.
Subshell Sanitization & Memory Guards: Injects CUBLAS_WORKSPACE_CONFIG=:4096:8 and GGML_CUDA_FORCE_MMQ=1 while stripping shell-breaking characters (&, ^, |, <, >).
Master Waveform Transport: Debounced timeline scrub mechanics (s_SeekLockFrames) with native waveaudio opening and DirectShow fallback.
5. 🎨 IMAGES (Diffusion Studio)
Engine Targets: FLUX.1 Schnell (flux1-schnell-Q4_0.gguf or compact flux1-schnell-Q2_K.gguf) with companion encoders (clip_l, t5xxl_q4_k, ae) in .gguf or .safetensors
Hybrid Offloading for 6 GB GPUs: Automatic memory management offloads CLIP, T5, and VAE latents to host RAM (--backend te=cpu,vae=cpu --offload-to-cpu --clip-on-cpu --vae-on-cpu), allowing FLUX to run cleanly without VRAM allocation crashes.
Granular Generation Controls: Dual positive and negative prompt inputs, inference steps (1–50), CFG scale adjustment, resolution presets, and integrated real-time photo-grading.
Prompt Streaming: Temporary file streaming (--prompt-file, --negative-prompt-file) eliminates subshell argument truncations on detailed prompts.
Automated VRAM Garbage Collection: Navigating away from the Image Studio automatically triggers ImageStudioUI::UnloadFromMemory to flush bound OpenGL textures and raw frame buffers.
⚙️ Hardware Compute Modes & Dynamic Hybrid Offload Architecture
Repetere AI introduces an elastic, hardware-aware compute architecture engineered to eliminate GPU Out-Of-Memory (OOM) crashes when executing high-parameter models on consumer cards:
1. Instant Runtime Backend Switching
Real-time [CUDA] ↔ [VULKAN] runtime toggles in the top-level menu bar with zero-downtime sidecar hot-swapping.
Automatic DXGI GPU detection maps NVIDIA accelerators to CUDA 12 and AMD Radeon / Intel Arc / APUs directly to Universal Vulkan 1.3.
2. Pure GPU Mode (-ngl 99)
Locks model execution entirely within dedicated onboard VRAM for maximum token velocity and minimum latency.
Enforces single-session VRAM isolation, unloading dormant sidecars when switching into media studios.
3. Dynamic HYBRID Mode (Elastic RAM / VRAM Co-Execution)
Dynamic Layer Math (CalculateSafeGpuLayers): Inspects physical dedicated VRAM (DedicatedVideoMemory) via DXGI and host physical RAM (ullAvailPhys) via Win32 GlobalMemoryStatusEx. Rather than relying on a static -ngl 16, the engine calculates exact per-layer byte sizes (modelSizeMB / totalLayers) and assigns only what fits safely onto the graphics card.
4.5 GB Dedicated Headroom Reservation: Explicitly reserves 4,500 MB to 5,500 MB of VRAM headroom for Windows Desktop Window Manager (DWM), OpenGL framebuffers, and CUDA runtime context buffers. On a 12 GB GPU (such as an RTX 5070 Ti), this keeps VRAM utilization at a cool ~7.2 GB to 7.5 GB instead of pinning at the 11.7 GB driver ceiling.
Flash Attention (-fa) & 4-bit Quantized KV Cache (-ctk q4_0 -ctv q4_0): Injects Flash Attention and 4-bit key/value cache quantization into llama-server.exe under Hybrid mode, compressing the active context buffer footprint by up to 75% and freeing critical device memory.
Dynamic Context Scaling: Automatically scales context ceilings between 4,096 tokens (under memory-constrained Hybrid execution) up to 16,384–32,768 tokens (under unconstrained GPU execution) to prevent context eviction crashes.
Full-System Multimodal Synchronization: Toggling [HYBRID] synchronizes across all five workspaces:
Text LLMs (Coding, Chat, Creative): Restarts llama-server.exe with calculated safe layer allocations (-ngl 16 to -ngl 24).
Diffusion Studio (FLUX): Injects --offload-to-cpu --clip-on-cpu --vae-on-cpu into sd.exe, streaming text conditioning models through host RAM.
Audio Studio (YuE2): Routes CPU thread pinning and host unified memory to prevent driver allocation timeout faults.
Model Manager [Set Active] Integration: Model overrides initiated in ModelManagerUI.cpp inspect the active g_ComputeMode and execute CalculateSafeGpuLayers, ensuring 27B and 32B checkpoints load cleanly without pinning VRAM.
📸 Workspace Screenshots
📋 Comprehensive Changelog & Version History
Version 0.98-Universal_Hybrid_Beta — Dynamic Hybrid Offload, Flash Attention, Embedded App Knowledge & Low-End Audio Hardening
Version 0.98 delivers dynamic memory offload mechanics across host RAM and VRAM, universal hyperlink parsing, embedded app self-awareness, and low-end hardware baseline compatibility:
+ Added dynamic VRAM-calculated layer offloading (CalculateSafeGpuLayers) based on DXGI VRAM and live host RAM
+ Added 4.5 GB VRAM headroom reservation in HardwareScanner.h to prevent driver pinning and TDR desktop lockups
+ Injected Flash Attention (-fa) and 4-bit KV cache quantization (-ctk q4_0 -ctv q4_0) into llama-server.exe Hybrid launches
+ Added dynamic context window scaling (-c 4096 in Hybrid vs -c 8192/16384 in dedicated GPU)
+ Added native app self-awareness via SystemPrompts.h steering inquiries directly to https://www.repetereai.com
+ Added zero-token multi-turn intent detection in InferenceClient.cpp with root system-prompt injection
+ Added interactive URL parsing in ChatUI.cpp rendering clickable browser-launch buttons via Win32 ShellExecuteA
+ Added synchronized g_ComputeMode linkage across ModelManagerUI.cpp [Set Active] button dispatches
+ Added verified Low-End YuE2 audio synthesis engine (yue2-3b_q2_k_s.gguf) for 4GB - 8GB VRAM systems and handheld APUs
+ Added Hybrid memory offload pipeline for FLUX diffusion (--offload-to-cpu --clip-on-cpu --vae-on-cpu)
+ Added flexible model filename pattern matching in ModelManagerUI supporting underscore and hyphen variants (yue2-3b_q2_k_s)
+ Added low-end diagnostic badges to the Workspace Tab Dependency verification table in Model Manager
+ Added synchronized catalog definitions for compact audio weights in ModelDownloader
! Fixed internal UI log pollution in Chat history ([Engine Warming Up]) preventing multi-turn prompt template corruption
! Fixed VRAM allocation crashes during high-resolution diffusion renders via automated CPU offloading flags
! Fixed strict string matching in model dependency checks that prevented installed Q2 audio weights from reporting [READY]
! Hardened dual-backend sidecar dispatch routines across both bin/cuda/ and bin/vulkan/ directories
Version 0.9.7-beta — Neural Audio Studio Bridge, Subshell Hardening & HiDPI Metrics
Version 0.9.7-beta integrates real-time song arrangement formatting directly into the Chat workspace and hardens audio playback pipelines:
+ Added persistent "YuE2 Song Formatter & Studio Bridge" modal utility directly inside ChatUI
+ Added asynchronous CPR query pipeline to port 8080 LLM endpoint for real-time lyric & style formatting
+ Added hardened structural extraction parsers: ExtractStyleBlock() & ExtractLyricsBlock()
+ Added dynamic hardware VRAM safety guarding (<8 GB check via HardwareScanner) in MusicStudioUI
+ Added dynamic GGUF prioritization (q8_0 down to q4_0/q4_k_m) and auto-play queueing (s_RequestAutoPlay)
+ Injected CUBLAS_WORKSPACE_CONFIG=:4096:8 and GGML_CUDA_FORCE_MMQ=1 into subshell generation invocation
! Fixed Win32 MCI Transport timeline: implemented waveaudio opening with mpegvideo DirectShow fallback
! Fixed timeline seeking: atomic pause -> seek -> play sequence with frame debounce cooldown (s_SeekLockFrames)
! Fixed command-line token sanitizer: converted '&' to 'and' and stripped shell-breaking operators (^, |, <, >)
! Fixed header action button clipping: replaced hardcoded 240px width with dynamic ImGui::CalcTextSize()
! Fixed right-aligned header action positioning to prevent overlapping active engine indicators
! Fixed directory path normalization: unified GetNormalizedRepoRoot() to eliminate nested /freeai/freeai/ drift
Version 0.9.0-beta / Beta .09 — Vulkan-CUDA Hybrid Architecture
+ Implemented dual-backend Vulkan and CUDA runtime architecture with segregated bin/cuda/ and bin/vulkan/ directories
+ Added universal hardware compatibility covering NVIDIA GeForce RTX, AMD Radeon, Intel Arc, and high-RAM APU/iGPU systems
+ Integrated cooperative matrix shader acceleration (NV_coopmat2 / KHR_coopmat) bypassing driver-level PTX JIT compilation stalls
Version 0.8.0-beta / Beta .08 — Dual-Backend Universal Vulkan & CUDA Stable
+ Added dynamic [CUDA] <-> [VULKAN] runtime switch buttons directly in the main top-level menu strip
+ Added dedicated Vulkan sidecars: llama-server.exe, sd.exe (sd-cli.exe), and audiocpp_cli.exe with ggml-vulkan.dll
+ Added automated AMD Radeon, Intel Arc, and APU/iGPU detection and auto-routing in HardwareScanner.h
+ Added temporary file streaming (--prompt-file, --negative-prompt-file) in ImageStudioUI to eliminate shell argument truncations
+ Added isolated backend directory resolution in MusicStudioUI to enforce bin/vulkan/audiocpp_cli.exe execution
+ Added End User License Agreement (EULA.txt) covering beta rights, local privacy guarantees, and software terms
+ Added Inno Setup packaging updates bundling the complete Vulkan toolchain and license acceptance flow
! Fixed audio synthesis failures on non-NVIDIA/Vulkan configurations caused by missing Vulkan backend registrations
! Fixed shell parsing, quotation truncation, and newline stripping during multi-line image diffusion prompts
! Fixed process supervisor sidecar execution to guarantee clean Win32 Job Object containment across both backends
! Removed hardcoded APU startup abort gate, allowing unified memory systems to compute safely
Version 0.7.0-Cuda_beta_stable — CUDA 12 Production Milestone & Novelist Studio
+ Stabilized native NVIDIA CUDA 12 execution runtime backend for local inference sidecars
+ Added interactive Split-Pane IDE workspace in CodingUI: 38% agent prompt/transcript pane, 62% code canvas
+ Added synchronized dual-column line-number gutters aligned with active code buffer
+ Added multi-pattern <<<<<<< SEARCH ... ======= ... >>>>>>> REPLACE in-place AST diff parser
+ Added whitespace- and indentation-tolerant search matching (tab/space normalization and line-ending trims)
+ Added smart markdown code-fence fallback replacing matching functions directly in the editor buffer
+ Added manual [Apply Response to Editor] toolbar action to push raw completions into the live canvas
+ Added dedicated Three-Pane Novelist Studio in CreativeUI: Lore Bible drawer, Live Prose Canvas, Directive Console
+ Added persistent Story Bible & Lore reference document loader (.txt, .md) with autoInjectBible context toggling
+ Added 1 MB dynamic manuscript buffer with 30-step undo/redo snapshot ring buffer (PushManuscriptSnapshot)
+ Added in-place narrative AST scene diff patcher (ApplyNarrativeDiff) with relaxed spacing and prose rewrite fallbacks
+ Added narrative directive presets (Sensory, Cadence, Dialogue Pass) targeting Hermes 3 Llama 3.1 8B
+ Added word count, character count, and modified status badges to the manuscript editor
+ Added green dynamic active model indicator badge in workspace headers and Model Manager ([model] (active))
+ Added modular UI translation unit decoupling: isolated ImageStudioUI, MusicStudioUI, and CreativeUI out of FREEAI.cpp
+ Added complete FLUX diffusion multi-component catalog: clip_l.gguf, t5xxl_q4_k.gguf, and ae.gguf
+ Added dual format support for encoders: accepts both .gguf and .safetensors variants (clip_l, ae, t5xxl_q4_k)
+ Added persistent red UI warning badges and action cards for missing companion weights in Image Studio
+ Added CPR follow-redirect flags (cpr::Redirect{10L, true, true, ...}) for Hugging Face LFS downloads
+ Added normalized single-root pathing (<repo_root>/output/music) to eliminate nested directory duplication
+ Added automated VRAM unloading on tab exit via ImageStudioUI::UnloadFromMemory
! Hardened CUDA PTX JIT compilation and process supervisor sidecar execution stability
! Fixed editor replacement failures by strictly enforcing system prompt diff formatting over raw markdown
! Fixed narrative prose line wrapping and dual-pane chat bubble duplication inside CreativeUI
! Fixed coding and creative session history omissions by hooking SaveSessionToDisk into completions, clears, and shutdown
! Fixed About dialog repository navigation to route directly to beta repo via Win32 ShellExecuteA
! Fixed "Open Output Folder" in Music Studio to ensure directory creation prior to shell dispatch
! Fixed splash screen startup failure by adding multi-level relative path resolution (./, ../, ../../)
! Fixed History transcript modal closing mechanics (Escape, title bar [X], and Return buttons restored)
! Fixed Settings menu to restore Hardware Diagnostics Profile access
📦 How to Download & Manage AI Models
AI models are local weights that power each workspace. They must be present on disk before generation can proceed.
Option A: In-App Model Downloader (Recommended)
In the top menu bar, click Settings ➔ Repetere Models.
Review the curated catalog and click [ Download ] next to your desired model:
Coding Workspace: Qwen 2.5 Coder 7B Instruct (or 14B / 32B for Hybrid)
Chat Workspace: Meta Llama 3.1 8B Instruct or Gemma 2 27B Instruct (Abliterated)
Creative Writing Workspace: Hermes 3 Llama 3.1 8B
Audio / Music Studio (Required Pairing):
Images Workspace:
Base diffusion model: flux1-schnell-Q4_0.gguf (or compact flux1-schnell-Q2_K.gguf)
Companion encoders: clip_l.gguf, t5xxl_q4_k.gguf, and ae.gguf (supports .safetensors variants)
When finished, the status badge changes to green (Installed).
Option B: Manual File Placement (Advanced)
Place .gguf or companion .safetensors weight files directly into your local application directory:
%LOCALAPPDATA%\Programs\Repetere AI\models\
🎥 Video Demonstrations
📂 Modular Codebase Layout
RepetereAI/
├── 📁 bin/ # Segregated native inference sidecars
│ ├── 📁 cuda/ # CUDA 12 runtimes (llama-server.exe, sd.exe, audiocpp_cli.exe, ggml-cuda.dll)
│ ├── 📁 vulkan/ # Vulkan runtimes (llama-server.exe, sd.exe, audiocpp_cli.exe, ggml-vulkan.dll)
│ └── 📁 audio/ # Bundled Neural VAE audio codec (yue2-vae-f16.gguf)
├── 📁 models/ # Target directory for downloaded .gguf weights, encoders, and sidecars
│ └── 📁 sidecars/ # YuE2 tokenizer and model config sidecars
├── 📁 output/ # Generated multimodal artifacts
│ ├── 📁 images/ # Output directory for diffusion renders
│ └── 📁 music/ # Output directory for synthesized WAV tracks
├── 📁 freeai/
│ ├── 📄 Types.h # Core structures: ChatSessionState, ImageStudioState, MusicStudioState, HardwareProfile
│ ├── 📄 SystemPrompts.h # Embedded app knowledge base, website routing, and zero-token intent detection
│ ├── 📄 HardwareScanner.h # DXGI & Win32 memory querying engine, VRAM tier routing, dynamic safe layers math
│ ├── 📄 ProcessManager.h # Win32 child process supervisor (Job Objects, Flash Attention, 4-bit KV flags)
│ ├── 📄 ModelDownloader.h/.cpp # Asynchronous CPR chunked model downloader with GGUF header validation
│ ├── 📄 ModelManagerUI.h/.cpp # Full-viewport model overlay, [Set Active] compute mode linkage, disk scanner
│ ├── 📄 InferenceClient.h/.cpp # Detached asynchronous CPR REST worker pipeline with app-knowledge context injection
│ ├── 📄 HistoryManager.h/.cpp # JSON serialization and chat_history.json disk persistence
│ ├── 📄 Theme.h/.cpp # OpenGL texture loading (stb_image), window icons, dark slate palette
│ ├── 📄 ChatUI.h/.cpp # Chat workspace, markdown code extraction, clickable URL links, and YuE2 Bridge
│ ├── 📄 CodingUI.h/.cpp # Interactive split-pane IDE and in-place AST diff parser
│ ├── 📄 CreativeUI.h/.cpp # Three-pane novelist studio, manuscript buffer, and narrative diff engine
│ ├── 📄 ImageStudioUI.h/.cpp # Decoupled FLUX diffusion studio with temporary file prompt streaming
│ ├── 📄 MusicStudioUI.h/.cpp # Decoupled YuE2 audio synthesis studio with multi-quant discovery and MCI timeline transport
│ └── 📄 FREEAI.cpp # Entry point, GLFW/OpenGL loop, splash screen, top menu bar, and workspace tabs
├── 📄 .gitignore # Excludes .vs/, x64/, Debug/, Release/, *.zip, and local build binaries
├── 📄 chat_history.json # Local serialized conversation transcript database
├── 📄 EULA.txt # End User License Agreement and local privacy terms
├── 📄 FREEAI.slnx # XML-based Visual Studio Solution
└── 🖼️ splashscreen.jpg # Startup graphic and window icon asset
📜 License & Acknowledgments
Engineered by Nathaniel Richardson Jr. as part of the Repetere AI compute initiative. Distributed under the terms outlined in EULA.txt. Special thanks to the open-source contributors behind llama.cpp, stable-diffusion.cpp, audio.cpp, Dear ImGui, GLFW, and YuE2.