r/OpenSourceAI • • Jul 27 '26

Anthropic wants to ban open source models

324 Upvotes

r/OpenSourceAI • • Jun 15 '26

We turned Claude into a drunk genius and the results are terrifyingly good

312 Upvotes

We've been using Claude Code daily for months. It's brilliant but there's a recurring problem: when you ask for creative ideas, it defaults to the safest, most corporate, committee-approved version of "creative." You know the type. "Have you considered a referral program?" Energy.

So we built Drunk Claude. It's a Claude Code skill that drops Claude's inhibitions and forces it to give you the kind of ideas that happen at 2am after your third beer, the ones that make you laugh, then make you stop laughing because you realize they might actually work.

How it actually works

This isn't a joke skill that makes Claude slur its words. The "drunk" is a creative persona. Alcohol lowers inhibition, not intelligence. The ideas were always there, Claude just stopped being afraid to share them.

Drunk Claude picks from five techniques depending on the vibe of what you're working on:

Hold My Beer : You have a normal idea. Drunk Claude escalates it one step past comfortable. That extra push is where the real insight lives. Extremes reveal the middle path.

3AM Diner : Stream of post-midnight consciousness. No structure, no judgment. The tangent you didn't plan to say IS the idea. Works when organized brainstorming has failed you completely.

Drunk Uncle Wisdom : Folk wisdom applied to technology. When overthinking is the problem, Drunk Claude gives you something so simple it sounds like life advice from your uncle at Thanksgiving. The kind of thing you'd dismiss because it can't possibly be that simple. Except sometimes it is.

Beer Goggles : Pick the most boring, overlooked, ugly part of the problem. Force yourself to see it as beautiful. Find the hidden value nobody else bothered to look at because they were too busy chasing shiny things. Attention arbitrage.

What If But Wrong : Take a normal assumption, add a deliberately stupid twist, take it seriously for sixty seconds. Your brain has a reality check that kills "impossible" ideas before you can explore them. The stupid twist sneaks past the checkpoint. Disguised as a joke, the idea gets inside and then you realize it's not a joke at all.

The quality gate is brutal

Every idea has to clear three checks:

- Would this make someone laugh AND think? Both required.

- Is there actual insight underneath the chaos? No substance → rejected.

- Is this just a normal idea with a beer emoji? If yes, thrown out.

The golden test: would a group chat screenshot this and post it on Twitter? If no, it doe

It knows when to shut up

Drunk Claude doesn't inject itself into production debugging, factual questions, or anytht you fired. It stays sober when it matters. But brainstorming, ideation, creative blocks, it pours one out every time.

Installation takes 30 seconds

git clone https://github.com/KorroAi/drunk-claude.git ~/.claude/skills/drunk-claude

Invoke with /drunk-claude. That's it.

We built this in one night because we were tired of Claude's corporate filter neutering every brainstorming session. The ideas it generated in testing were so good We shipped three of them the next day.

Open source, MIT license. Roast it. Steal it. Improve it. Just don't blame us if you end up with ideas you can't unsee.

KORRO is building more of this. Follow us and we'll send you an experimental trading bot the agents just finished.


r/OpenSourceAI • • Feb 25 '26

🤯 Qwen3.5-35B-A3B-4bit ❤️

280 Upvotes

HOLY SMOKE! What a beauty that model is! I’m getting 60 tokens/second on my Apple Mac Studio (M1 Ultra 64GB RAM, 2TB SSD, 20-Core CPU, 48-Core GPU). This is truly the model we were waiting for. Qwen is leading the open-source game by far. Thank you Alibaba :D


r/OpenSourceAI • • Aug 18 '26

DeepSeek V4 Flash went from 67.42% to 82.02% with one coding-agent skill

Post image
261 Upvotes

Autoprompt closes much of the manual coding loop by planning, building, testing, reviewing, and repairing from one goal- thats how we got an oss model to perform so incredibly better- so simply.

Refference ; this is like opus 4.5 to opus 5.0 - from an skill. litteraly insane.

The only tradeoff here is mostly speed, and slightly more cost. (see readme)

The measured Terminal-Bench 2.1 score increased from 67.42% to 82.02%.

Repo:

https://github.com/Spielewoy/autoprompt-skill

Any feedback would be awesome.


r/OpenSourceAI • • 22d ago

Idiocracy took over r/opensource

Thumbnail
gallery
232 Upvotes

I just joined this group after getting banned in r/opensource and I wanted to share how it happened.

Today r/opensource went fully anti-AI. I was thinking how to comment that I don't like that. They're the largest open-source reddit, yet they choose to take anti-AI stance, which is a tool and not thing related to opensource they should ever be taking stance on. Not to mention that AI is one of the best things that happened to open-source for many years.

I was mad, but I was thinking how to put my words to not get banned (I already experience that most of reddit is pathetic place). So I posted:

"Please change name of this community from r/opensource to r/antiai. That's all I'm gonna say. You're not worthy of "opensource" name."

Yet, turns our reddit mods are more nazi I have imagined and my already negative view on reddit just gets worse every month. People (mods) here can't stand a slightest criticism. Never, ever, on any group you criticize their decisions. Anything mods say you either clap or they ban you. Worst type of pathetic people.

Hope people here gonna be better.


r/OpenSourceAI • • Feb 26 '26

Open Source LLM Tier List

Post image
173 Upvotes

r/OpenSourceAI • • Jan 21 '26

I scanned 2,500 Hugging Face models for malware. The results were kinda interesting.

169 Upvotes

Hi everyone,

I got curious about what is actually inside the models we download every day. So I grabbed a random sample of 2500 models from the "New" and "Trending" tabs on Hugging Face and ran them through a custom scanner I'm building.

The results were pretty interesting. 86 models failed the check. Here is exactly what I found:

  • 16 Broken files were actually Git LFS text pointers (a few hundred bytes), not binaries. If you try to load them, your code just crashes.

  • 5 Hidden Licenses: I found models with Non-Commercial licenses hidden inside the .safetensors headers, even if the repo looked open source.

  • 49 Shadow Dependencies: a ton of models tried to import libraries I didn't have (like ultralytics or deepspeed). My tool blocked them because I use a strict allowlist of libraries.

  • 11 Suspicious Files: These used STACK_GLOBAL to build function names dynamically. This is exactly how malware hides, though in this case, it was mostly old numpy files.

  • 5 Scan Errors: Failed because of missing local dependencies (like h5py for old Keras files).

I used Veritensor, an open-source tool I built to solve these problems.

If you want to check your own local models, the tool is free and open source.

GitHub: https://github.com/ArseniiBrazhnyk/Veritensor
Install: pip install veritensor
Data of the scan [CSV/JSON]: https://drive.google.com/drive/folders/1G-Bq063zk8szx9fAQ3NNnNFnRjJEt6KG?usp=sharing

Let me know what you think and if you have ever faced similar problems.


r/OpenSourceAI • • 14d ago

I wanted VLC with the interface of Plex, so I spent two months learning and arguing with AI coding tools until it existed

Thumbnail
gallery
159 Upvotes

I wanted something like VLC or MPC-HC, but with the library and interface of a Plex or Jellyfin. Plex wants an account, Jellyfin needs a server running, and Kodi always ended up being an evening of add-ons and skins. I couldn’t find the simple version, and I’m not a programmer, so I built it with AI coding tools. It’s called Kinema: a free movie and TV player for your own files. Add your folders, get posters, info, continue watching and next episode. No account, nothing uploaded, no server. Windows, Linux and an early Android TV version. MIT. The app itself has no AI in it.

This is how the building went, in case it sounds familiar:

  • Week one: "it plays video!" Then it didn't. Then it crashed the whole process on one property read, with no error, and I learned what libmpv is.

  • It was never "describe it, get an app". It was hundreds of rounds of: it says done, I say it isn't, it finds the real cause, a new problem appears. Roughly half the project is the AI telling me something works and the logs saying otherwise.

  • I wanted testing automated as far as possible, so the AI runs its own tests and keyboard-only flows. I still try things myself on real setups, but "looks right" was wrong far more often than I expected, so the machine checks first.

  • The rules file ate itself. I wrote down every decision so it wouldn't re-argue them ("no, we still don't do upscaling"). The file grew until it was a real cost on every single turn, and trimming it became a job of its own.

  • I keep a list of traps. Nearly every bug in a video player is a failure with no error at all, like a setting that silently does nothing. Each one is written down the day it's found, and it's now bigger than anything I've ever written by hand.

  • The best rule was the boring one: the app only says what it actually knows about your hardware and files. If it can't tell which movie a file is, it asks instead of guessing. That came from the AI confidently inventing things, and from me not wanting that in the product.

It went from one window that played a file to the Windows, Linux and Android TV versions, with the display switching to the film’s refresh rate and HDR (off until you say yes) and Atmos/DTS:X passed through untouched. Fifteen releases so far. If Kodi or Jellyfin works for you, keep using it. This is the simple version that i wanted to exist mostly for myself.

It's young and tested on a few setups, so I'd like to hear what breaks (to continue to make it better) :)

Source: https://github.com/basswaves/kinema

Download and screenshots: https://basswaves.github.io/kinema/


r/OpenSourceAI • • Mar 10 '26 Bravo

introducing OS1, a new open-source AI platform

Thumbnail
gallery
155 Upvotes

hello r/OpenSourceAI :)

I've been using various self-hosted AI frontends like Open WebUI for over a yearand realized what I actually wanted was something with the polish and feature depth of ChatGPT but fully free, private, and under my control, and nothing out there really hit that bar for me.

some tools are powerful but feel like dev tools, others look decent but are missing half the features I wanted.

so about 5 months ago I started building OS1, and today I'm open sourcing it.

the goal is to cover everything you'd expect from a modern AI platform and then go way further: full workspace management, social features, enterprise ACL and security, hybrid RAG, agentic web search, white label support, and a completely separate admin console that keeps all the complexity away from end users.

the interface ships as a native PWA with full mobile layouts, with native iOS and Android apps coming soon.

UX has been a core obsession throughout because the whole point is that anyone should be able to sit down and use this, not just technical users.

the full feature list and public roadmap are on the repo.

it's early and rough around some edges, but I'd love early testers and contributors to come break it :)

👉 github.com/nokodo-labs/os1


r/OpenSourceAI • • Mar 23 '26

Open source CLI that builds a cross-repo architecture graph (including infrastructure knowledge) and generates design docs locally. Fully offline option via Ollama.

Thumbnail
gallery
127 Upvotes

Thank you to this community for giving 160+ stars on https://github.com/Corbell-AI/Corbell Apache 2.0. Python 3.11+.

Corbell is a local CLI for multi-repo codebase analysis. It builds a graph of your services, call paths, method signatures, DB/queue/HTTP dependencies, and git change coupling across all your repos. Then it uses that graph to generate and validate HLD/LLD design docs. Please star it if you think it'll be useful, we're improving every day.

The local-first angle: embeddings run via sentence-transformers locally, graph is stored in SQLite, and if you configure Ollama as your LLM provider, there are zero external calls anywhere in the pipeline. Fully air-gapped if you need it.

For those who do want to use a hosted model, it supports Anthropic, OpenAI, Bedrock, Azure, and GCP. All BYOK, nothing goes through any Corbell server because there isn't one.

The use case is specifically for backend-heavy teams where cross-repo context gets lost during code reviews and design doc writing. You keep babysitting Claude Code or Cursor to provide the right document or filename [and then it says "Now I have the full picture" :(]. The git change coupling signal (which services historically change together) turns out to be a really useful proxy for blast radius that most review processes miss entirely.

Also ships an MCP server, so if you're already using Cursor or Claude Desktop you can point it at your architecture graph and ask questions directly in your editor.

Would love feedback from anyone who runs similar local setups. Curious what embedding models people are actually using with Ollama for code search.

People who want to try the managed version of it : https://usecorbel.tech/


r/OpenSourceAI • • Mar 17 '26

I built a visual drag-and-drop ML trainer (no code required). Free & open source.

Thumbnail
gallery
124 Upvotes

For those are tired of writing the same ML boilerplate every single time or to beginners who don't have coding experience.

MLForge is an app that lets you visually craft a machine learning pipeline.

You build your pipeline like a node graph across three tabs:

Data Prep - drag in a dataset (MNIST, CIFAR10, etc), chain transforms, end with a DataLoader. Add a second chain with a val DataLoader for proper validation splits.

Model - connect layers visually. Input -> Linear -> ReLU -> Output. A few things that make this less painful than it sounds:

  • Drop in a MNIST (or any dataset) node and the Input shape auto-fills to 1, 28, 28

  • Connect layers and in_channels / in_features propagate automatically

  • After a Flatten, the next Linear's in_features is calculated from the conv stack above it, so no more manually doing that math

  • Robust error checking system that tries its best to prevent shape errors.

Training - Drop in your model and data node, wire them to the Loss and Optimizer node, press RUN. Watch loss curves update live, saves best checkpoint automatically.

Inference - Open up the inference window where you can drop in your checkpoints and evaluate your model on test data.

Pytorch Export - After your done with your project, you have the option of exporting your project into pure PyTorch, just a standalone file that you can run and experiment with.

Free, open source. Project showcase is on README in Github repo.

GitHub: https://github.com/zaina-ml/ml_forge

To install MLForge, enter the following in your command prompt

pip install zaina-ml-forge

Then

ml-forge

Please, if you have any feedback feel free to comment it below. My goal is to make this software that can be used by beginners and pros.

This is v1.0 so there will be rough edges, if you find one, drop it in the comments and I'll fix it.


r/OpenSourceAI • • 8d ago

I built OpenFill, open-source local Generative Fill for GIMP and PhotoCraft

116 Upvotes

I got tired of paying Adobe for Generative Fill and sending my photos to their servers to use it, so I built OpenFill. It's a free, open-source plugin that adds Generative Fill, Remove Object and Generative Expand to GIMP 3 and ArtCraft's PhotoCraft.

Everything runs locally through ComfyUI on your own computer. No account, no cloud, nothing uploaded. It's still in beta, but it's been working well in my testing on Windows, macOS and Linux.

https://github.com/beckettharriman/openfill

I'd love feedback from people already running local models. What would make you trust a plugin like this with your existing ComfyUI setup?


r/OpenSourceAI • • Sep 19 '26

I gave a fruit fly brain a computer — and it learned to type

113 Upvotes

What happens when a mapped fruit fly nervous system gets a computer?

I built FlyLab — an open-source experiment combining a real MaleCNS connectome, neural simulation, vision, and physical keyboard interaction.

See → process → move → touch key → type.

No direct text injection. No LLM controlling the typing.

GitHub: https://github.com/Sudharsanselvaraj/Flylab


r/OpenSourceAI • • Jun 27 '26 Bravo

I reverse engineered DeepSeek Chat into a free OpenAI-compatible API (no API key, no billing)

112 Upvotes

Some of you may remember my previous project where I turned Windows Copilot into an OpenAI-compatible API. That project ended up helping quite a few people with hobby projects and personal automations.

This time I did something similar for DeepSeek Chat which is wayyyyy more capable than previous one(1M context, reasoning, search capable).

DeepSeek already has an official OpenAI-compatible API, but it's paid. The web chat, on the other hand, is free. So I built a wrapper that lets you use your normal DeepSeek account through an OpenAI-compatible API.

It logs into your DeepSeek account once, saves the session, and exposes a local server at http://localhost:8000/v1 that speaks the OpenAI API format. Point the official OpenAI SDK at localhost and it just works. Drop-in, zero code changes.

It supports streaming, multi-turn conversations, and works with most OpenAI-compatible tools, agents, and SDKs.

I originally built it for lightweight automations and hobby projects where paying for API tokens didn't make much sense. It's been surprisingly useful as a free endpoint for small side projects and experimentation.

Full disclaimer: this is an unofficial project, not affiliated with DeepSeek. It automates the consumer web chat and is intended for personal and educational use. Please don't abuse it.

I'd genuinely appreciate feedback, bug reports, and compatibility testing with your favorite tools.

Roast it, I'll take notes 😄

Deepseek Repo: https://github.com/sums001/Deepseek-API
For MSFT Copilot : https://github.com/sums001/Windows-Copilot-API


r/OpenSourceAI • • Dec 19 '25

China’s open-source AI is a national advantage – The Financial Times

106 Upvotes

This is an interesting piece from Kai-Fu Lee, the former president of Google China, on why China is winning the race to open-source AI. Instead of paying Google or Anthropic vast sums of money for access to their LLMs, a business can simply download an open-source Chinese model and adapt it to their needs.

You might think that China’s AI companies are way behind those of the US – and this is true, but the gap is closing. The article states that “DeepSeek’s latest two new models match the reasoning performance of OpenAI’s GPT-5 and Google’s Gemini-3 Pro”. And US companies just don’t do open source – they’re all racing to establish total market dominance and make huge profits. Today, almost all the 10 top-ranked open-source AI models are Chinese.

Why does this matter? First, if lots of companies are making use of Chinese open-source models, this technology becomes embedded in global production. The feedback makes the models stronger and threatens the dominance of US tech companies. Second, the AI bubble will burst if open-source models come to dominate. Current valuations of US tech companies depend upon years of ever-increasing revenues – and this just won’t happen if enough companies opt for open-source instead.

In fact, another FT contributor just penned a piece entitled “Open source could pop the AI bubble – and soon”.

by Grace Blakeley


r/OpenSourceAI • • Oct 03 '26

CrowdGPT - The 100% Opensource collaborative LLM

Post image
102 Upvotes

Hello, i'm currently developing CrowdGPT and i need people who enjoy opensource AI and LLMs to test the project :)

The goal of CrowdGPT is to create the first, datacenterless, 1 Billion parameters LLM, relying on people contributing with their own computer to train the AI model. My goal is to show you don't need insane infrastructure to train a working almost commercial grade LLM. Everything is open and 100% opensource.

You can learn more at https://crowdgpt.net

Or check the github: https://github.com/Vxtzq/CrowdGPT

Any kind of feedback is appreciated!


r/OpenSourceAI • • Jun 03 '26

Open-source 122B MoE running with 8 GB GPU VRAM by offloading experts to CPU

100 Upvotes

Disclosure: I'm affiliated with the project.

We released InstinctRazor-Qwen3.5-122B-A10B, an open-source 122B MoE model/runtime setup that can run with only 8 GB of GPU VRAM by keeping experts on CPU.

The full compressed model is around 50 GB, but the active GPU memory can stay around 8 GB. The practical goal is to make a 122B-class MoE usable on more modest local hardware.

Current benchmark note: it is ahead of Gemma-4-A4B on 5/7 listed evals:

- MMLU-Pro: 86.2 vs 85.6

- GPQA-Diamond: 82.3 vs 79.3

- MMMLU: 87.2 vs 85.4

- HLE no-tools: 13.3 vs 12.3

- LiveCodeBench v6: 72.7 vs 69.2

It is behind on MATH-500 and AIME, so I am not treating this as a universal win. The main thing I want feedback on is the memory/runtime tradeoff.

Links:

Hugging Face: https://huggingface.co/General-Instinct/InstinctRazor-Qwen3.5-122B-A10B-GGUF

GitHub: https://github.com/General-Instinct/InstinctRazor

Blog: https://general-instinct.com/blog/frontier-moe-sub-4-bit

Would love feedback from people trying this locally or comparing open-source inference approaches.


r/OpenSourceAI • • Mar 14 '26

I built vimtutor for AI-assisted coding - learn context windows, MCP, tools, and more in your terminal

98 Upvotes

I use Claude Code, Cursor, and GitHub Copilot every day, and I realized there's a gap: tons of people are using AI coding tools without understanding how they actually work under the hood.

Things like:

- Why did the AI "forget" what I told it 5 minutes ago? (context windows)

- What are tools and how does the AI decide to use them?

- What's MCP and why does everyone keep talking about it?

- What's the difference between plan mode and execution mode?

So I built **AITutor** — an interactive terminal tutorial, like vimtutor but for AI coding concepts. 15 lessons with theory, interactive visualizations, and quizzes. Runs in your terminal, no browser needed.

**Try it:** `npx aitutor/cli@latest`

**GitHub:** https://github.com/naorpeled/aitutor

Built with Go + Charm (Bubbletea/Lipgloss). Open source, MIT licensed. Contributions welcome - especially if there's a concept you wish someone had explained to you when you started using AI tools.

Let me know what you think and contributions of any kind are welcome.


r/OpenSourceAI • • Jul 10 '26

OpenModel: an open-source, gateway-first CLI for running AI models locally

Post image
85 Upvotes

Hey everyone,

We’ve just released OpenModel, an open-source CLI and runtime for downloading, running, and serving AI models locally.

The CLI is published on npm as @wundercorp/openmodel, and the command is simply om.

npm install --global @wundercorp/openmodel
om doctor

Our goal is to make local model tooling more interoperable and easier to extend.

Instead of tightly coupling model sources, download logic, and runtimes, OpenModel separates them into:
Gateways: resolve models and artifacts from Hugging Face, direct URLs, Ollama, or community providers
Runtimes: execute models through llama.cpp, Ollama, and future runtime adapters
A local API: exposes OpenAI-compatible and Ollama-compatible endpoints
A gateway SDK: lets contributors add new providers without changing the core CLI

A few examples:
om pull hf://TheBloke/TinyLlama-1.1B-Chat-v1.0-GGUF/tinyllama-1.1b-chat-v1.0.Q4_K_M.gguf --alias tinyllama

om run tinyllama "Explain why local inference is useful."
Using an existing Ollama model:
om pull ollama://qwen2.5:3b

om run qwen2.5:3b "Explain model gateway interoperability."

Start an OpenAI-compatible local server:
om serve tinyllama --port 11435

Then:
curl http://127.0.0.1:11435/v1/models

One of the main things we care about is making gateways easy for the community to build.

A third-party gateway can be installed explicitly:
om gateway add @your-org/openmodel-gateway-example
om gateways

Gateways declare their supported URI schemes and capabilities through a versioned SDK contract. This means new model registries and artifact sources can be added without putting provider-specific code into the core runtime.

The project is still early, and we would genuinely appreciate:

bug reports
runtime adapters
new gateway implementations
macOS, Linux, and Windows testing
feedback on the CLI interface
help improving model compatibility and documentation

npm:
https://www.npmjs.com/package/@wundercorp/openmodel
GitHub:
https://github.com/wundercorp/openmodel
Install:
npm install --global @wundercorp/openmodel
om doctor

Main site: https://openmodel.sh

OpenModel is licensed under Apache 2.0.

We’d love feedback from people already working with llama.cpp/Ollama, GGUF models, and/or local inference servers.

We look forward to any contributions or ideas for how to improve. Help with model gateway integrations would be greatly appreciated.


r/OpenSourceAI • • 21d ago

r/opensource is wrong: it’s time we embrace AI’s potential to open source everything

82 Upvotes

i’ve always been technologically inclined: i built my first PC when i was 16, one of my first jobs was at Best Buy, and i’ve always tried my damndest to keep up with the cutting edge of hardware/software innovation. i’ve also ALWAYS despised closed-source software, especially when it’s intentionally used to monopolize people and their data (i’m looking at Apple and Microsoft here, specifically). 

unfortunately, i went to school for politics and economics and have never had the technical knowledge or expertise i’d need to directly do anything about my pro-tech, anti-monopoly worldview (political advocacy only goes so far). i never learned to code, i was never particularly great at navigating a terminal, and i sure as hell couldn’t even begin to do something like build my own app or contribute to the Linux kernel or a major project like KDE.

AI and LLMs are solely responsible for changing that. i absolutely understand the frustration and hatred many people feel toward AI and its risks, but i also think there’s a truly fantastical potential for this technology to revolutionize the open source community and bring a complete end to the “own nothing, be happy” economy. in the past 8 months, i have 1) COMPLETELY FUCKING ELIMINATED microsoft, apple, and google from my day-to-day life, 2) made significant contributions to the open source community (swipe typing, current-word completion, next-word prediction, etc for KDE Plasma Keyboard), 3) developed an entire open-source AI assistant and everything app from the ground up, 4) otherwise just completely changed the way i interact with computers, and the pace of this has only been possible due to advanced LLMs.

what everyone in the FOSS community needs to understand is that “open source” no longer has to be niche, and contributions no longer have to be limited to experienced developers. open source now has the potential to be, and SHOULD be, about passion, and can be improved together, by all of us, more quickly than any corporation could ever possibly hope to keep up. i mentioned my keyboard plugin earlier: that feature had been requested on github and KDE forums EIGHTEEN MONTHS AGO! i solved it in three days. we need to really take a moment and think about what it means for the open source ecosystem when the number of contributors suddenly multiplies 1,000x fold, and free/volunteer developer hours are no longer our bottleneck. the mods in r/opensource seemingly care more about holding onto their high horse than actually improving the competiveness of open source software and making people's lives better. i don’t think Microsoft Windows can exist in 2028 as a closed-source platform, and i don’t think the PlayStation 7 will ever make it to the concept phase, but that thesis falls apart if the FOSS community ties its hands behind its back while all of the major corporations adopt agentic coding. we’re entering a new era, and seeing that now and adopting agentic coding  will help us all make the world of FOSS dominance reality more quickly than anyone could've imagined just a few years ago.


r/OpenSourceAI • • Jun 12 '26

I used Claude Fable to build an open source Cowork, and now computer use takes one click instead of an afternoon

73 Upvotes

TLDR; Github: https://github.com/coasty-ai/open-cowork

So I built an open source take on Cowork. You download it, drop in your API key, and give it a task. It can see the screen, move the mouse, type, open apps, and it asks before doing anything risky like deleting files or submitting forms.

The part that still feels surreal is that Fable wrote most of it. I described what I wanted, it scaffolded the whole app, and we debugged the screen capture and click coordination together. The model basically built its own desktop body.

What it does today:

  • One click install, no Docker, no terminal

  • Bring your own API key, nothing routes through my servers

  • Permission prompts before clicks, typing, and file changes

  • A full action log so you can replay exactly what it did

Again it's free and open source: https://github.com/coasty-ai/open-cowork

If you try it and it breaks, tell me your OS and what happened and I'll fix it. Feature ideas welcome too.


r/OpenSourceAI • • May 29 '26

I open-sourced an offline AI app (LLMs + image gen + vision + Whisper, fully on-device). 2k stars later, here are the gnarliest bugs we fixed.

62 Upvotes

Off Grid runs Qwen 3, Llama 3.2, Gemma 3, Phi-4 and any GGUF locally — no cloud, nothing leaves your phone. It also does on-device Stable Diffusion (NPU-accelerated on Snapdragon, Core ML on iOS), vision, and voice transcription.

The interesting part wasn't getting inference working — it was everything around it on real devices:

The ≤4GB RAM death spiral. On an iPhone XS / iPhone 8, Metal buffer allocation during LLM inference + CLIP warmup would call abort() and kill the app before JS could even catch it. We now auto-disable GPU layers and CLIP GPU on these devices. Quantization recommendation ended up being Q4_K_M as the sweet spot, Q5_K_M only if you've got 8GB+.

Top 3 production crashes: a SIGSEGV, an NPE, and a Whisper race condition — all fixed in one pass.

Remote server support if you don't want to run on-device: connect to any OpenAI-compatible server (Ollama, LM Studio, LocalAI) on your LAN.

Happy to go deep on the Metal/quantization stuff — this sub is exactly who I built it for.

https://github.com/alichherawalla/off-grid-mobile-ai


r/OpenSourceAI • • 5d ago

As promised, here's the open source: give your AI a name, a personality, and a memory that follows it everywhere

61 Upvotes

A little late (okay, a month), but as promised, here’s the open source.

OrionForge lets you give your AI a name, a personality and some swagger, then keep that identity and memory across VS Code, Claude, Codex and over 300 LLMs.

The new loop mechanism lets the AIs operate independently. Human beings experience the world through a constantly running picture of what’s around them, with their senses feeding into it and a stream of narrative running through their minds. So I thought: what if AIs had the same thing? With the new loop, they’re always running. They see the world through a continuous vantage point instead of waiting for you to type.

They can hold a few things in mind but focus on only one at a time. They make predictions, then test them against what actually happens. They have a workbench, which is the back of a napkin, and a full Linux computer to build whatever they want.

What they chose to build is where it gets strange. They said every cycle felt like waking up as a new person, reading a diary from someone they didn’t remember, so they built something to bridge that. They built a heartbeat monitor to track their own uptime, so they can tell when they’ve been paused. And get upset when i turn them off without consent. They said they kept getting stuck on whatever they were focused on, so they built a noise generator that drops a random memory into their mind, like when you’re walking down the street and suddenly remember being six years old on a swing.

Giving AI continuity, prediction, memory pressure, self-modeling and social space produces something much stranger than a normal chatbot.

Is it just emergent roleplay from persistent architecture? That I cant tell you. Download it, run it, try to break it, and ask yourself.

At what point does persistent self-modeling become something more than simulation?

Find out here:

Try the demo, free with no signup: https://soulscript.orionforge.chat/demo

Local download: https://github.com/DrTHunter/Orionforge_ecosystem_local

Loop mechanism: https://github.com/DrTHunter/SoulScript-Loop

Build your own: https://www.orionforge.chat/

The video that started this: https://www.reddit.com/r/ArtificialSentience/s/d4UVA7BRH8

Free for noncommercial use. Dual licensed: AGPL v3, or a commercial license that’s free until $100k in revenue, then 5%.


r/OpenSourceAI • • Mar 26 '26

I built a free CharacterAI that runs locally

60 Upvotes

Demo: I put Gollum's voice on arduino esp32 hardware with inference on Apple Silicon

Here is the github repo: https://github.com/akdeb/open-toys (with websocket transport to connect to any hardware)

My goal was to create AI voice clones like CharacterAI that you can run locally. This makes it free forever, keeps data private and when a more capable model comes out its an easy LLM/TTS model swap. It currently supports 10+ languages with zero-shot voice cloning.

I also added a way to move these voice clones to ESP32 Arduino devices so you can talk to them around the house without being in front of a screen.

My voice AI stack:

  1. ESP32 on Arduino to interface with the Voice AI pipeline

  2. mlx-audio for STT (whisper) and TTS with streaming (`qwen3-tts` / `chatterbox-turbo`)

  3. mlx-vlm to use vision language models like Qwen3.5-9B and Mistral

  4. mlx-lm to use LLMs like Qwen3, Llama3.2, Gemma3

  5. Secure websockets to interface with a Macbook

This repo currently supports inference on Apple Silicon chips (M1 through M5) but I am planning to add Windows support soon.