r/databasedevelopment • • May 31 '26

Using Claude / Codex for database development

0 Upvotes

As the title suggests how many of you are really using claude / codex for true production database development. I have been experimenting codex on duckdb and I found it really good. So good that I told to rewrite duckdb in java for my own sake . I want to hear opinions and anecdotes from others as well. Thanks.


r/databasedevelopment • • Oct 17 '26

Tuple key (primary key) really sould be mutable? I dont think so,

0 Upvotes

Hi, Im UkJin CHOI from South Korea, Im really passinate for building database engine. Claude code makes it possible. and I found this channel. I worked as DBA and Data engineer for years.

While building many services with PostgreSQL, SQLite, Azure SQL. I found that there are rarely cases in which primary key were update in buisiness logic.

Mutable keys expand undo logs, deepen WAL record and plus complecity.

So Im building a database with immutable tuple key specialized in OLTP database for 2month with Claude code.

Minimum feature were finished like SQLs, Catalog, Transaction (ReadRepeatable, Read Committed), MVCC, WAL, Indexes, Forein Key. Dropping them keeps the engine simpler and faster.

What do you think?

Am I on the proper way? do you think that it will works and company adopt it rather than PostgreSQL if it is mature?

I really appreciate any advice and opinion!

Thank you.


r/databasedevelopment • • Jun 27 '26

Using Resource score with consistent Hashing in distributed databases

Thumbnail medium.com
0 Upvotes

So in order to learn more about the working of the distributed databases I read a few research papers of dynamodb, cockroachdb, gfs etc.., but I wanted to build something from this theory that I learned for indepth learning.

Irisdb is a fault tolerant database written in golang. It uses consistent hashing with resourceScore to determine the load/slot ranges assigned to each of the node in the cluster.

The project uses pebble as the data storage layer, initially I was planning to use rocksdb but it was messy setup in go so I used sn alternative. Pebble storage engine is developed by cockroachdb.

Note that this project is not meant for production use, I built this only for learning. I would also like to know your thoughts on using resource scores for slot distribution.

If you are interested in architecture make sure to read the article.


r/databasedevelopment • • Nov 06 '22

The database was developed from scratch for the search engine Kavunka

Thumbnail
youtu.be
0 Upvotes

r/databasedevelopment • • Jun 03 '23

Implement RougeDB, a Redis clone from outer space (Paid Course)

Thumbnail
learning.accelerant.dev
0 Upvotes

r/databasedevelopment • • May 19 '23

LLMs and Database Development

0 Upvotes

How does the popularity of LLMs in Software Engineering in the future influence Database Development?


r/databasedevelopment • • Dec 19 '21

If you are assigned to create a new cloud-native storage engine for SQL DBMS, which programming language you would like to use for core part of it?

0 Upvotes
52 votes, Dec 22 '21
9 C++/C
13 Go
30 Rust

r/databasedevelopment • • Apr 29 '24

Database companies that pay well for Staff SWE

Thumbnail
teamblind.com
0 Upvotes

r/databasedevelopment • • Dec 02 '25

Experimental hardware-grounded runtime: looking for critique

Thumbnail x.com
0 Upvotes

Hey all, we’re two founders working on a new concurrency engine that hits sub-µs read latency and scales past 50M nodes. We're early and looking for brutal technical feedback from people who understand systems/graphs/databases. Happy to answer all questions.

Feel free to check it out and let us know your thoughts!


r/databasedevelopment • • Aug 27 '24

An embedded database which is 10X faster than SQLite

2 Upvotes

r/databasedevelopment • • May 27 '25

Experiments on building a toy database from scratch with coding agent

1 Upvotes

As an backend system dev and newbee in database, always curious with building a database myself to learn from it, try to leverage coding agent to build one, and here are some highlights:

  • A version-chain based MVCC implementation;

  • A unified processing pipeline using volcano mode to define the query plan and execution;

  • A hash and b-tree indexing (not complete)

  • Bazel 7 build support with Java implementation.

This is unfinished and hard to find motivation to continue building it as a busy dad, leveraging coding agent to do it has prod and cons. Just to document and share the learnings here. https://www.architect.rocks/2025/05/building-toy-database-from-scratch-with.html


r/databasedevelopment • • Nov 26 '25

Ideas for a first project

1 Upvotes

Hello people 👋 I’m looking for ideas on what to build as my first database project (for educational purposes only). What are the different toy database ideas you can recommend to someone? I want to write it in Golang.

I’m thinking something along the lines of build a single node DB, then iterate over it and make it distributed, which should give me enough problems to keep me busy.

What do you think about this plan?


r/databasedevelopment • • Sep 30 '25

The Index is the Database

Post image
4 Upvotes

r/databasedevelopment • • Dec 17 '24

SarasDB: Multi-Modal, Fault-Tolerant Database in Rust

Thumbnail
xer0x.in
6 Upvotes

r/databasedevelopment • • Nov 05 '24

Seeking advice: I just created the fastest multi model client-server tcp database in the world. Commercializing a high-performance database solution while maintaining quality control

0 Upvotes

After extensive experience with various high-performance databases in the market, I've developed a multi-model database solution that shows promising benchmarks. I'm looking for guidance on:

  1. What are effective ways to demonstrate performance and capabilities while protecting IP?

  2. What are the different business models for database technologies (beyond the pure open-source route)?

  3. How can one balance community involvement with maintaining focused development?

Context: My concerns stem from seeing how some open-source databases evolved into complex, difficult-to-maintain systems due to feature bloat and competing priorities. I'd like to avoid this while still building something valuable for the community.

Looking for practical insights from those with experience in database development and commercialization.

Note: Not looking to criticize existing solutions, just seeking constructive discussion about sustainable development approaches.

edit : I just realised eatonphil is a moderator of this channel, read a lot of his stuff.


r/databasedevelopment • • Sep 22 '24

HYTRADBOI 2025

Thumbnail scattered-thoughts.net
7 Upvotes

r/databasedevelopment • • Sep 25 '25

All in one DB with no performance cost

7 Upvotes

Hi guys,
I am in the middle of designing a database system built in rust that should be able to store, KV, Vector Graph and more with a high NO-SQL write speed it is built off a LSM-Tree that I made some modifications to.

It's alot of work and I have to say I am enjoying the process but I am just wondering if there is any desire for me to opensource it / push to make it commercially viable?

The ideal for me would be something similar to serealDB:

Essentially the DB Takes advantage of LogStructured Merges ability to take large data but rather than utilising compaction I built a placement engine in the middle to allow me to allocate things to graph, key-value, vector, blockchain, etc

I work in an AI company as a CTO and it solved our compaction issues with a popular NoSQL DB but I was wondering if anyone else would be interested?

If so I'll leave my company and opensource it


r/databasedevelopment • • May 07 '25

UPDATE RECONSIDERED, delivered?

Thumbnail xtdb.com
1 Upvotes

I just published a blog post on UPDATE RECONSIDERED (1977) - as cited by Patrick O'Neil (inventor of LSMs) and many others over the years. I'd be curious to know who has seen one this before!


r/databasedevelopment • • May 05 '23

SurrealDB | SurrealDB Scalability

Thumbnail
surrealdb.com
0 Upvotes

r/databasedevelopment • • Feb 18 '24

Portable RDBMS?

0 Upvotes

Back in the day, I seem to recall I could export a Microsoft Access database in some format that I could send it to you and you could use it like an executable file without having to install anything. If I'm not mistaken about that, are there any databases that allow this now?


r/databasedevelopment • • May 06 '24

A note on Quorum Consensus

Thumbnail web.mit.edu
0 Upvotes

r/databasedevelopment • • Feb 20 '24

How to go about implementing a hash index for my storage?

0 Upvotes

Imagine i have to implement a time series data store where an entry looks like this:

{id - 64 bit auto incrementing long, time - 64 bit long, value - 64-512 bit binary, crc - 32 bit, version - 64 bit}

Primary key is {time, id}

The size of above entry would be between 36B - 92B.My table size would be at max 10GB.One host can be having 100s of table as this is a multi tenant system.

So I will have ~ 10GB/36B ~ 300M entries.

Now I have following req:

  1. Optimize for ingestion esp on tip(current time) which moves forwar

  2. Do deduplication based on {id + time + version} to reject lower versions synchronously. Again time here mostly would be tip

  3. Have support for fast snapshot of storage for backups

  4. Support deletion based on predicate which would be like:

Note that duplicates would be rare and hence I believe I would benefit from keeping an index(id + time) in memory and not entire data records.

I am evaluating following:

  1. Hash/Range based index - I am thinking of a bitcask like storage where i can keep index in memory. Since an index entry would take {16byte for key + 8byte for offset} = 24B, I would need 24B * 300 M ~ 7GB memory for index alone for 1 table which is a lot.Hence I am thinking of a slightly different design though where I will divide my store into N partitions internally on time(say 10) and keep only the bucket(s) which are actively ingesting in memory. Since my most common case is tip ingestion, it will be 1 bucket that would be memory and so my index size goes down by factor of 10. This however adds some complexity in design. Also I believe implementing 4 is tricky if no time predicate is in query and I have to open all buckets. I guess the one way to get around this is to track tombstones separately.

  2. LSM based engine - This should be obvious, however it does make sizing the memtable a bit tricky. Since the memtable now stores the whole entry, it means I can have less values in memory.

  3. BTree based engine - Thinking of something like Sqlite with primary key as {time + id} (and not {id + time}). However I don;t think it would shine on writes. This howevers offers ability to run complex queries(if needed in future).

Anyone wants to guide me here?

Edit: Title wrongly says "hash", ignore it


r/databasedevelopment • • Aug 17 '26

Why are we rebuilding the same database execution engine over and over?

14 Upvotes

I recently dug into Meta’s Velox, an open-source C++ execution engine designed to act like a reusable “engine block” for data systems.

Instead of Presto, Spark, etc. independently implementing things like vectorized execution, joins, memory management, spilling, and file readers, Velox provides these building blocks as a shared execution layer.

The performance numbers are interesting too:

  • 8.4× faster on TPC-H Q1

  • 9× faster on Q6

  • 6–7× average speedup on Meta production traffic

  • Up to 3× fewer servers

Checkout this interesting deep dive that how Velox actually works and why this architecture could matter for the future of data engines.

https://prestodb.io/blog/2026/08/13/inside-velox-open-source-universal-engine-block-for-big-data-and-ai/

Do you think shared execution layers like Velox will become the norm, or will specialized engines always win?


r/databasedevelopment • • Mar 30 '26

After 30+ years, "Is Linux disk I/O finally fast enough?"

Thumbnail
floedb.ai
10 Upvotes