r/sqlite • u/Individual_One_1793 • Sep 14 '26
Pop-Database vs SQLite
Pop-Database vs SQLite, 500K entities, 12 AND conditions per query, both single-threaded (CPU-affinity verified, so no thread-count trick).
Pop-Database finished in 6.26s.
SQLite finished in 88.81s.
Pop-Database is 14.2× faster — and both found the exact same 9,559 matches per query.
This ratio moves a bit run to run depending on what else the machine is doing at the time. I've seen this same test land anywhere from ~12× to ~14× depending on system load. Still solidly in the same range either way.
Trade-off is shown in the same video: SQLite inserts faster (2.64s vs 6.55s for 500K rows). Pop-Database is built for read-heavy workloads, not write-heavy ones - that's the deal!!!
13
u/30MinsToMoveYourCube Sep 14 '26
I mean, if we're just looking to match the same results as SQLite but faster and without all the reliability built into SQLite, I suggest grep
12
9
u/MVPhurricane Sep 14 '26
i hear that /dev/null is even *more* web scale than SQLite!
4
u/cowslayer7890 Sep 14 '26
Does /dev/null support sharding?
1
u/ErebusBat Sep 15 '26
It does!
It will read the exact same on different machines INSTANTLY!
2
u/Gear5th Sep 16 '26
Will it run circles around sql?
1
u/ErebusBat Sep 18 '26
If you're just measuring raw read speed or raw write speed, then yes. It's also super compressible.
8
u/prawnsalad Sep 14 '26
Pop-Database vs SQLite (500K rows, 12-condition queries)
Problem: standard databases re-scan on every query at scale.
Result: 11.9× faster queries, identical results (0.0% difference), at the cost of 0.5× slower inserts — a deliberate trade-off for read-heavy analytics.
Quoting you from other places you've posted this. If this is what you think other databases are doing then you are 100% missing things.
Problem: linear scan doesn't scale.
Result: ~79,900× speedup on my engine search vs. normal linear scan — an algorithmic complexity difference , not an implementation tweak. This became a core technical argument in my patent filing.
Again, if this is what you're comparing against, you need to dig into databases more.
If you do have something more then provide information on your benchmark. Table schema, the queries, your benchmarking environment, the sqlite setup, the trade offs, etc. None of that matters with your patent.
I could mspaint a "Prawnsalad-Database: 1.2s. Pop-Database: 6.26s" and make the same claims as you are posting all this around and we would both have the exact same creditability. It's doing you 0 favours.
5
u/Ok_Maintenance_9692 Sep 15 '26
It's funny so many things have been re-discovered and re-invented in the last 50 years... I think this is the first time I've seen somebody marvel at themselves to re-invent indexing and imagine that nobody has ever bothered before.
2
3
0
u/Vegetable-Arm-4238
Sep 14 '26
•
Link?
1
-3
u/Individual_One_1793 Sep 14 '26
3
u/Vegetable-Arm-4238 Sep 14 '26
So not open source?
4
u/drcforbin Sep 15 '26
Of course not. Feels like half the stuff here in r/sqlite is some kind of vibecoded closed source sqlite clone or SaaS sqlite, always with a very obviously vibecoded site. This one's actually a little worse than just closed source though, "the algorithm is patent pending."
1
u/txmail Sep 14 '26
Can you point me to your test case data? From what I am reading the secret sauce just looks like indexing, which means you would need to create those indexes in SQLite by hand if the select queries are using a non-indexed field which would cause each query to perform a full table scan instead of utilizing an index.
I think this is also why the initial 500k load on Pop is slower than SQLite.
Indexing automatically non PK fields is nice, but it means that it is using a bit more space to store the data. Database optimization is quite common to anyone working with databases, including creating indexes.
If your AND conditions on the SQLite side are non-indexed... that is kind of a disingenuous comparison. It is like saying Racecar A is faster than Racecar B, even though Racecar B had the hand brake on.
3
u/horizon_games Sep 14 '26
Hah like a new JS framework where they show a simple render case being 100x than the big options. As if that's the ONLY factor to switching entirely.
Reliability and community and being battle tested and...well...having a basic public Github and non-AI written website are much bigger factors.