r/DistributedComputing • • Apr 02 '14

Manhattan, Twitter's real-time, multi-tenant distributed database

Thumbnail
blog.twitter.com
5 Upvotes

r/DistributedComputing • • Feb 21 '14

Truly Altruistic number crunching projects

5 Upvotes

Hi:

Someone posted something about worthwhile projects to contribute to in the past. The commenting time on that question is over but I need more information.

I am looking for projects that are truly altruistic. What I mean by that is for example if I participate in something to cure cancer then lots of doctors and pharmaceutical companies are going to make lots and lots of money off of the cpu time I just donated.

I am looking for a project where I am not burning my cpu cycles feeding a rich doctor's family.


r/DistributedComputing • • Sep 28 '12

$99 “supercomputer” Kickstarter project

Thumbnail
arstechnica.com
5 Upvotes

r/DistributedComputing • • Jan 15 '10

Post your hardware, software, ppwu and other information

5 Upvotes

I thought it would be interesting to see everyones configuration as far as hardware and software goes. The points per wu seem to vary pretty wildly so it'd be nice to match up performance with the wu's people seem to get.

Edit: Also, since this is distributedComputing in general, tell which @home projects that you do work for.


r/DistributedComputing • • Jul 13 '26

FlowG now has a FoundationDB storage backend, making it truly distributed.

Thumbnail flowg.cloud
4 Upvotes

r/DistributedComputing • • Feb 19 '26

Before Quantum — Distributed GPU project searching for Bitcoin wallets generated with weak entropy (2009-2012)

4 Upvotes

Hey everyone,

I've been working on a distributed GPU computing project called Before Quantum and wanted to share it with this community since the distributed architecture might be interesting to some of you.

The problem:

Between 2009 and 2012, early Bitcoin wallet software used weak random number generators — timestamp-seeded LCGs, the Debian OpenSSL bug (CVE-2008-0166) that reduced entropy to 15 bits, brain wallets with simple passwords, JavaScript PRNGs with the Randstorm vulnerability, etc.

The private keys generated by these flawed algorithms have tiny search spaces — some as small as 65,536 possibilities, others up to a few billion.

There are ~2,845 known funded addresses that were likely generated by these weak methods. A modern GPU can test the full cryptographic pipeline (private key -> secp256k1 EC multiplication -> SHA-256 -> RIPEMD-160 -> match detection) at hundreds of millions of keys per second.

How it works:

- Single CUDA C++ file (~3,400 lines) implements 23 weak key generation modes, the full crypto pipeline, and a two-stage match detection system (bloom filter in constant memory + binary search confirmation)

- Precomputed EC multiplication tables (67 MB) reduce point multiplication from hundreds of double-and-add iterations to 16 table lookups + 15 additions

- Distributed work coordination via a FastAPI backend — the server assigns work units (mode + offset range), workers execute on GPU, results are verified server-side via checkpoint regeneration

- Canary targets (honeypot hashes) detect cheating workers who skip computation

- Anti-trust model: workers never send private keys to the server — only the Hash160 and key offset. The server independently regenerates and verifies the key

The distributed part:

Workers register via API, receive work units targeting ~10 seconds of GPU time (10M to 10B keys depending on mode), and report results with checkpoints. The server independently verifies each checkpoint by regenerating the private key from (mode, offset) using its own Python

implementation, then checking the EC multiplication and hashing. This means you don't have to trust the workers — and the workers don't have to trust the server with private keys.

Current status

The smaller keyspaces (Debian OpenSSL: 65K keys, low-bit keys, LCG-seeded PRNGs) have been fully exhausted. We're now starting work on SHA-256 Sequential — a mode that targets brain wallets derived from simple incrementing integers (SHA256("1"), SHA256("2"), ...). With a 2^64

keyspace and 2,845 target wallets to match against, this is a long-term effort that will require sustained GPU power across many contributors.

https://b4q.io

- Research writeup with CUDA engineering details: https://b4q.io/research

Current status

The smaller keyspaces (Debian OpenSSL: 65K keys, low-bit keys, LCG-seeded PRNGs) have been fully exhausted. We're now starting work on SHA-256 Sequential — a mode that targets brain wallets derived from simple incrementing integers (SHA256("1"), SHA256("2"), ...). With a 264 keyspace and 2,845 target wallets to match against, this is a long-term effort that will require sustained GPU power across many contributors.

Happy to answer any technical questions about the GPU pipeline, the verification system, or the distributed architecture.


r/DistributedComputing • • Jul 18 '25

Understanding Direct Memory Access (DMA): How Data Moves Efficiently Between Storage and Memory

Thumbnail nihcas.hashnode.dev
4 Upvotes

r/DistributedComputing • • May 04 '25

How to break into getting Distributed Systems jobs - Facing the chicken and the egg problem

4 Upvotes

Hi all,

I currently have around 3.5 years of software development experience, but I’m specifically looking for an opportunity where I can work under someone and help build a product involving distributed systems. I've studied the theory and built some production-level products based on the producer-consumer model using message queues. However, I still lack the in-depth hands-on experience in this area.

I've given interviews as well and have at times been rejected in the final round, primarily because of my limited practical exposure. Any ideas on how I can break this cycle? I'm open to opportunities to learn—even part-time unpaid positions are fine. I'm just not sure which doors to knock on.


r/DistributedComputing • • Apr 14 '25

How to simulate distributed computing?

4 Upvotes

I want to explore topics like distributed caches etc. Likely this is a dumb question but how do I simulate it on my machine. LLMs suggest multiple Docker instances but is that a good way?


r/DistributedComputing • • Feb 18 '25

Restate 1.2: a distributed durable execution engine, built from first principles

Thumbnail
restate.dev
4 Upvotes

r/DistributedComputing • • Aug 10 '24

RAFT Cluster Doubt

4 Upvotes

I'm currently developing a project of a distributed key value database using RAFT.
My questions are:

  • How should I communicate with the cluster should I query who is the leader and then do PUT , DELETE , UPDATE request to it ?

  • Also for READ queries should I check which node is nearest to my client(i.e least latent) node and then send the read request to it ?

  • Also any suggestions to set up a process that summarises the Health of the Cluster. Health meaning the time taken to be consistent, the memory usage by each node ,etc.

PS: I'm using Apache Ratis for the Raft implementation and Java , Maven fot the development part.


r/DistributedComputing • • Feb 19 '24

Elevate Your Computing Experience: Deploy Your Virtual Machine on CUDOS Intercloud Today!

4 Upvotes

Experience the future of cloud computing with CUDOS Intercloud! By deploying your own virtual machine, you unlock unparalleled benefits in scalability, cost efficiency, and customization. With the ability to tailor storage options and access diverse payment methods, including OSMO and USDCaxl on Osmosis, the platform offers unmatched flexibility. What's more, CUDOS Intercloud ensures your peace of mind with an exclusive USD guarantee for CUDOS token users, minimizing slippage losses. Join the revolution in decentralized computing and enjoy seamless performance with CUDOS Intercloud. Don't miss out on the opportunity to elevate your computing experience to new heights – start deploying your virtual machine today! intercloud.cudos.org 🚀


r/DistributedComputing • • May 26 '23

A Manifesto for Cloud-Oriented Programming from the creator of the CDK

4 Upvotes

In this insightful article, Elad Ben-Israel, the mind behind the CDK, shares his love for the cloud, but also his frustrations with the complexity of building cloud applications. The challenges he identifies include:

  1. Focus on non-functional mechanics: The need to understand and manage cloud platform mechanics instead of focusing on building valuable features for users.

  2. Lack of independence: Developers often need to rely on others to handle parts of the deployment process or to resolve issues, interrupting their work flow.

  3. Delayed feedback: The current iteration cycle in cloud development can take minutes or even longer, significantly slowing down the development process and making it harder for developers to stay in their flow state.

It's not just a rant

Elad is not just ranting about cloud development. He proposes a solution in the form of a programming language for the cloud. This language would treat the entire cloud as its computer. The language compiler will be able to see the complete cloud application, unbound by the limits of individual machines. Such a compiler would be able to handle a significant portion of the application's non-functional aspects, enabling developers to operate at a more abstract level, thus reducing complexity and promoting autonomy. Moreover, it could expedite iteration cycles by allowing to compile applications to quick local simulators during the development process.

The Winglang Project

Elad reveals that he's in the process of developing such an open-source, “cloud-oriented” language, dubbed Winglang. Wing aims to improve the developer experience of cloud applications by enabling developers to build distributed systems that leverage cloud services as first-class citizens. This is achieved by integrating infrastructure and application code in a secure, unified programming model. Wing programs can be executed locally via a fully-functional simulator or deployed to any cloud provider.

My Interest in Winglang

I, together with a group of dedicated contributors, joined forces with Elad to develop Winglang. While still in Alpha and not yet ready for production use, it's already possible to build some real applications.

Check out https://github.com/winglang/wing for more details.


r/DistributedComputing • • May 09 '23

Dask Performance Testing at Scale

4 Upvotes

We develop Dask and automatically deploy it to large clusters of cloud workers (sometimes 1000+ EC2 instances at once!). In order to avoid surprises when we publish a new release, Dask needs to be covered by a comprehensive battery of tests — both for functionality and performance.

In this blog, we explain how we do it, https://medium.com/coiled-hq/performance-testing-at-coiled-fa0d5940fc02


r/DistributedComputing • • May 02 '23

Compensating Actions, Part of a Complete Breakfast with Sagas

Thumbnail
temporal.io
4 Upvotes

r/DistributedComputing • • Jan 12 '23

[video] Design a Payment System - System Design Interview

Thumbnail
youtu.be
4 Upvotes

r/DistributedComputing • • Nov 30 '22

New Platform Engineering subreddit

4 Upvotes

Hi there! We've created a new subreddit and wanted to share it with you all here since you may be interested. Our subreddit is /r/platformengineering. Please check it out if you are interested in all things platform eng. It's pretty small right now, but we hope to grow it soon to talk about all things platform eng (of course), cloud, edge tech, careers etc.


r/DistributedComputing • • Sep 10 '22

Anyone have a BOINC project? Or what would it be if you did?

4 Upvotes

r/DistributedComputing • • Jun 13 '22

Is there a "shared" distributed computing project?

4 Upvotes

Like many of you i sometimes have the need to do some heavy stuff with my computer and its poor 2017 i5 takes hours and hours to do the job, sometimes even days, time that i have to spend waiting. Now, most of the time i don't need that processing power so i though that it would be fantastic if there was a network that i could join where everyone pools together their PCs to compute stuff and earn points that can be spent to submit work for the network to do, is there something like that already?


r/DistributedComputing • • Feb 26 '22

Joining Team Ukraine to show support?

4 Upvotes

Hi everyone in the DC community.

We over at XtemeSystems are joining the Ukraine team on some of their BOINC projects.This is the best way we can find to show our support for a sovereign country that was invaded by an another country and doing it NOW and where it can be seen.

We are seeing asking if anyone is as frustrated as we are. This is a way to show what we believe in, we do it every day with the projects we select.DC is about supporting what you believe in, it's personal, it costs us and so why not show our support for country that did not ask for war but it's people are getting killed as we speak.

It's not about POLITICS it about caring for humanity and that is what DC is all about!

Since most of us have no ability to help them fight the Russians militarily, this is one of the ways some of us are able to show show support for the Ukraine, this is about support, it's what we do on DC every day.

We know this is a personal choice but we wanted to tell the community that this is going on and if you wanna put your computers to work to show support,this is a way you can. It makes me feel good to do this but it's not for everyone.

This isn't even about the amount of points you contribute or positions taken,
but the action that it shows!
The more members from outside Ukraine joining "National Team of Ukraine"
From around the World joining, That matters,
It represents community support.

Here is there BOINC project team list:
https://stats.free-dc.org/stats.php?page=teammain&team=Ukraine

Here is our thread
https://xs4s.org/index.php?topic=30190.msg95387#msg95387

It's a small act in the realm of reality of what is happening, but something to show support at least.

Thanks for any support and if anyone has accounts on other forums, please feel free to post a thread there as well to gather support.

(If this is out of line or anything then the mods can delete or whatever.)

Thanks
SystemViper

This is me...

Me WCG


r/DistributedComputing • • Feb 08 '22

Hydra 2022 — June 1-3, online

4 Upvotes

JUG Ru Group's Hydra conference is back!

You can become its speaker. If you ever wanted to share knowledge but hesitated, felt shy, or waited for a better moment — this is it.

All you need is a session idea — the program committee will help you to prepare. The conference will be held online, so you can perform from anywhere or join the studio in Saint Petersburg.

Here are examples of expected topics:

– data structures & algorithms;
– blockchain;
– security;
– transactional memory;
– distributed computing.

But, this is only a recommendation — you can come up with any idea.

The call for papers is open till March 1. Visit the website to learn more and fill the form.


r/DistributedComputing • • Dec 31 '21

Leaderless consensus protocol in the wild

4 Upvotes

Hi, I'm looking for anyone who has ever used a leaderless protocol in an industry setting. I need to run such a setup and I'm fairly certain by now that this has never been done before. If you have, please let me know, I can make it worth your while.


r/DistributedComputing • • Jul 21 '21

Notes on the FoundationDB Paper with Additional Proof of Correctness

Thumbnail
blog.the-pans.com
4 Upvotes

r/DistributedComputing • • May 28 '21

ClickHouse - an open-source column-oriented database management system that allows generating analytical data reports in real time.

Thumbnail
github.com
4 Upvotes