r/DistributedComputing • u/temporal-tom • Mar 12 '25
Durable Execution: This Changes Everything
r/DistributedComputing • u/temporal-tom • Mar 12 '25
r/DistributedComputing • u/david-delassus • Mar 06 '25
r/DistributedComputing • u/coder_1082 • Mar 06 '25
I'm exploring the idea of a distributed computing platform that enables fine-tuning and inference of LLMs and classical ML/DL using computing nodes like MacBooks, desktop GPUs, and clusters.
The key differentiator is that data never leaves the nodes, ensuring privacy, compliance, and significantly lower infrastructure costs than cloud providers. This approach could scale across industries like healthcare, finance, and research, where data security is critical.
I would love to hear honest feedback. Does this have a viable market? What are the biggest hurdles?
r/DistributedComputing • u/autouzi • Sep 19 '24
I'm seeking ideas for BOINC projects that have a broad positive impact, such as a distributed chatbot (even though I understand that a fully distributed AI may not be practical with current CPUs/GPUs). Specifically looking for ideas that directly benefit anyone, not just researchers. Thank you!
r/DistributedComputing • u/Affectionate_Set_326 • Sep 09 '24
Project: Jetmaker
It is a framework for Python developers to connect multiple distributed nodes into one single system, so distributed apps can access one another's data and services. And it also provides tools to synchronize all the nodes just like how you do in multithreading and multiprocessing
Github link: https://github.com/gavinwei121/Jetmaker
Documentation: Documentation
r/DistributedComputing • u/Low_Pomelo_7678 • Jul 08 '24
I'm looking to create a distributed computing setup using two Windows 10 computers, where applications can run on either computer based on resource availability. The goal is for users to interact with the system as if it's a single workstation, with the applications being processed on the computer with the most available resources. The GUI should be displayed on the main computer regardless of where the application is processed.
Requirements:
Seamless User Experience: Users should interact with the system through a single Windows 10 interface. When an application is launched, it should run on the computer with the most available resources without requiring manual intervention.
Shared Storage: Applications and data should be stored on a shared storage accessible by both computers.
Resource Monitoring: The system should monitor resources (CPU, memory, disk usage) on both computers to decide where to run applications.
Remote Execution: Applications running on the secondary computer should have their GUI displayed on the main computer, ensuring a seamless user experience.
Questions: Feasibility: Is this setup feasible for achieving a seamless user experience? Are there potential issues such as network latency, security concerns, or compatibility problems that I should be aware of?
Best Tools and Methods: What are the best tools or methods for achieving this setup on Windows 10? Are there specific software solutions or configurations that can facilitate remote execution with GUI redirection to the main computer?
Resource Monitoring and Load Balancing: How can I effectively monitor resources and balance the load between the two computers? Are there existing tools that can handle this automatically?
Security Best Practices: What are the best practices for securing remote execution and shared storage in this setup to ensure system security and data integrity?
I appreciate any insights or suggestions on how to best achieve this setup and address any potential challenges.
r/DistributedComputing • u/No-Pick5821 • Mar 24 '24
Hi, folks, I have been tasked to create a fintech system. This means the systems needs to be
Highly auditable
Correct
Verifiable
Secure.
Any references would help, books, courses, blogs etc.
r/DistributedComputing • u/dask-jeeves • Mar 19 '24
I wanted to share the talks from last month’s Dask Demo Day, where folks from the Dask community give short demos to show off ongoing work. Hopefully this helps elevate some of the great work people are doing.
Last month’s talks:
One trillion row challenge
Deploy Dask on Databricks with dask-databricks
Deploy Prefect workflows on the cloud with Coiled
Scale embedding pipelines (LlamaIndex + Dask)
Use AWS Cost Explorer to see the cost of public IPv4 addresses
Recording on YouTube: https://www.youtube.com/watch?v=07e1JL83ur8
Join the next one this Thursday, March 21st, 11am ET https://github.com/dask/community/issues/307
r/DistributedComputing • u/Background_Bowler236 • Mar 03 '24
Why are most of the HPC job prospects here are from software Dev side? Is HPC mostly used by soft Dev in companies? How about ML + HPC? Or other applications except for software developing side?
Another question is ghat are HPC experts paid low? Many here are always stating, "don't expect too much in this field", "companies don't really need hpc expert so", etc. If yes which then which side of HPC gets paid more (as if architect, security, ops, soft Dev, network, computing)?
r/DistributedComputing • u/Dizzybreezy • Oct 26 '23
CUDOS is a high-performance computing platform within the blockchain ecosystem. It provides developers with access to cutting-edge computational resources for their decentralized applications. CUDOS focuses on off-chain processing, which enables intensive data analysis and complex operations, allowing developers to create DApps that deliver lightning-fast performance. By harnessing the full potential of high-performance computing, CUDOS opens doors to a new realm of possibilities for resource-intensive projects. In a world where speed and efficiency are essential, CUDOS stands out as a reliable and powerful solution for those seeking top-tier computational performance in their blockchain endeavors. Embrace the future with r/Cudos_Official! https://cudos.org
r/DistributedComputing • u/michaeljb41 • Apr 13 '23
Is it possible? Let's say Alice has 2 GPUs idle at the moment, Ben has 1 GPU, and Chris needs 3 GPUs for the next 12 hours. How to build such a system, and what problems there might occur? How to handle turning off one's machine? Does it even make sense to run training or inference on such (latency)?
r/DistributedComputing • u/Possible_Knowledge30 • Dec 06 '22
I've been an active contributor to the Folding@Home community for half a decade now. I like sharing my computational power for things that matter. In the end I pay with my time, power and hardware to do so.
I'd like to hear your thoughts on some concerns that popped up the more I thought about it:
What if medication that was developed in a direct or indirect result of donated computational power is being sold for an unreasonably high price, so that the vast majority of humanity won't benefit from it?
What if the results contribute to the design and creation of new viruses or biological weapons sometime in the future?
Is it possible to redirect computational power to render something else?
Wanted to post to /r/foldingathome. Haven't been approved. So I thought this Subreddit is also appropriate.
r/DistributedComputing • u/roma-glushko • Jul 20 '21
Distributed systems come with own complexity and unique challenges which we don't find in single-server setups. Sometimes we greatly underestimate and overlook them.
I have written a whole note on common under water stones that distributed systems inherit ⬇️
https://www.romaglushko.com/blog/nature-of-distributed-systems/
Hope you find it useful!
r/DistributedComputing • u/gptankit • Jun 09 '21
mlcache (https://github.com/gptankit/mlcache) provides a multi-level cache interface for seamlessly working with upto 5 cache implementations. You can also choose from read patterns - readthrough/cacheaside and write patterns - writethrough/writearound/writeback according to the application's needs. Reviews/comments/gotchas welcome.
r/DistributedComputing • u/beleeee_dat • May 21 '21
r/DistributedComputing • u/lenadroid • May 13 '21
"the theory behind failure detection, a couple of real-world examples of how the mechanism works in a real cloud - on Azure. Even though this article includes real-world applications of failure detection within Azure, the same notions could also apply to GCP, AWS, or any other distributed system."
r/DistributedComputing • u/mgalarny • May 12 '21
This provider will let #Airflow + Ray users know the code they are launching and give them complete flexibility to modify and templatize their DAGs while still taking advantage of Ray’s distributed computation capabilities.
If you want to learn more, you can read the following blog: https://www.astronomer.io/blog/airflow-ray-data-science-story

r/DistributedComputing • u/No-Application2148 • Mar 25 '21
r/DistributedComputing • u/Ramirond • Feb 15 '21
r/DistributedComputing • u/oybeka98 • Nov 26 '20
Dear community members,
I'm planning to send my application for my MS degree specializing in distributed and parallel computing.
I'm very enthusiastic about this technology, and I think that this core concept is/would be a part of our future.
However, I didn't have a chance to practice in this field. But I do hope that I will sharpen my knowledge while working on my degree.
Can you please suggest me what are the latest trends in distributed and cloud computing world nowadays? I want to include some detail in my Statement of Purpose so that it would be more powerful. What ideas and trends worth mentioning and outlining in my statement of purpose?
Thank you in advance!
r/DistributedComputing • u/chriscambridge • Sep 07 '20
r/DistributedComputing • u/osamashabrez • Jul 14 '18
I have studied distributed systems and now I am looking for a self project where I can build something, probably a simulation package involving distributed software systems. There are no limits except that I want to build it in java and the scope should be large enough to learn a few things on the way.
Can you give me some directions to think into?
r/DistributedComputing • u/GoodAILab • Sep 15 '17
Hi everyone,
I’m the founder of Good Ai Lab and we have just launched our new product Cluster One. It’s a very big project that heavily depends on a community of people being involved and I would love to get your feedback on it. At Cluster One we are trying to help advance science by building the world's largest AI supercomputer.
We understand how much computing power is wasted every day (around 10 billions hours!) and we feel that with our expertise, and if we all join together, we could really make a difference in advancing scientific research.
The product has just launched this week and so I would love your feedback on the site to understand if everything makes sense and would it be something you would want to try, and if not what would stop you?
r/DistributedComputing • u/decentralized-cloud • Apr 19 '17
I built a decentralized virtual machine platform in an effort to deliver the cloud that I had envisioned when I first heard the term.
This is an open platform and anyone can participate. Just like any other cloud provider consumers can buy virtual machines and block storage. On this platform however you can also sell virtual machine instances and block storage as a contributor of server hardware. We act as the Internet service provider and supply the networking glue that makes it possible for a server sitting in your house, garage or datacenter to run virtual machines that participate in our encrypted network fabric.
We make money by taking a small commission on sales and by charging for the IP transit we provide. We are responsible for building out a global network of peering points and handling IP prefix advertisement for thousands of public and private network fabrics. NOC support and abuse reports are handled no differently than any other ISP.
Consumers creating new virtual machines can search for providers based on hardware features and historical metrics for reputation, uptime, cpu, memory, iops, latency and throughput. If a contributor has to take their server offline then all consumer virtual machines and block storage can be live migrated to any server connected to our fabric with no downtime.
Contributors net boot our Linux distribution using a bootable USB key. Upon booting a unique identity is created and registers with our system. Our web administration interface allows you to claim these servers and bind them to your account. Then you determine if you want the server to be part of your own private cloud fabric or if you want anyone to be able to rent your resources on the public cloud fabric. You can also choose to do both, have your own private cloud but also monetize your under utilized servers and rent your excess capacity to the public.
Over the last year a few dozen people have been helping me test this platform during it's development. I've received positive feedback and it's time to invite the public to submit applications for the first phase of our beta round. Core services are production ready and battle tested but subject to a more frequent maintenance cycle. Once we enter the second phase of beta testing we will be accepting applications for server contributors.
You can submit beta applications and other questions to the following;
I'm looking for help with continued development. If you feel you could contribute to this project, please contact me at the address listed above. I plan on accepting applications for full time positions in the near future.
The goal of this project is to bring the "mining" model to the virtualization space and encourage anyone, including existing cloud providers put servers on our fabric and openly compete in a free market. Running our distribution eliminates all of the configuration and time required to setup a sophisticated cloud infrastructure and significantly lowers the barrier of entry to becoming a cloud provider. Anyone with a good server and fast unlimited internet can boot, register and list their server resources for rent in under 5 minutes. Your only responsibility is to make sure it stays connected and powered on and offer prices that are competitive with similar offerings.
To seed the initial foot print of the network, I setup two locations. Each location has four servers on dedicated fiber. Each site can easily achieve gigabit speeds to their peering points and communicate with each other over 10 GbE. One location is on the US West coast and the other is on the US East coast. These servers represent our initial fabric capacity and I plan to add 2 to 3 more servers in 2 or 3 more locations as the need arrises. The resources total;
192 virtual cores
768 gb of memory
192 tb of disk
2 tb of pci-e ssd
Here are some features that differ from typical services;
Decentralized - Don't think presence in a dozen locations, think servers in thousands of locations all over the globe.
Globally Routed - Continually growing our peering relationships and setting up traffic relays all over the world.
Anycast Enabled - Your IPv4 and IPv6 addresses stay the same regardless of your location in the fabric.
Self Healing - Fabric will automatically relay through other neighboring nodes to bypass Internet outages.
Encrypted - Encrypted from the edge routers to the hypervisor, even LAN traffic between servers is encrypted.
Mobility - Request a live migration to any other server location with zero downtime, same IP.
Encrypted Storage - All customer data is encrypted at rest, keys are not kept on disk or in memory.
Snapshots - Take a live snapshot of your disk image and roll back changes to a known state.
Disaster Recovery - Have your data automatically replicated to one or more other server locations.
High Availability - Incremental replication enables fast instance migration or restart with large offsite datasets.
Routing Policies - Choose peering points to send traffic through with custom ECMP policies or keep it automatic.
Here are some features I'm still working on;
Blockchain Orchestration - Send bitcoin/tokens to an address to create instance, destroy on zero balance.
Autonomous Hypervisors - Hypervisors that don't allow any login at all, lock out everyone including ourselves.
Customer Migrations - Customers can initiate a live migration to any other server location.
Bring Your Own IP - Create private network that utilize the our global network fabric to advertise your own prefix.
Customer Keys - Customer provided encryption keys for storage or private network communications.
Public Servers - Allow anyone to contribute capacity to the platform in the form of dedicated baremetal servers.
Auditing - Open source distribution and configuration for professional and public audit.
Initial pricing during the beta period is;
$1 / 1 shared vcpu
$1 / 1 anycast ipv4 address
$1 / 512 mb of ecc ram
$1 / 16 gb of pci-e nvm-e ssd
$1 / 128 gb of double parity fault tolerant disk
$1 / 100 gb of data transfer
For example;
1 vcpu ($1) + 512 mb ram ($1) + 16 gb ssd ($1) + nat ($0) = $3/month
1 vcpu ($1) + 512 mb ram ($1) + 16 gb ssd ($1) + ipv4 ($1) + 100 gb transfer ($1) = $5/month
2 vcpu ($2) + 1024 mb ram ($2) + 32 gb ssd ($2) + 256 gb disk ($2) + ipv4 ($1) + 200 gb transfer ($2) = $11/month
I know the current data transfer cost is too high. I'm working on lowering it, as soon as I setup more peering arrangements the cost should come down drastically. Only internet ingress and egress count towards data transfer accounting. All internal traffic is unmetered and free of charge, even if the traffic spans multiple servers in different locations. Instances without a public address are given private addresses and have no data transfer limits both internally between instances and externally to the Internet.
Pricing for highly available instances depends on the level of redundancy. So if you want your data replicated in to exist in 3 different locations then your price is simply triple the single instance price. If a location suddenly goes offline your instance can be restarted on closest location that has your replicated data. If failure is eminent your instance will be live migrated with no downtime.
Future contributors would probably like to know what kind of hardware requirements to expect;
The the current minimum;
x86-64 architecture and 8GB of memory
Internet connection that supports UDP (NAT ok, no public IP required, EasyTether on LTE works!)
Hardware that supports virtualization extensions
UNDI capable network card
Ability to boot from USB
No external peripherals (usb, firewire, etc)
These are optional, but highly recommended;
Hardware that supports AES-NI, AVX or AVX2 - Due to all of the encryption it would be pretty slow without them.
ECC Memory - People debate it, but I sleep better at night knowing it's there.
High Speed Internet - Try to avoid slow upstream connections. Symmetric gigabit fiber is ideal.
Redundant Internet - Dual WAN connections can help avoid losing contracts due to Internet downtime.
Unlimited Internet - Don't get slammed for data overage, pick a provider who won't limit you.
NVMe PCI-e SSD - Achieve the highest customer density when utilizing high iops, high throughput SSD's.
6 disks or more - Additional parity/mirroring configurations will be available in the future.
LSI2008 - This is what we are using now, so if you want to assured compatibility, use this.
10 GbE LAN - More than one server in a single location? It would be advisable to go 10 GbE.
Dedicated Bypass - Direct ethernet connections between servers will utilize the direct link first.
All pricing is subject to change, I only expect prices to go down. Eventually when we come out of beta, pricing will follow the free market as contributors will be able to set their price and compete with other contributing cloud providers on a level playing field.
Please comment, I'm looking for feedback.