r/DistributedComputing • • May 26 '21

The Mysterious Gotcha of gRPC Stream Performance

Thumbnail
ably.com
4 Upvotes

r/DistributedComputing • • Apr 24 '21

Notes On Kafka

Thumbnail
blog.uttpal.com
4 Upvotes

r/DistributedComputing • • Mar 02 '21

Getting Started with Distributed Machine Learning with Ray and PyTorch

Thumbnail
medium.com
4 Upvotes

r/DistributedComputing • • Dec 23 '20

TerarkDB, ByteDance's RocksDB replacement

Thumbnail
github.com
4 Upvotes

r/DistributedComputing • • Oct 13 '20

Forming a virtual paper-reading group

4 Upvotes

Hello!

Every week I pick up a paper in Distributed Systems, study it and write a summary report on it. So far, this has been an individual exercise for self learning, but instead of just sitting in a corner and learning things alone, I was hoping to form some sort of a group to do it with, to discuss ideas and take up interesting projects if a worthy idea comes up.

How should I go about this?

  • I could write blogs on medium/my website but my summary papers are quite long and I am not sure if medium readers would find long reports interesting.

  • I can look for people on reddit (which is what I am currently doing). Are there any subs or groups that are already doing this?

If anyone is interested, I can share my recent summary reports that I wrote on "Scaling Memcache at Facebook" and "Dynamo: Amazon's Highly Available Key-Value Store" over DM or on this thread if there's enough interest.


r/DistributedComputing • • Sep 13 '20

Benefits of cloud computing

Thumbnail itbloggy.com
4 Upvotes

r/DistributedComputing • • Jul 20 '19

New To Distributed Computing

4 Upvotes

Hi all,

I come from a web dev background but have a keen interest in distributed systems. I only have the experience of reading about the topic through interest and would like to transition my career towards something within the field. Is there any courses, or better ways to learn about distributed systems to help me become competent enough to work with distributed systems?

Thanks


r/DistributedComputing • • Oct 06 '18

Meta Data Acquisition Protocols for Distributed Computing Systems

4 Upvotes

I'm currently in the middle of a project with a focus on comparing and contrasting Meta Data acquisition protocols for distributed computing systems, and I was hopeful that if someone is more familiar with the topic, they would be so kind to provide protocol examples?

Currently we have a few we're digging into such as the Ganglia Architecture for Grid Computing by Massie et al (2004), as well as some peer-to-peer algorithms for snapshot creations. We also looked into the Echo Algorithm (AKA the Ping-Pong Algorithm).

I'm throwing this question out there alongside my current research, but if you already have some knowledge about protocols that fit this topic, and you would be so kind to give me some citations that you might feel are interesting, I would be very grateful.


r/DistributedComputing • • Sep 15 '17

Secure Kubernetes AMIs for HIPAA/PCI Compliance

Thumbnail
blog.opszero.com
4 Upvotes

r/DistributedComputing • • Jul 28 '16

“Distributed Computing for Everyone” startup launching publicly in a few days

Thumbnail
suchflex.com
4 Upvotes

r/DistributedComputing • • Jun 01 '16

Masterless Consensus Algorithm

Thumbnail
gridem.blogspot.com
4 Upvotes

r/DistributedComputing • • Mar 02 '16

I built a distributed computing project

Thumbnail computeforhumanity.org
4 Upvotes

r/DistributedComputing • • Dec 23 '14

Principles of Distributed Computing

Thumbnail dcg.ethz.ch
4 Upvotes

r/DistributedComputing • • Apr 07 '14

Nathan Marz on Storm, Immutability in the Lambda Architecture, Clojure

Thumbnail
infoq.com
4 Upvotes

r/DistributedComputing • • Mar 05 '14

Join HTC's Power to Give. And be a part of the future.

Thumbnail
youtube.com
4 Upvotes

r/DistributedComputing • • Feb 10 '14

How LinkedIn Uses Apache Samza

Thumbnail
infoq.com
4 Upvotes

r/DistributedComputing • • Jan 24 '14

SharePoint 2013: AppFabric and Distributed Cache Service

Thumbnail
social.technet.microsoft.com
4 Upvotes

r/DistributedComputing • • Jun 08 '12

Looking for low bandwidth project with small tasks

4 Upvotes

I am looking for a project that meets the following requirements:

Required:

  • Low bandwidth consumption (preferably less than 100k)

  • Small tasks that can be done quickly (preferably 15 seconds or less in a browser running JavaScript)

  • No hard disk writing (do it all in memory)

Optional (but preferable):

  • Help the medical community

  • Be "easily verifiable" by a computer

An example of a problem that meets all the required requirements (redundant, I know) and the second optional requirement would be to brute force a password given a hash (note: I absolutely do NOT want to do a project like this) as it requires low bandwidth (server gives client the password hash and a range for the password brute forcing and client gives back the password if found), the tasks can be extremely small (just limit the size of the password guessing range), it doesn't require any hard disk writing, and the server can easily verify a password that is given as a result (although it can't "easily" verify that a valid password was not in the range).

I'd imagine another example would be looking for primes although I haven't looked at the implementation(s) of those algorithm(s) in much detail to say that for sure.

Are there any projects that meet those requirements?

TL;DR Looking for projects with low bandwidth, many small tasks and no hard disk writing

Note: I am no expert on distributed computing so if the question I am asking is stupid (e.g. if any project that meets the requirements I gave would have bandwidth or other overhead costs that exceed the value of the distributed computing) please educate me.


r/DistributedComputing • • Apr 17 '11

Introducing Doozer: a distributed, consistent, highly-available data store written in Go.

Thumbnail xph.us
4 Upvotes

r/DistributedComputing • • Apr 08 '11

Let's compare stats

4 Upvotes

r/DistributedComputing • • Aug 03 '10

I put together a twitter bot that tweets the current reddit F@H team stats!

Thumbnail
twitter.com
4 Upvotes

r/DistributedComputing • • Apr 10 '10

The Eight Fallacies of Distributed Computing

Thumbnail nighthacks.com
4 Upvotes

r/DistributedComputing • • Jan 31 '10

And here's some love to the reddit WorldCommunityGrid team for those who use BOINC

Thumbnail
worldcommunitygrid.org
4 Upvotes

r/DistributedComputing • • Aug 26 '26

Could a workload router sit above BOINC/mining/AI compute networks?

3 Upvotes

I’ve been experimenting with an idea: instead of a machine being permanently tied to one distributed-compute client, a local controller could decide when hardware is idle and which compatible workload it should run.

Current prototype only has one workload, so this isn’t a finished multi-network router yet.

But the architecture is:

hardware → local availability/safety checks → workload router → compatible network

I’m curious whether people who already run distributed computing projects think this is useful or whether you’d rather dedicate hardware manually.

Would especially appreciate criticism around scheduling, trust, and resource controls.