r/DistributedComputing • • Mar 03 '21

What's a relative simple leader election algorithm

3 Upvotes

I know there are papers such Paxos, Raft - those contain leader election phase. Also an algorithm such as bully algorithm for synchronous environment. Others are described in Wikipedia[1]. I understand there is no the simplest algorithm but my naive question - is there leader election algorithm which is

- relatively simpler than those described above?

- for asynchronous environment?

- universal (without any prior knowledge of the topology of a network or its properties)?

- without using ZooKeeper?

Appreciate any commentary!

[1]. https://en.wikipedia.org/wiki/Leader_election


r/DistributedComputing • • Feb 22 '21

Will Hash Rate Limiters Impact Distributed Computing Projects?

3 Upvotes

Nvidia is implementing a "hash rate limiter" for GeForce RTX 3060 GPUs and will likely implement it on all future GeForce models: https://blogs.nvidia.com/blog/2021/02/18/geforce-cmp/

My fear is that this may affect the performance of GPU distributed computing projects. Part of the reason I fold is that I already have the gaming hardware in my system. I foresee this dramatically reducing the number of users who fold as it is unlikely many consumers would purchase a "mining GPU" at a premium instead of a gaming GPU, especially those who have no intention of mining or may not be aware of distributed computing projects. Thoughts?


r/DistributedComputing • • Feb 12 '21

Satellite - A New Decentralized Social Publishing Platform

Thumbnail
self.decentralization
3 Upvotes

r/DistributedComputing • • Dec 27 '20

Throttling made easy — Back pressure in Akka streams.

Thumbnail
jay-reddy.medium.com
3 Upvotes

r/DistributedComputing • • Nov 20 '20

Lunatic – Actor System for Rust/WebAssembly

Thumbnail
github.com
3 Upvotes

r/DistributedComputing • • Nov 17 '20

Achieving exactly-once message processing with Ably

Thumbnail
ably.io
3 Upvotes

r/DistributedComputing • • Nov 09 '20

braft: An industrial-grade C++ implementation of the RAFT consensus algorithm open sourced by Baidu

Thumbnail
github.com
3 Upvotes

r/DistributedComputing • • Oct 28 '20

Grafana Tempo, a scalable distributed tracing system

Thumbnail
grafana.com
3 Upvotes

r/DistributedComputing • • Sep 21 '20

DreamLab completes Phase 1 of its Corona-AI project

Thumbnail
vodafone.com.au
3 Upvotes

r/DistributedComputing • • Apr 20 '20

Read a paper: The Tail at Scale

Thumbnail
youtu.be
3 Upvotes

r/DistributedComputing • • Feb 07 '20

Distributed Compute Protocol on the Pi

Thumbnail
scidata.ca
3 Upvotes

r/DistributedComputing • • Jan 18 '20

Build MongoDB-Like Document Store Using InterPlanetary Linked Data(IPLD) 5 Mins

Thumbnail
simpleaswater.com
3 Upvotes

r/DistributedComputing • • Oct 06 '19

Clockwork: Distributed And Scalable Job Scheduler

Thumbnail
cynic.dev
3 Upvotes

r/DistributedComputing • • Jun 29 '19

Building RPC layer in a distributed system using Netty - A tutorial

3 Upvotes

r/DistributedComputing • • Feb 21 '19

Question: how do you maintain consistency in two dBs?

3 Upvotes

Two dB's are each in a microservice. Let's name the microservices: ms-user and ms-profile.

When a user gets created, both ms-user and ms-profile needs to have pertinent data created.

When a user gets deleted, both ms-user and ms-profile needs to delete the data.

If the transaction to do above fails on either one, transactional rollback needs to happen.

How do you design such a thing? I was told two-phase commit is not the way to go, and reading Kleppmann's post on this (using streams).. is a bit scary as I'm not an expert in distributed computing architecture.

Thanks!


r/DistributedComputing • • Jan 18 '19

Consistent Badge Count at Scale

Thumbnail
blog.the-pans.com
3 Upvotes

r/DistributedComputing • • Apr 26 '18

Rate Limiting: A Useful Tool with Distributed Systems

Thumbnail
blog.getambassador.io
3 Upvotes

r/DistributedComputing • • Mar 03 '18

Learning about geodistributed computing for resilience and HA

3 Upvotes

Hi all, I've become very interested in distributed computing, clustering, and redundancy (e.g., all within the same cabinet) for resilience and high availability.

I am looking to extend this in future work to geodistributed computing, where such clusters exhibit this redundancy and HA individually not only within their own cabinets, but across goegraphically distributed nodes.

I know there are many challenges in keeping the data in a consistent state, georeplication of data, and dealing with latency issues. I know it's a very hard problem but people are working on it and progress is being made.

Could anybody please point me to projects (preferably open source) that implement georeplication, or information about this topic, such as in books, blogs, academic papers, or any other particular things to watch out for? I would greatly appreciate this because I've had difficulty finding very much information. Thank you!!


r/DistributedComputing • • Dec 06 '17

Algorand explained

3 Upvotes

Can anybody explain Algorand?

  • In particular, its binary byzantine agreement algorithm

  • And why do they use two-step reduction:

In the first step of the reduction, each committee member votes for the hash of the block passed to Reduction() by BA⋆(). In the second step, committee members vote for the hash that received at least T·τ votes in the first step, or the hash of the default empty block if no hash received enough votes.

?

What is the idea behind the second step?


r/DistributedComputing • • Sep 07 '17

Opshell: DevOps Shell

Thumbnail
blog.opszero.com
3 Upvotes

r/DistributedComputing • • Aug 29 '17

DistComp in Python

3 Upvotes

I'm looking to get learning distributed computing in Python. Any suggestions/help with where to begin?


r/DistributedComputing • • Jan 07 '17

Sfs: OpenStack Swift API and Haystack Distributed Object Store written in Vert.x

Thumbnail
github.com
3 Upvotes

r/DistributedComputing • • Jun 28 '16

Why Spark is on fire: a conversation with creator Matei Zaharia

Thumbnail
siliconangle.com
3 Upvotes