Rootconf 2015

DevOps and scaling infrastructure

Managing distributed file system with consistent distributed store & leader based algorithm

Submitted by Atin Mukherjee (@atinmu) on Monday, 30 March 2015

videocam
Preview video

Technical level

Intermediate

Section

Full talk

Status

Confirmed & Scheduled

View proposal in schedule

Vote on this proposal

Login to vote

Total votes:  +5

Objective

The objective of this presentation is to bring awareness to the people about how to achieve consistency, availablity and fault tolerance in distributed system in an efficient way.

Description

In a typical distributed system managing n number of nodes in an effective way is always a challenge. Distributed systems always demands to meet CAP theorem which is really hard to meet with a good performance numbers. All the nodes participating in the cluster should have the consistent data which is one of the criteria of the CAP theorem. This could be achieved by keeping the configuration details across all the nodes in the cluster, however this algorithm doesn’t scale (considering n X n number of exchange of information) and can end up having split brain situations. This could be avoided having distributed consistent store across m number of nodes (considered) as leaders where m < n. There are few technologies like consul/etcd by which this can be achieved.

Speaker bio

Atin is a Glusterfs hacker and currently working as a Senior S/W Engineer in Redhat India. Apart from storage he has also worked on different other domains which include telecom, BFS.

Slides

http://www.slideshare.net/AtinMukherjee/using-consensus-algoindistributedsystem-mindmap

Preview video

https://www.youtube.com/watch?v=bXt_dneWnbY

Comments

  • 1
    Atin Mukherjee (@atinmu) Proposer 3 years ago

    In this video link https://www.youtube.com/watch?v=bXt_dneWnbY I spoke about what I plan to present about this topic.

    • 1
      Zainab Bawa (@zainabbawa) Reviewer 3 years ago

      Thank you for sharing the link. I have responded to you about the category of your talk and looped in the conference editor, Pankaj Kaushal, to add comments. Please respond.

  • 1
    Atin Mukherjee (@atinmu) Proposer 3 years ago

    Is anything else needed from my end?

  • 1
    Mike Place (@cachedout) 3 years ago

    I’m really excited for this one. I hope it’s not at the same time as any of my talks so that I can attend!

  • 1
    Atin Mukherjee (@atinmu) Proposer 3 years ago

Login with Twitter or Google to leave a comment