Code Monkey home page Code Monkey logo

codechallenge's Introduction

CodeChallenge

GA Backend System Design

How to handle billions write event? How to improve performance of distributed workload? How to handle a request by invoking multiple microservices and aggregating the results? Data collection limit to process latency. How to run min downtime? Reprocess historical data.

Design Flow Chart

Components

Microservices

  1. On a different platform, using different programming languages and developer tools
  2. Teams can develop, maintain, and deploy each microservice independently.
  3. Reduce the time to market and speed up CI/CD pipeline

HAproxy/ZEVENET

  1. Event Driven Architecture for Improved Performance.
  2. Allows Zero-Downtime Maintenance.
  3. Supports Traffic Encryption & SSL Termination.
  4. Several Load Balancing Algorithms/Configurations.
  5. Access to Integrated Server Monitoring Dashboard.
  6. Optimized HTTP Header Analysis.

Stream Process

A type of data processing engine that is designed with infinite data sets in mind.

  • Spark is popular

    • High throughput, good for many use cases where sub-latency is not required.
    • Fault tolerance by default due to micro-batch nature.
    • imple to use higher level APIs.
  • Samza can reprocess historical data quickly

    • Very good in maintaining large states of information.
    • Fault Tolerant and High performant.

codechallenge's People

Contributors

imlemon avatar

Watchers

James Cloos avatar  avatar

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    ๐Ÿ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. ๐Ÿ“Š๐Ÿ“ˆ๐ŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google โค๏ธ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.