• Road Map

• Computer Science

  1. Operating System
  2. Computer Architecture
  3. Compilation
  4. Network
  5. Data Structure
  6. Database

• Programming Language

  • C/C++

• Software Engineering

  1. Coding Cultivation
  2. Code Review
  3. Safety Precaution
  4. Testing
  5. Publishing

• System Design

• Linux

  1. Kernel
  2. Memory Management
  3. Linux Network
  4. AIO
  5. Lock-free
  6. Memory Order
  7. CPU Cache

• Distributed Architecture

  1. Distributed Messages System
  2. Logs & Data
  3. Distributed monitoring and tracking
  4. Data Analysis
  5. Distributed Architecture Engineering Design
  6. Design Pattern
  7. Failure testing of distributed systems
  8. Scalability
  9. Consistent Hashing
  10. Cache
  11. Message Queue
  12. Log
  13. Performance
  14. Search
  15. Architecture Practices by Companies

• Microservice

  1. API Gatway
  2. Microservice VS SOA, IaaS, Paas, Monolithic
  3. Practice
  4. Authentication & Authorization
  5. Design Pattern

• Cloud Native

• Thanks

• Teach Yourself Computer Science

• 📙 Computer Systems A Programmer’s Perspective ✏️ Book Notes

• 📙 Modern Operating Systems ✏️ Book Notes

• 📙 Operating Systems: Three Easy Pieces

• 📙 Operating System Concepts

• 📙 Operating Systems Design and Implementation

• CPU Registers x86

• 📙 Advanced Programming in the UNIX Environment

• 📙 Computer Organization and Design: The Hardware/Sofeware Interface ✏️ Book Notes
• 📙 Computer Architecture: A Quantitative Approach
• 📙 Structure and Interpretation of Computer Programs

• 📙 Compilers: Principles, Techniques, and Tools
• 📙 Programmer Self-Cultivation: Linking, Loading and Libraries (CN) ✏️ Book Notes

• 📙 TCP/IP ILLustrated Volume 1: The Protocols ✏️ Book Notes

• 📙 UNIX Network Programming, Volume 1: The Sockets Networking API ✏️ Book Notes: UNP ✏️ Book Notes: Linux Programming

• 📙 UNIX Network Programming, Volume 2: Interprocess Communications

• 📙 Linux System Programming

• 📙 Computer Networking: A Top-Down Approach

• 📙 Computer Networks, 5th Edition

• 📙 Practical Packet Analysis: Using Wireshark to Solve Real-World Network Problems, 2nd Edition

• Internet protocol suite (wikipedia)

• Let’s Code a TCP/IP Stack, 1: Ethernet & ARP

• Let’s Code a TCP/IP Stack, 2: IPV4 & ICMPv4

• Let’s Code a TCP/IP Stack, 3: TCP Basics & Handshake

• Let’s Code a TCP/IP Stack, 4: Tcp Data Flow & Socket API

• Let’s Code a TCP/IP Stack, 5: TCP Retransaction

• C10k Problem

• C10m Problem

• The Secret To 10 Million Concurrent Connections - The Kernel Is The Problem, Not The Solution

• Congestion Avoidance and Control.pdf

• Nginx HTTP/2

• HTTP

  • RFC 7230 - Hypertext Transfer Protocol (HTTP/1.1): Message Syntax and Routing
  • RFC 7231 - Hypertext Transfer Protocol (HTTP/1.1): Semantics and Content
  • RFC 7232 - Hypertext Transfer Protocol (HTTP/1.1): Conditional Requests
  • RFC 7233 - Hypertext Transfer Protocol (HTTP/1.1): Range Requests
  • RFC 7234 - Hypertext Transfer Protocol (HTTP/1.1): Caching
  • RFC 7235 - Hypertext Transfer Protocol (HTTP/1.1): Authentication
  • RFC 7540 - Hypertext Transfer Protocol Version 2 (HTTP/2)
  • RFC 7541 - HPACK: Header Compression for HTTP/2

• TLS

  • RFC 8446 - The Transport Layer Security (TLS) Protocol Version 1.3
  • RFC 8449 - Record Size Limit Extension for TLS

• QUIC

  • RFC 9000 - QUIC: A UDP-Based Multiplexed and Secure Transport

• ARP

  • RFC 826 - An Ethernet Address Resolution Protocol

• ICMP

  • RFC 792 - Inernet Control Message protocol

• TCP

  • RFC 793 - Transmission Control Protocol
  • RFC 813 - Window and Acknowledgement Strategy in TCP
  • RFC 879 - The TCP Maximum Segment Size and Related Topics
  • RFC 896 - Congestion Control in IP/TCP Internetworks
  • RFC 2581 - TCP Congestion Control
    • RFC 5681 - TCP Congestion Control
    • RFC 6582 - The NewReno Modification to TCP’s Fast Recovery Algorithm
  • RFC 2018 - TCP Selective Acknowledgment Options
    • RFC 2883 - An Extension to the Selective Acknowledgement (SACK) Option for TCP
  • RFC 2988 - Computing TCP’s Retransmission Timer
  • RFC 6298 - Computing TCP’s Retransmission Timer

• UDP

  • RFC 768 User Datagram Protocol

• IP

  • RFC 791 - Internet Protocol

• VXLAN

  • RFC 7348 - Virtual eXtensible Local Area Network

• Generic Routing Encapsulation

  • RFC 2784 - Generic Routing Encapsulation (GRE)
  • RFC 2890 - Key and Sequence Number Extensions to GRE
  • RFC 8086 - GRE-in-UDP Encapsulation

• Tunnel

  • RFC 1853 - IP in IP Tunneling
  • RFC 2784 - Generic Routing Encapsulation (GRE)
  • RFC 2661 - Layer Two Tunneling Protocol "L2TP"
  • RFC 2637 - Point-to-Point Tunneling Protocol (PPTP)

• Other

  • STUN Traceroute
  • Implementing Remote Procedure Calls

• 📙 Database System Concepts (Fifth Edition)
• 📙 High Performance MySQL, 3rd
• 📙 Inside MySAQL: InnoDB Storage Engine
• 📙 Relational Database Index Design and the Optimizers
• MySQL Internals Manual
• How to Analyze and Tune MySQL Queries for Better Performance
• MySQL Performance Tuning 101
• MySQL Performance Schema & Sys Schema
• MySQL Performance: Demystified Tuning & Best Practices
• MySQL Security Best Practices
• MySQL Cluster Deployment Best Practices
• MySQL High Availability with InnoDB Cluster

• 📙 Data Structures and Algorithm Analysis in C: Second Edition

• 📙 Algorithms，Fouth Edition
• 📙 Grokking Algorithms: An illustrated guide for programmers and other curious people
• 📙 Programming Pearls (2/e)
• 📙 Data Structures and Algorithm Analysis in C: Second Edition

• Niklaus Emil Wirth: Algorithms + Data Structures = Programs .pdf
• Robert Kowalski: Algorithm = Logic + Control .pdf

• The key to Accelerating Your Coding Skills
• Character Encoding
• What are some of the most basic things every programmer should know?
• 97 things every programmer should know?
• How to Ask Question The Smart Way

• 📙 Refactoring: Improving the Design of Existing Code ✏️ Book Notes

• 📙 Working Effectively with Legacy Code

• 📙 Clean Code: A Handbook of Agile Software Craftsmanship ✏️ Book Notes

• 📙 The Clean Coder：A Code of Conduct for Professional Programmers

• https://refactoring.guru

• Code Review Best Practices
• How Google Does Code Review

• https://www.owasp.org/index.php/Main_Page
• Secure Coding Practice Guidelines
• SEI SERT Coding Standards
• Hardening Your HTTP Security Headers

• 📙 Perfect Software: And Other Illusions about Testing
• 📙 How Google Tests Software

• Checklist

• 📙 Domain-Driven Design: Tackling Complexity in the Heart of Software

• 📙 The Art of UNIX Programming

• 📙 Clean Architecture

• donnemartin/system-design-primer

• Grokking System Design ✏️ Book Notes

• Grokking Advanced System Design ✏️ Book Notes

• Grokking the Object Oriented Design ✏️ Book Notes

• Six Programming Paradigm

• Programming Paradigms for Dummies.pdf

• Stanford Programming Paradigm

• The Twelve-Factor App

• Avoid Over Engineering

• Best Practices for Designing a Pragmatic RESTful API

• HTTP API Desgin

• API Guildlines

• The Problem With Logging

• Red Hat Enterprise Linux
• x86-TSO: A Rigorous and Usable Programmer’s Model for x86 Multiprocessors
• Spurious wakeup 🔗 C++ Condition Variable
• LWN.netNews Kernel Index

• ✏️ Linux Kernel 4.19
• ✏️ Understanding Linux Kernel
• ✏️ Linux Kernel Development
• What is RCU? – "Read, Copy, Update"
• Linux Insides
• LWN’s kernel page
• Learn Linux Kernel from Android Perspective
• Linux Kernel Doc
• Kernel Planet: Kernel Developers Doc
• Linux Performance and Tuning Guidelines.pdf
• Linux Performance
• Optimizing web servers for high throughput and low latency

• What Every Programmer Should Know About Memory.pdf
• Memory Barriers: a Hardware View for Software Hackers.pdf
• A Tutorial Introduction to the ARM and POWER Relaxed Memory Models.pdf
• Understanding glibc malloc
• ptmalloc
• tcmalloc 🔗 Ref 🔗 Ref
• jemalloc.pdf
• C dynamic memory allocation
• Research on ptmalloc, tcmalloc and jemalloc memory allocation strategies (CN)
• Memory optimization summary: ptmalloc, tcmalloc, and jemalloc
• Scalable memory allocation using jemalloc
• Linux Kernel Vs. Memory Fragmentation Part I

• 📙 Linux High Performance Server Programming (CN) ✏️ Linux Programmnig Noetes ✏️ Linux System Notes

• 📙 Network tuning

• Linux Advanced Routing & Traffic Control HOWTO

• Red Hat Enterprise Linux Network Performance Tuning Guide.pdf

• Awesome Pcap Tools

• Making Linux TCP Fast.pdf

• Monitoring and Tuning the Linux Networking Stack: Receiving Data

• Monitoring and Tuning the Linux Networking Stack: Sending Data

• The BSD Packet Filter: A New Architecture for User-level Packet Capture.pdf

• Boost application performance using asynchronous I/O
• Lazy Asynchronous I/O For Event-Driven Servers
• IOCP
• Reactor: An Object Behavioral Pattern for Demultiplexing and Dispatching Handles for Synchronous Events.pdf
• Understanding Reactor Pattern: Thread-Based and Event-Driven
• The Design and Implementation of the Reactor.pdf
• The Secret To 10 Million Concurrent Connections -The Kernel Is The Problem, Not The Solution
• Epoll is fundamentally broken 🔗 1 🔗 2
• The implementation of epoll 🔗 1 🔗 2 🔗 3 🔗 4

• An Introduction to Lock-Free Programming
• Lock-Free Data Structures
• Lock-Free Data Structures.pdf
• Is Parallel Programming Hard, And, If So, What Can You Do About It?
• Non-blocking Algorithm
• Read Copy Update
• Seqlock
• Implementing Lock-Free Queues
• Simple, Fast, and Practical Non-Blocking and Blocking Concurrent Queue Algorithms.pdf
• Implementing a Recursive Mutex

• Weak vs. Strong Memory Models
• This Is Why They Call It a Weakly-Ordered CPU
• Memory Barriers Are Like Source Control Operations
• Acquire and Release Semantics
• Memory Ordering at Compile Time
• The Happens-Before Relation
• The Synchronizes-With Relation
• Acquire and Release Fences Don't Work the Way You'd Expect
• Acquire and Release Fences
• Roll Your Own Lightweight Mutex
• Can Reordering of Release/Acquire Operations Introduce Deadlock?
• You Can Do Any Kind of Atomic Read-Modify-Write Operation
• The Purpose of memory_order_consume in C++11
• Atomic vs. Non-Atomic Operations
• Memory Reordering Caught in the Act

• Gallery of Processor Cache Effects TODO:?
• coolshell: CPU Cache
• L1 cache lines
• Scott Meyers: CPU Caches and Why You Care PPT
• Cache Architecture and Design
• Nonblocking Algorithms and Scalable Multicore Programming
• Optimizing for instruction caches Part 1 Part 2 Part 3
• Latency Numbers Every Programmer Should Know

• Distributed Systems Reading Group

• 📙 Distributed Systems, 3rd Edition

• 📙 Distributed Systems for fun and profit

• 📙 Designing Data Intensive Applications

• 📙 Distributed Systems: Principles and Paradigms.pdf

• 📙 Designing Distributed Systems: Patterns and Paradigms for Scalable, Reliable Services ✏️ Book Notes

• 📙 Principles of Distributed Systems.pdf

• 📰 Transaction Across DataCenter 📺 YouTuBe

• Scalable Web Architecture and Distributed Systems

• Scalability, Availability & Stability Patterns

• System Design Primer

• An introduction to distributed systems

• Byzantine fault PDF

• The Byzantine Generals Problem

• Practical Byzantine Fault Tolerance.pdf

• CAP Theorem

• A Brief Tour of FLP Impossibility

• DLS.pdf

• Introduction to Distributed System Priciples(CN)

• CAP Twelve Years Later: How the "Rules" Have Changed

• Harvest, yield, and scalable tolerant systems

• Base: An Acid Alternative

• Eventually Consistent

• Kafka: a Distributed Messaging System for Log Processing.pdf
• Wormhole: Reliable Pub-Sub to Support Geo-replicated Internet Services.pdf
• board the Databus! LinkedIn's Scalable Consistent Change Data Capture Platform

• The Log: What every software engineer should know about real-time data's unifying abstraction
• The Log-Structured Merge-Tree (LSM-Tree).pdf
• Immutability Changes Everything.pdf Video
• Tango: Distributed Data Structures over a Shared Log.pdf

• Dapper, a Large-Scale Distributed Systems Tracing Infrastructure.pdf

• The Unified Logging Infrastructure for Data Analytics at Twitter.pdf

• Scaling Big Data Mining Infrastructure: The Twitter Experience.pdf

• Dremel: Interactive Analysis of Web-Scale Datasets.pdfd

• Resilient Distributed Datasets: A Fault-Tolerant Abstraction for In-Memory Cluster Computing.pdf

• Distributed Programming Model.pdf

• PSYNC: A partially synchronous language for fault-tolerant distributed algorithms.pdf

• Logic and Lattices for Distributed Programming.pdf

• Services Engineering Reading List

• Readings in distributed systems

• Google Research - Distributed Systems and Parallel Computing

• Designs, Lessons and Advice from Building Large Distributed Systems.pdf
• Building Software Systems At Google and Lessons Learned
• The Twelve-Factor App
• Notes on Distributed Systems for Young Bloods
• On Designing and Deploying Internet-Scale Services
• 4 Things to Keep in Mind When Building a Platform for the Enterprise
• Principles of Chaos Engineering
• Building Fast & Resilient Web Applications
• Designing For Resiliency Will Be So 2013
• Ten design principles for Azure applications
• Eventually Consistent
• Writing Code that Scales
• Automate and Abstract: Lessons from Facebook on Engineering for Scale

• Martin Fowler: Patterns of Distributed Systems

  Open/Close

  • Consistent Core
  • Generation Clock
  • Gossip Dissemination
  • Heart Beat
  • High-Water Mark
  • Low-Water Mark
  • Idempotent Receiver
  • Leader Follwers
  • Lease
  • Quorum
  • Request Pipeline
  • Segemented Log
  • Single Scoket Channel
  • Singular Update Queue
  • State Watch
  • Write-Ahead Log
  • Fixed Partitions TODO
  • Follower Reads TODO
  • Hybrid Clock TODO
  • Key And Value TODO
  • Lamport Clock TODO
  • Paxos TODO
  • Replicated Log
  • Request Batch TODO
  • Two Phase Commit TODO
  • Version Vector TODO
  • Versioned Value TODO

• MicroSoft Cloud Design Patterns

  Open/Close

  • Design and implementation

    • Ambassador
    • Anti-corruption Layer
    • Backends for Frontends
    • Command and Query Responsibility Segregation (CQRS)
    • Compute Resource Consolidation
    • External Configuration Store
    • Gateway Aggregation
    • Gateway Offloading
    • Gateway Routing
    • Leader Election
    • Pipes and Filters
    • Sidecar
    • Static Content Hosting
    • Strangler Fig

  • Management and monitoring

    • Ambassador
    • Anti-corruption Layer
    • External Configuration Store
    • Gateway Aggregation
    • Gateway Offloading
    • Gateway Routing
    • Health Endpoint Monitoring
    • Sidecar
    • Strangler Fig

  • Messaging

    • Anti-corruption Layer
    • Claim Check
    • Choreography
    • Competing Consumers
    • Pipes and Filters
    • Priority Queue
    • Publisher/Subscriber
    • Queue-Based Load Leveling
    • Scheduler Agent Supervisor
    • Sequential Convoy
    • Asynchronous Request-Reply

  • Data management

    • Cache-Aside
    • Command and Query Responsibility Segregation (CQRS)
    • Event Sourcing
    • Index Table
    • Materialized View
    • Sharding
    • Static Content Hosting
    • Valet Key
    • Saga

  • Performance and scalability

    • Cache-Aside
    • Choreography
    • Command and Query Responsibility Segregation (CQRS)
    • Event Sourcing
    • Deployment Stamps
    • Geodes
    • Index Table
    • Materialized View
    • Priority Queue
    • Queue-Based Load Leveling
    • Sharding
    • Static Content Hosting
    • Throttling

  • Availability

    • Deployment Stamps
    • Geodes
    • Health Endpoint Monitoring
    • Queue-Based Load Leveling
    • Throttling

  • Resiliency

    • Bulkhead
    • Circuit Breaker
    • Compensating Transaction
    • Health Endpoint Monitoring
    • Leader Election
    • Queue-Based Load Leveling
    • Retry
    • Scheduler Agent Supervisor

  • Security

    • Federated Identity
    • Gatekeeper
    • Valet Key

• AWS Cloud Pattern

• Google: Design patterns for container-based distributed systems.pdf

• A pattern language for microservices

• SOA Patterns

• 4 Architecture Issues When Scaling Web Applications: Bottlenecks, Database, CPU, IO
• Scaling Stateful Objects
• Scale Up vs Scale Out: Hidden Costs
• Best Practices for Scaling Out
• Scalability Worst Practices
• Reddit: Lessons Learned From Mistakes Made Scaling To 1 Billion Pageviews A Month
• Autoscaling Pinterest
• Square: Autoscaling Based on Request Queuing
• PayPal: Autoscaling Applications
• Trivago: Your Definite Guide For Autoscaling Jenkins
• Scryer: Netflix’s Predictive Auto Scaling Engine

• Consistent Hashing
• Consistent Hashing: Algorithmic Tradeoffs
• Distributing Content to Open Connect
• Consistent Hashing in Cassandra

• Life Beyond Distributed Transactions
• How Sharding Works
• Why you don’t want to shard
• How to Scale Big Data Applications.pdf
• MySQL Sharding with ProxySQL

• Cache update routine (CN)
• Design Of A Modern Cache
• Netflix: Caching for a Global Netflix
• Facebook: An analysis of Facebook photo caching
• How trivago Reduced Memcached Memory Usage by 50%
• Caching Internal Service Calls at Yelp

• Understanding When to use RabbitMQ or Apache Kafka
• Trello: Why We Chose Kafka For The Trello Socket Architecture
• LinkedIn: Running Kafka At Scale
• Should You Put Several Event Types in the Same Kafka Topic
• Billions of Messages a Day - Yelp’s Real-time Data Pipeline
• Uber: Building Reliable Reprocessing and Dead Letter Queues with Kafka
• Uber: Introducing Chaperone: How Uber Engineering Audits Kafka End-to-End
• Uber: Uber’s Real-Time Push Platform
• Publishing with Apache Kafka at The New York Times
• Kafka Streams on Heroku
• Salesforce: How Apache Kafka Inspired Our Platform Events Architecture
• Exactly-once Semantics are Possible: Here’s How Kafka Does it
• Delivering billions of messages exactly once
• Benchmarking Streaming Computation Engines at Yahoo!

• Using Logs to Build a Solid Data Infrastructure - Martin Kleppmann
• Building DistributedLog: High-performance replicated log service
• LogDevice: a distributed data store for logs

• Understand Latency
• Common Bottlenecks
• Performance is a Feature
• Make Performance Part of Your Workflow 📙 Designing for Performance
• CloudFlare: How we built rate limiting capable of scaling to millions of domains

• Instagram: Search Architecture
• eBay: The Architecture of eBay Search.pdf
• eBay: Improving Search Engine Efficiency by over 25%
• LinkedIn: Introducing LinkedIn’s new search architecture
• LinkedIn: Search Federation Architecture at LinkedIn
• Slack: Search at Slack
• DoorDash: Search and Recommendations at DoorDash
• Twitter: Building a complete Tweet index
• Pinterest: Manas: High Performing Customized Search System
• Sherlock: Near Real Time Search Indexing at Flipkart
• Airbnb: Nebula: Storage Platform to Build Search Backends

• YouTube Architecture
• Scaling Pinterest
• Google Architecture
• Scaling Twitter
• The WhatsApp Architecture
• Flickr Architecture
• Amazon Architecture
• Stack Overflow Architecture
• Pinterest Architecture
• Tumblr Architecture
• Instagram Architecture
• TripAdvisor Architecture
• Scaling Mailbox
• Salesforce Architecture
• ESPN's Architecture At Scale - Operating At 100,000 Duh Nuh Nuhs Per Second
• Uber Architecture
• Dropbox Design
• Splunk Architecture

• Martin Fowler: Microservices Guide

• Martin Fowler: Microservice Architecture

• AWS: What are Microservices?

• Microsoft: Microservices architecture style

• Pivotal: Microservices

• Uber: Introducing Domain-Oriented Microservice Architecture

• Uber: Designing Edge Gateway, Uber’s API Lifecycle Management Platform

• Microservice Architecture https://microservices.io

• 📙 IBM: Microservices Best Practices for Java.pdf

• 📙 Building MicroService

• Google: API Improvement Proposals

• Nginx

  • Introduction to Microservices
  • Building Microservices: Using an API Gateway
  • Building Microservices: Inter-Process Communication in a Microservices Architecture
  • Service Discovery in a Microservices Architecture
  • Event-Driven Data Management for Microservices
  • Choosing a Microservices Deployment Strategy
  • Refactoring a Monolith into Microservices

• Auto0 Blog

  • An Introduction to Microservices, Part 1
  • API Gateway. An Introduction to Microservices, Part 2
  • An Introduction to Microservices, Part 3: The Service Registry
  • Intro to Microservices, Part 4: Dependencies and Data Sharing
  • API Gateway: the Microservices Superglue

• Kubernetes api gateway
• Uber: Designing Edge Gateway, Uber’s API Lifecycle Management Platform
• Uber: The Architecture of API gateway
• Uber: Scaling of Uber’s API gateway

• 📙 Microservices vs. Service-Oriented Architecture

• DZone: Microservices vs. SOA

• DZone: Microservices vs. SOA - Is There Any Difference at All?

• Microservices, SOA, and APIs: Friends or enemies?

• PaaS vs. IaaS for Microservices Architectures: Top 6 Differences

• Microservices vs. Monolithic Architectures: Pros, Cons, and How Cloud Foundry (PaaS) Can Help

• Microservices - Not A Free Lunch!

• The Hidden Costs Of Microservices

• Mircroservcie with Spring-Boot
  • Part 1 - Getting Started with Microservices Architecture
  • Part 2 - Creating Forex Microservice
  • Part 3 - Creating Currency Conversion Microservice
  • Part 4 - Using Ribbon for Load Balancing
  • Part 5 - Using Eureka Naming Server

• The Hidden Costs Of Microservices
• Microservice Antipatterns and Pitfalls
• Microservice Architecture: All The Best Practices You Need To Kno
• Best Practices for Building a Microservice Architecture
• Simplicity by Distributing Complexity
• Effective Microservices: 10 Best Practices

• ForgeRock: Identity Gateway
• ForgeRock: Token Validation Microservice
• Bringing Token state consistency to the Edge

• Microservice Architecture and its 10 Most Important Design Patterns
  • Database per Microservice Event Sourcing CQRS Saga BFF API Gateway Strangler Circuit Breaker Externalize Configuration Consumer-Driven Contract Testing
• Modularity and Information Hiding.pdf
• Separation of Concern
• Service Oriented Architecture

• Architecting Cloud Native .NET Applications for Azure

This roadmap is highly inspired by course: https://time.geekbang.org/column/intro/48. Thanks Hao Chen.