Designing Software Architecture

Why Developer To Architect? 3  min

What does it cover? 4  min

Who is the author? 2  min

System performance 2  min

A reference software system for discussion 2  min

Performance improvement demonstration setup 21  min demo 

Performance of a system 3  min

Performance problems 6  min

Performance principles 12  min

System performance objectives 5  min

Performance measurement metrics 11  min

Serial request latency 1  min

Network transfer latency 6  min

Minimizing network transfer latency 9  min

Memory access latency 3  min

Minimizing memory access latency 7  min

Disk access latency 1  min

Minimizing disk access latency 20  min

CPU processing latency 7  min

Minimizing CPU processing latency 10  min

Some common latency figures 12  min

Performance improvement of a serial request 39  min demo 

Concurrent related latency 1  min

Amdahl's law for concurrent tasks 13  min

Gunther's universal scalability law 7  min

Shared resource contention 9  min

Minimizing shared resource contention 19  min

Minimizing locking related contention 10  min

Pessimistic Locking 6  min

Optimistic Locking 11  min

Compare and swap mechanism 10  min

Deadlocks 11  min

Coherence related delays 10  min

Performance improvement for concurrent requests 20  min demo 

Throughput improvement by saturating capacity utilization 14  min demo 

Caching 1  min

System architecture for performance 4  min

Caching for performance 5  min

HTTP Caching of static data 14  min

Caching of dynamic data 12  min

Caching related challenges 15  min

Summary 5  min

Contents overview 2  min

Performance vs Scalability 5  min

Vertical & Horizontal scalability 6  min

Reverse proxy 5  min

System for scalability discussion 1  min

System scalability demonstration setup 11  min demo 

Scalability principles 5  min

Modularity for scalability 3  min

Replication 5  min

Stateful replication in web applications 13  min

Stateless replication in web applications 6  min

Stateless replication of services 3  min

Database replication 5  min

Database replication types 20  min

Need for specialized services 5  min

Specialized services - SOAP/REST 9  min

Asynchronous services 8  min

Asynchronous processing & scalability 8  min

Caching for scalability 4  min

Vertical partitioning with micro-services 7  min

Database partitioning 16  min

Database partitioning selection 10  min

Routing with database partitioning 4  min

Methods for horizontal scalability 3  min

Dealing with large scale systems 1  min

Load balancing multiple instances 5  min

Discovery service and load balancing 9  min

Load balancer discovery 3  min

HLB vs SLB 5  min

Layer-7 load balancers 5  min

DNS as load balancer 7  min

Global server load balancing 6  min

Global data replication 6  min

Auto scaling instances 6  min

Micro-Services Architecture 1  min

Micro-Services Motivation 6  min

Service Oriented Architecture 12  min

Micro-Services Architecture Style 18  min

Transactions in Micro-Services 20  min

Compensating Transactions - SAGA Pattern 20  min

Micro-services communication model 20  min

Event driven transactions 20  min

Extreme scalability with NoSQL and Kafka 20  min

Scaling up large scale systems - Part 1 20  min demo 

Scaling up large scale systems - Part 2 19  min demo 

Summary 4  min

System Reliability 2  min

Distributed system failures 6  min

Partial system failures 5  min

System reliability demonstration setup 5  min demo 

Reliability engineering 1  min

Reliability 3  min

Availability 3  min

High Availability 4  min

Fault Tolerance 2  min

Designing Fault Tolerance 1  min

Fault tolerant design 1  min

Redundancy 4  min

Types of redundancy 6  min

Single point of failures 3  min

Stateless single point of failure 4  min

Stateful single point of failure 15  min

Load balancer as SPOF 2  min

Datacentre infrastructure as SPOF 2  min

Creating datacenter redundancy 11  min

Fault detection 1  min

Fault models 3  min

Health checks 3  min

External monitoring service 7  min

Internal cluster monitoring 8  min

Fault detection in a system 2  min

Recovering from failures 1  min

Stateless component recovery 3  min

Stateful component recovery 9  min

Load Balancer high availability 1  min

Database recovery with hot standby 5  min

Database recovery with warm standby 6  min

Database recovery with cold backups 6  min

High Availability in a large scale system 12  min

Failover best practices 2  min

System stability 1  min

Timeouts 5  min

Retries 11  min

Circuit Breaker 4  min

Fail Fast and Shed Load 5  min

Making a large scale system reliable - Part 1 25  min demo 

Making a large scale system reliable - Part 2 25  min demo 

Making a large scale system reliable - Part 3 16  min demo 

Summary 4  min

System Security 2  min

Security objectives 8  min

System security demonstration setup 11  min demo 

Network security 1  min

Symmetric key encryption 4  min

Public key encryption 11  min

Secure network protocol 6  min

SSL and TLS 3  min

Hashing 4  min

Digital signatures 7  min

Digital certificates 7  min

Chain of trust 4  min

TLS/SSL handshake 5  min

Secure network channel 3  min

Firewalls 5  min

Network security 5  min

Identity management 1  min

Authentication and authorization 2  min

Authentication 1  min

Credentials transfer 11  min

Credentials storage & verification 9  min

Stateful authentication 8  min

Stateless authentication 8  min

Single Sign-On 3  min

Access management 1  min

Role based access control 8  min

Role based access example 5  min

Authorization 7  min

OAuth2 token grant 7  min

OAuth2 token grant - Code Flow 9  min

OAuth2 token grant - Password Flow 2  min

OAuth2 in a system 3  min

OAuth2 token types 11  min

Token storage 6  min

Json Web Tokens 7  min

Securing data at rest 12  min

Securing a software system 5  min

Common vulnerabilities 1  min

SQL Injection 6  min

Cross Site Scripting 6  min

Cross Site Resource Forgery 9  min

Making a system secure - Part 1 20  min demo 

Making a system secure - Part 2 20  min demo 

Making a system secure - Part 3 20  min demo 

Making a system secure - Part 4 19  min demo 

Summary 2  min

System Deployment 3  min

Large scale deployments 1  min

Application deployment 3  min

Infrastructure deployment 4  min

System operations 6  min

Modern deployment solutions 1  min

System deployment demonstration setup 2  min demo 

Application deployment 1  min

Component deployment 3  min

Component deployment automation 4  min

Deployment with virtual machines 9  min

Isolation through virtual machines 4  min

Deployment with containers 6  min

Docker containers 6  min

Infrastructure deployment 1  min

Infrastructure requirements 2  min

Provisioning and configuration 3  min

Deployment with containers on Cloud 3  min

Deployment with Cloud Stack 8  min

Deployment with Kubernetes 1  min

Kubernetes lifecycle management 2  min

Kubernetes naming and addressing 3  min

Kubernetes scaling with multiple instances 2  min

Kubernetes load balacing 2  min

Kubernetes high availability 1  min

Kubernetes rolling upgrades 3  min

Kubernetes capabilities 4  min

Kubernetes deployment 5  min

Kubernetes services and workloads 4  min

Kubernetes architecture 10  min

System upgrades 1  min

Rolling updates 3  min

Canary deployment 2  min

Recreate deployment 1  min

Blue Green deployment 2  min

A/B testing 3  min

System deployment demonstration setup details 6  min demo 

Kubernetes Configuration Details - Part 1 30  min demo 

Kubernetes Configuration Details - Part 2 24  min demo 

Kubernetes cluster creation for system deployment 18  min demo 

Deploying system on Kubernetes cluster - Part 1 25  min demo 

Deploying system on Kubernetes cluster - Part 2 25  min demo 

Deploying system on Kubernetes cluster - Part 3 18  min demo 

Summary 2  min

Introduction 4  min

Reference system 2  min

Web applications 3  min

Web application solutions 3  min

Apache webserver 6  min

Apache webserver architecture 6  min

Apache webServer scalability 5  min

Nginx webserver 1  min

Nginx architecture 10  min

Nginx as reverse proxy and cache 5  min

Web Containers & Spring Framework 6  min

Jetty & Spring 3  min

Node.JS 4  min

Node.JS event loop 12  min

Cloud solutions for web 14  min

Cloud storage 6  min

Cloud CDN 7  min

Services 3  min

Services solutions 2  min

Memcached 5  min

Memcached architecture 14  min

Redis cache & architecture 8  min

Cloud caching solutions 2  min

RabbitMQ 15  min

RabbitMQ architecture 12  min

Kafaka architecture 18  min

Redis Pub/Sub 10  min

Cloud MQ solutions 4  min

Datastores 2  min

Datastore solutions 2  min

RDBMS 10  min

RDBMS scalability architecture 8  min

NoSQL objectives & trade-offs 11  min

Amazon DynamoDB 9  min

DynamoDB architecture 11  min

Google BigTable 16  min

BigTable architecture 15  min

HBase 3  min

Cassandra 15  min

Cassandra features 5  min

MongoDB 6  min

MongoDB architecture 8  min

Analytics 4  min

Analytics solutions 2  min

Logstash architecture 14  min

Logstash data streaming architecture 10  min

Fluentd 8  min

Elasticsearch 18  min

Elasticsearch architecture 17  min

Hadoop HDFS 11  min

Map-Reduce 22  min

Apache Spark 10  min

Stream processing 12  min

Summary 11  min

Download Code

Create account on AWS 11  min aws 

Create EC2 VM instance for build 16  min aws 

Download codebase and install software 9  min aws 

Build system components Docker images 8  min aws 

Run and test system using Docker images 17  min aws 

Push Docker images into ECR service 15  min aws 

Create IAM roles for Kubernetes deployment on EKS service 8  min aws 

Create Kubernetes Cluster and Node Group on EKS service 7  min aws 

Deploy the system on EKS Cluster - Part 1 20  min aws 

Deploy the system on EKS Cluster - Part 2 22  min aws 

System shut down and AWS resource clean up 8  min aws 

Create GCP account and a project 5  min gcp 

Create compute VM instance and download codebase for build 12  min gcp 

Install software and build Docker images 9  min gcp 

Run and test system using Docker images 23  min gcp 

Push Docker images to GCR 14  min gcp 

Create Snapshot backup of build instance 9  min gcp 

Create Kubernetes Cluster on GKE 17  min gcp 

Deploy system on Kubernetes Cluster on GKE 23  min gcp 

System shutdown and GCP resource clean up 11  min gcp