Weekly system design newsletter: https://bit.ly/3tfAlYD

Checkout our bestselling System Design Interview books: 
Volume 1: https://amzn.to/3Ou7gkd
Volume 2: https://amzn.to/3HqGozy

Other things we made:
Digital version of System Design Interview books: https://bit.ly/3mlDSk9
Twitter: https://bit.ly/3HqEz5G
LinkedIn:  https://bit.ly/39h22JK

ABOUT US: 
Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.

System Design: Why is Kafka fast?

The Sidecar model is often used in Kubernetes deployments to add common tools like observability, service mesh and security into application pods.

eBPF is a kernel technology that lets us dynamically change the way that the kernel behaves - and it’s revolutionizing the way we instrument applications running under Kubernetes. Tools built with eBPF have the power to observe, secure and connect all the processes on a (virtual) machine, so there’s no need to inject a sidecar container into every pod.

Does eBPF mean we’ll be saying goodbye to sidecars? Attend this talk to find out!

PUBLICATION PERMISSIONS:
Original video was published with the Creative Commons Attribution license (reuse allowed). Link: https://www.youtube.com/watch?v=bnl25El7RYk

Hello eBPF! Goodbye Sidecars?

In this video we will explain how you can author a web application, host it on your laptop then expose it through the internet via port forwarding. We will explain the difference between private ip in Local Area network and Public IP, we will explain how routers have two IP addresses public and private IP. 

We will also do a live edit on my router configuration to do a port forwarding of port 8080 to my local laptop and even access that through my phone. 

-Hussein



Stay Awesome!
Hussein

Public IP vs. Private IP and Port Forwarding (Explained by Example)

Apache Kafka is a distributed stream processing software developed by LinkedIn and written in Scala and Java.  

Chapters 
0:00 Intro 
2:32 Kafka Broker
5:39 Kafka Producer
7:11 Kafka Consumer
8:34 Kafka Partitions
12:50 Queue vs Pub-Sub
16:47 Consumer Group
23:06 ZooKeeper
29:45 Coding Example
1:02:48 Kafka Pros-Cons
1:17:00 Summary

Download slides here 
https://payhip.com/b/Y0Cq
(Members get all slides for all my video courses for free)


In this video I want to focus on the basics of Kafka, talk about how it works give finally spin up a Kafka cluster and write a producer and a consumer. 

Kafka Components
_ producer
_consumer
_topic 
_partition
How Kafka works
Example ( Ride sharing ) 
Spin Kafka cluster 
Write a producer 
Write a consumer
Kafka Applications
Pros and Cons 



Source Code 
https://github.com/hnasr/javascript_playground/tree/master/kafka

Docker commands spin up kafka
//if you ever mess up or you want to start fresh just stop and remove the containers and rerun the command 

docker stop zookeeper kafka
docker rm zookeeper kafka

docker run --name zookeeper  -p 2181:2181 -d zookeeper


docker run -p 9092:9092 --name kafka  -e KAFKA_ZOOKEEPER_CONNECT=husseinmac:2181 -e KAFKA_ADVERTISED_LISTENERS=PLAINTEXT://husseinmac:9092 -e KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR=1 -d confluentinc/cp-kafka 

Get my fundamentals of database engineering course link redirects to udemy with coupon applied (https://database.husseinnasser.com)

Resources
 KIP 500 (Remove Zookeeper)
https://cwiki.apache.org/confluence/display/KAFKA/KIP-500%3A+Replace+ZooKeeper+with+a+Self-Managed+Metadata+Quorum
 
Become a Member on YouTube
https://www.youtube.com/channel/UC_ML5xP23TOWKUcc-oAE_Eg/join

🧑‍🏫 Courses I Teach
https://husseinnasser.com/courses 

🏭 Backend Engineering Videos in Order
https://backend.husseinnasser.com

💾 Database Engineering Videos
https://www.youtube.com/playlist?list=PLQnljOFTspQXjD0HOzN7P2tgzu7scWpl2

🎙️Listen to the Backend Engineering Podcast
https://husseinnasser.com/podcast 

Gears and tools used on the Channel (affiliates)

🖼️ Slides and Thumbnail Design 
Canva
https://partner.canva.com/c/2766475/647168/10068

🎙️ Mic Gear
Shure SM7B Cardioid Dynamic Microphone  
https://amzn.to/3o1NiBi

Cloudlifter
https://amzn.to/2RAeyLo

XLR cables
https://amzn.to/3tvMJRu

Focusrite Audio Interface
https://amzn.to/3f2vjGY


📷 Camera Gear
Canon M50 Mark II
https://amzn.to/3o2ed0c

Micro HDMI to HDMI 
https://amzn.to/3uwCxK3

Video capture card
https://amzn.to/3f34pyD

AC Wall for constant power
https://amzn.to/3eueoxP


Stay Awesome,
Hussein

Apache Kafka Crash Course

To get better at system design, subscribe to our weekly newsletter: https://bit.ly/3tfAlYD

Checkout our bestselling System Design Interview books: 
Volume 1: https://amzn.to/3Ou7gkd
Volume 2: https://amzn.to/3HqGozy

ABOUT US: 
Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.

What is API Gateway?

Weekly system design newsletter: https://bit.ly/3tfAlYD

Checkout our bestselling System Design Interview books: 
Volume 1: https://amzn.to/3Ou7gkd
Volume 2: https://amzn.to/3HqGozy

Other things we made:
Digital version of System Design Interview books: https://bit.ly/3mlDSk9
Twitter: https://bit.ly/3HqEz5G
LinkedIn:  https://bit.ly/39h22JK

Animation tools: Illustrator and After Effects

ABOUT US: 
Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.

System Design: Why is single-threaded Redis so fast?

TLS which stands for transport layer security is a protocol for securing communication between client and server. Specifically for HTTPS. Thats what the S is stands for. 

In this video, we will learnq how insecure vanilla HTTP works, HTTPS, then we will learn how HTTPS is possible via the transport layer security and finally we will talk about the improvements in 1.3 that was published August 2018. 


Chapters
0:00 Intro 
1:30 Vanilla HTTP
5:00 HTTPS
8:35 TLS 1.2
14:30 Diffie–Hellman
17:55 TLS 1.3


Vanilla HTTP
HTTPS 
TLS 1.2 handshake
TLS 1.3 enhancements
 

Vanilla HTTP 
Before we discuss TLS, HTTPS or anything else lets go through how HTTP request work. You can type in the browser www.husseinnasser.com , the OSI magic kicks in, client figures out the IP address of husseinnasser.com by calling the DNS which uses UDP. Then HTTP application layer makes a GET / request passes in the IP address and port 80 (default for insecure http). This creates an underlying TCP connection. GET / string among other stuff into the packet and send it over. TCP does its thing server receives GET / calls the appropriate process at the backend which could be just return index.html sets content type text/html and sends back big response for client. All of this obviously is plain text no encryption any kind and if you watched the OSI video we made you can tell that people can sniff/snoop packets and get packets they aren’t supposed to get


HTTPS
Works by negotiating a symmetric key so they can both secure messages. Watch the video we did on encryption. Before we jump to GET request there must be a handshake 🤝 that must occur between the client and server. The tricky part is exchanging that key. Same thing as above except port is 443 instead of 80. Remember once we lose the TCP connection we will have to renegotiate the key. But beauty of this is HTTP is stateless so it remains working just fine. 


Tls handshake 🤝 
The original TLS handshake involves 4 roundtrips. A client hello which the client includes which encryption algorithms it supports (Both symmteric and asymmetric). The server receives the request then replies back with the server certificate which includes the server public key and also the encryptions that they will change to. The client receives the server hello, generates the premaster key, encrypts it with the server’s public key then send it over. The Server decrypts the message, gets the premaster generates the symmetric key finally tells the client that we are good to go. 


Tls 1.3 
TLS 1.3 involves much shorter and much secure communication using only deffie hellman as key exchange and just two round trips. 


More Resources
https://www.cloudflare.com/learning-resources/tls-1-3/
https://blog.cloudflare.com/rfc-8446-aka-tls-1-3/


🏭 Software Architecture Videos
https://www.youtube.com/playlist?list=PLQnljOFTspQXNP6mQchJVP3S-3oKGEuw9

💾 Database Engineering Videos
https://www.youtube.com/playlist?list=PLQnljOFTspQXjD0HOzN7P2tgzu7scWpl2

🛰 Network Engineering Videos
https://www.youtube.com/playlist?list=PLQnljOFTspQUBSgBXilKhRMJ1ACqr7pTr

🏰 Load Balancing and Proxies Videos
https://www.youtube.com/playlist?list=PLQnljOFTspQVMeBmWI2AhxULWEeo7AaMC

🐘 Postgres Videos 
https://www.youtube.com/playlist?list=PLQnljOFTspQWGrOqslniFlRcwxyY94cjj

🧮 Programming Pattern Videos 
https://www.youtube.com/playlist?list=PLQnljOFTspQV1emqxKbcP5esAf4zpqWpe

🛡 Web Security Videos
https://www.youtube.com/playlist?list=PLQnljOFTspQU3YDMRSMvzflh_qXoz9zfv

🦠 HTTP Videos
https://www.youtube.com/playlist?list=PLQnljOFTspQU6zO0drAYHFtkkyfNJw1IO


🐍 Python Videos
https://www.youtube.com/playlist?list=PLQnljOFTspQU_M83ARz8mDdr4LThzkBKX

🔆 Javascript Videos 
https://www.youtube.com/playlist?list=PLQnljOFTspQWab0g3W6ZaDM6_Buh20EWM


Stay Awesome!
Hussein