https://amrmubarak.com Technical writing on distributed systems, databases, and software engineering en-us Sat, 25 Jul 2026 02:38:00 GMT https://amrmubarak.com/blog/database-migrations-at-scale https://amrmubarak.com/blog/database-migrations-at-scale Sun, 05 Jul 2026 00:00:00 GMT Database ## Why Migrations Break A migration that runs in 200ms on your local machine takes 30 minutes on the production table with 50 million rows. During those 30 minutes, your `ALTER TABLE` holds a lock t https://amrmubarak.com/blog/caching-in-production https://amrmubarak.com/blog/caching-in-production Sat, 04 Jul 2026 00:00:00 GMT System Design ## Why Caching Exists A single database query takes 5ms. A cache lookup takes 1ms. The difference seems small — but at 10,000 requests per second, that 4ms gap is 40 seconds of cumulative latency pe https://amrmubarak.com/blog/tcp-for-backend-engineers https://amrmubarak.com/blog/tcp-for-backend-engineers Tue, 21 Jul 2026 00:00:00 GMT Distributed Systems ## 1. What TCP Actually Is, and Why It Exists Start with the network underneath TCP, because that's the whole reason TCP exists. The internet moves data in packets, and the protocol that handles tha https://amrmubarak.com/blog/lsm-engine https://amrmubarak.com/blog/lsm-engine Wed, 06 May 2026 00:00:00 GMT Database Internals ## Where We Are In Part 1 we built a Write-Ahead Log. Every mutation — write or delete — is recorded to disk and fsynced before we acknowledge it to the caller. We have durability. What we do not h https://amrmubarak.com/blog/sstable https://amrmubarak.com/blog/sstable Wed, 06 May 2026 00:00:00 GMT Database Internals ## Where We Are Post 1 built the WAL — every write is fsynced to disk before being acknowledged. Post 2 built the memtable — an in-memory skip list that keeps keys sorted and serves reads in O(log n https://amrmubarak.com/blog/implementing-wal-in-go https://amrmubarak.com/blog/implementing-wal-in-go Mon, 04 May 2026 00:00:00 GMT Database Internals ## Implementing a Write-Ahead Log in Go A Write-Ahead Log is the mechanism behind the D in ACID. Before any mutation reaches your data files, a record describing that mutation is written and fsynced https://amrmubarak.com/blog/buildinga-load-balancer-in-go-part-1 https://amrmubarak.com/blog/buildinga-load-balancer-in-go-part-1 Sun, 03 May 2026 00:00:00 GMT System Design ## Introduction You have three backend servers. Each one can handle 1,000 requests per second. Together they can handle 3,000 — but only if requests are spread evenly across all three. Something ha https://amrmubarak.com/blog/buildinga-load-balancer-in-go-part-2 https://amrmubarak.com/blog/buildinga-load-balancer-in-go-part-2 Sun, 03 May 2026 00:00:00 GMT System Design ## Where We Left Off In Part 1 we built a reverse proxy that distributes requests across three backends using round robin. It works — but it is blind. Kill one of the backends and the load balancer https://amrmubarak.com/blog/implementing-job-queue-in-go https://amrmubarak.com/blog/implementing-job-queue-in-go Sat, 02 May 2026 00:00:00 GMT System Design ## Introduction Your API receives a request. You need to send a confirmation email, resize an image, call a third-party webhook, and update an analytics counter. You could do all of that synchronou https://amrmubarak.com/blog/write-ahead-logging-postgresql-crash-recovery-replication https://amrmubarak.com/blog/write-ahead-logging-postgresql-crash-recovery-replication Wed, 25 Mar 2026 00:00:00 GMT Database Internals ## Introduction Your application writes a row. PostgreSQL says "committed." The server loses power one millisecond later. When it comes back, is your row there? The answer is yes — and the reason https://amrmubarak.com/blog/concurrency-control-in-databases https://amrmubarak.com/blog/concurrency-control-in-databases Sat, 14 Mar 2026 00:00:00 GMT Database Internals ## Introduction Your application has one user. Concurrency is not a problem. That user reads data, writes data, nothing conflicts with anything. Then you have ten thousand users. Two of them update https://amrmubarak.com/blog/data-partitioning-distributed-databases https://amrmubarak.com/blog/data-partitioning-distributed-databases Thu, 12 Mar 2026 00:00:00 GMT Database Internals ## Introduction Your single database server handled your first 100,000 users just fine. Then you hit a million. Queries slowed down. Disk filled up. You threw more RAM at it. It helped — for a while https://amrmubarak.com/blog/btree https://amrmubarak.com/blog/btree Tue, 10 Mar 2026 00:00:00 GMT Database Internals ## Why B+ Trees Exist Your database has 50 million rows. You query by user ID. Without an index, the database reads every row until it finds yours. That's a full table scan. It gets slower with ever https://amrmubarak.com/blog/distributed-transactions https://amrmubarak.com/blog/distributed-transactions Fri, 28 Nov 2025 00:00:00 GMT Distributed Systems ## Why Single-Database Transactions Don't Scale A transaction in a single database is simple. You start a transaction, make changes, commit. Either everything commits or nothing does. The database h https://amrmubarak.com/blog/replication-strategies-in-distributed-databases https://amrmubarak.com/blog/replication-strategies-in-distributed-databases Wed, 26 Nov 2025 00:00:00 GMT Distributed Systems ## Why Replication Exists Your database will crash. Not maybe. It will. Hard drives fail, memory corrupts, someone runs the wrong command, power goes out. When that happens, you need another copy of https://amrmubarak.com/blog/inside-database-engine-how-data-is-stored https://amrmubarak.com/blog/inside-database-engine-how-data-is-stored Mon, 20 Oct 2025 00:00:00 GMT Database Internals ## Introduction Most developers understand SQL. Fewer understand what happens after the query planner finishes — how rows are physically laid out on disk, why certain writes cost more than others, w https://amrmubarak.com/blog/consistency-and-data-models-in-real-life-the-art-of-building-systems-that-never-lie-to-you https://amrmubarak.com/blog/consistency-and-data-models-in-real-life-the-art-of-building-systems-that-never-lie-to-you Fri, 17 Oct 2025 00:00:00 GMT Distributed Systems ## Introduction At some point you ship something that works perfectly in staging. The code is clean. The tests pass. You deploy it and feel good about it. Six months later you're debugging a produc https://amrmubarak.com/blog/acid-properties-and-isolation-levels-deep-dive-into-production-database-behavior https://amrmubarak.com/blog/acid-properties-and-isolation-levels-deep-dive-into-production-database-behavior Thu, 16 Oct 2025 00:00:00 GMT Database Internals ## Why This Matters in Production Every backend engineer has a story about a production incident that made ACID properties real. Maybe it was a race condition in a payment system that took hours to https://amrmubarak.com/blog/idempotency-in-production-making-your-system-safe-to-retry https://amrmubarak.com/blog/idempotency-in-production-making-your-system-safe-to-retry Thu, 16 Oct 2025 00:00:00 GMT System Design ## The Real Cost - What happens when you don't have idempotency Every backend engineer has experienced this: a user clicks a button, the request times out, they panic and click it again. Now somethi https://amrmubarak.com/blog/database-indexing-strategies https://amrmubarak.com/blog/database-indexing-strategies Tue, 14 Oct 2025 00:00:00 GMT Database Internals ## Introduction Your database has 50 million users. Someone searches by email. Without an index, the database reads every single row until it finds a match. That's a full table scan — and it gets sl