Discover in-depth
technical insights

Notes on system design, DevOps, and software engineering β€” written as I learn.

Deep Understanding of AI Large Language Models πŸ€–
AIMar 202510 min read

Deep Understanding of AI Large Language Models πŸ€–

Join us on a deep dive into the architecture, mathematics, and implementation of modern Large Language Models (LLMs)....

Token Embedding πŸ”’
AIMar 202510 min read

Token Embedding πŸ”’

Token embedding is the foundational step in any Natural Language Processing (NLP) pipeline. It involves converting di...

Text to Numbers πŸ”’
AIMar 202510 min read

Text to Numbers πŸ”’

Before an AI model can

10. Translating Between Tokenizers οΏ½οΏ½
AIMar 202510 min read

10. Translating Between Tokenizers οΏ½οΏ½

name=

Preparing Text for Tokens πŸ“–
AIMar 202510 min read

Preparing Text for Tokens πŸ“–

In real-world applications, data rarely arrives in a clean, perfectly formatted state. Before we can convert text to ...

Coding Challenge: Make a Tokenizer πŸ› οΈ
AIMar 202510 min read

Coding Challenge: Make a Tokenizer πŸ› οΈ

Now it

Coding Challenge: Tokenizing
AIMar 202510 min read

Coding Challenge: Tokenizing

In this challenge, we step up our game by processing a full-length book: H.G. Wells

5. Byte Pair Encoding (BPE) Concepts 🧬
AIMar 202510 min read

5. Byte Pair Encoding (BPE) Concepts 🧬

Byte Pair Encoding (BPE) is a cornerstone of modern NLP. It

Coding Challenge: Byte Pair Encoding (BPE) 🧬
AIMar 202510 min read

Coding Challenge: Byte Pair Encoding (BPE) 🧬

In this challenge, we implement a manual loop for Byte Pair Encoding (BPE). BPE is a subword tokenization method that...

GPT-4 Tokenizer
AIMar 202510 min read

GPT-4 Tokenizer

name=

BERT Tokenizer
AIMar 202510 min read

BERT Tokenizer

name=

9. CodeChallenge: BERT Character Counts 🧩
AIMar 202510 min read

9. CodeChallenge: BERT Character Counts 🧩

name=

Containers
DevOpsMar 202510 min read

Containers

- Containers provide a way of creating an isolated environment, sometimes called a sandbox, in which applications and...

JavaScript Interview Masterclass πŸš€
EngineeringMar 202510 min read

JavaScript Interview Masterclass πŸš€

This is a comprehensive guide to JavaScript interview questions, mirrored directly from the Top JavaScript Interview ...

πŸ“š JavaScript Complete Refresher
EngineeringMar 202510 min read

πŸ“š JavaScript Complete Refresher

---

React Interview Masterclass βš›οΈ
EngineeringMar 202510 min read

React Interview Masterclass βš›οΈ

This is a comprehensive guide to React interview questions, mirrored directly from the Top React Interview Questions ...

βš›οΈ React Complete Refresher
EngineeringMar 202510 min read

βš›οΈ React Complete Refresher

---

Git Basics
DevOpsMar 202510 min read

Git Basics

- Version control is a system that records changes to a file or set of files over time so that you can recall specifi...

Git Branches
DevOpsMar 202510 min read

Git Branches

What is the use of Branches?

Git for Professionals
DevOpsMar 202510 min read

Git for Professionals

- File staging helps in better commits, (easier to manage, review code and adding commit messages).

Configuration Management
DevOpsMar 202510 min read

Configuration Management

- It helps to maintain infrastructure using software (like providing resources)

Pod
DevOpsMar 202510 min read

Pod

- Pods are the smallest deployable units of computing that you can create and manage in Kubernetes.

Worker Node
DevOpsMar 202510 min read

Worker Node

A Kubernetes cluster consists of a set of worker machines, called nodes, that run containerized applications.

Please edit the object below. Lines beginning with a
DevOpsMar 202510 min read

Please edit the object below. Lines beginning with a

Minikube is a single node k8s cluster which can be run on virtual box in local machine (used for testing purposes).

Kubernetes Configuration File
DevOpsMar 202510 min read

Kubernetes Configuration File

Each configuration file has 3 parts:

Mongo Express K8s Cluster
DevOpsMar 202510 min read

Mongo Express K8s Cluster

$ kubectl get all

Intro
AIMar 202510 min read

Intro

- Code has zero autonomy and is 100% deterministic

Elements
AIMar 202510 min read

Elements

- The State is a shared data Structure that holds current information or context of an application.

Drafter Agent πŸ“
AIMar 202510 min read

Drafter Agent πŸ“

- Our company is not working efficiently! We spend way too much time writing emails and documents and this need to be...

Reflection Agent 🧠
AIMar 202510 min read

Reflection Agent 🧠

1. Basic Reflection Agents

Reflexion Agent 🧠
AIMar 202510 min read

Reflexion Agent 🧠

Reflection Agent System consists of a generator and a reflector component

Hello World Graph 🌍
AIMar 202510 min read

Hello World Graph 🌍

1. Understand and define the AgentState structure

Multiple Input Graph πŸ”’
AIMar 202510 min read

Multiple Input Graph πŸ”’

1. Define a more complex AgentState

Sequential Graph ♾️
AIMar 202510 min read

Sequential Graph ♾️

1. Create multiple Nodes that sequentially process and update different parts of the state.

Conditional Graph 🚧
AIMar 202510 min read

Conditional Graph 🚧

1. Implement conditional logic to route the flow of data to different nodes.

Looping Graph 🌌
AIMar 202510 min read

Looping Graph 🌌

1. Implement looping logic to route the flow of data to different nodes.

Simple Bot Agent πŸ€–
AIMar 202510 min read

Simple Bot Agent πŸ€–

1. Define state structure with a list of Human Message objects.

Chatbot Agent 🧠
AIMar 202510 min read

Chatbot Agent 🧠

1. Use different message types - HumanMessage and AIMessage.

ReAct Agent πŸ“±
AIMar 202510 min read

ReAct Agent πŸ“±

Think

MERN Stack Tutorial
EngineeringMar 202510 min read

MERN Stack Tutorial

This includes Repository includes my personal notes, and cover important topics that you need to know about MERN stac...

Node JS
EngineeringMar 202510 min read

Node JS

- Node JS Installer

Express JS
EngineeringMar 202510 min read

Express JS

Docs : https://expressjs.com/en/guide/routing.html

Mongo DB
EngineeringMar 202510 min read

Mongo DB

- MongoDB is a source-available cross-platform document-oriented database program.

RESTful API
EngineeringMar 202510 min read

RESTful API

Mozzila Docs

Rust
LanguagesMar 202510 min read

Rust

Rust is a general-purpose programming language emphasizing performance, type safety, and concurrency. It enforces mem...

Introduction
LanguagesMar 202510 min read

Introduction

fn main() {

Traits
LanguagesMar 202510 min read

Traits

pub struct NewsArticle {

Lifetimes
LanguagesMar 202510 min read

Lifetimes

- A dangling reference is a pointer that references a location in memory that may have been given to someone else, or...

Testing
LanguagesMar 202510 min read

Testing

- create a new library project named adder.

Mini Grep CLI
LanguagesMar 202510 min read

Mini Grep CLI

use std::env;

Closures
LanguagesMar 202510 min read

Closures

- Clousures are like functions, expect that are anonymous that can be stored at variables

Iterators
LanguagesMar 202510 min read

Iterators

- Iterators are provided by the standard library

Smart Pointer
LanguagesMar 202510 min read

Smart Pointer

- A pointer is a variable that stores the memory address, which points to any other data in the memory.

Concurrency
LanguagesMar 202510 min read

Concurrency

- Concurrency programming is different parts of your program executes

Programming Concepts
LanguagesMar 202510 min read

Programming Concepts

fn main() {

Memory Management
LanguagesMar 202510 min read

Memory Management

Ways to manage memory:

Structs
LanguagesMar 202510 min read

Structs

- Allows grouping related data of different types

Enums
LanguagesMar 202510 min read

Enums

- Enums are a way to define a type by enumerating a list of variants.

Module System
LanguagesMar 202510 min read

Module System

- cargo new creates a new package

Vectors
LanguagesMar 202510 min read

Vectors

fn main() {

Error Handling
LanguagesMar 202510 min read

Error Handling

- Rust has a robust error handling system

Generics
LanguagesMar 202510 min read

Generics

- Generics are a way to define functions, structs, enums, and methods that work with any type

SQL for Data Analytics πŸ“Š
LanguagesMar 202510 min read

SQL for Data Analytics πŸ“Š

Welcome to the comprehensive guide on using SQL for data analytics. This series covers everything from the basics of ...

Page 1: Introduction β€” Why SQL Is the Analyst
LanguagesMar 202510 min read

Page 1: Introduction β€” Why SQL Is the Analyst

SQL is the cornerstone of data analysis. While newer tools and languages emerge, SQL remains the universal language o...

Page 2: Preparing Your Data β€” The Foundation of Good Analysis πŸ—οΈ
LanguagesMar 202510 min read

Page 2: Preparing Your Data β€” The Foundation of Good Analysis πŸ—οΈ

The quality of your analysis is directly proportional to the quality of your data. Data preparation, often called

Page 3: Time Series Analysis β€” Tracking Trends Over Time πŸ“ˆ
LanguagesMar 202510 min read

Page 3: Time Series Analysis β€” Tracking Trends Over Time πŸ“ˆ

Time is perhaps the most important dimension in any analytical model. Understanding how metrics evolve over days, mon...

Page 4: Cohort Analysis β€” Understanding Groups Over Time πŸ‘₯
LanguagesMar 202510 min read

Page 4: Cohort Analysis β€” Understanding Groups Over Time πŸ‘₯

A cohort is a group of users who share a common characteristic over a specified period. The most common cohort is bas...

Page 5: Text Analysis with SQL β€” Mining Meaning from Words πŸ“
LanguagesMar 202510 min read

Page 5: Text Analysis with SQL β€” Mining Meaning from Words πŸ“

While SQL isn

Page 6: Anomaly Detection β€” Finding What Doesn
LanguagesMar 202510 min read

Page 6: Anomaly Detection β€” Finding What Doesn

Anomaly detection is the process of identifying data points that deviate significantly from the

Page 7: Experiment Analysis β€” Testing Hypotheses with SQL πŸ§ͺ
LanguagesMar 202510 min read

Page 7: Experiment Analysis β€” Testing Hypotheses with SQL πŸ§ͺ

A/B testing is how modern companies make decisions. While statisticians use specialized tools, the core data for expe...

Page 8: Building Complex Data Sets β€” Advanced SQL Techniques βš™οΈ
LanguagesMar 202510 min read

Page 8: Building Complex Data Sets β€” Advanced SQL Techniques βš™οΈ

As projects grow, your SQL becomes more complex. Maintaining readability, performance, and accuracy requires moving b...

Large Scale Deployment πŸš€
EngineeringMar 202510 min read

Large Scale Deployment πŸš€

Deployment is not a one-time activity; it is a continuous process of delivering value through upgrades and bug fixes....

System Design πŸ—οΈ
EngineeringMar 202510 min read

System Design πŸ—οΈ

Master the core concepts of scalable, reliable, and efficient system design.

Software Architecture Patterns πŸ—οΈ
EngineeringMar 202510 min read

Software Architecture Patterns πŸ—οΈ

Software architecture is the high-level structure of a software system. It defines the components, their relationship...

Event-Driven Architecture (EDA)
EngineeringMar 202510 min read

Event-Driven Architecture (EDA)

Event-Driven Architecture (EDA) is a software design pattern where decoupled components communicate through events ra...

Microservices Architecture πŸš€
EngineeringMar 202510 min read

Microservices Architecture πŸš€

Microservices architecture is a software design pattern where applications are structured as a collection of small, l...

Multi-Tier Architecture
EngineeringMar 202510 min read

Multi-Tier Architecture

Multi-Tier Architecture is a software design pattern that structures applications into multiple physical or logical l...

Design a Chat Application (WhatsApp) πŸ’¬
EngineeringMar 202510 min read

Design a Chat Application (WhatsApp) πŸ’¬

Designing a real-time chat application requires handling millions of persistent connections, ensuring sub-second mess...

Design a News Feed (aka Twitter) πŸ“±
EngineeringMar 202510 min read

Design a News Feed (aka Twitter) πŸ“±

A news feed is a constantly updating list of posts and updates from people you follow. It is the core feature of plat...

Design a Notification System πŸ””
EngineeringMar 202510 min read

Design a Notification System πŸ””

A notification system delivers critical updatesβ€”like messages, shipping alerts, or security codesβ€”across multiple cha...

Design a Ticketing System (BookMyShow) 🎟️
EngineeringMar 202510 min read

Design a Ticketing System (BookMyShow) 🎟️

A ticketing system is a high-concurrency platform that allows users to browse, book, and manage tickets for massive e...

Design a URL Shortener (TinyURL) πŸ”—
EngineeringMar 202510 min read

Design a URL Shortener (TinyURL) πŸ”—

A URL shortening service converts long URLs into short, unique links for easy sharing and tracking.

Networking & Communication 🌐
EngineeringMar 202510 min read

Networking & Communication 🌐

Explore the fundamentals of how systems communicate over a network, from basic client-server models to advanced globa...

What is the Client-Server Model?
EngineeringMar 202510 min read

What is the Client-Server Model?

The client-server model is a computing model where clients request services and servers provide them. This is the fou...

Networking Basics & IP Addresses
EngineeringMar 202510 min read

Networking Basics & IP Addresses

Networking is the backbone of any distributed system. Every system relies on data exchange between components to enab...

DNS in Distributed Systems
EngineeringMar 202510 min read

DNS in Distributed Systems

DNS (Domain Name System) is the

Communication Patterns
EngineeringMar 202510 min read

Communication Patterns

Understanding how data travels between systems is crucial for designing scalable applications.

What is a Proxy?
EngineeringMar 202510 min read

What is a Proxy?

A proxy is an intermediary server that acts as a gateway between a client and another server (usually on the internet...

Load Balancing
EngineeringMar 202510 min read

Load Balancing

Load balancing is the process of distributing incoming network traffic across multiple backend servers to ensure effi...

API Gateway
EngineeringMar 202510 min read

API Gateway

An API Gateway is a server that acts as an intermediary between clients and backend services. It serves as a <Highlig...

Content Delivery Networks (CDNs)
EngineeringMar 202510 min read

Content Delivery Networks (CDNs)

A Content Delivery Network (CDN) is a globally distributed network of servers that work together to deliver internet ...

System Performance: Speed, Capacity & Efficiency ⚑
EngineeringMar 202510 min read

System Performance: Speed, Capacity & Efficiency ⚑

Performance is a multi-dimensional goal. It

Caching for Speed & Optimization 🚰
EngineeringMar 202510 min read

Caching for Speed & Optimization 🚰

Caching is the technique of storing frequently accessed data in a faster storage layer (usually in-memory) to reduce ...

Concurrency & Parallelism 🧡
EngineeringMar 202510 min read

Concurrency & Parallelism 🧡

In modern system design, the terms Concurrency and Parallelism are often used interchangeably, but they represent two...

Database Performance Optimization πŸ—„οΈ
EngineeringMar 202510 min read

Database Performance Optimization πŸ—„οΈ

Optimizing database performance is a critical task in system design. As data grows, the way we store, retrieve, and m...

Performance Measurement: SLAs, SLOs & Percentiles πŸ“Š
EngineeringMar 202510 min read

Performance Measurement: SLAs, SLOs & Percentiles πŸ“Š

To optimize performance, you must first be able to measure it accurately. Averages are often misleading in distribute...

Messaging & Queues for Decoupling πŸ“¬
EngineeringMar 202510 min read

Messaging & Queues for Decoupling πŸ“¬

In distributed systems, components often need to communicate without being tightly coupled. Asynchronous messaging al...

Performance Testing & Monitoring πŸ”
EngineeringMar 202510 min read

Performance Testing & Monitoring πŸ”

Performance isn

Network Protocols πŸ“‘
EngineeringMar 202510 min read

Network Protocols πŸ“‘

Protocols are the sets of rules that govern how data is transmitted across a network. Explore the fundamental protoco...

TCP vs. UDP: The Core Protocols
EngineeringMar 202510 min read

TCP vs. UDP: The Core Protocols

---

Introduction to HTTP
EngineeringMar 202510 min read

Introduction to HTTP

---

REST & RESTful API Design
EngineeringMar 202510 min read

REST & RESTful API Design

---

Introduction to Real-Time Communication
EngineeringMar 202510 min read

Introduction to Real-Time Communication

---

Modern API Protocols: Beyond REST
EngineeringMar 202510 min read

Modern API Protocols: Beyond REST

---

System Reliability πŸ›‘οΈ
EngineeringMar 202510 min read

System Reliability πŸ›‘οΈ

Reliability is the ability of a system to operate continuously without failure for a specified period and under certa...

Backup & Recovery πŸ’ΎπŸ”„
EngineeringMar 202510 min read

Backup & Recovery πŸ’ΎπŸ”„

No matter how highly available or fault-tolerant a system is, data loss can still occur due to extreme circumstances....

Disaster Recovery (DR) πŸŒͺοΈπŸ›‘οΈ
EngineeringMar 202510 min read

Disaster Recovery (DR) πŸŒͺοΈπŸ›‘οΈ

While High Availability (HA) keeps the system running through minor failures (like a single server crash), Disaster R...

High Availability, Fault Tolerance & Failover πŸ›οΈ
EngineeringMar 202510 min read

High Availability, Fault Tolerance & Failover πŸ›οΈ

Building a reliable system at scale requires achieving High Availability (HA) and Fault Tolerance. This ensures that ...

Scalability in System Design πŸ“ˆ
EngineeringMar 202510 min read

Scalability in System Design πŸ“ˆ

Scalability is the ability of a system to handle an increasing amount of work, or its potential to accommodate growth...

Autoscaling: The Elastic Power of Cloud ☁️
EngineeringMar 202510 min read

Autoscaling: The Elastic Power of Cloud ☁️

Autoscaling is the automatic adjustment of compute resources based on real-time load. It ensures that your applicatio...

Load Balancing: The Traffic Controller βš–οΈ
EngineeringMar 202510 min read

Load Balancing: The Traffic Controller βš–οΈ

Load balancing is the critical process of distributing incoming network traffic across a group of backend servers, al...

Scaling Strategies: Horizontal, Vertical & Diagonal πŸš€
EngineeringMar 202510 min read

Scaling Strategies: Horizontal, Vertical & Diagonal πŸš€

Choosing the right scaling strategy is one of the most important decisions in system design. It determines how your a...

Authentication & Authorization πŸ”’πŸ”‘
EngineeringMar 202510 min read

Authentication & Authorization πŸ”’πŸ”‘

In any distributed system, the first line of defense is ensuring that users are who they say they are (Authentication...

Data Protection & Secure Communication πŸ”πŸ“‘
EngineeringMar 202510 min read

Data Protection & Secure Communication πŸ”πŸ“‘

In a world of constant data breaches and strict regulations (GDPR, HIPAA), protecting data at every stage of its life...

Network & Infrastructure Security 🌐🧱
EngineeringMar 202510 min read

Network & Infrastructure Security 🌐🧱

Building a secure distributed system requires more than just encrypting data and checking passwords. You must also pr...

Storage Basics: The Foundation of Data πŸ—„οΈ
EngineeringMar 202510 min read

Storage Basics: The Foundation of Data πŸ—„οΈ

In system design, storage is not just about

The CAP Theorem: Balancing Distributed Data βš–οΈ
EngineeringMar 202510 min read

The CAP Theorem: Balancing Distributed Data βš–οΈ

In any distributed system, you can only fully guarantee two out of the following three properties at any given time. ...

Database Scaling, Replication & Sharding πŸš€
EngineeringMar 202510 min read

Database Scaling, Replication & Sharding πŸš€

As applications grow from thousands to millions of users, a single database server becomes a bottleneck. To handle ma...

Distributed File Systems & Big Data 🌏
EngineeringMar 202510 min read

Distributed File Systems & Big Data 🌏

A File System defines how data is stored and retrieved on disk. While traditional systems (like NTFS or ext4) are gre...

Object Storage: Scalable Data for the Modern Web πŸ“¦
EngineeringMar 202510 min read

Object Storage: Scalable Data for the Modern Web πŸ“¦

Object Storage is a storage architecture that manages data as discrete units called

SQL vs. NoSQL: Choosing the Right Database πŸ—„οΈ
EngineeringMar 202510 min read

SQL vs. NoSQL: Choosing the Right Database πŸ—„οΈ

A database is a structured way to store, retrieve, and manage data. It is a core component of backend systems, servin...

Linux & Terminal Commands
DevOpsMar 202510 min read

Linux & Terminal Commands

A shell is a command-line interface which allows to perform certain tasks using command

Should you start a startup                           ?
StartupMar 202510 min read

Should you start a startup ?

Should You Start A Startup? | Startup School

How to Get and Evaluate Startup Ideas ?
StartupMar 202510 min read

How to Get and Evaluate Startup Ideas ?

How to Get and Evaluate Startup Ideas | Startup School

Startup Business Models and Pricing
StartupMar 202510 min read

Startup Business Models and Pricing

Startup Business Models and Pricing | Startup School

How to get First Customers
StartupMar 202510 min read

How to get First Customers

How to Get Your First Customers | Startup School

How to build an MVP
StartupMar 202510 min read

How to build an MVP

βœ… β€œLaunch Quickly, then Iterate”

The Best Way to Launch your Startup
StartupMar 202510 min read

The Best Way to Launch your Startup

The Best Way To Launch Your Startup | Startup School

Tips for Technical Startup Founders
StartupMar 202510 min read

Tips for Technical Startup Founders

- Evolve into leading a small team of engineers

Β© 2026 Driptanil Datta. All rights reserved.

Software Developer & Engineer

Disclaimer:The content provided on this blog is for educational and informational purposes only. While I strive for accuracy, all information is provided "as is" without any warranties of completeness, reliability, or accuracy. Any action you take upon the information found on this website is strictly at your own risk.

Copyright & IP:Certain technical content, interview questions, and datasets are curated from external educational sources to provide a centralized learning resource. Respect for original authorship is maintained; no copyright infringement is intended. All trademarks, logos, and brand names are the property of their respective owners.

System Operational

Built with Love ❀️ | Last updated: Mar 16 2026