01 / LEARNTECHNICAL KNOWLEDGE INDEX

UNDERSTAND
THE FUNDAMENTALS.

Explore structured explanations across AI, machine learning, mathematics, algorithms, computer science, and systems. Understand the ideas, visualize how they behave, and implement them from first principles.

KNOWLEDGE GRAPHSYS.01
RELATIONS // 12
MATH04STATS05ALGO06ML01DL02CS07RL03SYS08
Active Node // 01ML — Empirical Loss & Voronoi
4 Links
02 //PRIMARY KNOWLEDGE DOMAINS

LEARNING DOMAINS

Eight foundational disciplines. Hover over any domain card to inspect its internal structure and subtopics.

01 //24 CONCEPTS

MACHINE LEARNING

From statistical foundations to practical learning algorithms and optimization.

DOMAIN STRUCTURE:
Supervised Learning
Unsupervised Clustering
Loss Surfaces & Optimization
Generalization & Bounds
Explore
02 //18 CONCEPTS

DEEP LEARNING

Neural networks, representation learning, optimization, and modern deep architectures.

DOMAIN STRUCTURE:
Computational Graphs
Backpropagation & Gradients
Attention & Transformers
Diffusion & Generative SDEs
Explore
03 //7 CONCEPTS

REINFORCEMENT LEARNING

Learning through actions, rewards, environments, and sequential decision making.

DOMAIN STRUCTURE:
Markov Decision Processes
Bellman Optimality
Policy Gradients & PPO
Deep Q-Networks
Explore
04 //31 CONCEPTS

MATHEMATICS

Linear algebra, multivariable calculus, probability, and optimization theory.

DOMAIN STRUCTURE:
Spectral Theory & Eigenvalues
Vector Spaces & Tensors
Matrix Calculus
Convex Optimization
Explore
05 //15 CONCEPTS

STATISTICS

Probability, distributions, inference, estimation, and statistical reasoning.

DOMAIN STRUCTURE:
Gaussian & Exponential Families
Maximum Likelihood Estimation
Bayesian Inference
Hypothesis Testing
Explore
06 //22 CONCEPTS

ALGORITHMS

Data structures, computational complexity, graphs, and algorithmic problem solving.

DOMAIN STRUCTURE:
Graph Partitioning
Dynamic Programming
Amortized Analysis
Randomized Algorithms
Explore
07 //14 CONCEPTS

COMPUTER SCIENCE

Core computational models, automata theory, and foundational systems theory.

DOMAIN STRUCTURE:
Turing Computability
Type Systems & Lambda Calculus
Memory Hierarchies
Concurrency Semantics
Explore
08 //19 CONCEPTS

SYSTEMS

Software architecture, hardware-software boundary, and distributed engineering principles.

DOMAIN STRUCTURE:
GPU Compute & CUDA
SIMD Vectorization
Distributed Consensus & Raft
Cache Alignment & Locks
Explore
03 //RECOMMENDED ONBOARDING SEQUENCE

NEW TO BYTELOGIC? START HERE.

A non-intimidating, step-by-step entry path designed to build foundational intuitions before diving into specialized architectures.

STAGE // 0145 mins
FIRST PRINCIPLES

Mathematical Foundations

Vector Spaces & Matrix Calculus

Understand geometric vectors, projections, and derivatives as the physical canvas where machine learning lives.

START FIRSTBegin
STAGE // 0260 mins
CORE INTUITION

Machine Learning Foundations

Empirical Loss & Decision Boundaries

Deconstruct how algorithms fit data, measure prediction error, and discover patterns without manual rules.

PREREQ: STAGE 01Begin
STAGE // 0350 mins
NUMERICAL METHOD

Optimization Fundamentals

Gradient Descent & Convex Surfaces

Visualize the downhill traversal of high-dimensional loss landscapes and how step sizes dictate convergence.

PREREQ: STAGE 02Begin
STAGE // 0475 mins
SYSTEM VERIFICATION

Build Your First Model

From Scratch in Pure NumPy

Translate mathematical equations directly into verified, vectorized code without high-level library abstractions.

PREREQ: STAGE 03Begin
04 //WHERE SHOULD I GO NEXT?

FEATURED LEARNING PATHS

While domains identify what subject you are exploring, learning paths answer where you should progress next through structured, sequential curricula.

PATH // 01Foundational
12 Concepts~8 hours

Machine Learning Foundations

A structured mathematical and programmatic progression from probability theory to empirical learning models.

CURRICULUM PROGRESSION (8 STAGES):
01Probability→02Statistics→03Linear Algebra→04Linear Regression→05Logistic Regression→06Optimization→07Classification→08Model Evaluation
STARTING AT: Probability & Distributions
START PATH
PATH // 02Intermediate
16 Concepts~12 hours

Deep Learning Foundations

From vector operations to computational differentiation, neural layers, and modern transformer architectures.

CURRICULUM PROGRESSION (6 STAGES):
01Linear Algebra→02Neural Networks→03Forward Propagation→04Backpropagation→05Optimization→06Regularization
STARTING AT: Matrix Algebra & Autodiff
START PATH
05 //DIRECT ENTRY CATALOG

POPULAR CONCEPTS

Direct entry points into core algorithmic, mathematical, and machine learning principles with full derivations and interactive simulations.

MACHINE LEARNING/STATISTICAL LEARNING & OPTIMIZATION
INTERMEDIATE

What Does a Model Actually Learn?

An exploration of parameters, internal representations, optimization dynamics, generalization, and what “learning” really means inside a model.

ARTICLECONCEPT
12 min studyExplore
MACHINE LEARNING/UNSUPERVISED LEARNING
INTERMEDIATE

K-Means Clustering

Iterative expectation-maximization algorithm that partitions unlabelled observations into Voronoi cells around centroid vectors.

CONCEPTVISUALIMPLEMENTATIONEXPERIMENT
12 min studyExplore
OPTIMIZATION/FIRST-ORDER CALCULUS
FOUNDATION

Gradient Descent & Loss Optimization

Iterative first-order optimization algorithm for finding the local minimum of a differentiable objective function along negative gradients.

CONCEPTVISUALARTICLE
15 min studyExplore
MATHEMATICS/DIMENSIONALITY REDUCTION
INTERMEDIATE

Principal Component Analysis (PCA)

Orthogonal linear transformation that projects data into a new coordinate system such that the greatest variance lies on the first coordinate.

CONCEPTARTICLEIMPLEMENTATION
18 min studyExplore
MACHINE LEARNING/SUPERVISED LEARNING
FOUNDATION

Linear Regression from First Principles

Linear approach for modelling relationships between a scalar response and explanatory variables via ordinary least squares.

CONCEPTIMPLEMENTATIONVISUAL
10 min studyExplore
DEEP LEARNING/COMPUTATIONAL DIFFERENTIATION
ADVANCED

Backpropagation & Autodiff Graphs

Reverse-mode automatic differentiation algorithm calculating analytical gradient vectors for network weights via the multivariate chain rule.

CONCEPTARTICLEEXPERIMENT
22 min studyExplore
STATISTICS/PROBABILISTIC INFERENCE
FOUNDATION

Probability Distributions & Likelihood

Mathematical functions providing the probabilities of occurrence of different possible outcomes in an experiment across discrete and continuous spaces.

CONCEPTVISUALEXPERIMENT
14 min studyExplore
MACHINE LEARNING/UNSUPERVISED HEURISTICS
INTERMEDIATE

K-Means++ Seeding Algorithm

Probabilistic centroid initialization heuristic that guarantees an O(log k) approximation ratio to optimal Lloyd clustering.

CONCEPTVISUALEXPERIMENT
12 min studyExplore
DEEP LEARNING/TRANSFORMERS
ADVANCED

Scaled Dot-Product Attention

Mapping query and key-value pairs to an output through scaled dot-product softmax weighting in high-dimensional embedding spaces.

CONCEPTVISUALIMPLEMENTATION
20 min studyExplore
REINFORCEMENT LEARNING/DYNAMIC PROGRAMMING
ADVANCED

Bellman Optimality & Value Iteration

Recursive decomposition of dynamic decision optimization into immediate reward plus discounted expected future value.

CONCEPTARTICLEEXPERIMENT
25 min studyExplore
ALGORITHMS/GRAPH THEORY
FOUNDATION

Dijkstra Single-Source Shortest Path

Greedy graph algorithm finding the shortest path from a starting node to all other nodes in a weighted graph with non-negative edges.

CONCEPTVISUALIMPLEMENTATION
15 min studyExplore
SYSTEMS/GPU COMPUTING
ADVANCED

CUDA Kernel Execution & Memory Hierarchy

Thread blocks, warp schedulers, and coalesced global memory access patterns in massively parallel SIMT architectures.

CONCEPTIMPLEMENTATIONEXPERIMENT
28 min studyExplore
07 //PEDAGOGICAL FRAMEWORK

HOW BYTELOGIC TEACHES

The 5-stage first-principles cognitive loop. Every concept, algorithm, and system follows this rigorous progression.

STAGE // 01

UNDERSTAND

What is the foundational idea?

Strip away superficial buzzwords and black-box library APIs. Formulate the core problem from mathematical and physical first principles.

OUTPUT:Analytical formulation, axioms, and constraints.
STAGE // 02

VISUALIZE

Can I see what is happening dynamically?

Transform abstract symbolic notation into geometric intuition. Observe vector projections, decision boundaries, and convergence paths.

OUTPUT:Interactive 2D/3D topological canvas.
STAGE // 03

IMPLEMENT

Can I build it from bare metal?

Translate mathematical equations directly into verified, vectorized NumPy or systems code without hidden high-level abstractions.

OUTPUT:Zero-dependency standalone implementation.
STAGE // 04

EXPERIMENT

Can I test, stress, and break it?

Push hyper-parameters to their boundaries. Inject noise, perturb initial conditions, and observe failure modes in live sandbox environments.

OUTPUT:Empirical benchmark and ablation matrix.
STAGE // 05

DISCOVER

What can I build beyond the original idea?

Synthesize the concept into broader computational architectures. Formulate novel extensions and tackle real-world engineering challenges.

OUTPUT:Research frontiers and systems architectures.

See the Philosophy in Action

Experience how K-Means Clustering applies this exact 5-stage loop with live interactive Voronoi diagrams.

LAUNCH K-MEANS DOSSIER