Hi, I'm [Chris Albon](Bio.md). I'm the Director of Machine Learning at the [Wikimedia Foundation](https://wikimediafoundation.org/). This site is for my 137 technical notes on 64 topics from 36 sources on using applied artificial intelligence to do things that matter. ## Technical Notes - **Artifical Intelligence** - **Data** - [[Extracting Training Data From Models]] - [[Mutual Information]] - [[One-hot encoding]] - [[Target encoding]] - **Fundamentals** - [[Bias-Variance Tradeoff]] - [[Bias]] - [[Capacity]] - [[Classification]] - [[Clustering]] - [[Dimensionality Reduction]] - [[Feature Scaling]] - [[FLOPS]] - [[Four Types Of AI]] - [[Gradient Descent]] - [[Internal Covarate Shift]] - [[Learning Rate]] - [[Model Collapse]] - [[Motivation]] - [[Overfitting And Underfitting]] - [[Positional Encoding]] - [[Regression]] - [[Reinforcement Learning]] - [[Stochastic Gradient Descent]] - [[Vanishing Gradient]] - [[Weight Decay Regularization]] - **Large Language Models** - **Prompts** - [[Prompt Attacks]] - [[Prompt Hierarchy]] - [[Fine-Tuning Vs. Pretraining]] - [[Hallucinations]] - [[History]] - [[Model Collapse]] - **Neural Networks** - **Architecture** - **Activation Functions** - [[Gaussian Error Linear Unit (GELU)]] - [[Hyperbolic Tangent (Tanh)]] - [[Leaky ReLU]] - [[Motivation]] - [[Rectified Linear Unit (ReLU)]] - [[What is an activation?]] - **Layers** - [[Batch Normalization Layer]] - [[Convolutional Layers]] - [[Dropout Layer]] - [[Embedding Layers]] - [[Fully Connected Layers]] - [[Max Pooling Layer]] - [[Skip Connections]] - **Models** - [[Stable Diffusion]] - **Training** - [[Training, Test, And Validation Sets]] - [[Autoencoders]] - [[Batching]] - [[Deep Double Descent]] - [[How Deep Neural Networks Learn]] - [[Model Soups]] - **MLOps** - [[Data Model]] - [[Data Warehouse Vs. Data Lake]] - [[Declarative ML Systems]] - **Python** - **Object Oriented Programming** - **Three Tenets Of OOP** - [[Abstraction]] - [[Encapsulation]] - [[Inheritance]] - [[Polymorphism]] - [[Abstract Base Classes And Methods]] - [[Difference Between Class And Instance Variables]] - [[Example Of @property]] - [[Type Hinting]] - **Software Engineering** - [[Clean Code]] - [[Concurrency]]