Hi, I'm [Chris Albon](Bio.md). I'm the Director of Machine Learning at the [Wikimedia Foundation](https://wikimediafoundation.org/). This site is for my 137 technical notes on 64 topics from 36 sources on using applied artificial intelligence to do things that matter.
## Technical Notes
- **Artifical Intelligence**
- **Data**
- [[Extracting Training Data From Models]]
- [[Mutual Information]]
- [[One-hot encoding]]
- [[Target encoding]]
- **Fundamentals**
- [[Bias-Variance Tradeoff]]
- [[Bias]]
- [[Capacity]]
- [[Classification]]
- [[Clustering]]
- [[Dimensionality Reduction]]
- [[Feature Scaling]]
- [[FLOPS]]
- [[Four Types Of AI]]
- [[Gradient Descent]]
- [[Internal Covarate Shift]]
- [[Learning Rate]]
- [[Model Collapse]]
- [[Motivation]]
- [[Overfitting And Underfitting]]
- [[Positional Encoding]]
- [[Regression]]
- [[Reinforcement Learning]]
- [[Stochastic Gradient Descent]]
- [[Vanishing Gradient]]
- [[Weight Decay Regularization]]
- **Large Language Models**
- **Prompts**
- [[Prompt Attacks]]
- [[Prompt Hierarchy]]
- [[Fine-Tuning Vs. Pretraining]]
- [[Hallucinations]]
- [[History]]
- [[Model Collapse]]
- **Neural Networks**
- **Architecture**
- **Activation Functions**
- [[Gaussian Error Linear Unit (GELU)]]
- [[Hyperbolic Tangent (Tanh)]]
- [[Leaky ReLU]]
- [[Motivation]]
- [[Rectified Linear Unit (ReLU)]]
- [[What is an activation?]]
- **Layers**
- [[Batch Normalization Layer]]
- [[Convolutional Layers]]
- [[Dropout Layer]]
- [[Embedding Layers]]
- [[Fully Connected Layers]]
- [[Max Pooling Layer]]
- [[Skip Connections]]
- **Models**
- [[Stable Diffusion]]
- **Training**
- [[Training, Test, And Validation Sets]]
- [[Autoencoders]]
- [[Batching]]
- [[Deep Double Descent]]
- [[How Deep Neural Networks Learn]]
- [[Model Soups]]
- **MLOps**
- [[Data Model]]
- [[Data Warehouse Vs. Data Lake]]
- [[Declarative ML Systems]]
- **Python**
- **Object Oriented Programming**
- **Three Tenets Of OOP**
- [[Abstraction]]
- [[Encapsulation]]
- [[Inheritance]]
- [[Polymorphism]]
- [[Abstract Base Classes And Methods]]
- [[Difference Between Class And Instance Variables]]
- [[Example Of @property]]
- [[Type Hinting]]
- **Software Engineering**
- [[Clean Code]]
- [[Concurrency]]