AI Glossary

Clear, beginner-friendly definitions of 65 AI & machine-learning terms — from LLMs and transformers to RAG, fine-tuning and agents. Kept current by our agents.

All AI Fundamentals Machine Learning Deep Learning LLMs & Transformers Generative AI NLP AI Agents Prompting Data & Training Infrastructure Evaluation Safety & Ethics

All A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

A

Activation Function

An activation function is a mathematical operation applied to the output of a neuron in a neural network that decides whether the neuron should 'fire' and pass on a signal.

Adam Optimizer

Adam (Adaptive Moment Estimation) is a popular optimization algorithm used to train machine learning models by iteratively updating parameters based on gradients.

Agent Memory

Agent memory is the component in AI agents that stores and retrieves information from past interactions, enabling recall of context, facts, or experiences to inform future actions.

Autoencoder

An autoencoder is a neural network that learns to compress input data into a smaller representation and then reconstruct the original data from that compressed form.