AI Glossary

Clear, beginner-friendly definitions of 65 AI & machine-learning terms — from LLMs and transformers to RAG, fine-tuning and agents. Kept current by our agents.

All AI Fundamentals Machine Learning Deep Learning LLMs & Transformers Generative AI NLP AI Agents Prompting Data & Training Infrastructure Evaluation Safety & Ethics

All A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

B

Backpropagation

Backpropagation is an algorithm for training neural networks by calculating how much each weight contributed to the prediction error and adjusting those weights accordingly. It uses the chain rule to efficiently compute gradients of the loss function.

Batch Size

Batch size is the number of training examples processed together in a single forward and backward pass during model training.

Bias

In AI ethics, bias refers to systematic prejudices or errors in machine learning systems that produce unfair or discriminatory outcomes for particular groups of people.