Data & Training
Datasets, fine-tuning and pipelines.
AllAI FundamentalsMachine LearningDeep LearningLLMs & TransformersGenerative AINLPAI AgentsPromptingData & TrainingInfrastructureEvaluationSafety & Ethics
P
PEFT
PEFT (Parameter-Efficient Fine-Tuning) is a family of techniques that adapt large pre-trained models to new tasks by updating or adding only a tiny fraction of parameters instead of retraining the entire model.
Pretraining
Pretraining is the first stage of training an AI model on a very large, general dataset so it learns broad patterns and representations before being adapted to specific tasks.