LLMs & Transformers
Large language models and how they work.
AllAI FundamentalsMachine LearningDeep LearningLLMs & TransformersGenerative AINLPAI AgentsPromptingData & TrainingInfrastructureEvaluationSafety & Ethics
T
Temperature
Temperature is a parameter in large language models that controls the randomness of generated text. Lower values produce more focused and deterministic outputs, while higher values increase creativity and variability.
Top-p Sampling
Top-p sampling (nucleus sampling) is a text-generation technique that dynamically selects the smallest set of most likely next tokens whose combined probability exceeds a threshold p (e.g. 0.9), then samples from that set.