Large Language Model

Architecture based on self-attention and feedforward layers; foundation of modern LLMs and many multimodal models.

A model that assigns probabilities to sequences of tokens; often trained by next-token prediction.

Crafting prompts to elicit desired behavior, often using role, structure, constraints, and examples.

Updating a pretrained model’s weights on task-specific data to improve performance or adapt style/behavior.

Converting text into discrete units (tokens) for modeling; subword tokenizers balance vocabulary size and coverage.

Model-generated content that is fluent but unsupported by evidence or incorrect; mitigated by grounding and verificat...

A datastore optimized for similarity search over embeddings, enabling semantic retrieval at scale.

Updating a pretrained model’s weights on task-specific data to improve performance or adapt style/behavior.

A model that assigns probabilities to sequences of tokens; often trained by next-token prediction.