Tag: architecture
10 entries with this tag.
Context Window
The maximum amount of text (measured in tokens) that an AI model can process at one time.
Grounding
The practice of tying an AI model’s responses directly to verifiable, factual data sources (like a company database or web search) to prevent hallucinations.
Deep Learning
A subset of machine learning based on artificial neural networks with multiple layers.
Tokens & Tokenization
The base units of data processed by an LLM. A token is typically a chunk of characters rather than a full word.
Parameters (Weights)
The internal variables a neural network learns during training. They act as the "knowledge" of the model.
Semantic Search
A search technique that aims to understand the user’s intent and the contextual meaning of terms, rather than relying on exact keyword matches.
API
A set of rules and protocols that allows different software applications to communicate with each other.
Mixture of Experts (MoE)
An AI architecture that replaces a single dense neural network with multiple specialized sub-networks (experts) to improve efficiency and scale.
Transformer Architecture
The neural network architecture introduced in 2017 that powers virtually all modern large language models through self-attention mechanisms.
Function Calling (Tool Use)
A capability that allows LLMs to invoke structured external tools or APIs mid-conversation, enabling reliable real-world actions and grounded data retrieval.