Tag: architecture

10 entries with this tag.

Models3 min read

Context Window

The maximum amount of text (measured in tokens) that an AI model can process at one time.

limitstokensarchitecture
Systems6 min read

Grounding

The practice of tying an AI model’s responses directly to verifiable, factual data sources (like a company database or web search) to prevent hallucinations.

reliabilityarchitecturecontext
Foundations4 min read

Deep Learning

A subset of machine learning based on artificial neural networks with multiple layers.

neural-networksarchitectureresearch
Models2 min read

Tokens & Tokenization

The base units of data processed by an LLM. A token is typically a chunk of characters rather than a full word.

architecturepricing
Models2 min read

Parameters (Weights)

The internal variables a neural network learns during training. They act as the "knowledge" of the model.

architecturesizing
Systems3 min read

Semantic Search

A search technique that aims to understand the user’s intent and the contextual meaning of terms, rather than relying on exact keyword matches.

architectureretrieval
Systems2 min read

API

A set of rules and protocols that allows different software applications to communicate with each other.

architectureintegration
Models3 min read

Mixture of Experts (MoE)

An AI architecture that replaces a single dense neural network with multiple specialized sub-networks (experts) to improve efficiency and scale.

architectureperformance
Models5 min read

Transformer Architecture

The neural network architecture introduced in 2017 that powers virtually all modern large language models through self-attention mechanisms.

architectureresearchneural-networks
Systems7 min read

Function Calling (Tool Use)

A capability that allows LLMs to invoke structured external tools or APIs mid-conversation, enabling reliable real-world actions and grounded data retrieval.

agencyintegrationarchitecture