Models

9 entries in this category.

Models7 min read

Large Language Model (LLM)

A neural network trained on large text datasets to predict and generate human-like language.

nlpgenerativefoundation-model
Models4 min read

Fine-Tuning (PEFT, LoRA)

The process of taking a pre-trained model and training it further on a smaller, specialized dataset to adapt it to specific tasks or domains.

trainingoptimizationcustomization
Models3 min read

Context Window

The maximum amount of text (measured in tokens) that an AI model can process at one time.

limitstokensarchitecture
Models2 min read

Tokens & Tokenization

The base units of data processed by an LLM. A token is typically a chunk of characters rather than a full word.

architecturepricing
Models2 min read

Parameters (Weights)

The internal variables a neural network learns during training. They act as the "knowledge" of the model.

architecturesizing
Models3 min read

Mixture of Experts (MoE)

An AI architecture that replaces a single dense neural network with multiple specialized sub-networks (experts) to improve efficiency and scale.

architectureperformance
Models5 min read

Transformer Architecture

The neural network architecture introduced in 2017 that powers virtually all modern large language models through self-attention mechanisms.

architectureresearchneural-networks
Models6 min read

Foundation Models

Large AI models trained on broad, general datasets at massive scale, designed to be adapted for a wide range of downstream tasks.

foundation-modeltrainingcapabilities
Models5 min read

Multimodal AI

AI systems that can process and generate content across multiple modalities—text, images, audio, and video—within a single model.

visioncapabilitiesgenerative