SLMs

This on-device AI model allows NPCs to provide quicker, more relevant responses in games. It runs locally on RTX PCs, enhancing player-character interactions.

NVIDIA's Mistral-NeMo-Minitron 8B model combines pruning and distillation to achieve high accuracy with 8B parameters, running on RTX workstations.

OpenAI's GPT-4o mini offers high AI performance at 60% lower cost than GPT-3.5 Turbo. It excels in reasoning, math, and coding, with a 128K token context window.

AI terms explained: Language models, grounding, RAG, orchestration, memory simulation. Transformer vs diffusion models. Frontier models push limits.