[ ABORT TO HUD ]
SEQ. 1
SEQ. 2
Ollama Quickstart
🦙 Ollama: Local AI⏱ 10 min⭐ 100 BASE XP⌨ HANDS-ON LAB
One-Command LLM Deployment
Ollama is the easiest way to run open-source models locally. It handles downloading, GPU detection, and API serving automatically. As of v0.30, Ollama defaults to Vulkan for broad AMD/Intel support, native GGUF loading without conversions, and integrates agent tool-calling natively.
Getting Started
# Install (macOS/Linux) curl -fsSL https://ollama.com/install.sh | sh # Run a model (auto-downloads on first use) ollama run llama3.3-70b ollama run mistral-large ollama run qwen3.5:32b ollama run gemma4:4b
OpenAI-Compatible API
Ollama exposes an API on localhost:11434 that's compatible with the OpenAI SDK - just change the base URL:
from openai import OpenAI
client = OpenAI(base_url="http://localhost:11434/v1", api_key="ollama")
response = client.chat.completions.create(
model="mistral-large",
messages=[{"role": "user", "content": "Explain Docker networking"}]
)
print(response.choices[0].message.content)
Custom Modelfiles
# Modelfile FROM mistral-small:latest SYSTEM "You are a senior DevOps engineer. Always provide Docker and Kubernetes examples." PARAMETER temperature 0.3 PARAMETER num_ctx 32768
Build: ollama create devops-assistant -f Modelfile
🐳 Container Deployment:
Now any app on your network can call
docker run -d --gpus all -v ollama:/root/.ollama -p 11434:11434 --name ollama ollama/ollamadocker exec ollama ollama pull mistral-largeNow any app on your network can call
http://host:11434/v1/chat/completions⌨ HANDS-ON LABPull, Run & List Local Models
⭐ +150 XPZero to local inference in three commands. Pull a model from the Ollama registry, chat with it, then audit what's on disk.
1Pull a model from the registry (e.g. llama3.3).
2Start an interactive chat with the model you pulled.
3List all models stored locally.
OBJECTIVE 1 / 3 — type "hint" if stuck
KNOWLEDGE CHECK
QUERY 1 // 2
What port does Ollama's local API run on by default?
8080
3000
11434
5000