Offline SQL AI Assistant Setup Guide
This guide explains how to build a fully offline local AI assistant capable of generating MySQL queries, schemas,
triggers, and coding help using Ollama and Qwen2.5-Coder on Windows.
System Requirements
• Windows 10/11
• 8GB RAM minimum (16GB recommended)
• At least 15GB free storage
• Stable internet connection for initial model download
• Docker Desktop
• Python 3.x
• Git
• Ollama
Installation Steps
Step Description
Install Python Download Python from [Link] and enable 'Add Python to PATH' during installati
Install Git Download and install Git for Windows from [Link].
Install Docker Desktop Install Docker Desktop and enable WSL2 support.
Install Ollama Download Ollama for Windows from [Link].
Download AI Model Run: ollama pull qwen2.5-coder
Run AI Model Run: ollama run qwen2.5-coder
Install Open WebUI Run Docker container for Open WebUI to get ChatGPT-like interface.
Important Commands
• ollama pull qwen2.5-coder
• ollama run qwen2.5-coder
• docker run -d -p 3000:8080 --add-host=[Link]:host-gateway -v
open-webui:/app/backend/data --name open-webui --restart always
[Link]/open-webui/open-webui:main
Features
• Offline SQL query generation
• Database schema generation
• Trigger and stored procedure creation
• No cloud API dependency
• Local AI inference
• Privacy-friendly workflow
Architecture Flow
User Prompt → Open WebUI → Ollama → Qwen2.5-Coder → Generated SQL/Code
Limitations
• Large models consume high RAM
• Offline models can generate incorrect SQL
• Performance depends on CPU/GPU hardware
• Complex enterprise database optimization may be inaccurate