Scribd
Upload
11 views1 page

OneFileLLM Architecture Overview

The document outlines a system architecture involving user interactions through a UI or CLI that sends HTTP requests to an application. This application fetches context from a PostgreSQL database, formats prompts, and interacts with a locally running LLM. The process includes SQL queries, API calls, and responses to manage context and generate outputs from the LLM.

Uploaded by

gelellavivek
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd
11 views1 page

OneFileLLM Architecture Overview

The document outlines a system architecture involving user interactions through a UI or CLI that sends HTTP requests to an application. This application fetches context from a PostgreSQL database, formats prompts, and interacts with a locally running LLM. The process includes SQL queries, API calls, and responses to manage context and generate outputs from the LLM.

Uploaded by

gelellavivek
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as TXT, PDF, TXT or read online on Scribd

+-----------+ HTTP Request +---------------------+ SQL Query

+-----------------+
| User (UI/ |-------------------->| Your Application |------------------->|
PostgreSQL |
| CLI) | | (Python, [Link],etc)|<-------------------|
(Context Store) |
+-----------+ HTTP Response | - Fetches context |<--- SQL Result
+-----------------+
(LLM output) | - Formats prompt |
| - Calls local LLM |
| - Stores new context|
+---------------------+
| ^
| | LLM Request (prompt with context)
Local API Call| | LLM Response
v |
+---------------------+
| Locally Running LLM |
| (Ollama, LM Studio, |
| [Link], etc.) |
+---------------------+

You might also like