Skip to content
Merged
Show file tree
Hide file tree
Changes from 1 commit
Commits
Show all changes
50 commits
Select commit Hold shift + click to select a range
ff2a979
Merge pull request #6 from mattcurf/fix_oneapi_dependency
mattcurf Oct 28, 2024
2e18d91
Update webui
pepijndevos Nov 7, 2024
0e4cf4f
Update docker-compose-wsl2.yml
pepijndevos Nov 7, 2024
eb23896
Merge pull request #8 from pepijndevos/patch-1
mattcurf Nov 8, 2024
c74f6f2
Update Dockerfile to use Intel public ipex container
mattcurf Nov 14, 2024
91d2045
Merge pull request #11 from mattcurf/ipex_intel_image
mattcurf Nov 28, 2024
6df0d8d
Update ipex-llm image from Intel to 2.2.0-SNAPSHOT
mattcurf Jan 17, 2025
07e8a24
Merge pull request #21 from mattcurf/update_tags
mattcurf Jan 21, 2025
b74bab0
Update to latest open-webui releases
mattcurf Jan 24, 2025
d51c656
Merge pull request #24 from mattcurf/update-webui
mattcurf Jan 26, 2025
8e69333
Update README.md
mattcurf Jan 26, 2025
c230c45
Update README.md
mattcurf Jan 26, 2025
ddd565f
docs: update README.md
eltociear Jan 30, 2025
1581a50
Merge pull request #27 from eltociear/patch-1
mattcurf Feb 5, 2025
765a8c0
Update to latest ipex-llm dockerfile 20250211
mattcurf Feb 12, 2025
f08a310
Update README.md
mattcurf Feb 12, 2025
ec7dec8
Merge pull request #36 from mattcurf/updated-docker-image
mattcurf Feb 17, 2025
2fc5265
Update to use new ipex portable .zip packages
mattcurf Feb 19, 2025
dd84c20
Minor fixes
mattcurf Feb 19, 2025
c47c879
Merge branch 'main' into ollama_portable_zip
mattcurf Feb 19, 2025
fed3cf9
Update README.md
mattcurf Feb 19, 2025
fa579db
Increase context window size
mattcurf Feb 19, 2025
db8d96c
Merge pull request #39 from mattcurf/ollama_portable_zip
mattcurf Feb 22, 2025
85e28fc
Cache link
mattcurf Feb 23, 2025
d81b21c
Merge pull request #42 from mattcurf/fix-links
mattcurf Feb 23, 2025
e1da4a4
Allow for user choice of ollama portable zip at build time
blebo Mar 16, 2025
2c82aed
Update compose file with build args
blebo Mar 16, 2025
1e92fbe
Updates to allow latest ollama in compose file, with fallback to cach…
blebo Mar 16, 2025
b33c01f
Updated README.md for Dockerfile args.
blebo Mar 16, 2025
451f910
Revert compose to cached .tgz by default.
blebo Mar 17, 2025
86f0765
Merge pull request #49 from blebo/dockerfile-args
mattcurf Mar 17, 2025
61288f5
Update to ipex-llm-2.2.0b20250313
mattcurf Mar 17, 2025
6964b45
Merge pull request #50 from mattcurf/update_ipex
mattcurf Mar 17, 2025
504a1d3
Update default to ipex-llm v2.2.0 (guide for v2.3.0-nightly in docs)
blebo Apr 16, 2025
f1bbedb
Update Intel libraries
charlescng Apr 18, 2025
dea2fd0
Merge pull request #55 from charlescng/update_intel_libs
mattcurf Apr 19, 2025
8172339
Merge pull request #54 from blebo/update-ipex-v2.2.0
mattcurf Apr 20, 2025
1759294
Update Docker configurations for deployment improvements
eSlider Apr 22, 2025
c98fd71
Ignore shelf
eSlider Apr 22, 2025
0a7f974
Update Docker configurations and Intel GPU runtimes for improved perf…
eSlider Jun 20, 2025
1239010
Clean up Dockerfile by adding autoremove and autoclean commands to re…
eSlider Jun 20, 2025
96913a2
Update Intel GPU stack and ipex-llm to latest available versions
eSlider Feb 12, 2026
8debf20
Fix ollama not reachable from host due to hardcoded OLLAMA_HOST in en…
eSlider Feb 12, 2026
63c3b81
Upgrade ollama from 0.9.3 (IPEX-LLM) to 0.15.6 (official) with Vulkan…
eSlider Feb 12, 2026
c56646e
Switch GPU backend from Vulkan to SYCL for ~2x inference performance …
eSlider Feb 12, 2026
971852d
Rework README for better GitHub presentation
eSlider Feb 12, 2026
52672c3
Add GitHub Actions CI to build and push Docker image to GHCR
eSlider Feb 12, 2026
e397010
Create FUNDING.yml
eSlider Feb 12, 2026
5924879
chore: remove committed JetBrains .idea gitignore
cursoragent Feb 13, 2026
9f56e70
Remove dead libsycl glob no-op in Dockerfile
cursoragent Feb 13, 2026
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
Fix ollama not reachable from host due to hardcoded OLLAMA_HOST in en…
…trypoint

The IPEX-LLM bundled start-ollama.sh hardcodes OLLAMA_HOST=127.0.0.1 and
OLLAMA_KEEP_ALIVE=10m, overriding docker-compose environment variables and
preventing external connections through Docker port mapping.

- Add custom start-ollama.sh that honours env vars with sensible defaults
- Mount it read-only into the container
- Fix LD_LIBRARY_PATH env var syntax (: -> =)
- Add .gitignore for IDE/swap/webui data files
- Update CHANGELOG and README with fix documentation

Co-authored-by: Cursor <cursoragent@cursor.com>
  • Loading branch information
eSlider and cursoragent committed Feb 12, 2026
commit 8debf2010b52207f7b1325737f7127f3426945d7
9 changes: 9 additions & 0 deletions .gitignore
Original file line number Diff line number Diff line change
@@ -0,0 +1,9 @@
# IDE
.idea/

# Swap files
*.swp
*.swo

# Open WebUI local data
webui/
13 changes: 13 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -2,6 +2,19 @@

## 2026-02-12

### Fix: Ollama not reachable from host via Docker port mapping

The bundled IPEX-LLM `/start-ollama.sh` entrypoint hardcodes
`OLLAMA_HOST='127.0.0.1:11434'` and `OLLAMA_KEEP_ALIVE=10m`, overriding any
values set through Docker Compose environment variables.

- Added a custom `start-ollama.sh` that respects environment variables
(`${OLLAMA_HOST:-0.0.0.0:11434}`, `${OLLAMA_KEEP_ALIVE:-24h}`) instead of
hardcoding them
- Mounted the script into the container as a read-only volume
(`./start-ollama.sh:/start-ollama.sh:ro`)
- Fixed `LD_LIBRARY_PATH` env var syntax in docker-compose.yml (`:` -> `=`)

### Updated Intel GPU runtime stack to latest releases

- **level-zero**: v1.22.4 -> v1.28.0
Expand Down
11 changes: 11 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -34,6 +34,17 @@ docker compose up

Then launch your web browser to http://localhost:3000 to launch the web ui. Create a local OpenWeb UI credential, then click the settings icon in the top right of the screen, then select 'Models', then click 'Show', then download a model like 'llama3.1:8b-instruct-q8_0' for Intel ARC A770 16GB VRAM

### Custom `start-ollama.sh` entrypoint

The upstream IPEX-LLM portable zip ships a `start-ollama.sh` that hardcodes
`OLLAMA_HOST=127.0.0.1` and `OLLAMA_KEEP_ALIVE=10m`, preventing the container
from accepting connections via Docker port mapping and ignoring Compose
environment overrides.

This repo includes a corrected `start-ollama.sh` (mounted read-only into the
container) that honours environment variables set in `docker-compose.yml`,
falling back to sensible defaults (`0.0.0.0:11434`, `24h`).

### Update to the latest IPEX-LLM Portable Zip Version

To update to the latest portable zip version of IPEX-LLM's Ollama, update the compose file with the build arguments shown below, using the latest `ollama-*.tgz` release from https://github.com/intel/ipex-llm/releases/tag/v2.3.0-nightly , then rebuild the image.
Expand Down
9 changes: 7 additions & 2 deletions docker-compose.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,10 +15,14 @@ services:
volumes:
- /tmp/.X11-unix:/tmp/.X11-unix
- ollama-intel-gpu:/root/.ollama
- ./start-ollama.sh:/start-ollama.sh:ro
shm_size: "16G"
environment:
- ONEAPI_DEVICE_SELECTOR=level_zero:0
#- SYCL_PI_LEVEL_ZERO_USE_IMMEDIATE_COMMANDLISTS=1
#- SYCL_CACHE_PERSISTENT=1
- IPEX_LLM_NUM_CTX=16384
- LD_LIBRARY_PATH:/opt/intel/oneapi/compiler/2024.2/lib
- LD_LIBRARY_PATH=/opt/intel/oneapi/compiler/2024.2/lib
- DISPLAY=${DISPLAY}
- OLLAMA_DEFAULT_KEEPALIVE="6h"
- OLLAMA_HOST=0.0.0.0
Expand All @@ -38,7 +42,8 @@ services:
ollama-webui:
image: ghcr.io/open-webui/open-webui:latest
container_name: ollama-webui
#volumes:
volumes:
- ./webui/data:/app/backend/data
# - ollama-webui:/app/backend/data
depends_on:
- ollama-intel-gpu
Expand Down
18 changes: 18 additions & 0 deletions start-ollama.sh
Original file line number Diff line number Diff line change
@@ -0,0 +1,18 @@
#!/bin/bash
export OLLAMA_NUM_GPU=999
export no_proxy=localhost,127.0.0.1
export ZES_ENABLE_SYSMAN=1
# [optional] under most circumstances, the following environment variable may improve performance, but sometimes this may also cause performance degradation
export SYCL_PI_LEVEL_ZERO_USE_IMMEDIATE_COMMANDLISTS=1

# Use OLLAMA_HOST and OLLAMA_KEEP_ALIVE from environment (set via docker-compose),
# falling back to sensible defaults if not set.
export OLLAMA_HOST="${OLLAMA_HOST:-0.0.0.0:11434}"
export OLLAMA_KEEP_ALIVE="${OLLAMA_KEEP_ALIVE:-24h}"

# [optional] if you want to run on single GPU, use below command to limit GPU may improve performance
# export ONEAPI_DEVICE_SELECTOR=level_zero:0
# If you have more than one dGPUs, according to your configuration you can use configuration like below, it will use the first and second card.
# export ONEAPI_DEVICE_SELECTOR="level_zero:0;level_zero:1"

./ollama serve