Scribd
Upload
18 views16 pages

Dockerfile Build Process for Python App

The document outlines the process of deploying a Python application using Docker, starting with the confirmation of a correct Dockerfile. It details the steps involved in building the container, including loading the Dockerfile, transferring context, and installing required Python packages from a requirements.txt file. The deployment process involves several stages, including loading metadata, building the image, and installing dependencies such as FastAPI and PyTorch.

Uploaded by

davidkevin2775
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
18 views16 pages

Dockerfile Build Process for Python App

The document outlines the process of deploying a Python application using Docker, starting with the confirmation of a correct Dockerfile. It details the steps involved in building the container, including loading the Dockerfile, transferring context, and installing required Python packages from a requirements.txt file. The deployment process involves several stages, including loading metadata, building the image, and installing dependencies such as FastAPI and PyTorch.

Uploaded by

davidkevin2775
Copyright
© All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd

⚡ ~ lightning deploy serve.

py --cloud

Dockerfile already exists in the current directory, we will use it for building the container.

Please review the Dockerfile at /teamspace/studios/this_studio/Dockerfile and make sure it is


correct.

Is the Dockerfile correct? [y/n] (y): y

#0 building with "default" instance using docker driver

#1 load .dockerignore

#1 transferring context: 2B done

#1 DONE 0.0s

#2 load build definition from Dockerfile

#2 transferring dockerfile: 465B done

#2 DONE 0.0s

#3 load metadata for [Link]/library/python:3.12-slim

#3 DONE 0.3s

#4 [1/4] FROM [Link]/library/python:3.12-


slim@sha256:0175d8ff0ad1dc8ceca4bcf311c3e47d08807a940959fa1cdbcefa87841883a1

#4 DONE 0.0s

#5 [2/4] WORKDIR /app

#5 CACHED

#6 load build context

#6 transferring context: 758.65MB 4.7s

#6 transferring context: 1.57GB 9.7s

#6 transferring context: 2.39GB 14.8s

#6 transferring context: 3.19GB 19.8s

#6 transferring context: 3.95GB 24.8s


#6 transferring context: 4.74GB 29.9s

#6 transferring context: 5.50GB 34.9s

#6 transferring context: 6.24GB 39.9s

#6 transferring context: 6.97GB 44.9s

#6 transferring context: 7.71GB 49.9s

#6 transferring context: 7.71GB 49.9s done

#6 DONE 50.0s

#7 [3/4] COPY . /app

#7 DONE 26.9s

#8 [4/4] RUN pip install --no-cache-dir litserve==0.2.11 -r [Link]

#8 3.609 Collecting litserve==0.2.11

#8 3.686 Downloading [Link] (19 kB)

#8 3.754 Collecting fastapi>=0.104.1 (from -r [Link] (line 1))

#8 3.766 Downloading [Link] (27 kB)

#8 3.812 Collecting uvicorn>=0.24.0 (from -r [Link] (line 2))

#8 3.824 Downloading [Link] (6.5 kB)

#8 3.843 Collecting python-multipart>=0.0.6 (from -r [Link] (line 3))

#8 3.854 Downloading python_multipart-[Link] (1.8 kB)

#8 4.105 Collecting numpy>=1.24.3 (from -r [Link] (line 4))

#8 4.117 Downloading numpy-2.3.0-cp312-cp312-manylinux_2_28_x86_64.[Link] (62 kB)

#8 4.261 Collecting pydantic>=2.11.5 (from -r [Link] (line 5))

#8 4.274 Downloading [Link] (67 kB)

#8 4.306 Collecting python-dotenv>=1.0.0 (from -r [Link] (line 6))

#8 4.317 Downloading python_dotenv-[Link] (24 kB)

#8 4.371 Collecting torch>=2.0.0 (from -r [Link] (line 7))

#8 4.388 Downloading torch-2.7.1-cp312-cp312-manylinux_2_28_x86_64.[Link] (29 kB)

#8 4.441 Collecting torchvision>=0.15.0 (from -r [Link] (line 8))

#8 4.454 Downloading torchvision-0.22.1-cp312-cp312-manylinux_2_28_x86_64.[Link] (6.1


kB)
#8 4.504 Collecting transformers>=4.30.0 (from -r [Link] (line 9))

#8 4.516 Downloading [Link] (38 kB)

#8 4.643 Collecting peft>=0.15.0 (from -r [Link] (line 10))

#8 4.655 Downloading [Link] (13 kB)

#8 4.702 Collecting lightning>=2.2.1 (from -r [Link] (line 12))

#8 4.716 Downloading [Link] (39 kB)

#8 4.814 Collecting deepdiff>=6.3.1 (from -r [Link] (line 13))

#8 4.826 Downloading [Link] (8.2 kB)

#8 4.865 Collecting accelerate>=0.20.0 (from -r [Link] (line 14))

#8 4.877 Downloading [Link] (19 kB)

#8 5.206 Collecting pyzmq>=22.0.0 (from litserve==0.2.11)

#8 5.219 Downloading pyzmq-26.4.0-cp312-cp312-manylinux_2_28_x86_64.[Link] (6.0 kB)

#8 5.257 Collecting starlette<0.47.0,>=0.40.0 (from fastapi>=0.104.1->-r [Link] (line 1))

#8 5.269 Downloading [Link] (6.2 kB)

#8 5.356 Collecting typing-extensions>=4.8.0 (from fastapi>=0.104.1->-r [Link] (line 1))

#8 5.368 Downloading typing_extensions-[Link] (3.0 kB)

#8 5.390 Collecting click>=7.0 (from uvicorn>=0.24.0->-r [Link] (line 2))

#8 5.401 Downloading [Link] (2.5 kB)

#8 5.414 Collecting h11>=0.8 (from uvicorn>=0.24.0->-r [Link] (line 2))

#8 5.426 Downloading [Link] (8.3 kB)

#8 5.445 Collecting annotated-types>=0.6.0 (from pydantic>=2.11.5->-r [Link] (line 5))

#8 5.458 Downloading annotated_types-[Link] (15 kB)

#8 6.197 Collecting pydantic-core==2.33.2 (from pydantic>=2.11.5->-r [Link] (line 5))

#8 6.208 Downloading pydantic_core-2.33.2-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (6.8 kB)

#8 6.229 Collecting typing-inspection>=0.4.0 (from pydantic>=2.11.5->-r [Link] (line 5))

#8 6.242 Downloading typing_inspection-[Link] (2.6 kB)

#8 6.290 Collecting filelock (from torch>=2.0.0->-r [Link] (line 7))

#8 6.303 Downloading [Link] (2.9 kB)

#8 6.498 Collecting setuptools (from torch>=2.0.0->-r [Link] (line 7))

#8 6.510 Downloading [Link] (6.6 kB)


#8 6.537 Collecting sympy>=1.13.3 (from torch>=2.0.0->-r [Link] (line 7))

#8 6.550 Downloading [Link] (12 kB)

#8 6.575 Collecting networkx (from torch>=2.0.0->-r [Link] (line 7))

#8 6.587 Downloading [Link] (6.3 kB)

#8 6.611 Collecting jinja2 (from torch>=2.0.0->-r [Link] (line 7))

#8 6.622 Downloading [Link] (2.9 kB)

#8 6.690 Collecting fsspec (from torch>=2.0.0->-r [Link] (line 7))

#8 6.702 Downloading [Link] (11 kB)

#8 6.771 Collecting nvidia-cuda-nvrtc-cu12==12.6.77 (from torch>=2.0.0->-r [Link] (line


7))

#8 6.782 Downloading nvidia_cuda_nvrtc_cu12-12.6.77-py3-none-


manylinux2014_x86_64.[Link] (1.5 kB)

#8 6.803 Collecting nvidia-cuda-runtime-cu12==12.6.77 (from torch>=2.0.0->-r [Link] (line


7))

#8 6.816 Downloading nvidia_cuda_runtime_cu12-12.6.77-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.[Link] (1.5 kB)

#8 6.838 Collecting nvidia-cuda-cupti-cu12==12.6.80 (from torch>=2.0.0->-r [Link] (line 7))

#8 6.850 Downloading nvidia_cuda_cupti_cu12-12.6.80-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.[Link] (1.6 kB)

#8 6.873 Collecting nvidia-cudnn-cu12==[Link] (from torch>=2.0.0->-r [Link] (line 7))

#8 6.884 Downloading nvidia_cudnn_cu12-[Link]-py3-none-


manylinux_2_28_x86_64.[Link] (1.6 kB)

#8 6.905 Collecting nvidia-cublas-cu12==[Link] (from torch>=2.0.0->-r [Link] (line 7))

#8 6.917 Downloading nvidia_cublas_cu12-[Link]-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.[Link] (1.5 kB)

#8 6.934 Collecting nvidia-cufft-cu12==[Link] (from torch>=2.0.0->-r [Link] (line 7))

#8 6.946 Downloading nvidia_cufft_cu12-[Link]-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.[Link] (1.5 kB)

#8 6.965 Collecting nvidia-curand-cu12==[Link] (from torch>=2.0.0->-r [Link] (line 7))

#8 6.976 Downloading nvidia_curand_cu12-[Link]-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.[Link] (1.5 kB)

#8 6.996 Collecting nvidia-cusolver-cu12==[Link] (from torch>=2.0.0->-r [Link] (line 7))

#8 7.008 Downloading nvidia_cusolver_cu12-[Link]-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.[Link] (1.6 kB)
#8 7.026 Collecting nvidia-cusparse-cu12==[Link] (from torch>=2.0.0->-r [Link] (line 7))

#8 7.038 Downloading nvidia_cusparse_cu12-[Link]-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.[Link] (1.6 kB)

#8 7.051 Collecting nvidia-cusparselt-cu12==0.6.3 (from torch>=2.0.0->-r [Link] (line 7))

#8 7.062 Downloading nvidia_cusparselt_cu12-0.6.3-py3-none-


manylinux2014_x86_64.[Link] (6.8 kB)

#8 7.077 Collecting nvidia-nccl-cu12==2.26.2 (from torch>=2.0.0->-r [Link] (line 7))

#8 7.089 Downloading nvidia_nccl_cu12-2.26.2-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.[Link] (2.0 kB)

#8 7.104 Collecting nvidia-nvtx-cu12==12.6.77 (from torch>=2.0.0->-r [Link] (line 7))

#8 7.116 Downloading nvidia_nvtx_cu12-12.6.77-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.[Link] (1.6 kB)

#8 7.137 Collecting nvidia-nvjitlink-cu12==12.6.85 (from torch>=2.0.0->-r [Link] (line 7))

#8 7.148 Downloading nvidia_nvjitlink_cu12-12.6.85-py3-none-


manylinux2010_x86_64.manylinux_2_12_x86_64.[Link] (1.5 kB)

#8 7.163 Collecting nvidia-cufile-cu12==[Link] (from torch>=2.0.0->-r [Link] (line 7))

#8 7.175 Downloading nvidia_cufile_cu12-[Link]-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.[Link] (1.5 kB)

#8 7.198 Collecting triton==3.3.1 (from torch>=2.0.0->-r [Link] (line 7))

#8 7.210 Downloading triton-3.3.1-cp312-cp312-


manylinux_2_27_x86_64.manylinux_2_28_x86_64.[Link] (1.5 kB)

#8 7.512 Collecting pillow!=8.3.*,>=5.3.0 (from torchvision>=0.15.0->-r [Link] (line 8))

#8 7.524 Downloading pillow-11.2.1-cp312-cp312-manylinux_2_28_x86_64.[Link] (8.9 kB)

#8 7.593 Collecting huggingface-hub<1.0,>=0.30.0 (from transformers>=4.30.0->-r [Link]


(line 9))

#8 7.606 Downloading huggingface_hub-[Link] (14 kB)

#8 7.676 Collecting packaging>=20.0 (from transformers>=4.30.0->-r [Link] (line 9))

#8 7.689 Downloading [Link] (3.3 kB)

#8 7.734 Collecting pyyaml>=5.1 (from transformers>=4.30.0->-r [Link] (line 9))

#8 7.747 Downloading PyYAML-6.0.2-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (2.1 kB)

#8 8.152 Collecting regex!=2019.12.17 (from transformers>=4.30.0->-r [Link] (line 9))

#8 8.164 Downloading regex-2024.11.6-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (40 kB)
#8 8.198 Collecting requests (from transformers>=4.30.0->-r [Link] (line 9))

#8 8.210 Downloading [Link] (4.6 kB)

#8 8.507 Collecting tokenizers<0.22,>=0.21 (from transformers>=4.30.0->-r [Link] (line 9))

#8 8.520 Downloading tokenizers-0.21.1-cp39-abi3-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (6.8 kB)

#8 8.692 Collecting safetensors>=0.4.3 (from transformers>=4.30.0->-r [Link] (line 9))

#8 8.707 Downloading safetensors-0.5.3-cp38-abi3-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (3.8 kB)

#8 8.782 Collecting tqdm>=4.27 (from transformers>=4.30.0->-r [Link] (line 9))

#8 8.795 Downloading [Link] (57 kB)

#8 8.902 Collecting psutil (from peft>=0.15.0->-r [Link] (line 10))

#8 8.914 Downloading

psutil-7.0.0-cp36-abi3-
manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.
[Link] (22 kB)

#8 8.986 Collecting lightning-utilities<2.0,>=0.10.0 (from lightning>=2.2.1->-r [Link] (line


12))

#8 8.999 Downloading lightning_utilities-[Link] (5.6 kB)

#8 9.012 Collecting packaging>=20.0 (from transformers>=4.30.0->-r [Link] (line 9))

#8 9.024 Downloading [Link] (3.2 kB)

#8 9.054 Collecting torchmetrics<3.0,>=0.7.0 (from lightning>=2.2.1->-r [Link] (line 12))

#8 9.066 Downloading [Link] (21 kB)

#8 9.199 Collecting pytorch-lightning (from lightning>=2.2.1->-r [Link] (line 12))

#8 9.212 Downloading pytorch_lightning-[Link] (20 kB)

#8 9.254 Collecting orderly-set<6,>=5.4.1 (from deepdiff>=6.3.1->-r [Link] (line 13))

#8 9.267 Downloading orderly_set-[Link] (6.2 kB)

#8 10.00 Collecting aiohttp!=4.0.0a0,!=4.0.0a1 (from fsspec<2026.0,>=2022.5.0->lightning>=2.2.1->-r


[Link] (line 12))

#8 10.02 Downloading aiohttp-3.12.11-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (7.6 kB)

#8 10.07 Collecting hf-xet<2.0.0,>=1.1.2 (from huggingface-hub<1.0,>=0.30.0->transformers>=4.30.0-


>-r [Link] (line 9))

#8 10.09 Downloading hf_xet-1.1.3-cp37-abi3-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (879 bytes)
#8 10.16 Collecting anyio<5,>=3.6.2 (from starlette<0.47.0,>=0.40.0->fastapi>=0.104.1->-r
[Link] (line 1))

#8 10.17 Downloading [Link] (4.7 kB)

#8 10.19 Collecting mpmath<1.4,>=1.1.0 (from sympy>=1.13.3->torch>=2.0.0->-r [Link]


(line 7))

#8 10.21 Downloading [Link] (8.6 kB)

#8 10.35 Collecting httptools>=0.6.3 (from uvicorn>=0.29.0->litserve==0.2.11)

#8 10.36 Downloading

httptools-0.6.4-cp312-cp312-
manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.
metadata (3.6 kB)

#8 10.42 Collecting uvloop>=0.15.1 (from uvicorn>=0.29.0->litserve==0.2.11)

#8 10.43 Downloading uvloop-0.21.0-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (4.9 kB)

#8 10.51 Collecting watchfiles>=0.13 (from uvicorn>=0.29.0->litserve==0.2.11)

#8 10.53 Downloading watchfiles-1.0.5-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (4.9 kB)

#8 10.65 Collecting websockets>=10.4 (from uvicorn>=0.29.0->litserve==0.2.11)

#8 10.66 Downloading

websockets-15.0.1-cp312-cp312-
manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.
metadata (6.8 kB)

#8 10.75 Collecting MarkupSafe>=2.0 (from jinja2->torch>=2.0.0->-r [Link] (line 7))

#8 10.76 Downloading MarkupSafe-3.0.2-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (4.0 kB)

#8 10.89 Collecting charset-normalizer<4,>=2 (from requests->transformers>=4.30.0->-r


[Link] (line 9))

#8 10.91 Downloading charset_normalizer-3.4.2-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (35 kB)

#8 10.93 Collecting idna<4,>=2.5 (from requests->transformers>=4.30.0->-r [Link] (line 9))

#8 10.95 Downloading [Link] (10 kB)

#8 10.99 Collecting urllib3<3,>=1.21.1 (from requests->transformers>=4.30.0->-r [Link]


(line 9))

#8 11.00 Downloading [Link] (6.5 kB)

#8 11.04 Collecting certifi>=2017.4.17 (from requests->transformers>=4.30.0->-r [Link]


(line 9))
#8 11.05 Downloading [Link] (2.5 kB)

#8 11.08 Collecting aiohappyeyeballs>=2.5.0 (from aiohttp!=4.0.0a0,!=4.0.0a1-


>fsspec<2026.0,>=2022.5.0->lightning>=2.2.1->-r

[Link] (line 12))

#8 11.09 Downloading [Link] (5.9 kB)

#8 11.11 Collecting aiosignal>=1.1.2 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec<2026.0,>=2022.5.0-


>lightning>=2.2.1->-r [Link] (line

12))

#8 11.12 Downloading [Link] (3.8 kB)

#8 11.14 Collecting attrs>=17.3.0 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec<2026.0,>=2022.5.0-


>lightning>=2.2.1->-r [Link] (line

12))

#8 11.15 Downloading [Link] (10 kB)

#8 11.24 Collecting frozenlist>=1.1.1 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec<2026.0,>=2022.5.0-


>lightning>=2.2.1->-r [Link]

(line 12))

#8 11.25 Downloading

frozenlist-1.6.2-cp312-cp312-
manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl.
metadata (17 kB)

#8 11.56 Collecting multidict<7.0,>=4.5 (from aiohttp!=4.0.0a0,!=4.0.0a1-


>fsspec<2026.0,>=2022.5.0->lightning>=2.2.1->-r [Link]

(line 12))

#8 11.57 Downloading multidict-6.4.4-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (5.3 kB)

#8 11.61 Collecting propcache>=0.2.0 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec<2026.0,>=2022.5.0-


>lightning>=2.2.1->-r [Link] (line

12))

#8 11.63 Downloading propcache-0.3.1-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (10 kB)

#8 11.93 Collecting yarl<2.0,>=1.17.0 (from aiohttp!=4.0.0a0,!=4.0.0a1->fsspec<2026.0,>=2022.5.0-


>lightning>=2.2.1->-r [Link]

(line 12))

#8 11.94 Downloading yarl-1.20.0-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.[Link] (72 kB)
#8 11.98 Collecting sniffio>=1.1 (from anyio<5,>=3.6.2->starlette<0.47.0,>=0.40.0->fastapi>=0.104.1-
>-r [Link] (line 1))

#8 11.99 Downloading [Link] (3.9 kB)

#8 12.09 Downloading [Link] (75 kB)

#8 12.10 Downloading [Link] (95 kB)

#8 12.11 Downloading [Link] (62 kB)

#8 12.13 Downloading python_multipart-[Link] (24 kB)

#8 12.14 Downloading numpy-2.3.0-cp312-cp312-manylinux_2_28_x86_64.whl (16.6 MB)

#8 12.30 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 16.6/16.6 MB 109.9 MB/s eta


0:00:00

#8 12.31 Downloading [Link] (444 kB)

#8 12.33 Downloading pydantic_core-2.33.2-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.whl (2.0 MB)

#8 12.34 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 183.1 MB/s eta


0:00:00

#8 12.35 Downloading python_dotenv-[Link] (20 kB)

#8 12.37 Downloading torch-2.7.1-cp312-cp312-manylinux_2_28_x86_64.whl (821.0 MB)

#8 15.48 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 821.0/821.0 MB 288.5 MB/s


eta 0:00:00

#8 15.49 Downloading nvidia_cublas_cu12-[Link]-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.whl (393.1 MB)

#8 17.20 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 393.1/393.1 MB 226.4 MB/s


eta 0:00:00

#8 17.21 Downloading nvidia_cuda_cupti_cu12-12.6.80-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.whl (8.9 MB)

#8 17.25 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 8.9/8.9 MB 235.6 MB/s eta


0:00:00

#8 17.26 Downloading nvidia_cuda_nvrtc_cu12-12.6.77-py3-none-manylinux2014_x86_64.whl (23.7


MB)

#8 17.37 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 23.7/23.7 MB 233.6 MB/s eta


0:00:00

#8 17.38 Downloading nvidia_cuda_runtime_cu12-12.6.77-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.whl (897 kB)

#8 17.39 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 897.7/897.7 kB 406.3 MB/s eta


0:00:00
#8 17.40 Downloading nvidia_cudnn_cu12-[Link]-py3-none-manylinux_2_28_x86_64.whl (571.0
MB)

#8 19.73 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 571.0/571.0 MB 251.8 MB/s


eta 0:00:00

#8 19.74 Downloading nvidia_cufft_cu12-[Link]-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.whl (200.2 MB)

#8 20.53 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 200.2/200.2 MB 253.8 MB/s


eta 0:00:00

#8 20.54 Downloading nvidia_cufile_cu12-[Link]-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.whl (1.1 MB)

#8 20.55 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.1/1.1 MB 327.3 MB/s eta


0:00:00

#8 20.56 Downloading nvidia_curand_cu12-[Link]-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.whl (56.3 MB)

#8 20.82 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 56.3/56.3 MB 231.5 MB/s eta


0:00:00

#8 20.83 Downloading nvidia_cusolver_cu12-[Link]-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.whl (158.2 MB)

#8 21.51 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 158.2/158.2 MB 237.0 MB/s


eta 0:00:00

#8 21.52 Downloading nvidia_cusparse_cu12-[Link]-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.whl (216.6 MB)

#8 22.36 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 216.6/216.6 MB 258.8 MB/s


eta 0:00:00

#8 22.37 Downloading nvidia_cusparselt_cu12-0.6.3-py3-none-manylinux2014_x86_64.whl (156.8


MB)

#8 22.98 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 156.8/156.8 MB 259.7 MB/s


eta 0:00:00

#8 22.99 Downloading nvidia_nccl_cu12-2.26.2-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.whl (201.3 MB)

#8 23.75 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 201.3/201.3 MB 268.0 MB/s


eta 0:00:00

#8 23.76 Downloading nvidia_nvjitlink_cu12-12.6.85-py3-none-


manylinux2010_x86_64.manylinux_2_12_x86_64.whl (19.7 MB)

#8 23.84 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 19.7/19.7 MB 276.8 MB/s eta


0:00:00

#8 23.85 Downloading nvidia_nvtx_cu12-12.6.77-py3-none-


manylinux2014_x86_64.manylinux_2_17_x86_64.whl (89 kB)
#8 23.86 Downloading triton-3.3.1-cp312-cp312-
manylinux_2_27_x86_64.manylinux_2_28_x86_64.whl (155.7 MB)

#8 24.43 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 155.7/155.7 MB 277.0 MB/s


eta 0:00:00

#8 24.44 Downloading torchvision-0.22.1-cp312-cp312-manylinux_2_28_x86_64.whl (7.5 MB)

#8 24.47 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 7.5/7.5 MB 295.3 MB/s eta


0:00:00

#8 24.48 Downloading [Link] (10.5 MB)

#8 24.52 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 10.5/10.5 MB 260.9 MB/s eta


0:00:00

#8 24.54 Downloading [Link] (411 kB)

#8 24.55 Downloading [Link] (819 kB)

#8 24.56 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 819.0/819.0 kB 563.2 MB/s eta


0:00:00

#8 24.57 Downloading [Link] (85 kB)

#8 24.58 Downloading [Link] (362 kB)

#8 24.59 Downloading annotated_types-[Link] (13 kB)

#8 24.60 Downloading [Link] (102 kB)

#8 24.62 Downloading [Link] (199 kB)

#8 24.63 Downloading [Link] (37 kB)

#8 24.64 Downloading huggingface_hub-[Link] (512 kB)

#8 24.65 Downloading lightning_utilities-[Link] (28 kB)

#8 24.66 Downloading orderly_set-[Link] (12 kB)

#8 24.68 Downloading [Link] (65 kB)

#8 24.69 Downloading pillow-11.2.1-cp312-cp312-manylinux_2_28_x86_64.whl (4.6 MB)

#8 24.71 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.6/4.6 MB 302.0 MB/s eta


0:00:00

#8 24.72 Downloading PyYAML-6.0.2-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.whl (767 kB)

#8 24.72 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 767.5/767.5 kB 493.0 MB/s eta


0:00:00

#8 24.73 Downloading pyzmq-26.4.0-cp312-cp312-manylinux_2_28_x86_64.whl (855 kB)

#8 24.74 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 855.9/855.9 kB 133.3 MB/s eta


0:00:00
#8 24.76 Downloading regex-2024.11.6-cp312-cp312-
manylinux_2_17_x86_64.manylinux2014_x86_64.whl (796 kB)

#8 24.76 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 796.9/796.9 kB 262.4 MB/s eta


0:00:00

#8 24.78 Downloading safetensors-0.5.3-cp38-abi3-


manylinux_2_17_x86_64.manylinux2014_x86_64.whl (471 kB)

#8 24.79 Downloading [Link] (1.2 MB)

#8 24.80 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.2/1.2 MB 486.4 MB/s eta


0:00:00

#8 24.81 Downloading [Link] (72 kB)

#8 24.82 Downloading [Link] (6.3 MB)

#8 24.85 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 6.3/6.3 MB 260.8 MB/s eta


0:00:00

#8 24.86 Downloading tokenizers-0.21.1-cp39-abi3-


manylinux_2_17_x86_64.manylinux2014_x86_64.whl (3.0 MB)

#8 24.88 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 3.0/3.0 MB 248.4 MB/s eta


0:00:00

#8 24.89 Downloading [Link] (962 kB)

#8 24.89 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 962.5/962.5 kB 453.9 MB/s eta


0:00:00

#8 24.90 Downloading [Link] (78 kB)

#8 24.92 Downloading typing_extensions-[Link] (43 kB)

#8 24.93 Downloading typing_inspection-[Link] (14 kB)

#8 24.94 Downloading [Link] (16 kB)

#8 24.95 Downloading [Link] (134 kB)

#8 24.96 Downloading [Link] (2.0 MB)

#8 24.97 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.0/2.0 MB 488.2 MB/s eta


0:00:00

#8 24.98 Downloading psutil-7.0.0-cp36-abi3-


manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.
whl (277

kB)

#8 25.00 Downloading pytorch_lightning-[Link] (823 kB)

#8 25.00 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 823.1/823.1 kB 557.8 MB/s eta


0:00:00
#8 25.01 Downloading [Link] (64 kB)

#8 25.02 Downloading aiohttp-3.12.11-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.whl (1.7 MB)

#8 25.03 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 1.7/1.7 MB 375.6 MB/s eta


0:00:00

#8 25.04 Downloading [Link] (100 kB)

#8 25.06 Downloading [Link] (159 kB)

#8 25.07 Downloading charset_normalizer-3.4.2-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.whl (148 kB)

#8 25.08 Downloading hf_xet-1.1.3-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl


(4.8 MB)

#8 25.10 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.8/4.8 MB 296.8 MB/s eta


0:00:00

#8 25.11 Downloading httptools-0.6.4-cp312-cp312-


manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
(510

kB)

#8 25.13 Downloading [Link] (70 kB)

#8 25.14 Downloading MarkupSafe-3.0.2-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.whl (23 kB)

#8 25.15 Downloading [Link] (536 kB)

#8 25.16 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 536.2/536.2 kB 346.7 MB/s eta


0:00:00

#8 25.17 Downloading [Link] (128 kB)

#8 25.18 Downloading uvloop-0.21.0-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.whl (4.7 MB)

#8 25.20 ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 4.7/4.7 MB 301.8 MB/s eta


0:00:00

#8 25.21 Downloading watchfiles-1.0.5-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.whl (454 kB)

#8 25.23 Downloading websockets-15.0.1-cp312-cp312-


manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl

(182 kB)

#8 25.24 Downloading [Link] (15 kB)

#8 25.25 Downloading [Link] (7.6 kB)

#8 25.27 Downloading [Link] (63 kB)


#8 25.28 Downloading frozenlist-1.6.2-cp312-cp312-
manylinux_2_5_x86_64.manylinux1_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl
(240

kB)

#8 25.29 Downloading multidict-6.4.4-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.whl (223 kB)

#8 25.30 Downloading propcache-0.3.1-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.whl (245 kB)

#8 25.31 Downloading [Link] (10 kB)

#8 25.34 Downloading yarl-1.20.0-cp312-cp312-


manylinux_2_17_x86_64.manylinux2014_x86_64.whl (349 kB)

#8 38.25 Installing collected packages: nvidia-cusparselt-cu12, mpmath, websockets, uvloop, urllib3,


typing-extensions, tqdm, sympy,

sniffio, setuptools, safetensors, regex, pyzmq, pyyaml, python-multipart, python-dotenv, psutil,


propcache, pillow, packaging, orderly-set,

nvidia-nvtx-cu12, nvidia-nvjitlink-cu12, nvidia-nccl-cu12, nvidia-curand-cu12, nvidia-cufile-cu12,


nvidia-cuda-runtime-cu12,

nvidia-cuda-nvrtc-cu12, nvidia-cuda-cupti-cu12, nvidia-cublas-cu12, numpy, networkx, multidict,


MarkupSafe, idna, httptools, hf-xet, h11,

fsspec, frozenlist, filelock, click, charset-normalizer, certifi, attrs, annotated-types, aiohappyeyeballs,


yarl, uvicorn,

typing-inspection, triton, requests, pydantic-core, nvidia-cusparse-cu12, nvidia-cufft-cu12, nvidia-


cudnn-cu12, lightning-utilities, jinja2,

deepdiff, anyio, aiosignal, watchfiles, starlette, pydantic, nvidia-cusolver-cu12, huggingface-hub,


aiohttp, torch, tokenizers, fastapi,

transformers, torchvision, torchmetrics, litserve, accelerate, pytorch-lightning, peft, lightning

#8 111.4 Successfully installed MarkupSafe-3.0.2 accelerate-1.7.0 aiohappyeyeballs-2.6.1 aiohttp-


3.12.11 aiosignal-1.3.2

annotated-types-0.7.0 anyio-4.9.0 attrs-25.3.0 certifi-2025.4.26 charset-normalizer-3.4.2 click-8.2.1


deepdiff-8.5.0 fastapi-0.115.12

filelock-3.18.0 frozenlist-1.6.2 fsspec-2025.5.1 h11-0.16.0 hf-xet-1.1.3 httptools-0.6.4 huggingface-


hub-0.32.4 idna-3.10 jinja2-3.1.6

lightning-2.5.1.post0 lightning-utilities-0.14.3 litserve-0.2.11 mpmath-1.3.0 multidict-6.4.4 networkx-


3.5 numpy-2.3.0

nvidia-cublas-cu12-[Link] nvidia-cuda-cupti-cu12-12.6.80 nvidia-cuda-nvrtc-cu12-12.6.77 nvidia-


cuda-runtime-cu12-12.6.77
nvidia-cudnn-cu12-[Link] nvidia-cufft-cu12-[Link] nvidia-cufile-cu12-[Link] nvidia-curand-
cu12-[Link] nvidia-cusolver-cu12-[Link]

nvidia-cusparse-cu12-[Link] nvidia-cusparselt-cu12-0.6.3 nvidia-nccl-cu12-2.26.2 nvidia-nvjitlink-


cu12-12.6.85 nvidia-nvtx-cu12-12.6.77

orderly-set-5.4.1 packaging-24.2 peft-0.15.2 pillow-11.2.1 propcache-0.3.1 psutil-7.0.0 pydantic-


2.11.5 pydantic-core-2.33.2

python-dotenv-1.1.0 python-multipart-0.0.20 pytorch-lightning-2.5.1.post0 pyyaml-6.0.2 pyzmq-


26.4.0 regex-2024.11.6 requests-2.32.3

safetensors-0.5.3 setuptools-80.9.0 sniffio-1.3.1 starlette-0.46.2 sympy-1.14.0 tokenizers-0.21.1


torch-2.7.1 torchmetrics-1.7.2

torchvision-0.22.1 tqdm-4.67.1 transformers-4.52.4 triton-3.3.1 typing-extensions-4.14.0 typing-


inspection-0.4.1 urllib3-2.4.0

uvicorn-0.34.3 uvloop-0.21.0 watchfiles-1.0.5 websockets-15.0.1 yarl-1.20.0

#8 111.4 WARNING: Running pip as the 'root' user can result in broken permissions and conflicting
behaviour with the system package manager,

possibly rendering your system unusable. It is recommended to use a virtual environment instead:
[Link] Use the

--root-user-action option if you know what you are doing and want to suppress this warning.

#8 111.6

#8 111.6 A new release of pip is available: 25.0.1 -> 25.1.1

#8 111.6 To update, run: pip install --upgrade pip

#8 DONE 113.5s

#9 exporting to image

#9 exporting layers

#9 exporting layers 45.7s done

#9 writing image
sha256:02b351e29b4fa2222c3c4611d5969dfa7356f7122dfa136b44bf3706ae685658 done

#9 naming to [Link]/library/litserve-jun-08-10_34:latest 0.0s done

#9 DONE 45.7s

Pushing container to registry. It may take a while...

The push refers to repository


Preparing

Preparing

Preparing

Preparing

Preparing

Preparing

Preparing

Pushed

Pushed

Pushed

Pushed

Pushed

Pushed

Pushed

latest: digest: sha256:a3728ca5336d67c04709f3b5aa3873c9ddd2246ab208e5a3880dc4ca15d85b6c


size: 1793

Container pushed successfully

✅ Image pushed to litserve-jun-08-10_34:latest

No cloud account was provided, defaulting to legislative-indigo-lpsx

🚀 Deployment started, access at [Link]


jun-08-10_34

⚡~

this is what I have done with those files how can I use the llm model now is it deployed publicly?

You might also like