LiteLLM
LiteLLM is a lightweight OpenAI API-compatible proxy for managing multiple LLM providers with a single endpoint.
How to deploy
Deploy LiteLLM on Notploy
- Install Notploy on your server if you haven't already.
- In your Notploy panel, open a project and click Create Service → Template.
- Search for LiteLLM and click Create — Notploy configures domains, environment variables, and volumes for you.
Alternatively, create a Compose service, go to Advanced → Import from Base64, and paste this payload:
ewogICJjb21wb3NlIjogInNlcnZpY2VzOlxuICBsaXRlbGxtOlxuICAgIGltYWdlOiBnaGNyLmlvL2JlcnJpYWkvbGl0ZWxsbTptYWluLWxhdGVzdFxuICAgIHJlc3RhcnQ6IHVubGVzcy1zdG9wcGVkXG4gICAgZGVwZW5kc19vbjpcbiAgICAgIGxpdGVsbG0tZGI6XG4gICAgICAgIGNvbmRpdGlvbjogc2VydmljZV9oZWFsdGh5XG4gICAgZW52aXJvbm1lbnQ6XG4gICAgICBEQVRBQkFTRV9VUkw6ICR7REFUQUJBU0VfVVJMfVxuICAgICAgTElURUxMTV9NQVNURVJfS0VZOiAke0xJVEVMTE1fTUFTVEVSX0tFWX1cbiAgICAgIFVJX1VTRVJOQU1FOiAke1VJX1VTRVJOQU1FfVxuICAgICAgVUlfUEFTU1dPUkQ6ICR7VUlfUEFTU1dPUkR9XG4gICAgICBTVE9SRV9NT0RFTF9JTl9EQjogXCJUcnVlXCJcblxuICAgICAgIyBQcm92aWRlciBLZXlzXG4gICAgICBPUEVOQUlfQVBJX0tFWTogJHtPUEVOQUlfQVBJX0tFWX1cbiAgICAgIE9QRU5BSV9CQVNFX1VSTDogJHtPUEVOQUlfQkFTRV9VUkx9XG4gICAgICBDT0hFUkVfQVBJX0tFWTogJHtDT0hFUkVfQVBJX0tFWX1cbiAgICAgIE9SX1NJVEVfVVJMOiAke09SX1NJVEVfVVJMfVxuICAgICAgT1JfQVBQX05BTUU6ICR7T1JfQVBQX05BTUV9XG4gICAgICBPUl9BUElfS0VZOiAke09SX0FQSV9LRVl9XG4gICAgICBBWlVSRV9BUElfQkFTRTogJHtBWlVSRV9BUElfQkFTRX1cbiAgICAgIEFaVVJFX0FQSV9WRVJTSU9OOiAke0FaVVJFX0FQSV9WRVJTSU9OfVxuICAgICAgQVpVUkVfQVBJX0tFWTogJHtBWlVSRV9BUElfS0VZfVxuICAgICAgUkVQTElDQVRFX0FQSV9LRVk6ICR7UkVQTElDQVRFX0FQSV9LRVl9XG4gICAgICBSRVBMSUNBVEVfQVBJX1RPS0VOOiAke1JFUExJQ0FURV9BUElfVE9LRU59XG4gICAgICBBTlRIUk9QSUNfQVBJX0tFWTogJHtBTlRIUk9QSUNfQVBJX0tFWX1cbiAgICAgIElORklTSUNBTF9UT0tFTjogJHtJTkZJU0lDQUxfVE9LRU59XG4gICAgICBOT1ZJVEFfQVBJX0tFWTogJHtOT1ZJVEFfQVBJX0tFWX1cbiAgICAgIElORklOSVRZX0FQSV9LRVk6ICR7SU5GSU5JVFlfQVBJX0tFWX1cblxuICAgIGV4cG9zZTpcbiAgICAgIC0gNDAwMFxuXG4gIGxpdGVsbG0tZGI6XG4gICAgaW1hZ2U6IHBvc3RncmVzOjE2LWFscGluZVxuICAgIHJlc3RhcnQ6IG9uLWZhaWx1cmU6NVxuICAgIGhlYWx0aGNoZWNrOlxuICAgICAgdGVzdDogW1wiQ01ELVNIRUxMXCIsIFwicGdfaXNyZWFkeSAtVSAke1BPU1RHUkVTX1VTRVJ9IC1kICR7UE9TVEdSRVNfREJ9XCJdXG4gICAgICBpbnRlcnZhbDogNXNcbiAgICAgIHRpbWVvdXQ6IDVzXG4gICAgICByZXRyaWVzOiA1XG4gICAgdm9sdW1lczpcbiAgICAgIC0gbGl0ZWxsbS1kYjovdmFyL2xpYi9wb3N0Z3Jlc3FsL2RhdGFcbiAgICBlbnZpcm9ubWVudDpcbiAgICAgIFBPU1RHUkVTX0RCOiAke1BPU1RHUkVTX0RCfVxuICAgICAgUE9TVEdSRVNfVVNFUjogJHtQT1NUR1JFU19VU0VSfVxuICAgICAgUE9TVEdSRVNfUEFTU1dPUkQ6ICR7UE9TVEdSRVNfUEFTU1dPUkR9XG5cbnZvbHVtZXM6XG4gIGxpdGVsbG0tZGI6IHt9IiwKICAiY29uZmlnIjogIlt2YXJpYWJsZXNdXG5tYWluX2RvbWFpbiA9IFwiJHtkb21haW59XCJcblxuIyBEYXRhYmFzZVxucG9zdGdyZXNfZGIgPSBcImxpdGVsbG1cIlxucG9zdGdyZXNfdXNlciA9IFwibGl0ZWxsbVwiXG5wb3N0Z3Jlc19wYXNzd29yZCA9IFwiJHtwYXNzd29yZDozMn1cIlxuXG4jIExpdGVMTE0gVUkgKyBNYXN0ZXIgS2V5XG51aV91c2VybmFtZSA9IFwiJHt1c2VybmFtZX1cIlxudWlfcGFzc3dvcmQgPSBcIiR7cGFzc3dvcmQ6MzJ9XCJcbmxpdGVsbG1fbWFzdGVyX2tleSA9IFwiJHtwYXNzd29yZDo2NH1cIlxuXG4jIFByb3ZpZGVyIEFQSSBLZXlzIChlbXB0eSBieSBkZWZhdWx0KVxub3BlbmFpX2FwaV9rZXkgPSBcIlwiXG5vcGVuYWlfYmFzZV91cmwgPSBcIlwiXG5jb2hlcmVfYXBpX2tleSA9IFwiXCJcbm9yX3NpdGVfdXJsID0gXCJcIlxub3JfYXBwX25hbWUgPSBcIkxpdGVMTE0gRXhhbXBsZSBhcHBcIlxub3JfYXBpX2tleSA9IFwiXCJcbmF6dXJlX2FwaV9iYXNlID0gXCJcIlxuYXp1cmVfYXBpX3ZlcnNpb24gPSBcIlwiXG5henVyZV9hcGlfa2V5ID0gXCJcIlxucmVwbGljYXRlX2FwaV9rZXkgPSBcIlwiXG5yZXBsaWNhdGVfYXBpX3Rva2VuID0gXCJcIlxuYW50aHJvcGljX2FwaV9rZXkgPSBcIlwiXG5pbmZpc2ljYWxfdG9rZW4gPSBcIlwiXG5ub3ZpdGFfYXBpX2tleSA9IFwiXCJcbmluZmluaXR5X2FwaV9rZXkgPSBcIlwiXG5cbltjb25maWddXG5tb3VudHMgPSBbXVxuW1tjb25maWcuZG9tYWluc11dXG5zZXJ2aWNlTmFtZSA9IFwibGl0ZWxsbVwiXG5wb3J0ID0gNDAwMFxuaG9zdCA9IFwiJHttYWluX2RvbWFpbn1cIlxuXG5bY29uZmlnLmVudl1cbiMgRGF0YWJhc2VcbkRBVEFCQVNFX1VSTCA9IFwicG9zdGdyZXNxbDovLyR7cG9zdGdyZXNfdXNlcn06JHtwb3N0Z3Jlc19wYXNzd29yZH1AbGl0ZWxsbS1kYjo1NDMyLyR7cG9zdGdyZXNfZGJ9XCJcblBPU1RHUkVTX0RCID0gXCIke3Bvc3RncmVzX2RifVwiXG5QT1NUR1JFU19VU0VSID0gXCIke3Bvc3RncmVzX3VzZXJ9XCJcblBPU1RHUkVTX1BBU1NXT1JEID0gXCIke3Bvc3RncmVzX3Bhc3N3b3JkfVwiXG5cbiMgTGl0ZUxMTVxuVUlfVVNFUk5BTUUgPSBcIiR7dWlfdXNlcm5hbWV9XCJcblVJX1BBU1NXT1JEID0gXCIke3VpX3Bhc3N3b3JkfVwiXG5MSVRFTExNX01BU1RFUl9LRVkgPSBcIiR7bGl0ZWxsbV9tYXN0ZXJfa2V5fVwiXG5TVE9SRV9NT0RFTF9JTl9EQiA9IFwiVHJ1ZVwiXG5cbiMgUHJvdmlkZXJzXG5PUEVOQUlfQVBJX0tFWSA9IFwiJHtvcGVuYWlfYXBpX2tleX1cIlxuT1BFTkFJX0JBU0VfVVJMID0gXCIke29wZW5haV9iYXNlX3VybH1cIlxuQ09IRVJFX0FQSV9LRVkgPSBcIiR7Y29oZXJlX2FwaV9rZXl9XCJcbk9SX1NJVEVfVVJMID0gXCIke29yX3NpdGVfdXJsfVwiXG5PUl9BUFBfTkFNRSA9IFwiJHtvcl9hcHBfbmFtZX1cIlxuT1JfQVBJX0tFWSA9IFwiJHtvcl9hcGlfa2V5fVwiXG5BWlVSRV9BUElfQkFTRSA9IFwiJHthenVyZV9hcGlfYmFzZX1cIlxuQVpVUkVfQVBJX1ZFUlNJT04gPSBcIiR7YXp1cmVfYXBpX3ZlcnNpb259XCJcbkFaVVJFX0FQSV9LRVkgPSBcIiR7YXp1cmVfYXBpX2tleX1cIlxuUkVQTElDQVRFX0FQSV9LRVkgPSBcIiR7cmVwbGljYXRlX2FwaV9rZXl9XCJcblJFUExJQ0FURV9BUElfVE9LRU4gPSBcIiR7cmVwbGljYXRlX2FwaV90b2tlbn1cIlxuQU5USFJPUElDX0FQSV9LRVkgPSBcIiR7YW50aHJvcGljX2FwaV9rZXl9XCJcbklORklTSUNBTF9UT0tFTiA9IFwiJHtpbmZpc2ljYWxfdG9rZW59XCJcbk5PVklUQV9BUElfS0VZID0gXCIke25vdml0YV9hcGlfa2V5fVwiXG5JTkZJTklUWV9BUElfS0VZID0gXCIke2luZmluaXR5X2FwaV9rZXl9XCIiCn0=
Reference files
Configuration
The exact Docker Compose and template configuration this template deploys.
More like this
Related Templates
FreeLLMAPI
Version v0.8.4
FreeLLMAPI aggregates free tiers from 29 LLM providers into a single OpenAI-compatible endpoint with smart routing, automatic failover, per-key rate tracking, and encrypted key storage.
Langfuse
Version 4
Langfuse is an open-source LLM engineering platform for tracing, prompt management, evaluation, and cost/usage analytics of LLM applications.
9Router
Version 0.5.59
Self-hosted AI model router that rotates requests across 40+ providers with automatic fallback, exposing an OpenAI-compatible endpoint for coding agents.
AnythingLLM
Version latest
AnythingLLM is a private AI chat app for working with your own documents. Self-host it on your own server with Dokploy, which deploys AnythingLLM as a Docker Compose service in a few clicks.
Arche
Version latest
Arche is a self-hosted AI workspace platform that spawns per-user OpenCode coding containers backed by a shared Knowledge Base. Requires the `arche-internal` external Docker network and `/opt/arche/{kb-content,kb-config,users}` directories on the host before deploy. Images are linux/amd64 by default; override `ARCHE_WEB_IMAGE` and `ARCHE_WORKSPACE_IMAGE` to the `-arm64` tag variants for ARM64 hosts.
bolt.diy
Version latest
Prompt, run, edit, and deploy full-stack web applications using any LLM you want!
Free and open source
Self-host LiteLLM in minutes
Notploy is a free, open source deployment platform. Deploy LiteLLM and 571+ other templates on your own infrastructure with a single click.