FreeLLMAPI
FreeLLMAPI aggregates free tiers from 29 LLM providers into a single OpenAI-compatible endpoint with smart routing, automatic failover, per-key rate tracking, and encrypted key storage.
How to deploy
Deploy FreeLLMAPI on Notploy
- Install Notploy on your server if you haven't already.
- In your Notploy panel, open a project and click Create Service → Template.
- Search for FreeLLMAPI and click Create — Notploy configures domains, environment variables, and volumes for you.
Alternatively, create a Compose service, go to Advanced → Import from Base64, and paste this payload:
ewogICJjb21wb3NlIjogInNlcnZpY2VzOlxuICBmcmVlbGxtYXBpOlxuICAgIGltYWdlOiBnaGNyLmlvL3Rhc2hmZWVuYWhtZWQvZnJlZWxsbWFwaTp2MC44LjRcbiAgICByZXN0YXJ0OiB1bmxlc3Mtc3RvcHBlZFxuICAgIGVudmlyb25tZW50OlxuICAgICAgTk9ERV9FTlY6IHByb2R1Y3Rpb25cbiAgICAgIFBPUlQ6ICR7UE9SVH1cbiAgICAgIEVOQ1JZUFRJT05fS0VZOiAke0VOQ1JZUFRJT05fS0VZfVxuICAgIGV4cG9zZTpcbiAgICAgIC0gMzAwMVxuICAgIHZvbHVtZXM6XG4gICAgICAtIGZyZWVsbG1hcGktZGF0YTovYXBwL3NlcnZlci9kYXRhXG4gICAgaGVhbHRoY2hlY2s6XG4gICAgICB0ZXN0OlxuICAgICAgICBbXG4gICAgICAgICAgXCJDTURcIixcbiAgICAgICAgICBcIm5vZGVcIixcbiAgICAgICAgICBcIi1lXCIsXG4gICAgICAgICAgXCJmZXRjaCgnaHR0cDovLzEyNy4wLjAuMTozMDAxL2FwaS9waW5nJykudGhlbigocmVzKSA9PiB7IGlmICghcmVzLm9rKSBwcm9jZXNzLmV4aXQoMSk7IH0pLmNhdGNoKCgpID0+IHByb2Nlc3MuZXhpdCgxKSk7XCJcbiAgICAgICAgXVxuICAgICAgaW50ZXJ2YWw6IDMwc1xuICAgICAgdGltZW91dDogNXNcbiAgICAgIHN0YXJ0X3BlcmlvZDogMTVzXG4gICAgICByZXRyaWVzOiAzXG5cbnZvbHVtZXM6XG4gIGZyZWVsbG1hcGktZGF0YToiLAogICJjb25maWciOiAiW3ZhcmlhYmxlc11cbm1haW5fZG9tYWluID0gXCIke2RvbWFpbn1cIlxuZW5jcnlwdGlvbl9rZXkgPSBcIiR7aGFzaDo2NH1cIlxuXG5bY29uZmlnXVxuW1tjb25maWcuZG9tYWluc11dXG5zZXJ2aWNlTmFtZSA9IFwiZnJlZWxsbWFwaVwiXG5wb3J0ID0gMzAwMVxuaG9zdCA9IFwiJHttYWluX2RvbWFpbn1cIlxuXG5bY29uZmlnLmVudl1cbk5PREVfRU5WID0gXCJwcm9kdWN0aW9uXCJcblBPUlQgPSBcIjMwMDFcIlxuRU5DUllQVElPTl9LRVkgPSBcIiR7ZW5jcnlwdGlvbl9rZXl9XCIiCn0=
Reference files
Configuration
The exact Docker Compose and template configuration this template deploys.
More like this
Related Templates
LiteLLM
Version main-stable
LiteLLM is a lightweight OpenAI API-compatible proxy for managing multiple LLM providers with a single endpoint.
9Router
Version 0.5.59
Self-hosted AI model router that rotates requests across 40+ providers with automatic fallback, exposing an OpenAI-compatible endpoint for coding agents.
AnythingLLM
Version latest
AnythingLLM is a private AI chat app for working with your own documents. Self-host it on your own server with Dokploy, which deploys AnythingLLM as a Docker Compose service in a few clicks.
Arche
Version latest
Arche is a self-hosted AI workspace platform that spawns per-user OpenCode coding containers backed by a shared Knowledge Base. Requires the `arche-internal` external Docker network and `/opt/arche/{kb-content,kb-config,users}` directories on the host before deploy. Images are linux/amd64 by default; override `ARCHE_WEB_IMAGE` and `ARCHE_WORKSPACE_IMAGE` to the `-arm64` tag variants for ARM64 hosts.
bolt.diy
Version latest
Prompt, run, edit, and deploy full-stack web applications using any LLM you want!
Corsfix
Version 8899bb15e71c7238285ccefc4c95a0cd47daeaf0
Corsfix is an open source CORS proxy platform for fetching APIs from browser applications, with origin and target allowlists, encrypted API secrets, response caching, and a management dashboard.
Free and open source
Self-host FreeLLMAPI in minutes
Notploy is a free, open source deployment platform. Deploy FreeLLMAPI and 571+ other templates on your own infrastructure with a single click.