Crawl4AI

v0.7.3

Crawl4AI is a modern AI-powered web crawler with support for screenshots, PDFs, JavaScript execution, and LLM-based extraction. Includes an interactive playground and MCP (Model Context Protocol) integration.

crawler scraping ai llm api

Deploy on Notploy

Website GitHub Documentation

How to deploy

Deploy Crawl4AI on Notploy

Install Notploy on your server if you haven't already.
In your Notploy panel, open a project and click Create Service → Template.
Search for Crawl4AI and click Create — Notploy configures domains, environment variables, and volumes for you.

Alternatively, create a Compose service, go to Advanced → Import from Base64, and paste this payload:

base64

ewogICJjb21wb3NlIjogInNlcnZpY2VzOlxuICBjcmF3bDRhaTpcbiAgICBpbWFnZTogdW5jbGVjb2RlL2NyYXdsNGFpOmxhdGVzdFxuICAgIHJlc3RhcnQ6IHVubGVzcy1zdG9wcGVkXG4gICAgc2htX3NpemU6IDFnXG4gICAgZXhwb3NlOlxuICAgICAgLSAxMTIzNVxuICAgIGVudmlyb25tZW50OlxuICAgICAgLSBMTE1fUFJPVklERVI9JHtMTE1fUFJPVklERVJ9XG4gICAgICAtIE9QRU5BSV9BUElfS0VZPSR7T1BFTkFJX0FQSV9LRVl9XG4gICAgICAtIEFOVEhST1BJQ19BUElfS0VZPSR7QU5USFJPUElDX0FQSV9LRVl9XG4gICAgICAtIERFRVBTRUVLX0FQSV9LRVk9JHtERUVQU0VFS19BUElfS0VZfVxuICAgICAgLSBHUk9RX0FQSV9LRVk9JHtHUk9RX0FQSV9LRVl9XG4gICAgICAtIFRPR0VUSEVSX0FQSV9LRVk9JHtUT0dFVEhFUl9BUElfS0VZfVxuICAgICAgLSBNSVNUUkFMX0FQSV9LRVk9JHtNSVNUUkFMX0FQSV9LRVl9XG4gICAgICAtIEdFTUlOSV9BUElfVE9LRU49JHtHRU1JTklfQVBJX1RPS0VOfVxuICAgIGhlYWx0aGNoZWNrOlxuICAgICAgdGVzdDogW1wiQ01EXCIsIFwiY3VybFwiLCBcIi1mXCIsIFwiaHR0cDovL2xvY2FsaG9zdDoxMTIzNS9oZWFsdGhcIl1cbiAgICAgIGludGVydmFsOiAzMHNcbiAgICAgIHRpbWVvdXQ6IDEwc1xuICAgICAgcmV0cmllczogMyIsCiAgImNvbmZpZyI6ICJbdmFyaWFibGVzXVxubWFpbl9kb21haW4gPSBcIiR7ZG9tYWlufVwiXG5cbltjb25maWddXG5bW2NvbmZpZy5kb21haW5zXV1cbnNlcnZpY2VOYW1lID0gXCJjcmF3bDRhaVwiXG5wb3J0ID0gMTEyMzVcbmhvc3QgPSBcIiR7bWFpbl9kb21haW59XCJcblxuW2NvbmZpZy5lbnZdXG5MTE1fUFJPVklERVIgPSBcIm9wZW5haS9ncHQtNG8tbWluaVwiXG5PUEVOQUlfQVBJX0tFWSA9IFwiJHtwYXNzd29yZDo0OH1cIlxuQU5USFJPUElDX0FQSV9LRVkgPSBcIlwiXG5ERUVQU0VFS19BUElfS0VZID0gXCJcIlxuR1JPUV9BUElfS0VZID0gXCJcIlxuVE9HRVRIRVJfQVBJX0tFWSA9IFwiXCJcbk1JU1RSQUxfQVBJX0tFWSA9IFwiXCJcbkdFTUlOSV9BUElfVE9LRU4gPSBcIlwiIgp9

Reference files

Configuration

The exact Docker Compose and template configuration this template deploys.

Firecrawl

Version 2.11.230

Production-ready, authenticated Firecrawl with persistent queues, browser rendering, a generated API key, and interactive OpenAPI documentation.

apicrawlerscraping

AnythingLLM

Version latest

AnythingLLM is a private AI chat app for working with your own documents. Self-host it on your own server with Dokploy, which deploys AnythingLLM as a Docker Compose service in a few clicks.

aillmchatbot

Arche

Version latest

Arche is a self-hosted AI workspace platform that spawns per-user OpenCode coding containers backed by a shared Knowledge Base. Requires the `arche-internal` external Docker network and `/opt/arche/{kb-content,kb-config,users}` directories on the host before deploy. Images are linux/amd64 by default; override `ARCHE_WEB_IMAGE` and `ARCHE_WORKSPACE_IMAGE` to the `-arm64` tag variants for ARM64 hosts.

aicodingworkspace

bolt.diy

Version latest

Prompt, run, edit, and deploy full-stack web applications using any LLM you want!

aiself-hosteddevelopment

Crawlab (Master)

Version latest

Crawlab is a distributed web crawler admin platform supporting multiple programming languages and frameworks. This template deploys the master node with MongoDB.

crawlerscrapingdistributed