Crawlab (Master)
Crawlab is a distributed web crawler admin platform supporting multiple programming languages and frameworks. This template deploys the master node with MongoDB.
How to deploy
Deploy Crawlab (Master) on Notploy
- Install Notploy on your server if you haven't already.
- In your Notploy panel, open a project and click Create Service → Template.
- Search for Crawlab (Master) and click Create — Notploy configures domains, environment variables, and volumes for you.
Alternatively, create a Compose service, go to Advanced → Import from Base64, and paste this payload:
ewogICJjb21wb3NlIjogInNlcnZpY2VzOlxuICBjcmF3bGFiLW1hc3RlcjpcbiAgICBpbWFnZTogY3Jhd2xhYnRlYW0vY3Jhd2xhYjpsYXRlc3RcbiAgICByZXN0YXJ0OiB1bmxlc3Mtc3RvcHBlZFxuICAgIGVudmlyb25tZW50OlxuICAgICAgLSBDUkFXTEFCX05PREVfTUFTVEVSPVlcbiAgICAgIC0gQ1JBV0xBQl9NT05HT19IT1NUPW1vbmdvXG4gICAgICAtIENSQVdMQUJfTU9OR09fUE9SVD0yNzAxN1xuICAgICAgLSBDUkFXTEFCX01PTkdPX0RCPWNyYXdsYWJcbiAgICAgIC0gQ1JBV0xBQl9NT05HT19VU0VSTkFNRT0ke01PTkdPX1VTRVJOQU1FfVxuICAgICAgLSBDUkFXTEFCX01PTkdPX1BBU1NXT1JEPSR7TU9OR09fUEFTU1dPUkR9XG4gICAgICAtIENSQVdMQUJfTU9OR09fQVVUSFNPVVJDRT1hZG1pblxuICAgIHZvbHVtZXM6XG4gICAgICAtIGNyYXdsYWItbWFzdGVyLWRhdGE6L3Jvb3QvLmNyYXdsYWJcbiAgICAgIC0gY3Jhd2xhYi1hcHAtZGF0YTovZGF0YVxuICAgICAgLSBjcmF3bGFiLWxvZ3M6L3Zhci9sb2cvY3Jhd2xhYlxuICAgIGV4cG9zZTpcbiAgICAgIC0gXCI4MDgwXCJcbiAgICAgIC0gXCI5NjY2XCJcbiAgICBkZXBlbmRzX29uOlxuICAgICAgLSBtb25nb1xuICAgIGRlcGxveTpcbiAgICAgIHJlc291cmNlczpcbiAgICAgICAgbGltaXRzOlxuICAgICAgICAgIGNwdXM6IFwiJHtDUFVfTElNSVQ6LTAuOH1cIiAjIDAuOCB3aWxsIGxpbWl0IHRvIDgwJSBvZiBDUFUgaWYgb25lIGNvcmUuIElmIDIgY29yZXMsIHlvdSBuZWVkIHRvIHB1dCAwLjgqMj0xLjZcblxuICBtb25nbzpcbiAgICBpbWFnZTogbW9uZ286NC4yXG4gICAgcmVzdGFydDogdW5sZXNzLXN0b3BwZWRcbiAgICBlbnZpcm9ubWVudDpcbiAgICAgIC0gTU9OR09fSU5JVERCX1JPT1RfVVNFUk5BTUU9JHtNT05HT19VU0VSTkFNRX1cbiAgICAgIC0gTU9OR09fSU5JVERCX1JPT1RfUEFTU1dPUkQ9JHtNT05HT19QQVNTV09SRH1cbiAgICB2b2x1bWVzOlxuICAgICAgLSBtb25nby1kYXRhOi9kYXRhL2RiXG5cbnZvbHVtZXM6XG4gIGNyYXdsYWItbWFzdGVyLWRhdGE6XG4gIGNyYXdsYWItYXBwLWRhdGE6XG4gIGNyYXdsYWItbG9nczpcbiAgbW9uZ28tZGF0YToiLAogICJjb25maWciOiAiW3ZhcmlhYmxlc11cbk1PTkdPX1VTRVJOQU1FID0gXCJjcmF3bGFiXCJcbk1PTkdPX1BBU1NXT1JEID0gXCIke3Bhc3N3b3JkOjI0fVwiXG5DUFVfTElNSVQgPSBcIjAuOFwiXG5cbltjb25maWddXG5lbnYgPSBbXCJNT05HT19VU0VSTkFNRT0ke01PTkdPX1VTRVJOQU1FfVwiLCBcIk1PTkdPX1BBU1NXT1JEPSR7TU9OR09fUEFTU1dPUkR9XCIsIFwiQ1BVX0xJTUlUPSR7Q1BVX0xJTUlUfVwiXVxuXG5bW2NvbmZpZy5kb21haW5zXV1cbnNlcnZpY2VOYW1lID0gXCJjcmF3bGFiLW1hc3RlclwiXG5wb3J0ID0gODA4MFxuaG9zdCA9IFwiJHtkb21haW59XCIiCn0=
Reference files
Configuration
The exact Docker Compose and template configuration this template deploys.
More like this
Related Templates
Crawlab (Worker)
Version latest
Crawlab worker node for distributed web crawling. Connects to an existing Crawlab master node via gRPC.
Firecrawl
Version 2.11.230
Production-ready, authenticated Firecrawl with persistent queues, browser rendering, a generated API key, and interactive OpenAPI documentation.
Crawl4AI
Version 0.7.3
Crawl4AI is a modern AI-powered web crawler with support for screenshots, PDFs, JavaScript execution, and LLM-based extraction. Includes an interactive playground and MCP (Model Context Protocol) integration.
Ackee
Version latest
Ackee is a self-hosted analytics tool for your website.
Affine Pro
Version stable
AFFiNE is a workspace for notes, docs, and whiteboards, and an alternative to Notion. Self-host it on your own server with Dokploy, which deploys AFFiNE as a Docker Compose service in a few clicks.
Akaunting
Version latest
Akaunting is a self-hosted, open-source accounting app for small businesses.
Free and open source
Self-host Crawlab (Master) in minutes
Notploy is a free, open source deployment platform. Deploy Crawlab (Master) and 571+ other templates on your own infrastructure with a single click.