Crawlab (Worker)
Crawlab worker node for distributed web crawling. Connects to an existing Crawlab master node via gRPC.
How to deploy
Deploy Crawlab (Worker) on Notploy
- Install Notploy on your server if you haven't already.
- In your Notploy panel, open a project and click Create Service → Template.
- Search for Crawlab (Worker) and click Create — Notploy configures domains, environment variables, and volumes for you.
Alternatively, create a Compose service, go to Advanced → Import from Base64, and paste this payload:
ewogICJjb21wb3NlIjogInNlcnZpY2VzOlxuICBjcmF3bGFiLXdvcmtlcjpcbiAgICBpbWFnZTogY3Jhd2xhYnRlYW0vY3Jhd2xhYjpsYXRlc3RcbiAgICByZXN0YXJ0OiB1bmxlc3Mtc3RvcHBlZFxuICAgIGVudmlyb25tZW50OlxuICAgICAgLSBDUkFXTEFCX05PREVfTUFTVEVSPU5cbiAgICAgIC0gQ1JBV0xBQl9HUlBDX0FERFJFU1M9JHtNQVNURVJfR1JQQ19BRERSRVNTfVxuICAgICAgLSBDUkFXTEFCX0ZTX0ZJTEVSX1VSTD0ke01BU1RFUl9GSUxFUl9VUkx9XG4gICAgdm9sdW1lczpcbiAgICAgIC0gY3Jhd2xhYi13b3JrZXItZGF0YTovcm9vdC8uY3Jhd2xhYlxuICAgICAgLSBjcmF3bGFiLXdvcmtlci1hcHA6L2RhdGFcbiAgICBkZXBsb3k6XG4gICAgICByZXNvdXJjZXM6XG4gICAgICAgIGxpbWl0czpcbiAgICAgICAgICBjcHVzOiBcIiR7Q1BVX0xJTUlUOi0wLjh9XCIgIyAwLjggd2lsbCBsaW1pdCB0byA4MCUgb2YgQ1BVIGlmIG9uZSBjb3JlLiBJZiAyIGNvcmVzLCB5b3UgbmVlZCB0byBwdXQgMC44KjI9MS42XG5cbnZvbHVtZXM6XG4gIGNyYXdsYWItd29ya2VyLWRhdGE6XG4gIGNyYXdsYWItd29ya2VyLWFwcDoiLAogICJjb25maWciOiAiW3ZhcmlhYmxlc11cbk1BU1RFUl9HUlBDX0FERFJFU1MgPSBcIjxtYXN0ZXJfbm9kZV9pcD46OTY2NlwiXG5NQVNURVJfRklMRVJfVVJMID0gXCJodHRwOi8vPG1hc3Rlcl9ub2RlX2lwPjo4MDgwL2FwaS9maWxlclwiXG5DUFVfTElNSVQgPSBcIjAuOFwiXG5cbltjb25maWddXG5lbnYgPSBbXCJNQVNURVJfR1JQQ19BRERSRVNTPSR7TUFTVEVSX0dSUENfQUREUkVTU31cIiwgXCJNQVNURVJfRklMRVJfVVJMPSR7TUFTVEVSX0ZJTEVSX1VSTH1cIiwgXCJDUFVfTElNSVQ9JHtDUFVfTElNSVR9XCJdIgp9
Reference files
Configuration
The exact Docker Compose and template configuration this template deploys.
More like this
Related Templates
Crawlab (Master)
Version latest
Crawlab is a distributed web crawler admin platform supporting multiple programming languages and frameworks. This template deploys the master node with MongoDB.
Firecrawl
Version 2.11.230
Production-ready, authenticated Firecrawl with persistent queues, browser rendering, a generated API key, and interactive OpenAPI documentation.
Crawl4AI
Version 0.7.3
Crawl4AI is a modern AI-powered web crawler with support for screenshots, PDFs, JavaScript execution, and LLM-based extraction. Includes an interactive playground and MCP (Model Context Protocol) integration.
Ackee
Version latest
Ackee is a self-hosted analytics tool for your website.
Affine Pro
Version stable
AFFiNE is a workspace for notes, docs, and whiteboards, and an alternative to Notion. Self-host it on your own server with Dokploy, which deploys AFFiNE as a Docker Compose service in a few clicks.
Akaunting
Version latest
Akaunting is a self-hosted, open-source accounting app for small businesses.
Free and open source
Self-host Crawlab (Worker) in minutes
Notploy is a free, open source deployment platform. Deploy Crawlab (Worker) and 571+ other templates on your own infrastructure with a single click.