Skip to Main Content
Skip to Footer
Download Open Web Crawler
Prerequisite
Running instance of Elasticsearch
1
Download
Crawler source:
Source
Containers:
Docker
2
Connect to Elasticsearch
Access the Elasticsearch instance with
API key
or a username/password.
See
elasticsearch.yml.example
3
Configure Crawler
Configure using
config file
.
4
Use CLI to start a crawl
Crawler CLI
5
Learn more
See our documentation for the latest up-to-date information.
Docs
Getting started guide
Learn more
Blog
Creation of a chatbot
Learn more
Summary
Version:
0.2.2
View past releases
Release date:
February 11, 2025
View release notes
License:
Elastic License
Elastic License
Notes:
Running on Kubernetes? Try the
Elastic Cloud on Kubernetes (ECK)
)
.
This default distribution is governed by the Elastic License, and includes the
full set of free features
.