Back to Home
Required Plan: Pro or higher

Site Auto-Crawl

Automatically discover and register pages by following sitemaps and links. Easily train your AI chatbot on sites with hundreds of pages.

Massive Time Savings
No need to register URLs one by one. Just enter your homepage URL to automatically explore your entire site.
Complete Coverage
Analyzes sitemaps and link structures to automatically discover and register pages that might be overlooked.
Handle Regular Updates
Re-crawl when content updates to maintain current state. AI always responds with the latest information.

How to Use

1

Enter Starting URL

Enter the URL to start crawling from (usually your homepage) and configure crawl settings.

2

Auto-Crawl Execution

Follows links within your site to automatically discover and register pages within configured scope.

3

Review Results

After crawling completes, review discovered pages. Exclude unnecessary pages as needed.

Get Started Today

Start with our free plan and upgrade as you grow.