LearnerBot
Powered by Skyfire Payments
Website to crawl
Search
Skyfire API Key
This defines how many levels of links the crawler will follow from the start URL. For example, a depth of 1 means only the direct links from the start URL will be followed.
Max Depth per Crawl
This is the maximum amount the crawler will pay to access a specific folder or section of a website. It ensures the crawler doesn’t spend more than this limit when gathering information.
Max Payment per Directory
Crawled Data Logs
Payment Protocol Logs