Robot Duplication
Robot duplication is useful to extract data from pages with the same structure without training a new robot.
Robot duplication is only available for Extract Recorder Mode.
When to Duplicate a Robot
- The new page has the same structure as the existing page.
- You want to extract the same data as the existing page.
Example: If you've created a robot for producthunt.com/topics/chrome-extensions, you can duplicate it to scrape similar pages like producthunt.com/topics/sports without training a robot from scratch.
Using robot duplication, you can bulk extract the same data from thousands of pages of the same website, without writing code.
When Not to Duplicate a Robot
- The new page does not have the same structure as the existing page.
- You don't want to extract the same data as the existing page even if the pages are structurally the same.
Example: If you've created a robot for producthunt.com/topics/chrome-extensions, you should not duplicate it to scrape pages like github.com. If you do so, you will get no data.
Duplicate With the API and CLI
You can also duplicate robots programmatically:
REST API
POST /api/v1/robots/{id}/duplicate with a url in the body. See Cloud API.
CLI
maxun robots duplicate <robot-id> --url <new-url>. See CLI Robots.