Robot Duplication
Robot duplication is useful to extract data from pages with the same structure without training a new robot!
✅ When to duplicate a robot?
- The new page has the same structure as the existing page.
- You want to extract the same data as the existing page.
Example: If you've created a robot for producthunt.com/topics/chrome-extensions, you can duplicate it to scrape similar pages like producthunt.com/topics/sports without training a robot from scratch.
Using robot duplication, you can bulk extract same data from thousands of pages of the same website, without writing code.
❌ When to not duplicate a robot?
- The new page does not have the same structure as the existing page.
- You don't want to extract the same data as the existing page even if the pages are structurally same.
Example: If you've created a robot for producthunt.com/topics/chrome-extensions, you should not duplicate it to scrape pages like github.com. If you do so, you will get no data.