The crawler only crawled down 2k products, not all of Amazon's products.

[wfh1300]

Downloads are no longer changing at 2k. But Amazon's products are in the hundreds of millions.

[platonai]

Of course, our program will not crawl the entire amazon.com by default, which would be a very huge project. To start a real world data project, you need to make some simple configuration changes. Usually, each user has some special business logic, which requires a little code modifications to meet the business needs.

[wfh1300]

Would you please tell me which file should I change？

[platonai]

Update your code, repackage and run:

ENV=prod java -jar target/exotic-amazon-0.0.2-SNAPSHOT.jar

[platonai]

Essentially, a java environment variable named prod must be passed in to run the program in production mode.