commoncrawl / news-crawl

News crawling with StormCrawler - stores content as WARC
Apache License 2.0
316 stars 34 forks source link

Error: Could not find or load main class com.digitalpebble.stormcrawler.elasticsearch.ESSeedInjector #27

Closed rishrockstar closed 5 years ago

rishrockstar commented 5 years ago

Hi, I Just Follow the Readme.. I Create the Uber Jar Using the mvn clean package but i am getting this error.

Error: Could not find or load main class com.digitalpebble.stormcrawler.elasticsearch.ESSeedInjector Please Guide me the way. image

sebastian-nagel commented 5 years ago

Did the build command (mvn clean package) succeed? Right now you need to build the news crawler package with Stormcrawler 824cefa, see this discussion. Sorry, that's not ideal but I haven't found the time to update this project. Lesson learned: only build it against released Stormcrawler versions. In detail, the steps to build it should be:

git clone https://github.com/DigitalPebble/storm-crawler.git
cd storm-crawler
git checkout 824cefa
mvn install  # installs 1.8-SNAPSHOT in local Maven repository
cd .../news-crawl
mvn clean package
sebastian-nagel commented 5 years ago

Closing. Please reopen if the problem persists. With 319e2f3 this project is based on a released version of StormCrawler and should always build properly.