elixir-crawly / crawly

Crawly, a high-level web crawling & scraping framework for Elixir.
https://hexdocs.pm/crawly
Apache License 2.0
988 stars 116 forks source link

failed to run quickstart: Could not classify module <xxxxxxx> as spider #301

Closed shuiRong closed 4 months ago

shuiRong commented 4 months ago

Running the quickstart project in the repository according to the README failed, and the following exception logs appeared in the console.

Thanks for help in advanced.

14:00:41.650 [debug] Opening/checking dynamic spiders storage

14:00:41.660 [debug] Using the following folder to load extra spiders: ./spiders

14:00:41.663 [info] No spiders found to auto-load: %MatchError{term: {:error, :enoent}}

14:00:41.666 [debug] Starting data storage

14:00:41.961 [debug] Could not classify module inets_service as spider: %UndefinedFunctionError{module: :inets_service, function: :module_info, arity: 1, reason: nil, message: nil}

14:00:41.962 [debug] Could not classify module inets_lib as spider: %UndefinedFunctionError{module: :inets_lib, function: :module_info, arity: 1, reason: nil, message: nil}

14:00:41.962 [debug] Could not classify module httpc_handler as spider: %UndefinedFunctionError{module: :httpc_handler, function: :module_info, arity: 1, reason: nil, message: nil}

14:00:41.962 [debug] Could not classify module httpc_request as spider: %UndefinedFunctionError{module: :httpc_request, function: :module_info, arity: 1, reason: nil, message: nil}

14:00:41.962 [debug] Could not classify module httpc_response as spider: %UndefinedFunctionError{module: :httpc_response, function: :module_info, arity: 1, reason: nil, message: nil}

14:00:41.962 [debug] Could not classify module http_chunk as spider: %UndefinedFunctionError{module: :http_chunk, function: :module_info, arity: 1, reason: nil, message: nil}

14:00:41.962 [debug] Could not classify module http_request as spider: %UndefinedFunctionError{module: :http_request, function: :module_info, arity: 1, reason: nil, message: nil}

14:00:41.962 [debug] Could not classify module http_response as spider: %UndefinedFunctionError{module: :http_response, function: :module_info, arity: 1, reason: nil, message: nil}
shuiRong commented 4 months ago

I am a beginner in Elixir. The latest update is that these exceptions do not affect the crawler. Therefore, I am planning to ignore them.