search

sntran / scrapex

An Elixir open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way. Or just an experiment writing a scraper in Elixir to scratch my own itch. Use at your own risk.
https://sntran.github.io/scrapex/doc/
MIT License
17 stars 2 forks source link

BadFunctionError exception #6

Open sntran opened 8 years ago

sntran commented 8 years ago

During scraping, sometimes the following exception is thrown:

 ** (BadFunctionError) expected a function, got: %Scrapex.GenSpider.Request{pid: nil, ref: nil, url: ""}
2015-11-24T04:14:25.182758138Z app[web.1]:         (elixir) lib/enum.ex:1959: Enum.do_find/3
2015-11-24T04:14:25.182873123Z app[web.1]:         lib/scrapex/gen_spider.ex:610: Scrapex.GenSpider.handle_info/2
2015-11-24T04:14:25.182900495Z app[web.1]:         (stdlib) gen_server.erl:615: :gen_server.try_dispatch/4
2015-11-24T04:14:25.183015390Z app[web.1]:         (stdlib) gen_server.erl:681: :gen_server.handle_msg/5
2015-11-24T04:14:25.183042094Z app[web.1]:         (stdlib) proc_lib.erl:239: :proc_lib.init_p_do_apply/3