And when I have add js_render configuration (to crawl my single page doc), I have this error when I run my docker command :
WARNING: The requested image's platform (linux/amd64) does not match the detected host platform (linux/arm64/v8) and no specific platform was requested
Traceback (most recent call last):
File "/usr/lib/python3.6/runpy.py", line 193, in _run_module_as_main
"__main__", mod_spec)
File "/usr/lib/python3.6/runpy.py", line 85, in _run_code
exec(code, run_globals)
File "/root/src/index.py", line 119, in <module>
run_config(environ['CONFIG'])
File "/root/src/index.py", line 33, in run_config
config = ConfigLoader(config)
File "/root/src/config/config_loader.py", line 78, in __init__
self.user_agent)
File "/root/src/config/browser_handler.py", line 37, in init
options=chrome_options)
File "/root/.local/share/virtualenvs/root-BuDEOXnJ/lib/python3.6/site-packages/selenium/webdriver/chrome/webdriver.py", line 81, in __init__
desired_capabilities=desired_capabilities)
File "/root/.local/share/virtualenvs/root-BuDEOXnJ/lib/python3.6/site-packages/selenium/webdriver/remote/webdriver.py", line 157, in __init__
self.start_session(capabilities, browser_profile)
File "/root/.local/share/virtualenvs/root-BuDEOXnJ/lib/python3.6/site-packages/selenium/webdriver/remote/webdriver.py", line 252, in start_session
response = self.execute(Command.NEW_SESSION, parameters)
File "/root/.local/share/virtualenvs/root-BuDEOXnJ/lib/python3.6/site-packages/selenium/webdriver/remote/webdriver.py", line 321, in execute
self.error_handler.check_response(response)
File "/root/.local/share/virtualenvs/root-BuDEOXnJ/lib/python3.6/site-packages/selenium/webdriver/remote/errorhandler.py", line 242, in check_response
raise exception_class(message, screen, stacktrace)
selenium.common.exceptions.WebDriverException: Message: unknown error: Chrome failed to start: crashed.
(chrome not reachable)
(The process started from chrome location /usr/bin/google-chrome is no longer running, so ChromeDriver is assuming that Chrome has crashed.)
I don't know if it's a bug or a bad configuration of me.
Thanks,
Edit : Work's with platform (linux/amd64) but not with my apple M1.
Hi,
Problem :
I use docker command line :
docker run -it --env-file=.env -e "CONFIG=$(cat ./config.json | jq -r tostring)" algolia/docsearch-scraper
With this config.json :
And when I have add js_render configuration (to crawl my single page doc), I have this error when I run my docker command :
I don't know if it's a bug or a bad configuration of me. Thanks,
Edit : Work's with platform (linux/amd64) but not with my apple M1.