search

exorde-labs / youtube00e1f862e5eff

Youtube latest title & comment scraper, anonymized, no personal data
GNU General Public License v3.0
0 stars 0 forks source link

ERROR - Exception while exporting Span batch. - more detailed #2

Open epsilonion-liam opened 3 months ago

epsilonion-liam commented 3 months ago

ok started a fresh and get this on all youtube scrapers: R730, CPU E5-2698 v3 @ 2.30GHz (2 Sockets), 188GB Ram, hyper threading enabled (64 cores). Latest version of docker & docker compose, running portainer on standard ports apart from 8000 is now 8050. ubuntu 24.2LTS Proxmox LXC

Commands used to install: git clone https://github.com/exorde-labs/Exorde-Client-Microservice-Mint.git cd exorde-labs/Exorde-Client-Microservice-Mint.git MAIN_ADDRESS=0x5............. UPIPE_SIZE=4 docker compose up -d rss=0 bit=0 jvc=0 ch4=0 for=0 hac=0 mas=0 nos=0 a7d=0 ap9=0 lem=0 wei=0 fol=0 you=30 tra=0 docker compose -f spotters.yaml up -d

2024-07-09 07:01:05,608 - INFO - scraping loop
2024-07-09 07:01:05,610 - INFO - [Youtube] found new comment: {'url': 'https://www.youtube.com/watch?v=I06FbWRj2ug&lc=UgxHinwVsRJzn7AlMNp4AaABAg', 'content': 'BONK TOKEN KABOOOOOM MOMENT NEXT FOR COIN PRICE. Your recommendation led me to XAI94X, expecting huge returns! 🌍', 'title': 'BONK TOKEN KABOOOOOM MOMENT !!!!! | WHAT’S NEXT FOR PRICE? | BONK COIN PRICE PREDICTION🔥', 'created_at': '2024-07-09T06:32:37.00Z', 'external_id': 'UgxHinwVsRJzn7AlMNp4AaABAg'}
2024-07-09 07:01:05,611 - INFO - get_targe.pre_loaded_targets = 
2024-07-09 07:01:05,611 - INFO - fetch_ips_from_orchestrator, orchestrator_name is 'orchestrator'
2024-07-09 07:01:05,611 - INFO -     query_params are network.exorde.service: upipe
2024-07-09 07:01:05,611 - INFO - Environment Variables:
2024-07-09 07:01:05,611 - INFO - PATH: /usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-07-09 07:01:05,611 - INFO - HOSTNAME: 97f32ee8c9e5
2024-07-09 07:01:05,611 - INFO - TRACE: false
2024-07-09 07:01:05,611 - INFO - LANG: C.UTF-8
2024-07-09 07:01:05,611 - INFO - GPG_KEY: A035C8C19219BA821ECEA86B64E628F8D684696D
2024-07-09 07:01:05,611 - INFO - PYTHON_VERSION: 3.10.11
2024-07-09 07:01:05,611 - INFO - PYTHON_PIP_VERSION: 23.0.1
2024-07-09 07:01:05,612 - INFO - PYTHON_SETUPTOOLS_VERSION: 65.5.1
2024-07-09 07:01:05,612 - INFO - PYTHON_GET_PIP_URL: https://github.com/pypa/get-pip/raw/0d8570dc44796f4369b652222cf176b3db6ac70e/public/get-pip.py
2024-07-09 07:01:05,612 - INFO - PYTHON_GET_PIP_SHA256: 96461deced5c2a487ddc65207ec5a9cffeca0d34e7af7ea1afc470ff0d746207
2024-07-09 07:01:05,612 - INFO - scraper_module: youtube00e1f862e5eff
2024-07-09 07:01:05,612 - INFO - HOME: /root
2024-07-09 07:01:08,509 - ERROR - Exception while exporting Span batch.
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/opentelemetry/sdk/trace/export/__init__.py", line 367, in _export_batch
    self.span_exporter.export(self.spans_list[:idx])  # type: ignore
  File "/usr/local/lib/python3.10/site-packages/opentelemetry/exporter/jaeger/thrift/__init__.py", line 225, in export
    self._agent_client.emit(batch)
  File "/usr/local/lib/python3.10/site-packages/opentelemetry/exporter/jaeger/thrift/send.py", line 95, in emit
    udp_socket.sendto(buff, self.address)
socket.gaierror: [Errno -2] Name or service not known
2024-07-09 07:01:13,751 - INFO - fetch_ips_from_orchestrator - ['http://172.18.0.19:8000', 'http://172.18.0.31:8000', 'http://172.18.0.35:8000', 'http://172.18.0.26:8000']
2024-07-09 07:01:13,752 - INFO - get_target.targets = ['http://172.18.0.19:8000', 'http://172.18.0.31:8000', 'http://172.18.0.35:8000', 'http://172.18.0.26:8000']
2024-07-09 07:01:13,752 - INFO - get_target.choice = http://172.18.0.19:8000
2024-07-09 07:01:13,752 - INFO - pushing target is http://172.18.0.19:8000
2024-07-09 07:01:13,752 - INFO - Pushing item
2024-07-09 07:01:14,769 - INFO - scraping loop
2024-07-09 07:01:14,770 - INFO - [Youtube] found new comment: {'url': 'https://www.youtube.com/watch?v=I06FbWRj2ug&lc=UgyHHousZI08z8iqooB4AaABAg', 'content': 'BONK TOKEN KABOOOOOM MOMENT NEXT FOR BONK COIN PRICE. Thanks for the insights! BTC’s stability and ETH’s upcoming updates are encouraging. DOGE has strong community support. I see a great opportunity in new cryptos, so I invested $5,000 in XAI94X. Excited for its future! 🚀', 'title': 'BONK TOKEN KABOOOOOM MOMENT !!!!! | WHAT’S NEXT FOR PRICE? | BONK COIN PRICE PREDICTION🔥', 'created_at': '2024-07-09T06:32:37.00Z', 'external_id': 'UgyHHousZI08z8iqooB4AaABAg'}
2024-07-09 07:01:14,771 - INFO - get_targe.pre_loaded_targets = 
2024-07-09 07:01:14,771 - INFO - fetch_ips_from_orchestrator, orchestrator_name is 'orchestrator'
2024-07-09 07:01:14,771 - INFO -     query_params are network.exorde.service: upipe
2024-07-09 07:01:14,771 - INFO - Environment Variables:
2024-07-09 07:01:14,772 - INFO - PATH: /usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-07-09 07:01:14,772 - INFO - HOSTNAME: 97f32ee8c9e5
2024-07-09 07:01:14,772 - INFO - TRACE: false
2024-07-09 07:01:14,772 - INFO - LANG: C.UTF-8
2024-07-09 07:01:14,772 - INFO - GPG_KEY: A035C8C19219BA821ECEA86B64E628F8D684696D
2024-07-09 07:01:14,772 - INFO - PYTHON_VERSION: 3.10.11
2024-07-09 07:01:14,772 - INFO - PYTHON_PIP_VERSION: 23.0.1
2024-07-09 07:01:14,772 - INFO - PYTHON_SETUPTOOLS_VERSION: 65.5.1
2024-07-09 07:01:14,773 - INFO - PYTHON_GET_PIP_URL: https://github.com/pypa/get-pip/raw/0d8570dc44796f4369b652222cf176b3db6ac70e/public/get-pip.py
2024-07-09 07:01:14,773 - INFO - PYTHON_GET_PIP_SHA256: 96461deced5c2a487ddc65207ec5a9cffeca0d34e7af7ea1afc470ff0d746207
2024-07-09 07:01:14,773 - INFO - scraper_module: youtube00e1f862e5eff
2024-07-09 07:01:14,773 - INFO - HOME: /root
2024-07-09 07:01:18,504 - ERROR - Exception while exporting Span batch.
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/opentelemetry/sdk/trace/export/__init__.py", line 367, in _export_batch
    self.span_exporter.export(self.spans_list[:idx])  # type: ignore
  File "/usr/local/lib/python3.10/site-packages/opentelemetry/exporter/jaeger/thrift/__init__.py", line 225, in export
    self._agent_client.emit(batch)
  File "/usr/local/lib/python3.10/site-packages/opentelemetry/exporter/jaeger/thrift/send.py", line 95, in emit
    udp_socket.sendto(buff, self.address)
socket.gaierror: [Errno -2] Name or service not known
2024-07-09 07:01:22,639 - INFO - fetch_ips_from_orchestrator - ['http://172.18.0.19:8000', 'http://172.18.0.31:8000', 'http://172.18.0.35:8000', 'http://172.18.0.26:8000']
2024-07-09 07:01:22,640 - INFO - get_target.targets = ['http://172.18.0.19:8000', 'http://172.18.0.31:8000', 'http://172.18.0.35:8000', 'http://172.18.0.26:8000']
2024-07-09 07:01:22,640 - INFO - get_target.choice = http://172.18.0.35:8000
2024-07-09 07:01:22,640 - INFO - pushing target is http://172.18.0.35:8000
2024-07-09 07:01:22,640 - INFO - Pushing item
2024-07-09 07:01:23,507 - ERROR - Exception while exporting Span batch.
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/opentelemetry/sdk/trace/export/__init__.py", line 367, in _export_batch
    self.span_exporter.export(self.spans_list[:idx])  # type: ignore
  File "/usr/local/lib/python3.10/site-packages/opentelemetry/exporter/jaeger/thrift/__init__.py", line 225, in export
    self._agent_client.emit(batch)
  File "/usr/local/lib/python3.10/site-packages/opentelemetry/exporter/jaeger/thrift/send.py", line 95, in emit
    udp_socket.sendto(buff, self.address)
socket.gaierror: [Errno -2] Name or service not known
2024-07-09 07:01:23,648 - INFO - scraping loop
2024-07-09 07:01:23,649 - INFO - [Youtube] found new comment: {'url': 'https://www.youtube.com/watch?v=I06FbWRj2ug&lc=UgyTp3gLmPKQUWDtCUt4AaABAg', 'content': 'BONK KABOOOOOM MOMENT NEXT FOR BONK COIN PRICE. Appreciate the analysis! BTC’s reliability and ETH’s scalability improvements are key. SHIBA’s active community adds excitement. Based on these, I’ve invested $5,000 in XAI94X. Looking forward to its growth! 🚀', 'title': 'BONK TOKEN KABOOOOOM MOMENT !!!!! | WHAT’S NEXT FOR PRICE? | BONK COIN PRICE PREDICTION🔥', 'created_at': '2024-07-09T06:32:37.00Z', 'external_id': 'UgyTp3gLmPKQUWDtCUt4AaABAg'}
2024-07-09 07:01:23,650 - INFO - get_targe.pre_loaded_targets = 
2024-07-09 07:01:23,650 - INFO - fetch_ips_from_orchestrator, orchestrator_name is 'orchestrator'
2024-07-09 07:01:23,650 - INFO -     query_params are network.exorde.service: upipe
2024-07-09 07:01:23,650 - INFO - Environment Variables:
2024-07-09 07:01:23,650 - INFO - PATH: /usr/local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin
2024-07-09 07:01:23,650 - INFO - HOSTNAME: 97f32ee8c9e5
2024-07-09 07:01:23,650 - INFO - TRACE: false
2024-07-09 07:01:23,650 - INFO - LANG: C.UTF-8
2024-07-09 07:01:23,651 - INFO - GPG_KEY: A035C8C19219BA821ECEA86B64E628F8D684696D
2024-07-09 07:01:23,651 - INFO - PYTHON_VERSION: 3.10.11
2024-07-09 07:01:23,651 - INFO - PYTHON_PIP_VERSION: 23.0.1
2024-07-09 07:01:23,651 - INFO - PYTHON_SETUPTOOLS_VERSION: 65.5.1
2024-07-09 07:01:23,651 - INFO - PYTHON_GET_PIP_URL: https://github.com/pypa/get-pip/raw/0d8570dc44796f4369b652222cf176b3db6ac70e/public/get-pip.py
2024-07-09 07:01:23,651 - INFO - PYTHON_GET_PIP_SHA256: 96461deced5c2a487ddc65207ec5a9cffeca0d34e7af7ea1afc470ff0d746207
2024-07-09 07:01:23,651 - INFO - scraper_module: youtube00e1f862e5eff
2024-07-09 07:01:23,651 - INFO - HOME: /root
2024-07-09 07:01:28,503 - ERROR - Exception while exporting Span batch.
Traceback (most recent call last):
  File "/usr/local/lib/python3.10/site-packages/opentelemetry/sdk/trace/export/__init__.py", line 367, in _export_batch
    self.span_exporter.export(self.spans_list[:idx])  # type: ignore
  File "/usr/local/lib/python3.10/site-packages/opentelemetry/exporter/jaeger/thrift/__init__.py", line 225, in export
    self._agent_client.emit(batch)
  File "/usr/local/lib/python3.10/site-packages/opentelemetry/exporter/jaeger/thrift/send.py", line 95, in emit
    udp_socket.sendto(buff, self.address)
socket.gaierror: [Errno -2] Name or service not known

As there is no documentation on this could you help me understand what is going on please?