search

blockscout / blockscout

Blockchain explorer for Ethereum based network and a tool for inspecting and analyzing EVM based blockchains.
http://docs.blockscout.com
GNU General Public License v3.0
3.49k stars 2.35k forks source link

Can't download more than 10k tx using CSV API #8197

Closed 0xtzData closed 8 months ago

0xtzData commented 1 year ago

https://eth-goerli.blockscout.com/ Backend: v5.2.1-beta.+commit.baff2721

We now have a fix to limit transactions up to 10k per one download. Still can't download.

Steps to reproducece:

  1. Go to https://eth-goerli.blockscout.com/csv-export?type=transactions&filterType=address&filterValue=undefined&address=0x1B809925ba90c541d895D19f0b7D70eE281a987F
  2. Try to download for 1-2 months range

Response is either 404 or 500.

undefined filter value?

Image

0xtzData commented 1 year ago 
curl 'https://eth-goerli.blockscout.com/api/v1/transactions-csv?address_id=0x1B809925ba90c541d895D19f0b7D70eE281a987F&from_period=2023-06-13&to_period=2023-08-14&filter_type=address&filter_value=null&recaptcha_response=03ADUVZwDKcjGlpIDocufNhB9cbrVbrgdfEtoDFmBZH48YLY8i6rN3JjcPVwVG1Vru7P--QwQsCrY-Q2ulL70WptP3scARwaDOoJfB6Ygq6Q4bRscuXeIrsR05pAXe0MdSFjrqAP_0eYMN_dGH9lHxNTpC2UljJiLDhArugdwUQh5iG_kmqbCIvtsEXj-VkgwlGntdfWFa2c3jPq-5kEzS_RwFLR4WKWfBH0vUJEdhuHbjg1hnWuNzysJ-3_wXbp9EK54Lxp9dBMudZc8GIrhrUzudx8NmZs509Anrpv-m2_12oZsg9do7YNXbGxzOUxDKLUGvqoVNIhLZIqj7UmTzMfhDrV8hfd9Q8eYoOknwBI7btB2ORnupXz3uS-G519_ktG1FSL7ebNF5QX2n9n9k2liv2aLX0vlDEn3yAfttY_NcsbNwUc9H1hxq5q7jUwVv7fEKmb0TeVIOZh1uWMDUWzNKFh2x5ryPBj0czjXd-v2k9jfqJFPcX6WpVf4EHLezrNC7_CbfwjOMXckRcVFF0JAUF7IGbKqVt1mLp_t1zsShmW9kV04MsdT0nhfqMmiYW4madV8sPNL8' \
  -H 'authority: eth-goerli.blockscout.com' \
  -H 'accept: */*' \
  -H 'accept-language: ru-RU,ru;q=0.9,en-US;q=0.8,en;q=0.7' \
  -H 'cache-control: no-cache' \
  -H 'content-type: application/octet-stream' \
  -H 'cookie: intercom-id-gsgyurk3=245a72ab-b19c-4e8e-afff-41d7cc596c1c; intercom-device-id-gsgyurk3=a782b3e3-48cf-494e-830f-c1fb123f1256; cb_user_id=null; cb_group_id=null; cb_anonymous_id=%223ba466d1-6fb4-4747-9d21-51f857ceca8d%22; indexing_alert=false; nav_bar_collapsed=false; chakra-ui-color-mode=dark; __cuid=47cf729029034f95912b7f956f71284b; amp_fef1e8=39cca2df-c5ed-47f2-8efc-29180edf752bR...1h76hl3gm.1h76hl8qb.2a.18.3i; _ga_KLS8PZVF3D=GS1.1.1691480346.13.0.1691480346.0.0.0; _gid=GA1.2.673866409.1691846958; _explorer_key=SFMyNTY.g3QAAAACbQAAAAtfY3NyZl90b2tlbm0AAAAYTE95ZF9ucHg2Y0s4MDBncFFJUXVWcVRMbQAAAAxjdXJyZW50X3VzZXJ0AAAACGQABmF2YXRhcm0AAAB6aHR0cHM6Ly9zLmdyYXZhdGFyLmNvbS9hdmF0YXIvNGE2ZmRmNDI5MGNjYTJiN2RjYTM1ZjA3MDdiMjJkZTI_cz00ODAmcj1wZyZkPWh0dHBzJTNBJTJGJTJGY2RuLmF1dGgwLmNvbSUyRmF2YXRhcnMlMkZmNC5wbmdkAAVlbWFpbG0AAAAUZjRocmVuaDlpdEBnbWFpbC5jb21kAA5lbWFpbF92ZXJpZmllZGQABHRydWVkAAJpZGIAAAEzZAAEbmFtZW0AAAAUZjRocmVuaDlpdEBnbWFpbC5jb21kAAhuaWNrbmFtZW0AAAAKZjRocmVuaDlpdGQAA3VpZG0AAAAeYXV0aDB8NjQ3ZDFkOWQ5NDQ5OWQwYzlhYzY5OTJjZAAMd2F0Y2hsaXN0X2lkYgAAATI.h8Zkq0mM_KcAOQX4xujVGwPEgHFeTmFMPgbQkHHwGbQ; csv-downloaded=true; mp_4b03b67c70939e1e9e893e11b280c700_mixpanel=%7B%22distinct_id%22%3A%20%22%24device%3A18871ebc30b5b1-05eb673803f7df-1c525634-1aeaa0-18871ebc30b5b1%22%2C%22%24device_id%22%3A%20%2218871ebc30b5b1-05eb673803f7df-1c525634-1aeaa0-18871ebc30b5b1%22%2C%22%24initial_referrer%22%3A%20%22%24direct%22%2C%22%24initial_referring_domain%22%3A%20%22%24direct%22%2C%22Chain%20id%22%3A%20%225%22%2C%22Environment%22%3A%20%22Prod%22%2C%22Authorized%22%3A%20true%2C%22Viewport%20width%22%3A%201680%2C%22Viewport%20height%22%3A%20859%2C%22Language%22%3A%20%22ru-RU%22%2C%22User%20id%22%3A%20%22131101393.1656328965%22%2C%22Device%20type%22%3A%20%22Browser%22%2C%22%24search_engine%22%3A%20%22google%22%7D; _gat_gtag_UA_125140709_1=1; _ga=GA1.1.131101393.1656328965; _ga_LHEEE3FJ3R=GS1.1.1692015532.203.1.1692015694.0.0.0' \
  -H 'pragma: no-cache' \
  -H 'referer: https://eth-goerli.blockscout.com/csv-export?type=transactions&filterType=address&filterValue=undefined&address=0x1B809925ba90c541d895D19f0b7D70eE281a987F' \
  -H 'sec-ch-ua: "Not.A/Brand";v="8", "Chromium";v="114", "Google Chrome";v="114"' \
  -H 'sec-ch-ua-mobile: ?0' \
  -H 'sec-ch-ua-platform: "macOS"' \
  -H 'sec-fetch-dest: empty' \
  -H 'sec-fetch-mode: cors' \
  -H 'sec-fetch-site: same-origin' \
  -H 'user-agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10_15_7) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/114.0.0.0 Safari/537.36' \
  --compressed
vbaranov commented 8 months ago

CSV export works much faster after installing 6.0.0. I was able to export 2 months range in several seconds. Please re-test this.