search

MWATelescope / giant-squid

An alternative MWA ASVO client
Other
6 stars 1 forks source link

can't list jobs when too many jobs submitted. #3

Closed d3v-null closed 1 year ago

d3v-null commented 2 years ago

when too many jobs have been submitted to asvo, giant-squid list doesn't work at all, even if you've given it a valid obsid or jobid filter. 

Error: Couldn't decode the JSON from the ASVO response: invalid value: integer `128`, expected i8 at line 1 column 57125 

Caused by:                                                                                                               
    invalid value: integer `128`, expected i8 at line 1 column 57125

more verbose log


16:30:54 [TRACE] (1) reqwest::blocking::wait: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/reqwest-0.11.11/src/blocking/wait.rs:42] (ThreadId(1)) park timeout 28.890224525s
16:30:54 [TRACE] (2) reqwest::connect::verbose: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/reqwest-0.11.11/src/connect.rs:1106] 186930ed read: b"\": 586315}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322310040\", \"priority\": 1054, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:48.070024\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586316}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322480408\", \"priority\": 1055, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:48.197258\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586317}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 2, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322480528\", \"priority\": 1056, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:48.326982\", \"started\": \"2022-08-24T08:26:54.521168\", \"completed\": \"2022-08-24T08:29:17.201536\", \"product\": {\"files\": [{\"type\": \"acacia\", \"url\": \"https://ingest.pawsey.org.au/mwa-asvo/1322480528_586318_vis.tar?AWSAccessKeyId=HIGHENTROPYSTRING\"}]}, \"id\": 586318}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322480768\", \"priority\": 1057, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:48.457994\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586319}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322480888\", \"priority\": 1058, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:48.599115\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586320}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322481008\", \"priority\": 1059, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:48.725653\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586321}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 1, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322481128\", \"priority\": 1060, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:48.849577\", \"started\": \"2022-08-24T08:26:50.066675\", \"completed\": null, \"product\": null, \"id\": 586322}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322481248\", \"priority\": 1061, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:48.976211\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586323}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322481368\", \"priority\": 1062, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:49.100644\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586324}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322481488\", \"priority\": 1063, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:49.223864\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586325}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322481608\", \"priority\": 1064, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:49.350897\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586326}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322481728\", \"priority\": 1065, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:49.482171\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586327}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322481848\", \"priority\": 1066, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:49.606687\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586328}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322481968\", \"priority\": 1067, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:49.730695\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586329}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322482088\", \"priority\": 1068, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:49.854121\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586330}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322482208\", \"priority\": 1069, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:49.978137\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586331}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322482328\", \"priority\": 1070, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:50.101974\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586332}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322653416\", \"priority\": 1071, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:50.225002\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586333}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322653536\", \"priority\": 1072, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:50.347478\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586334}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322653656\", \"priority\": 1073, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:50.478987\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586335}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322653776\", \"priority\": 1074, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:50.602227\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586336}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322653896\", \"priority\": 1075, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:50.726672\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586337}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322654016\", \"priority\": 1076, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:50.851826\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586338}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322654136\", \"priority\": 1077, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:50.975771\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586339}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322654256\", \"priority\": 1078, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:51.100536\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586340}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322654376\", \"priority\": 1079, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:51.226573\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586341}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322654496\", \"priority\": 1080, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:51.349719\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586342}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322654616\", \"priority\": 1081, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:51.473962\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586343}}, {\"action\": \"INSERT\", \"table\": \"jobs\", \"row\": {\"job_type\": 1, \"job_state\": 0, \"user_id\": 1523, \"job_params\": {\"delivery\": \"acacia\", \"download_type\": \"vis\", \"job_type\": \"download\", \"obs_id\": \"1322654736\", \"priority\": 1082, \"user_pawsey_group\": \"mwaeor\"}, \"error_code\": null, \"error_text\": null, \"created\": \"2022-08-24T08:14:51.610171\", \"started\": null, \"completed\": null, \"product\": null, \"id\": 586344}}]"
16:30:54 [TRACE] (2) want: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/want-0.3.0/src/lib.rs:341] signal: Want
16:30:54 [TRACE] (2) want: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/want-0.3.0/src/lib.rs:355] signal found waiting giver, notifying
16:30:54 [TRACE] (1) reqwest::blocking::wait: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/reqwest-0.11.11/src/blocking/wait.rs:42] (ThreadId(1)) park timeout 28.889374725s
16:30:54 [TRACE] (2) want: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/want-0.3.0/src/lib.rs:341] signal: Want
16:30:54 [TRACE] (2) want: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/want-0.3.0/src/lib.rs:200] poll_want: taker wants!
16:30:54 [TRACE] (2) want: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/want-0.3.0/src/lib.rs:341] signal: Want
16:30:54 [TRACE] (1) reqwest::blocking::client: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/reqwest-0.11.11/src/blocking/client.rs:944] closing runtime thread (ThreadId(2))
16:30:54 [TRACE] (1) reqwest::blocking::client: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/reqwest-0.11.11/src/blocking/client.rs:946] signaled close for runtime thread (ThreadId(2))
16:30:54 [TRACE] (2) reqwest::blocking::client: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/reqwest-0.11.11/src/blocking/client.rs:998] (ThreadId(2)) Receiver is shutdown
16:30:54 [TRACE] (2) reqwest::blocking::client: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/reqwest-0.11.11/src/blocking/client.rs:1003] (ThreadId(2)) end runtime::block_on
16:30:54 [TRACE] (2) mio::poll: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/mio-0.8.4/src/poll.rs:652] deregistering event source from poller
16:30:54 [TRACE] (2) want: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/want-0.3.0/src/lib.rs:330] signal: Closed
16:30:54 [TRACE] (2) reqwest::blocking::client: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/reqwest-0.11.11/src/blocking/client.rs:1005] (ThreadId(2)) finished
16:30:54 [TRACE] (1) reqwest::blocking::client: [/home/curtin_devn/.cargo/registry/src/github.com-1ecc6299db9ec823/reqwest-0.11.11/src/blocking/client.rs:948] closed runtime thread (ThreadId(2))
Error: Couldn't decode the JSON from the ASVO response: invalid value: integer `128`, expected i8 at line 1 column 57125