search

streamingfast / merger

Apache License 2.0
4 stars 5 forks source link

Getting one block file data not found #9

Closed maoueh closed 2 years ago

maoueh commented 2 years ago

Logs:

This is from a restart after upgrading and old merger to the latest merger.

$ kczl -f merger-v3-0
[2022-01-12 14:13:10.760 EST] INFO (dtracing@v0.0.0-20210811175635-d55665d3622a/api.go:139) registering development exporters from environment variables {"logger":"common"}
[2022-01-12 14:13:10.760 EST] INFO (cli/start.go:50) Starting with config file '' {"logger":"dfuse"}
[2022-01-12 14:13:10.761 EST] INFO (cli/start.go:124) Launching applications: merger {"logger":"dfuse"}
[2022-01-12 14:13:10.761 EST] INFO (merger/app.go:60) running merger {"config":{"GRPCListenAddr":":9000","MaxOneBlockOperationsBatchSize":2000,"NextExclusiveHighestBlockLimit":0,"OneBlockDeletionThreads":10,"StateFile":"/data/merger.seen.gob","StorageMergedBlocksFilesPath":"gs://dfuseio-global-blocks-us/eth-polygon-mainnet/v1","StorageOneBlockFilesPath":"gs://dfuseio-global-blocks-us/eth-polygon-mainnet/v1-oneblock","TimeBetweenStoreLookups":5000000000,"WritersLeewayDuration":20000000000},"logger":"merger"}
[2022-01-12 14:13:10.766 EST] WARNING (merger/app.go:98) failed to load bundle  {"file_name":"/data/merger.seen.gob","logger":"merger"}
[2022-01-12 14:13:16.713 EST] INFO (bundle/bundler.go:25) new bundler {"bundle_size":100,"first_exclusive_highest_block_limit":23642900,"logger":"merger"}
[2022-01-12 14:13:17.263 EST] INFO (bundle/bundler.go:76) Bootstrapping  {"last_merged_low_block_num":23642700,"lib_num_to_start_from":23642599,"logger":"merger"}
[2022-01-12 14:13:17.263 EST] INFO (bundle/bundler.go:97) fetching merged files {"at_low_block_num":23642500,"logger":"merger"}
[2022-01-12 14:13:17.786 EST] INFO (bundle/bundler.go:110) processed merge file {"at_low_block_num":23642500,"logger":"merger"}
[2022-01-12 14:13:17.786 EST] INFO (bundle/bundler.go:97) fetching merged files {"at_low_block_num":23642600,"logger":"merger"}
[2022-01-12 14:13:18.397 EST] INFO (bundle/bundler.go:110) processed merge file {"at_low_block_num":23642600,"logger":"merger"}
[2022-01-12 14:13:18.397 EST] INFO (bundle/bundler.go:97) fetching merged files {"at_low_block_num":23642700,"logger":"merger"}
[2022-01-12 14:13:18.894 EST] INFO (bundle/bundler.go:110) processed merge file {"at_low_block_num":23642700,"logger":"merger"}
[2022-01-12 14:13:18.894 EST] INFO (bundle/bundler.go:87) Bootstrapped {"lib_id":"a7ba9002","lib_num":23642500,"logger":"merger"}
[2022-01-12 14:13:18.894 EST] INFO (merger/app.go:139) merger initiated {"logger":"merger"}
[2022-01-12 14:13:18.895 EST] INFO (merger/app.go:153) merger running {"logger":"merger"}
[2022-01-12 14:13:18.895 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:73) starting merger {"bundle":"\nbundle_size: 100, \nlast_merge_block_num: 0, \ninclusive_lower_block_num: 23642800, \nexclusive_highest_block_limit: 23642900 \nlib_num: 23642500 \nlib id:a7ba9002  \nlongest chain lenght: 300","logger":"merger"}
[2022-01-12 14:13:18.899 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/server.go:20) grpc server created {"logger":"merger"}
[2022-01-12 14:13:18.899 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/server.go:27) tcp listener created {"logger":"merger"}
[2022-01-12 14:13:18.899 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/server.go:31) server registered {"logger":"merger"}
[2022-01-12 14:13:18.899 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:88) verifying if bundle file already exist in store {"bundle_inclusive_lower_block":23642800,"logger":"merger"}
[2022-01-12 14:13:18.899 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/server.go:34) listening & serving grpc content {"grpc_listen_addr":":9000","logger":"merger"}
[2022-01-12 14:13:28.615 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger_io.go:152) retrieved list of files {"files_count":145,"logger":"merger"}
[2022-01-12 14:13:28.620 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:190) retrieved list of files {"added_files_count":145,"logger":"merger","too_old_files_count":0}
[2022-01-12 14:13:28.620 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:115) one block retrieved {"last_block_file":23642895,"logger":"merger"}
[2022-01-12 14:13:28.636 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:129) bundle not completed after retrieving one block file {"bundle":"\nbundle_size: 100, \nlast_merge_block_num: 0, \ninclusive_lower_block_num: 23642800, \nexclusive_highest_block_limit: 23642900 \nlib_num: 23642500 \nlib id:a7ba9002  \nlongest chain lenght: 396","logger":"merger"}
[2022-01-12 14:13:33.644 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:88) verifying if bundle file already exist in store {"bundle_inclusive_lower_block":23642800,"logger":"merger"}
[2022-01-12 14:13:42.525 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger_io.go:152) retrieved list of files {"files_count":149,"logger":"merger"}
[2022-01-12 14:13:42.530 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:190) retrieved list of files {"added_files_count":149,"logger":"merger","too_old_files_count":0}
[2022-01-12 14:13:42.530 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:115) one block retrieved {"last_block_file":23642899,"logger":"merger"}
[2022-01-12 14:13:42.547 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:129) bundle not completed after retrieving one block file {"bundle":"\nbundle_size: 100, \nlast_merge_block_num: 0, \ninclusive_lower_block_num: 23642800, \nexclusive_highest_block_limit: 23642900 \nlib_num: 23642500 \nlib id:a7ba9002  \nlongest chain lenght: 400","logger":"merger"}
[2022-01-12 14:13:47.555 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:88) verifying if bundle file already exist in store {"bundle_inclusive_lower_block":23642800,"logger":"merger"}
[2022-01-12 14:13:55.531 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger_io.go:152) retrieved list of files {"files_count":153,"logger":"merger"}
[2022-01-12 14:13:55.536 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:190) retrieved list of files {"added_files_count":153,"logger":"merger","too_old_files_count":0}
[2022-01-12 14:13:55.536 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:115) one block retrieved {"last_block_file":23642899,"logger":"merger"}
[2022-01-12 14:13:55.552 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:129) bundle not completed after retrieving one block file {"bundle":"\nbundle_size: 100, \nlast_merge_block_num: 0, \ninclusive_lower_block_num: 23642800, \nexclusive_highest_block_limit: 23642900 \nlib_num: 23642500 \nlib id:a7ba9002  \nlongest chain lenght: 400","logger":"merger"}
[2022-01-12 14:14:00.560 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:88) verifying if bundle file already exist in store {"bundle_inclusive_lower_block":23642800,"logger":"merger"}
[2022-01-12 14:14:08.548 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger_io.go:152) retrieved list of files {"files_count":159,"logger":"merger"}
[2022-01-12 14:14:08.554 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:190) retrieved list of files {"added_files_count":159,"logger":"merger","too_old_files_count":0}
[2022-01-12 14:14:08.554 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:115) one block retrieved {"last_block_file":23642899,"logger":"merger"}
[2022-01-12 14:14:08.570 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:129) bundle not completed after retrieving one block file {"bundle":"\nbundle_size: 100, \nlast_merge_block_num: 0, \ninclusive_lower_block_num: 23642800, \nexclusive_highest_block_limit: 23642900 \nlib_num: 23642500 \nlib id:a7ba9002  \nlongest chain lenght: 400","logger":"merger"}
[2022-01-12 14:14:13.578 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:88) verifying if bundle file already exist in store {"bundle_inclusive_lower_block":23642800,"logger":"merger"}
[2022-01-12 14:14:21.590 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger_io.go:152) retrieved list of files {"files_count":163,"logger":"merger"}
[2022-01-12 14:14:21.599 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:190) retrieved list of files {"added_files_count":163,"logger":"merger","too_old_files_count":0}
[2022-01-12 14:14:21.599 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:115) one block retrieved {"last_block_file":23642899,"logger":"merger"}
[2022-01-12 14:14:21.617 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:129) bundle not completed after retrieving one block file {"bundle":"\nbundle_size: 100, \nlast_merge_block_num: 0, \ninclusive_lower_block_num: 23642800, \nexclusive_highest_block_limit: 23642900 \nlib_num: 23642500 \nlib id:a7ba9002  \nlongest chain lenght: 400","logger":"merger"}
[2022-01-12 14:14:26.625 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:88) verifying if bundle file already exist in store {"bundle_inclusive_lower_block":23642800,"logger":"merger"}
[2022-01-12 14:14:34.489 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger_io.go:152) retrieved list of files {"files_count":172,"logger":"merger"}
[2022-01-12 14:14:34.495 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:190) retrieved list of files {"added_files_count":172,"logger":"merger","too_old_files_count":0}
[2022-01-12 14:14:34.495 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:115) one block retrieved {"last_block_file":23642899,"logger":"merger"}
[2022-01-12 14:14:34.511 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:129) bundle not completed after retrieving one block file {"bundle":"\nbundle_size: 100, \nlast_merge_block_num: 0, \ninclusive_lower_block_num: 23642800, \nexclusive_highest_block_limit: 23642900 \nlib_num: 23642500 \nlib id:a7ba9002  \nlongest chain lenght: 400","logger":"merger"}
[2022-01-12 14:14:39.519 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:88) verifying if bundle file already exist in store {"bundle_inclusive_lower_block":23642800,"logger":"merger"}
[2022-01-12 14:14:46.776 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger_io.go:152) retrieved list of files {"files_count":175,"logger":"merger"}
[2022-01-12 14:14:46.782 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:190) retrieved list of files {"added_files_count":175,"logger":"merger","too_old_files_count":0}
[2022-01-12 14:14:46.782 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:115) one block retrieved {"last_block_file":23642902,"logger":"merger"}
[2022-01-12 14:14:46.799 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:140) merging bundle {
  "bundle": "\nbundle_size: 100, \nlast_merge_block_num: 0, \ninclusive_lower_block_num: 23642800, \nexclusive_highest_block_limit: 23642900 \nlib_num: 23642500 \nlib id:a7ba9002  \nlongest chain lenght: 403",
  "count": 149,
  "highest_bundle_block_num": 23642899,
  "logger": "merger"
}
[2022-01-12 14:14:46.807 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger_io.go:87) about to write merged blocks to storage location {
  "filename": "0023642800",
  "highest_block_num": 23642899,
  "logger": "merger",
  "lower_block_num": 23642800,
  "write_timeout": 300
}
[2022-01-12 14:14:46.813 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642800-20220112T190958.0-8f48559b-e55dd164","logger":"merger"}
[2022-01-12 14:14:46.820 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642801-20220112T191000.0-95030c29-8f48559b","logger":"merger"}
[2022-01-12 14:14:46.825 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642802-20220112T191002.0-68d9c7bb-95030c29","logger":"merger"}
[2022-01-12 14:14:46.830 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642803-20220112T191004.0-b23139b4-68d9c7bb","logger":"merger"}
[2022-01-12 14:14:46.836 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642804-20220112T191006.0-1f0d6669-b23139b4","logger":"merger"}
[2022-01-12 14:14:46.844 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642804-20220112T191008.0-a6bb415a-b23139b4","logger":"merger"}
[2022-01-12 14:14:46.848 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642805-20220112T191008.0-511532af-1f0d6669","logger":"merger"}
[2022-01-12 14:14:46.853 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642805-20220112T191010.0-17e57b34-1f0d6669","logger":"merger"}
[2022-01-12 14:14:46.854 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642806-20220112T191010.0-eaed9e3a-511532af","logger":"merger"}
[2022-01-12 14:14:46.859 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642807-20220112T191012.0-9edebe39-eaed9e3a","logger":"merger"}
[2022-01-12 14:14:46.865 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642808-20220112T191014.0-17151c85-9edebe39","logger":"merger"}
[2022-01-12 14:14:46.871 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642809-20220112T191016.0-640727c1-17151c85","logger":"merger"}
[2022-01-12 14:14:46.877 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642810-20220112T191018.0-d4461352-640727c1","logger":"merger"}
[2022-01-12 14:14:46.885 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642811-20220112T191020.0-07f69349-d4461352","logger":"merger"}
[2022-01-12 14:14:46.890 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642812-20220112T191022.0-b39a9b7e-07f69349","logger":"merger"}
[2022-01-12 14:14:46.897 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642813-20220112T191024.0-5ce43186-b39a9b7e","logger":"merger"}
[2022-01-12 14:14:46.902 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642814-20220112T191026.0-7785a8e7-5ce43186","logger":"merger"}
[2022-01-12 14:14:46.908 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642815-20220112T191028.0-824c1ecf-7785a8e7","logger":"merger"}
[2022-01-12 14:14:46.913 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642816-20220112T191034.0-8bf57021-824c1ecf","logger":"merger"}
[2022-01-12 14:14:46.923 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642817-20220112T191036.0-270947f6-8bf57021","logger":"merger"}
[2022-01-12 14:14:46.931 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642818-20220112T191038.0-eebcce1c-270947f6","logger":"merger"}
[2022-01-12 14:14:46.931 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642819-20220112T191040.0-bce0596f-eebcce1c","logger":"merger"}
[2022-01-12 14:14:46.937 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642820-20220112T191042.0-4f6affbf-bce0596f","logger":"merger"}
[2022-01-12 14:14:46.937 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642821-20220112T191044.0-6897d244-4f6affbf","logger":"merger"}
[2022-01-12 14:14:46.944 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642822-20220112T191046.0-03dc5fb1-6897d244","logger":"merger"}
[2022-01-12 14:14:46.948 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642822-20220112T191048.0-d12eef15-6897d244","logger":"merger"}
[2022-01-12 14:14:46.954 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642822-20220112T191048.0-df34caa6-6897d244","logger":"merger"}
[2022-01-12 14:14:46.960 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642823-20220112T191048.0-979abcb0-03dc5fb1","logger":"merger"}
[2022-01-12 14:14:46.960 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642824-20220112T191050.0-9dcdd6a9-979abcb0","logger":"merger"}
[2022-01-12 14:14:46.965 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642824-20220112T191052.0-d31be770-979abcb0","logger":"merger"}
[2022-01-12 14:14:46.968 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642825-20220112T191052.0-d3a68949-9dcdd6a9","logger":"merger"}
[2022-01-12 14:14:46.973 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642825-20220112T191054.0-69ba5465-9dcdd6a9","logger":"merger"}
[2022-01-12 14:14:46.976 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642826-20220112T191054.0-ad03b2d3-d3a68949","logger":"merger"}
[2022-01-12 14:14:46.979 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642827-20220112T191056.0-bfff752a-ad03b2d3","logger":"merger"}
[2022-01-12 14:14:46.982 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642828-20220112T191058.0-9d16af87-bfff752a","logger":"merger"}
[2022-01-12 14:14:46.982 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642829-20220112T191100.0-95f796ac-9d16af87","logger":"merger"}
[2022-01-12 14:14:46.988 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642829-20220112T191102.0-268acaea-9d16af87","logger":"merger"}
[2022-01-12 14:14:46.994 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642830-20220112T191102.0-8675cf7a-95f796ac","logger":"merger"}
[2022-01-12 14:14:46.994 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642831-20220112T191104.0-d2aa544e-8675cf7a","logger":"merger"}
[2022-01-12 14:14:46.999 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642831-20220112T191106.0-c1effc6a-8675cf7a","logger":"merger"}
[2022-01-12 14:14:47.005 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642832-20220112T191106.0-df552a1e-d2aa544e","logger":"merger"}
[2022-01-12 14:14:47.009 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642832-20220112T191108.0-fdf2fe89-d2aa544e","logger":"merger"}
[2022-01-12 14:14:47.009 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642833-20220112T191108.0-5059f6db-df552a1e","logger":"merger"}
[2022-01-12 14:14:47.009 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642833-20220112T191108.0-3cc1c21b-df552a1e","logger":"merger"}
[2022-01-12 14:14:47.013 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642833-20220112T191110.0-b19d46b1-df552a1e","logger":"merger"}
[2022-01-12 14:14:47.021 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642834-20220112T191110.0-00645157-5059f6db","logger":"merger"}
[2022-01-12 14:14:47.026 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642834-20220112T191112.0-ee958441-3cc1c21b","logger":"merger"}
[2022-01-12 14:14:47.026 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642835-20220112T191112.0-5ff4d296-00645157","logger":"merger"}
[2022-01-12 14:14:47.030 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642835-20220112T191114.0-549b1c32-00645157","logger":"merger"}
[2022-01-12 14:14:47.037 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642836-20220112T191114.0-0f13d6ab-5ff4d296","logger":"merger"}
[2022-01-12 14:14:47.037 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642837-20220112T191116.0-2901a2ac-0f13d6ab","logger":"merger"}
[2022-01-12 14:14:47.042 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642838-20220112T191118.0-b3a7632f-2901a2ac","logger":"merger"}
[2022-01-12 14:14:47.048 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642839-20220112T191120.0-2c7bb359-b3a7632f","logger":"merger"}
[2022-01-12 14:14:47.048 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642840-20220112T191122.0-4ec350bb-2c7bb359","logger":"merger"}
[2022-01-12 14:14:47.053 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642841-20220112T191124.0-c6d35e95-4ec350bb","logger":"merger"}
[2022-01-12 14:14:47.058 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642841-20220112T191126.0-e2608958-4ec350bb","logger":"merger"}
[2022-01-12 14:14:47.068 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642841-20220112T191126.0-f8c060f4-4ec350bb","logger":"merger"}
[2022-01-12 14:14:47.073 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642842-20220112T191126.0-19cc8df3-c6d35e95","logger":"merger"}
[2022-01-12 14:14:47.073 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642843-20220112T191128.0-e16ddd39-19cc8df3","logger":"merger"}
[2022-01-12 14:14:47.080 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642843-20220112T191130.0-0e4b56e9-19cc8df3","logger":"merger"}
[2022-01-12 14:14:47.086 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642844-20220112T191130.0-11330df1-e16ddd39","logger":"merger"}
[2022-01-12 14:14:47.086 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642844-20220112T191130.0-83cd6869-e16ddd39","logger":"merger"}
[2022-01-12 14:14:47.090 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642845-20220112T191132.0-6abad888-11330df1","logger":"merger"}
[2022-01-12 14:14:47.096 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642846-20220112T191134.0-59067f86-6abad888","logger":"merger"}
[2022-01-12 14:14:47.096 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642847-20220112T191136.0-a06a94f0-59067f86","logger":"merger"}
[2022-01-12 14:14:47.104 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642847-20220112T191138.0-3f27c511-59067f86","logger":"merger"}
[2022-01-12 14:14:47.110 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642848-20220112T191138.0-90fa14c9-a06a94f0","logger":"merger"}
[2022-01-12 14:14:47.110 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642849-20220112T191140.0-bf99d12d-90fa14c9","logger":"merger"}
[2022-01-12 14:14:47.115 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642849-20220112T191142.0-2b361cc1-90fa14c9","logger":"merger"}
[2022-01-12 14:14:47.121 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642849-20220112T191142.0-f4affe23-90fa14c9","logger":"merger"}
[2022-01-12 14:14:47.126 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642850-20220112T191142.0-1a4a0ca5-bf99d12d","logger":"merger"}
[2022-01-12 14:14:47.126 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642850-20220112T191142.0-bc0471ef-bf99d12d","logger":"merger"}
[2022-01-12 14:14:47.130 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642851-20220112T191144.0-af2dd8fd-1a4a0ca5","logger":"merger"}
[2022-01-12 14:14:47.135 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642851-20220112T191146.0-270447bb-bc0471ef","logger":"merger"}
[2022-01-12 14:14:47.135 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642852-20220112T191146.0-c020b612-af2dd8fd","logger":"merger"}
[2022-01-12 14:14:47.135 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642853-20220112T191148.0-74c13dd5-c020b612","logger":"merger"}
[2022-01-12 14:14:47.143 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642854-20220112T191150.0-37d873eb-74c13dd5","logger":"merger"}
[2022-01-12 14:14:47.149 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642854-20220112T191152.0-16efa048-74c13dd5","logger":"merger"}
[2022-01-12 14:14:47.160 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642854-20220112T191152.0-b3957dc6-74c13dd5","logger":"merger"}
[2022-01-12 14:14:47.167 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642855-20220112T191152.0-40f7c119-37d873eb","logger":"merger"}
[2022-01-12 14:14:47.167 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642855-20220112T191154.0-8d916af3-37d873eb","logger":"merger"}
[2022-01-12 14:14:47.167 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642856-20220112T191154.0-cb5bd8c8-40f7c119","logger":"merger"}
[2022-01-12 14:14:47.173 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642856-20220112T191156.0-8b471a5c-40f7c119","logger":"merger"}
[2022-01-12 14:14:47.178 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642857-20220112T191156.0-d241136e-cb5bd8c8","logger":"merger"}
[2022-01-12 14:14:47.178 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642858-20220112T191158.0-5528217b-d241136e","logger":"merger"}
[2022-01-12 14:14:47.183 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642858-20220112T191200.0-47c4fe82-d241136e","logger":"merger"}
[2022-01-12 14:14:47.190 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642859-20220112T191200.0-a93eb42b-5528217b","logger":"merger"}
[2022-01-12 14:14:47.190 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642860-20220112T191202.0-42395a2f-a93eb42b","logger":"merger"}
[2022-01-12 14:14:47.196 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642860-20220112T191204.0-dd4f93e0-a93eb42b","logger":"merger"}
[2022-01-12 14:14:47.203 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642860-20220112T191204.0-58d83fa8-a93eb42b","logger":"merger"}
[2022-01-12 14:14:47.211 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642861-20220112T191204.0-04944444-42395a2f","logger":"merger"}
[2022-01-12 14:14:47.211 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642862-20220112T191206.0-e75cfcac-04944444","logger":"merger"}
[2022-01-12 14:14:47.216 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642862-20220112T191208.0-6ba74c2f-04944444","logger":"merger"}
[2022-01-12 14:14:47.222 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642862-20220112T191208.0-2fdcc90b-04944444","logger":"merger"}
[2022-01-12 14:14:47.230 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642863-20220112T191208.0-29121ea4-e75cfcac","logger":"merger"}
[2022-01-12 14:14:47.230 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642863-20220112T191210.0-221927c4-e75cfcac","logger":"merger"}
[2022-01-12 14:14:47.230 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642864-20220112T191210.0-fcead4c8-29121ea4","logger":"merger"}
[2022-01-12 14:14:47.237 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642864-20220112T191212.0-3f2bd763-29121ea4","logger":"merger"}
[2022-01-12 14:14:47.243 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642865-20220112T191212.0-1ae94cce-fcead4c8","logger":"merger"}
[2022-01-12 14:14:47.243 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642866-20220112T191214.0-6f0913f9-1ae94cce","logger":"merger"}
[2022-01-12 14:14:47.250 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642866-20220112T191216.0-45d604cb-1ae94cce","logger":"merger"}
[2022-01-12 14:14:47.259 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642867-20220112T191216.0-baa0841f-6f0913f9","logger":"merger"}
[2022-01-12 14:14:47.259 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642868-20220112T191218.0-8228f072-baa0841f","logger":"merger"}
[2022-01-12 14:14:47.265 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642868-20220112T191220.0-778fe7e9-baa0841f","logger":"merger"}
[2022-01-12 14:14:47.271 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642868-20220112T191220.0-48cc2f6f-baa0841f","logger":"merger"}
[2022-01-12 14:14:47.276 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642869-20220112T191220.0-2e9b1c28-8228f072","logger":"merger"}
[2022-01-12 14:14:47.276 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642870-20220112T191222.0-f3d18a82-2e9b1c28","logger":"merger"}
[2022-01-12 14:14:47.281 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642870-20220112T191224.0-5165f7e0-2e9b1c28","logger":"merger"}
[2022-01-12 14:14:47.285 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642870-20220112T191224.0-74511f3a-2e9b1c28","logger":"merger"}
[2022-01-12 14:14:47.289 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642871-20220112T191224.0-c6b3c6b4-f3d18a82","logger":"merger"}
[2022-01-12 14:14:47.289 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642871-20220112T191224.0-7ae9edcc-f3d18a82","logger":"merger"}
[2022-01-12 14:14:47.296 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642871-20220112T191226.0-11029e83-f3d18a82","logger":"merger"}
[2022-01-12 14:14:47.296 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642871-20220112T191226.0-eaa65724-f3d18a82","logger":"merger"}
[2022-01-12 14:14:47.301 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642872-20220112T191226.0-d8f1f7ad-c6b3c6b4","logger":"merger"}
[2022-01-12 14:14:47.306 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642872-20220112T191228.0-bcbb1cf5-7ae9edcc","logger":"merger"}
[2022-01-12 14:14:47.306 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642873-20220112T191228.0-4883c1e8-d8f1f7ad","logger":"merger"}
[2022-01-12 14:14:47.310 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642873-20220112T191230.0-33cece8b-d8f1f7ad","logger":"merger"}
[2022-01-12 14:14:47.315 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642874-20220112T191230.0-2fc06f65-4883c1e8","logger":"merger"}
[2022-01-12 14:14:47.315 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642875-20220112T191232.0-fc100c79-2fc06f65","logger":"merger"}
[2022-01-12 14:14:47.322 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642875-20220112T191234.0-13729bd3-2fc06f65","logger":"merger"}
[2022-01-12 14:14:47.327 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642875-20220112T191234.0-417d5913-2fc06f65","logger":"merger"}
[2022-01-12 14:14:47.329 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642876-20220112T191234.0-b91ce860-fc100c79","logger":"merger"}
[2022-01-12 14:14:47.329 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642877-20220112T191236.0-5f0f516b-b91ce860","logger":"merger"}
[2022-01-12 14:14:47.335 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642877-20220112T191238.0-37030afe-b91ce860","logger":"merger"}
[2022-01-12 14:14:47.338 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642878-20220112T191238.0-18e77f5d-5f0f516b","logger":"merger"}
[2022-01-12 14:14:47.339 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642878-20220112T191240.0-89bba7e2-5f0f516b","logger":"merger"}
[2022-01-12 14:14:47.339 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642879-20220112T191240.0-b7c5864d-18e77f5d","logger":"merger"}
[2022-01-12 14:14:47.343 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642879-20220112T191242.0-34e6d8e5-18e77f5d","logger":"merger"}
[2022-01-12 14:14:47.347 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642880-20220112T191246.0-fde12685-b7c5864d","logger":"merger"}
[2022-01-12 14:14:47.352 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642881-20220112T191248.0-61d5e964-fde12685","logger":"merger"}
[2022-01-12 14:14:47.356 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642882-20220112T191250.0-8ce5e9aa-61d5e964","logger":"merger"}
[2022-01-12 14:14:47.361 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642883-20220112T191252.0-4c391c1e-8ce5e9aa","logger":"merger"}
[2022-01-12 14:14:47.367 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642884-20220112T191254.0-d7158ab6-4c391c1e","logger":"merger"}
[2022-01-12 14:14:47.374 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642885-20220112T191256.0-8cf3350c-d7158ab6","logger":"merger"}
[2022-01-12 14:14:47.381 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642886-20220112T191258.0-7aea3d88-8cf3350c","logger":"merger"}
[2022-01-12 14:14:47.387 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642887-20220112T191300.0-3ddd03da-7aea3d88","logger":"merger"}
[2022-01-12 14:14:47.394 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642888-20220112T191302.0-a92f8de2-3ddd03da","logger":"merger"}
[2022-01-12 14:14:47.399 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642889-20220112T191304.0-72e557f7-a92f8de2","logger":"merger"}
[2022-01-12 14:14:47.405 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642890-20220112T191306.0-1160ac2d-72e557f7","logger":"merger"}
[2022-01-12 14:14:47.412 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642890-20220112T191308.0-d13226fa-72e557f7","logger":"merger"}
[2022-01-12 14:14:47.417 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642891-20220112T191308.0-88571ed8-1160ac2d","logger":"merger"}
[2022-01-12 14:14:47.421 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642892-20220112T191310.0-daff492d-88571ed8","logger":"merger"}
[2022-01-12 14:14:47.426 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642893-20220112T191312.0-4db70580-daff492d","logger":"merger"}
[2022-01-12 14:14:47.432 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642894-20220112T191314.0-3481faf9-4db70580","logger":"merger"}
[2022-01-12 14:14:47.438 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642895-20220112T191316.0-bdadc0b7-3481faf9","logger":"merger"}
[2022-01-12 14:14:47.442 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642896-20220112T191318.0-b33aae97-bdadc0b7","logger":"merger"}
[2022-01-12 14:14:47.448 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642897-20220112T191320.0-85970f2e-b33aae97","logger":"merger"}
[2022-01-12 14:14:47.453 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642898-20220112T191322.0-31a2352b-85970f2e","logger":"merger"}
[2022-01-12 14:14:47.458 EST] INFO (bundle/bundlereader.go:41) downloading one block file {"canonical_name":"0023642899-20220112T191324.0-58606af4-31a2352b","logger":"merger"}
[2022-01-12 14:14:47.681 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger_io.go:98) merged and uploaded {"filename":"0023642800","logger":"merger","merge_time":0.873800539}
[2022-01-12 14:14:47.681 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:150) bundle files uploaded {"logger":"merger"}
[2022-01-12 14:14:47.681 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:155) bundle merged and committed {"bundle":"\nbundle_size: 100, \nlast_merge_block_num: 23642899, \ninclusive_lower_block_num: 23642900, \nexclusive_highest_block_limit: 23643000 \nlib_num: 23642500 \nlib id:a7ba9002  \nlongest chain lenght: 403","last_merge_one_block_time":"2022-01-12T19:13:24Z","logger":"merger"}
[2022-01-12 14:14:47.690 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:158) saving state {"logger":"merger","state":"exclusive_highest_block_limit: 23643000"}
[2022-01-12 14:14:47.692 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger_io.go:217) deleting files that are too old or already seen {
  "first_file": "0023642871-20220112T191224.0-c6b3c6b4-f3d18a82",
  "last_file": "0023642804-20220112T191008.0-a6bb415a-b23139b4",
  "logger": "merger",
  "number_of_files": 172
}
[2022-01-12 14:14:47.692 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:88) verifying if bundle file already exist in store {"bundle_inclusive_lower_block":23642900,"logger":"merger"}
[2022-01-12 14:14:48.683 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger_io.go:152) retrieved list of files {"files_count":17,"logger":"merger"}
[2022-01-12 14:14:48.683 EST] INFO (merger@v0.0.3-0.20220111193505-74ca06396be5/merger.go:78) merger exited {"error":"retreiving one block files: fetching one block files: getting one block file data: not found","logger":"merger"}
[2022-01-12 14:14:48.683 EST] ERROR (launcher/launcher.go:174)
################################################################
Fatal error in app merger:

retreiving one block files: fetching one block files: getting one block file data: not found
################################################################
 {"context":{"reportLocation":{"filePath":"/work/go/pkg/mod/github.com/streamingfast/dlauncher@v0.0.0-20211210162313-cf4aa5fc4878/launcher/launcher.go","functionName":"github.com/streamingfast/dlauncher/launcher.(*Launcher).shutdownDueToApp.func1","lineNumber":"174"}},"logger":"dfuse"}
[2022-01-12 14:14:48.684 EST] INFO (cli/start.go:140) Application merger shutdown unexpectedly, quitting {"logger":"dfuse"}
[2022-01-12 14:14:48.684 EST] INFO (launcher/launcher.go:259) Waiting for all apps termination... {"logger":"dfuse"}
[2022-01-12 14:14:48.684 EST] INFO (launcher/launcher.go:273) All apps terminated gracefully {"logger":"dfuse"}
Error: unable to launch: retreiving one block files: fetching one block files: getting one block file data: not found
[2022-01-12 14:14:48.684 EST] ERROR (derr@v0.0.0-20210811180100-9138d738bcec/cli.go:25) dfuse {"context":{"reportLocation":{"filePath":"/work/go/pkg/mod/github.com/streamingfast/derr@v0.0.0-20210811180100-9138d738bcec/cli.go","functionName":"github.com/streamingfast/derr.Check","lineNumber":"25"}},"error":"unable to launch: retreiving one block files: fetching one block files: getting one block file data: not found","logger":"common"}%
sduchesneau commented 2 years ago

This issue only happened with one-block-files without the lib number in its name (ex from the log: 0023642899-20220112T191324.0-58606af4-31a2352b)

We had a workaround where the file would be read back to figure out the lib number... this behavior has been removed, now the lib num must be in the filename: 0023642899-20220112T191324.0-58606af4-31a2352b-23642699-hostname, this older format is not supported anymore. Removing this workaround also removes this bug (which is a race condition between the workaround and the deletion mechanism)