search

steemit / steem

The blockchain for Smart Media Tokens (SMTs) and decentralized applications.
https://steem.com
Other
1.95k stars 792 forks source link

Autoscaling of shared memory file not working #3459

Open Jolly-Pirate opened 5 years ago

Jolly-Pirate commented 5 years ago

During a reindex+replay, the autoscaling didn't trigger and didn't give any check_free_memory warnings as described by @Gandalf-the-Grey in https://github.com/steemit/steem/issues/2902

config.ini:

shared-file-size = 5G
shared-file-dir = /shm/ # mapped in docker to /dev/shm
shared-file-full-threshold = 9500
shared-file-scale-rate = 1000
plugin = condenser_api network_broadcast_api witness

steemd (v0.20.12) crashed, despite having 60G allocated in tmpfs:

$ df -h /dev/shm/shared_memory.bin
Filesystem      Size  Used Avail Use% Mounted on
tmpfs            60G  5.1G   55G   9% /dev/shm

crash log:

   30.2421%   10700000 of 35381086   (2728M free)
   30.5248%   10800000 of 35381086   (2724M free)
   30.8074%   10900000 of 35381086   (2801M free)
   31.0901%   11000000 of 35381086   (2860M free)
   31.3727%   11100000 of 35381086   (2910M free)
   31.6553%   11200000 of 35381086   (2958M free)
   31.938%   11300000 of 35381086   (3031M free)
   32.2206%   11400000 of 35381086   (3062M free)
   32.5032%   11500000 of 35381086   (3113M free)
   32.7859%   11600000 of 35381086   (3085M free)
   33.0685%   11700000 of 35381086   (3057M free)
   33.3512%   11800000 of 35381086   (2992M free)
   33.6338%   11900000 of 35381086   (2905M free)
   33.9164%   12000000 of 35381086   (2827M free)
   34.1991%   12100000 of 35381086   (2737M free)
   34.4817%   12200000 of 35381086   (2651M free)
   34.7643%   12300000 of 35381086   (2571M free)
   35.047%   12400000 of 35381086   (2512M free)
   35.3296%   12500000 of 35381086   (2438M free)
   35.6122%   12600000 of 35381086   (2282M free)
   35.8949%   12700000 of 35381086   (2103M free)
   36.1775%   12800000 of 35381086   (1915M free)
   36.4602%   12900000 of 35381086   (1692M free)
1333424ms database.cpp:4968             apply_hardfork       ] HARDFORK 19 at block 12988978
   36.7428%   13000000 of 35381086   (1446M free)
   37.0254%   13100000 of 35381086   (1147M free)
   37.3081%   13200000 of 35381086   (850M free)
   37.5907%   13300000 of 35381086   (563M free)
   37.8733%   13400000 of 35381086   (295M free)
   38.156%   13500000 of 35381086   (33M free)
1551519ms database.cpp:3252             _apply_block         ] 13 N5boost12interprocess9bad_allocE: boost::interprocess::bad_alloc
boost::interprocess::bad_alloc: 
    {"o":{"parent_author":"","parent_permlink":"nsfw","author":"michaellamden68","permlink":"644u4b-p-o-v-point-of-view","title":"P.O.V.....Point Of View!!!","body":"Source. http://fuck-me-till-the-end.com/post/155589929431\n\n\n\n\n\n\nhttps://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\nhttps://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\nhttps://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\nhttps://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\nhttps://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\nhttps://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\nhttps://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\nhttps://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\nhttps://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\nhttps://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif","json_metadata":"{\"tags\":[\"nsfw\",\"pov\",\"fuck\",\"porn\"],\"image\":[\"https://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\",\"https://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\",\"https://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\",\"https://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\",\"https://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\",\"https://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\",\"https://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\",\"https://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\",\"https://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\",\"https://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif\"],\"links\":[\"http://fuck-me-till-the-end.com/post/155589929431\"],\"app\":\"steemit/0.1\",\"format\":\"markdown\"}"},"what":"boost::interprocess::bad_alloc"}
    steem_evaluator.cpp:1001 do_apply

    {"op":{"type":"comment_operation","value":{"parent_author":"","parent_permlink":"nsfw","author":"michaellamden68","permlink":"644u4b-p-o-v-point-of-view","title":"P.O.V.....Point Of View!!!","body":"Source. http://fuck-me-till-the-end.com/post/155589929431\n\n\n\n\n\n\nhttps://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\nhttps://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\nhttps://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\nhttps://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\nhttps://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\nhttps://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\nhttps://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\nhttps://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\nhttps://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\nhttps://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif","json_metadata":"{\"tags\":[\"nsfw\",\"pov\",\"fuck\",\"porn\"],\"image\":[\"https://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\",\"https://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\",\"https://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\",\"https://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\",\"https://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\",\"https://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\",\"https://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\",\"https://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\",\"https://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\",\"https://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif\"],\"links\":[\"http://fuck-me-till-the-end.com/post/155589929431\"],\"app\":\"steemit/0.1\",\"format\":\"markdown\"}"}}}
    database.cpp:3491 _apply_transaction

    {"trx":{"ref_block_num":3075,"ref_block_prefix":2058483080,"expiration":"2017-07-08T12:48:54","operations":[{"type":"comment_operation","value":{"parent_author":"","parent_permlink":"nsfw","author":"michaellamden68","permlink":"644u4b-p-o-v-point-of-view","title":"P.O.V.....Point Of View!!!","body":"Source. http://fuck-me-till-the-end.com/post/155589929431\n\n\n\n\n\n\nhttps://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\nhttps://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\nhttps://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\nhttps://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\nhttps://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\nhttps://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\nhttps://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\nhttps://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\nhttps://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\nhttps://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif","json_metadata":"{\"tags\":[\"nsfw\",\"pov\",\"fuck\",\"porn\"],\"image\":[\"https://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\",\"https://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\",\"https://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\",\"https://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\",\"https://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\",\"https://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\",\"https://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\",\"https://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\",\"https://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\",\"https://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif\"],\"links\":[\"http://fuck-me-till-the-end.com/post/155589929431\"],\"app\":\"steemit/0.1\",\"format\":\"markdown\"}"}},{"type":"comment_options_operation","value":{"author":"michaellamden68","permlink":"644u4b-p-o-v-point-of-view","max_accepted_payout":{"amount":"1000000000","precision":3,"nai":"@@000000013"},"percent_steem_dollars":0,"allow_votes":true,"allow_curation_rewards":true,"extensions":[]}}],"extensions":[],"signatures":["1f393317c6355c3b10f591b5bc0d4b7dc32ba9c758adfc00ae55b6ad7c19bc2a377bc980460f3111d5327feb3f28b4db71264a5b3fdfd345be102396c87e317388"]}}
    database.cpp:3497 _apply_transaction
1551519ms database.cpp:3252             _apply_block         ] next_block.block_num(): 13503496 
13 N5boost12interprocess9bad_allocE: boost::interprocess::bad_alloc
boost::interprocess::bad_alloc: 
    {"o":{"parent_author":"","parent_permlink":"nsfw","author":"michaellamden68","permlink":"644u4b-p-o-v-point-of-view","title":"P.O.V.....Point Of View!!!","body":"Source. http://fuck-me-till-the-end.com/post/155589929431\n\n\n\n\n\n\nhttps://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\nhttps://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\nhttps://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\nhttps://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\nhttps://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\nhttps://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\nhttps://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\nhttps://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\nhttps://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\nhttps://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif","json_metadata":"{\"tags\":[\"nsfw\",\"pov\",\"fuck\",\"porn\"],\"image\":[\"https://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\",\"https://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\",\"https://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\",\"https://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\",\"https://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\",\"https://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\",\"https://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\",\"https://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\",\"https://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\",\"https://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif\"],\"links\":[\"http://fuck-me-till-the-end.com/post/155589929431\"],\"app\":\"steemit/0.1\",\"format\":\"markdown\"}"},"what":"boost::interprocess::bad_alloc"}
    steem_evaluator.cpp:1001 do_apply

    {"op":{"type":"comment_operation","value":{"parent_author":"","parent_permlink":"nsfw","author":"michaellamden68","permlink":"644u4b-p-o-v-point-of-view","title":"P.O.V.....Point Of View!!!","body":"Source. http://fuck-me-till-the-end.com/post/155589929431\n\n\n\n\n\n\nhttps://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\nhttps://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\nhttps://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\nhttps://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\nhttps://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\nhttps://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\nhttps://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\nhttps://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\nhttps://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\nhttps://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif","json_metadata":"{\"tags\":[\"nsfw\",\"pov\",\"fuck\",\"porn\"],\"image\":[\"https://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\",\"https://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\",\"https://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\",\"https://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\",\"https://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\",\"https://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\",\"https://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\",\"https://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\",\"https://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\",\"https://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif\"],\"links\":[\"http://fuck-me-till-the-end.com/post/155589929431\"],\"app\":\"steemit/0.1\",\"format\":\"markdown\"}"}}}
    database.cpp:3491 _apply_transaction

    {"trx":{"ref_block_num":3075,"ref_block_prefix":2058483080,"expiration":"2017-07-08T12:48:54","operations":[{"type":"comment_operation","value":{"parent_author":"","parent_permlink":"nsfw","author":"michaellamden68","permlink":"644u4b-p-o-v-point-of-view","title":"P.O.V.....Point Of View!!!","body":"Source. http://fuck-me-till-the-end.com/post/155589929431\n\n\n\n\n\n\nhttps://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\nhttps://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\nhttps://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\nhttps://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\nhttps://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\nhttps://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\nhttps://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\nhttps://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\nhttps://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\nhttps://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif","json_metadata":"{\"tags\":[\"nsfw\",\"pov\",\"fuck\",\"porn\"],\"image\":[\"https://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\",\"https://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\",\"https://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\",\"https://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\",\"https://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\",\"https://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\",\"https://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\",\"https://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\",\"https://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\",\"https://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif\"],\"links\":[\"http://fuck-me-till-the-end.com/post/155589929431\"],\"app\":\"steemit/0.1\",\"format\":\"markdown\"}"}},{"type":"comment_options_operation","value":{"author":"michaellamden68","permlink":"644u4b-p-o-v-point-of-view","max_accepted_payout":{"amount":"1000000000","precision":3,"nai":"@@000000013"},"percent_steem_dollars":0,"allow_votes":true,"allow_curation_rewards":true,"extensions":[]}}],"extensions":[],"signatures":["1f393317c6355c3b10f591b5bc0d4b7dc32ba9c758adfc00ae55b6ad7c19bc2a377bc980460f3111d5327feb3f28b4db71264a5b3fdfd345be102396c87e317388"]}}
    database.cpp:3497 _apply_transaction
rethrow
    {"next_block.block_num()":13503496}
    database.cpp:3252 _apply_block

    {"next_block":{"previous":"00ce0c07fbe1efe90d2e0dc6bcac0a42deaee694","timestamp":"2017-07-08T12:48:00","witness":"wackou","transaction_merkle_root":"e8bb196bab9e66213d9b066753afe6244b884b34","extensions":[],"witness_signature":"205dae08f9a4250bdf0d6292ba619785a4a4dd88469da95218ddc89853631c46f82bdfe78287986de4e7fa1394da1c82a2b6dcd7ece514c0f9b6d84368769dc36f","transactions":[{"ref_block_num":3075,"ref_block_prefix":2058483080,"expiration":"2017-07-08T12:48:54","operations":[{"type":"custom_json_operation","value":{"required_auths":[],"required_posting_auths":["rejakurniawn"],"id":"follow","json":"[\"follow\",{\"follower\":\"rejakurniawn\",\"following\":\"reggaemuffin\",\"what\":[\"blog\"]}]"}}],"extensions":[],"signatures":["20776965d1bb7b775b1f9f0605054784ef36730a27042917e1a017d320cd1ba50336b8663d299057734608d6684d000b7f4512082bc30333bfa36c2d1438899768"]},{"ref_block_num":3075,"ref_block_prefix":2058483080,"expiration":"2017-07-08T12:48:54","operations":[{"type":"comment_operation","value":{"parent_author":"","parent_permlink":"steemit","author":"me-tarzan","permlink":"5k4d3g-thursday-s-power-down-is-above-thursday-s-average-line-daily-steem-power-down","title":"THURSDAY'S POWER DOWN IS ABOVE THURSDAY'S AVERAGE LINE < DAILY STEEM POWER DOWN <><>","body":"https://steemitimages.com/0x0/https://steemitimages.com/0x0/http://i.imgur.com/kdEB9s9.png\n\n# &#128018; Thursday's Power Downs : Steem being Powered Down on Thursday's only .\nHighest Thursday Power Down :  \nLowest Thursday Power Down: \n\n\n\n\n&#128018;\nDATE|STEEM POWEERED DOWN|DAY OF WEEK\n-|-|-\n1/19/2017|144,675|THURS\n1/26/2017|123,925|THURS\n2/02/2017|118,431|THURS\n2/09/2017|117,672|THURS\n2/16/2017|116,194|THURS\n2/23/2017|119,125|THURS\n3/02/2017|122,826|THURS\n3/09/2017|125,038|THURS\n3/16/2017|115,546|THUR\n3/23/2017 |105,983 |THUR \n3/30/2017|376,140|THUR\n4/06/2017|591,895|THUR\n4/13/2017|610,461|THUR\n4/20/2017|465,726|THUR\n4/27/2017|402,148|THUR\n5/04/2017|390,693|THUR\n5/11/2017|384,362|THUR\n5/18/2017|559,364|THUR\n5/25/2017|374,472|THUR\n6/01/2017|371,109|THUR\n6/08/2017|829,298|THUR\n6/15/2017  |874,464  |THUR  \n6/22/2017|862,058|THUR\n6/29/2017|574,869|THUR\n7/06/2017|635,619|THUR\n\n\n\n\nBelow :\nChart showing the amount of Steem being Powered Down every Thursday since (1/19/2017)\nCOLUMN : = Amount of Steem Powered Down on Thursday's\nLINE : = Average amount of Steem Powered Down on Thursday's\n\n<a href=\"https://imgflip.com/i/1s6c4r\"><img src=\"https://i.imgflip.com/1s6c4r.jpg\" title=\"made at imgflip.com\"/></a>\n\n\nDISCLAIMER : This content is for informational, educational and research purposes only.\nPlease get the advice of a competent financial advisor before investing your money in any financial instrument.\n\nIt is strongly recommend that you consult with a licensed financial professional before using any information provided here at DAILY STEEM POWER DOWN . Any market data or news commentary used here is for illustrative and informational purposes only.\n\nPlease voice your opinions in the comments below.\nhttps://steemitimages.com/0x0/https://steemitimages.com/0x0/https://steemitimages.com/0x0/https://steemitimages.com/0x0/https://s23.postimg.org/ggouzbb0r/follw.gif\n\n**SUMMARY**\nI have added an average line on the chart .\nThursday's Powered Down Steem is ABOVE the average Line for Thursday's , by **255,174**  more Steem than the average for Thursday's .\n\n# &#128018;","json_metadata":"{\"tags\":[\"steemit\",\"steem\",\"money\",\"beyondbitcoin\",\"trading\"],\"image\":[\"https://steemitimages.com/0x0/https://steemitimages.com/0x0/http://i.imgur.com/kdEB9s9.png\",\"https://i.imgflip.com/1s6c4r.jpg\",\"https://steemitimages.com/0x0/https://steemitimages.com/0x0/https://steemitimages.com/0x0/https://steemitimages.com/0x0/https://s23.postimg.org/ggouzbb0r/follw.gif\"],\"links\":[\"https://imgflip.com/i/1s6c4r\"],\"app\":\"steemit/0.1\",\"format\":\"markdown\"}"}},{"type":"comment_options_operation","value":{"author":"me-tarzan","permlink":"5k4d3g-thursday-s-power-down-is-above-thursday-s-average-line-daily-steem-power-down","max_accepted_payout":{"amount":"1000000000","precision":3,"nai":"@@000000013"},"percent_steem_dollars":0,"allow_votes":true,"allow_curation_rewards":true,"extensions":[]}}],"extensions":[],"signatures":["1f1e996e78825f9b98d1f795a9afcb500ba6a99bfe6d444c3b6d4ef3d4a7d3f2cb6db7d20bf2e8d3bd051eb6e3a2f53e675b682cd27b10592432a8d6abdbdb51e5"]},{"ref_block_num":3075,"ref_block_prefix":2058483080,"expiration":"2017-07-08T12:48:54","operations":[{"type":"custom_json_operation","value":{"required_auths":[],"required_posting_auths":["ultimatefails"],"id":"follow","json":"[\"follow\",{\"follower\":\"ultimatefails\",\"following\":\"ahmedezzat\",\"what\":[\"blog\"]}]"}}],"extensions":[],"signatures":["1f4992f24f79f6756ad9e3eae0d821fec24e770826cea2be161415ae1d759ad9c0465aba30381dd236050d54e5ec555cb15b6d69264254a2b1fd73e557178fbf9b"]},{"ref_block_num":3075,"ref_block_prefix":2058483080,"expiration":"2017-07-08T12:48:54","operations":[{"type":"comment_operation","value":{"parent_author":"","parent_permlink":"nsfw","author":"michaellamden68","permlink":"644u4b-p-o-v-point-of-view","title":"P.O.V.....Point Of View!!!","body":"Source. http://fuck-me-till-the-end.com/post/155589929431\n\n\n\n\n\n\nhttps://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\nhttps://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\nhttps://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\nhttps://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\nhttps://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\nhttps://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\nhttps://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\nhttps://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\nhttps://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\nhttps://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif","json_metadata":"{\"tags\":[\"nsfw\",\"pov\",\"fuck\",\"porn\"],\"image\":[\"https://68.media.tumblr.com/26d581f648476088766c40edda7679b4/tumblr_nmwgz7bR0x1semc6ko1_500.gif\",\"https://68.media.tumblr.com/638d1e5398021d611103bf6454e45b82/tumblr_nmwgz7bR0x1semc6ko2_500.gif\",\"https://68.media.tumblr.com/b66fdeeb363f48b184cdea6f6669a17d/tumblr_nmwgz7bR0x1semc6ko3_500.gif\",\"https://68.media.tumblr.com/9af68c777dc16e0f700d9ac88b6378e0/tumblr_nmwgz7bR0x1semc6ko4_500.gif\",\"https://68.media.tumblr.com/1818ba8c3eae1ef18a79b45895113847/tumblr_nmwgz7bR0x1semc6ko5_500.gif\",\"https://68.media.tumblr.com/7dc55cfb7ea9e1df426f35b706e921c4/tumblr_nmwgz7bR0x1semc6ko6_500.gif\",\"https://68.media.tumblr.com/4414cbd31cd3300ee3ea18981a2186a6/tumblr_nmwgz7bR0x1semc6ko7_500.gif\",\"https://68.media.tumblr.com/d6c72084d1465eb79be50fffd2b21939/tumblr_nmwgz7bR0x1semc6ko8_500.gif\",\"https://68.media.tumblr.com/3e7d83d8aa436be426f796d57cecd053/tumblr_nmwgz7bR0x1semc6ko9_500.gif\",\"https://68.media.tumblr.com/92ad0829826d4b76c7b0526b9d6158c1/tumblr_nmwgz7bR0x1semc6ko10_500.gif\"],\"links\":[\"http://fuck-me-till-the-end.com/post/155589929431\"],\"app\":\"steemit/0.1\",\"format\":\"markdown\"}"}},{"type":"comment_options_operation","value":{"author":"michaellamden68","permlink":"644u4b-p-o-v-point-of-view","max_accepted_payout":{"amount":"1000000000","precision":3,"nai":"@@000000013"},"percent_steem_dollars":0,"allow_votes":true,"allow_curation_rewards":true,"extensions":[]}}],"extensions":[],"signatures":["1f393317c6355c3b10f591b5bc0d4b7dc32ba9c758adfc00ae55b6ad7c19bc2a377bc980460f3111d5327feb3f28b4db71264a5b3fdfd345be102396c87e317388"]},{"ref_block_num":3075,"ref_block_prefix":2058483080,"expiration":"2017-07-08T12:48:54","operations":[{"type":"claim_reward_balance_operation","value":{"account":"moderninvestor","reward_steem":{"amount":"0","precision":3,"nai":"@@000000021"},"reward_sbd":{"amount":"41","precision":3,"nai":"@@000000013"},"reward_vests":{"amount":"47564437","precision":6,"nai":"@@000000037"}}}],"extensions":[],"signatures":["1f05ac97cdb31e81b1471da1d511cd649dfd1f3abd447a5be06a7fe5da7e1880de0be95a6f875fd71232781b13d4083f81b86be818d65bf9a2927be8b175eddaba"]},{"ref_block_num":3076,"ref_block_prefix":2781143185,"expiration":"2017-07-08T12:48:57","operations":[{"type":"vote_operation","value":{"voter":"nocturnal","author":"kinakomochi","permlink":"taiyaki-ohana-coffee","weight":10000}}],"extensions":[],"signatures":["2056997d291456f1836a4bebd5e3fe29822fc1e79cf15d5f7416af21a64a7d2c161185ae72f7fdf3a811ee284a8263a4099f6c43ea12697be977592742334b0583"]},{"ref_block_num":3075,"ref_block_prefix":2058483080,"expiration":"2017-07-08T12:48:54","operations":[{"type":"custom_json_operation","value":{"required_auths":[],"required_posting_auths":["ultimatefails"],"id":"follow","json":"[\"follow\",{\"follower\":\"ultimatefails\",\"following\":\"aidancloquell\",\"what\":[\"blog\"]}]"}}],"extensions":[],"signatures":["1f6a8e48ebe6cac474aa7e6a2dc1b457ce0249262d5b32838f45732910b0bb19632a17313cc4b9853f77e199196500691c9ca356f0e16b32042e2cbd939dbedf44"]},{"ref_block_num":3076,"ref_block_prefix":2781143185,"expiration":"2017-07-08T12:48:57","operations":[{"type":"custom_json_operation","value":{"required_auths":[],"required_posting_auths":["ultimatefails"],"id":"follow","json":"[\"follow\",{\"follower\":\"ultimatefails\",\"following\":\"ahumada1999\",\"what\":[\"blog\"]}]"}}],"extensions":[],"signatures":["20494df1a6bfaa08cf1324b641f3ff40b3e32d3df6a409f742525c198a687f5b284fb7dd16fefe9bc24c406dc1b50d6569a109c328cf252b4207add0d41d337e6e"]},{"ref_block_num":3076,"ref_block_prefix":2781143185,"expiration":"2017-07-08T12:48:57","operations":[{"type":"custom_json_operation","value":{"required_auths":[],"required_posting_auths":["rlaeoghks"],"id":"follow","json":"[\"follow\",{\"follower\":\"rlaeoghks\",\"following\":\"joanaltres\",\"what\":[\"blog\"]}]"}}],"extensions":[],"signatures":["205ade02a6b19ffa24b819246b5050950aac2af3ccfbf08442357385341f9548c045f8818d9623d78ddada53a89a6bf47cbdcaeef4fd134d89f4c14d094e0fe0b5"]},{"ref_block_num":3073,"ref_block_prefix":2757057122,"expiration":"2017-07-08T12:48:48","operations":[{"type":"vote_operation","value":{"voter":"atafauzan79","author":"hanshotfirst","permlink":"a-geeky-guy-s-movie-guide-to-baby-driver","weight":2508}}],"extensions":[],"signatures":["2056678199becf470647a3e48aeea64e00955c1d06460ffe463a991b642af34e6f278ee430212440a64bafd6c45f56c75ada024a738cef23411baa07c2d2fbc288"]},{"ref_block_num":3076,"ref_block_prefix":2781143185,"expiration":"2017-07-08T12:48:57","operations":[{"type":"vote_operation","value":{"voter":"change4life","author":"steemmate","permlink":"incorporating-crypto-into-life-not-letting-it-reign-supreme","weight":10000}}],"extensions":[],"signatures":["1f7261d08310bd06fe1f54fafb22e5c97f3d90fe58bd90162e7a1c2949effc2e51049e3bc81657520f34f37e26585d2b763dc9de87d59d9933cdb2b7884920c5a7"]},{"ref_block_num":3079,"ref_block_prefix":3924812283,"expiration":"2017-07-08T12:48:13","operations":[{"type":"vote_operation","value":{"voter":"sandra","author":"steevc","permlink":"rocking-the-pub","weight":600}}],"extensions":[],"signatures":["202583bdc225ff0b35db9ce270c1f380317b76ce68d81e0c2b02eb75da792d89b33715cd8f49a5f0e6dc1cd076be0587274dd8d8bfa95ddb00ad347b1d80eafd04"]}]}}
    database.cpp:3026 apply_block

    {"args.data_dir":"/steem/witness_node_data_dir/blockchain","args.shared_mem_dir":"/shm/"}
    database.cpp:345 reindex
mvandeberg commented 5 years ago

I am not seeing any evidence of autoscaling during reindex, only resync and live. We can add the behavior to reindexing as well.