search

overcast07 / wayback-machine-spn-scripts

Bash scripts which interact with Internet Archive Wayback Machine's Save Page Now
MIT License
104 stars 9 forks source link

Corrupt JSON - possible race condition #34

Open AnyOldName3 opened 7 months ago

AnyOldName3 commented 7 months ago

In a success-json.log file produced by this script, I found

{"counters":{"embeds":48,"outlinks":0},"delay_wb_availability":true,"duration_sec":7.6,"first_archive":true,"http_status":409,"job_id":"spn2-39bd1dec1e3d329f78fca8aded561300b91fa0ab","original_url":"https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687","resources":["https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687","https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687","https://www.paypalobjects.com/en_US/i/scr/pixel.gif","https://www.paypalobjects.com/en_US/i/btn/btn_donateCC_LG.gif","https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js","https://googleads.g.doubleclick.net/pagead/html/r20240207/r20190131/zrt_lookup_fy2021.html","https://www.vasiljevski.com/forum/assets/css/font-awesome.min.css?assets_version=9","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/stylesheet.css?assets_version=9","https://www.v{"counters":{"embeds":57,"outlinks":20},"delay_wb_availability":true,"duration_sec":13.16,"first_archive":true,"http_status":200,"job_id":"spn2-54e45429c3e4300970a519bd0d447c15155f02ea","original_url":"https://www.vasiljevski.com/forum/search.php?author_id=806&sr=posts&sid=5a6b717de59c733d56d86de2fd9de687","outlinks":["https://www.vasiljevski.com/forum/ucp.php?mode=terms&sid=d29fcdbc69910356964a39c5256493cb","https://www.vasiljevski.com/forum/ucp.php?mode=login&redirect=search.php%3Fauthor_id%3D806%26sr%3Dposts&sid=d29fcdbc69910356964a39c5256493cb","https://www.vasiljevski.com/forum/search.php?search_id=active_topics&sid=d29fcdbc69910356964a39c5256493cb","https://www.vasiljevski.com/forum/ucp.php?mode=register&sid=d29fcdbc69910356964a39c5256493cb","https://www.vasiljevski.com/forum/","http://www.joomla.org/","https://www.vasiljevski.com/forum/index.php?sid=d29fcdbc69910356964a39c5256493cb","http://www.opensourcematters.org/","https://www.vasiljevski.com/forum/search.php?sid=d29fcdbc69910356964a39c5256493cb","asiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/en/stylesheet.css?assets_version=9","https://www.vasiljevski.com/forum/assets/javascript/jquery-3.5.1.min.js?assets_version=9","https://www.vasiljevski.com/forum/assets/javascript/core.js?assets_version=9","https://www.vasiljevski.com/forum/styles/prosilver/template/forum_fn.js?assets_version=9","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/normalize.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/base.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/utilities.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/common.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/content.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/links.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/cp.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/http://www.vasiljevski.com/","http://www.admiror-design-studio.com/","https://www.phpbb.com/","https://www.vasiljevski.com/forum/ucp.php?mode=privacy&sid=d29fcdbc69910356964a39c5256493cb","https://www.vasiljevski.com/forum/help/faq?sid=d29fcdbc69910356964a39c5256493cb","https://www.vasiljevski.com/forum/ucp.php?mode=delete_cookies&sid=d29fcdbc69910356964a39c5256493cb","https://www.vasiljevski.com/forum/search.php?search_id=unanswered&sid=d29fcdbc69910356964a39c5256493cb"],"resources":["https://www.vasiljevski.com/forum/search.php?author_id=806&sr=posts&sid=5a6b717de59c733d56d86de2fd9de687","https://www.paypalobjects.com/en_US/i/scr/pixel.gif","https://www.paypalobjects.com/en_US/i/btn/btn_donateCC_LG.gif","https://pagead2.googlesyndication.com/pagead/js/adsbygoogle.js","https://googleads.g.doubleclick.net/pagead/html/r20240207/r20190131/zrt_lookup_fy2021.html","https://www.vasiljevski.com/forum/assets/css/font-awesome.min.css?assets_version=9","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/thetheme/buttons.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/responsive.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/forms.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/icons.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/colours.css?v=3.2","https://pagead2.googlesyndication.com/pagead/managed/js/adsense/m202402010101/show_ads_impl_fy2021.js?bust=31080932","https://www.vasiljevski.com/forum/styles/prosilver/template/ajax.js?assets_version=9","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/template/jquery-ui.js?assets_version=9","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/template/collapse.js?assets_version=9","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/images/site_logo.gif","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/images/banner-AGHOME.jpg","https://www.vasiljevski.com/forum/images/vasiljevskme/en/stylesheet.css?assets_version=9","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/stylesheet.css?assets_version=9","https://www.vasiljevski.com/forum/assets/javascript/core.js?assets_version=9","https://www.vasiljevski.com/forum/styles/prosilver/template/forum_fn.js?assets_version=9","https://www.vasiljevski.com/forum/assets/javascript/jquery-3.5.1.min.js?assets_version=9","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/normalize.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/utilities.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/base.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/common.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/links.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/cp.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/forms.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/content.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/responsive.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/buttons.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/icons.css?v=3.2","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/colours.css?v=3.2","https://www.vasiljevski.com/forum/styles/prosilver/template/ajax.js?assets_version=9","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/template/jquery-ui.js?assets_version=9","https://pagead2.googlesyndication.com/pagead/managed/js/adsense/m202401310101/show_ads_impl_fy2021.js","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/theme/images/banner-AGHOME.jpg","https://www.vasiljevski.com/forum/images/vasiljevski-home.jpg","https://www.vasiljevski.com/forum/styles/AllanStyle-SUBSILVER/template/collapse.js?assets_version=9","https://www.vasiljevski.com/forum/styles/Ai-home.jpg","https://www.vasiljevski.com/forum/assets/fonts/fontawesome-webfont.woff2?v=4.7.0","https://googleads.g.doubleclick.net/pagead/ads?client=ca-pub-4580185424743894&output=html&h=280&slotname=8585021723&adk=1660479718&adf=93774972&pi=t.ma~as.8585021723&w=728&fwrn=4&fwrnh=100&lmt=1707453263&rafmt=1&format=728x280&url=https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687&fwr=0&fwrattr=true&rh=90&rw=728&rpe=1&resp_fmts=3&wgl=1&dt=1707453263245&bpp=77&bdt=843&idt=194&shv=r20240207&mjsv=m202402010101&ptt=9&saldr=aa&abxe=1&correlator=258243914012&frm=20&pv=2&ga_vid=566796895.1707453263&ga_sid=1707453263&ga_hid=658293508&ga_fc=0&u_tz=0&u_his=2&u_h=900&u_w=1400&u_ah=900&u_aw=1400&u_cd=24&u_sd=1&dmc=18&adx=653&ady=170&biw=1385&bih=885&scr_x=0&scr_y=0&eid=44759876,44759927,44759837,44808398,31080650,31080780,31080794,31080798,31080947,31080932,95324155,95324161,95324260&oid=2&pvsid=451703505265433&tmod=1734510754&uas=0&nvt=2&ref=https://www.vasiljevski.collanStyle-SUBSILVER/theme/images/site_logo.gif","https://www.vasiljevski.com/forum/assets/fonts/fontawesome-webfont.woff2?v=4.7.0","https://googleads.g.doubleclick.net/pagead/ads?client=ca-pub-4580185424743894&output=html&h=280&slotname=8585021723&adk=1660479718&adf=93774972&pi=t.ma~as.8585021723&w=728&fwrn=4&fwrnh=100&lmt=1707453251&rafmt=1&format=728x280&url=https://www.vasiljevski.com/forum/search.php?author_id=806&sr=posts&sid=5a6b717de59c733d56d86de2fd9de687&fwr=0&fwrattr=true&rh=90&rw=728&rpe=1&resp_fmts=3&wgl=1&dt=1707453250918&bpp=93&bdt=811&idt=249&shv=r20240207&mjsv=m202401310101&ptt=9&saldr=aa&abxe=1&correlator=5964033442789&frm=20&pv=2&ga_vid=1176706915.1707453251&ga_sid=1707453251&ga_hid=2140856768&ga_fc=0&u_tz=0&u_his=2&u_h=900&u_w=1400&u_ah=900&u_aw=1400&u_cd=24&u_sd=1&dmc=29&adx=653&ady=170&biw=1385&bih=885&scr_x=0&scr_y=0&eid=44759876,44759927,44759837,44808397,31080794,31080886,31080947,44795921,95322433,95323760,95324155,95324161,21065724&oid=2&pvsid=2706683535616053&tmod=1681310640&uas=0&nm/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687&fc=640&brdim=0,0,0,0,1400,0,1400,900,1400,900&vis=1&rsz=d||eE|n&abl=XS&pfx=0&fu=1152&bc=31&bz=1&psd=W251bGwsbnVsbCxudWxsLDNd&ifi=1&uci=a!1&fsb=1&dtd=232","https://googleads.g.doubleclick.net/pagead/ads?client=ca-pub-4580185424743894&output=html&adk=1511961599&adf=2261577023&lmt=1707453263&plat=3:16,4:16,9:32776,16:8388608,17:32,24:32,25:32,30:1081344,32:32,41:32,42:32&format=0x0&url=https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687&pra=7&wgl=1&easpi=0&asro=0&aslmt=0.4&asamt=-1&asefa=1&aseiel=1~2~4~6&aslcwct=150&asacwct=25&dt=1707453263571&bpp=9&bdt=1170&idt=9&shv=r20240207&mjsv=m202402010101&ptt=9&saldr=aa&abxe=1&prev_fmts=728x280&nras=1&correlator=258243914012&frm=20&pv=1&ga_vid=566796895.1707453263&ga_sid=1707453263&ga_hid=658293508&ga_fc=0&u_tz=0&u_his=2&u_h=900&u_w=1400&u_ah=900&u_aw=1400&u_cd=24&u_sd=1&dmc=31&adx=-12245933&ady=-12245933&biw=1385&bih=885&scr_x=0&svt=1&fc=640&brdim=0,0,0,0,1400,0,1400,900,1400,900&vis=1&rsz=d||eE|n&abl=XS&pfx=0&fu=1152&bc=31&bz=1&psd=W251bGwsbnVsbCxudWxsLDNd&ifi=1&uci=a!1&fsb=1&dtd=307","https://googleads.g.doubleclick.net/pagead/ads?client=ca-pub-4580185424743894&output=html&adk=1511961599&adf=2261577023&lmt=1707453251&plat=3:16,4:16,9:32776,16:8388608,17:32,24:32,25:32,30:1081344,32:32,41:32,42:32&format=0x0&url=https://www.vasiljevski.com/forum/search.php?author_id=806&sr=posts&sid=5a6b717de59c733d56d86de2fd9de687&pra=7&wgl=1&easpi=0&asro=0&aslmt=0.4&asamt=-1&asedf=0&asefa=1&aseiel=1~2~4~6&aslcwct=150&asacwct=25&dt=1707453251265&bpp=9&bdt=1159&idt=9&shv=r20240207&mjsv=m202401310101&ptt=9&saldr=aa&abxe=1&prev_fmts=728x280&nras=1&correlator=5964033442789&frm=20&pv=1&ga_vid=1176706915.1707453251&ga_sid=1707453251&ga_hid=2140856768&ga_fc=0&u_tz=0&u_his=2&u_h=900&u_w=1400&u_ah=900&u_aw=1400&u_cd=24&u_sd=1&dmc=16&adx=-12245933&ady=-12245933&biw=1385&bih=885&scr_x=0&scr_y=0&eid=44759876,44759927,44759837,44808397,31080794,31080886,31080947cr_y=0&eid=44759876,44759927,44759837,44808398,31080650,31080780,31080794,31080798,31080947,31080932,95324155,95324161,95324260&oid=2&pvsid=451703505265433&tmod=1734510754&uas=0&nvt=2&fsapi=1&ref=https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687&fc=896&brdim=0,0,0,0,1400,0,1400,900,1400,900&vis=1&rsz=||s|&abl=NS&fu=33792&bc=31&bz=1&psd=W251bGwsbnVsbCxudWxsLDNd&ifi=2&uci=a!2&fsb=1&dtd=32","https://pagead2.googlesyndication.com/getconfig/sodar?sv=200&tid=gda&tv=r20240207&st=env","https://tpc.googlesyndication.com/sodar/sodar2.js","https://tpc.googlesyndication.com/sodar/sodar2/225/runner.html","https://www.google.com/recaptcha/api2/aframe","https://pagead2.googlesyndication.com/bg/s6Lo-ySsTFszeicWuLCsm9BIHYA2isJaSryvoQutTtY.js","https://pagead2.googlesyndication.com/pagead/sodar?id=sodar2&v=225&li=gda_r20240207&jk=451703505265433&rc=","https://googleads.g.doubleclick.net/pagead/ads?client=ca-pub-4580185424743894&output=html&h=60&adk=809031717&adf=35367,44795921,95322433,95323760,95324155,95324161,21065724&oid=2&pvsid=2706683535616053&tmod=1681310640&uas=0&nvt=1&fsapi=1&fc=896&brdim=0,0,0,0,1400,0,1400,900,1400,900&vis=1&rsz=||s|&abl=NS&fu=33792&bc=31&bz=1&psd=W251bGwsbnVsbCxudWxsLDNd&ifi=2&uci=a!2&fsb=1&dtd=36","https://pagead2.googlesyndication.com/pagead/managed/js/adsense/m202401310101/reactive_library_fy2021.js","https://pagead2.googlesyndication.com/getconfig/sodar?sv=200&tid=gda&tv=r20240207&st=env","https://tpc.googlesyndication.com/sodar/sodar2.js","https://googleads.g.doubleclick.net/pagead/html/r20240207/r20110914/zrt_lookup_fy2021.html?fsb=1","https://tpc.googlesyndication.com/sodar/sodar2/225/runner.html","https://tpc.googlesyndication.com/pagead/js/r20240207/r20110914/elements/html/fullscreen_api_adapter_fy2021.js","https://tpc.googlesyndication.com/pagead/js/r20240207/r20110914/elements/html/interstitial_ad_frame_fy2021.js","https://fonts.googleapis.com/css2?family=Roboto:wght@400;700&display=swap","https://pagead2.googlesyndication.com/bg/s664724&pi=t.aa~a.897811002~rp.1&w=1200&fwrn=4&fwrnh=100&lmt=1707453264&rafmt=1&to=qs&pwprc=7999977537&format=1200x60&url=https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687&fwr=0&pra=3&rpe=1&resp_fmts=3&wgl=1&fa=40&dt=1707453264153&bpp=1&bdt=1752&idt=2&shv=r20240207&mjsv=m202402010101&ptt=9&saldr=aa&abxe=1&cookie=ID=6f17665e28a95831:T=1707453263:RT=1707453263:S=ALNI_MbnqExgMWZFGLUqm2t47h0qbA_iSw&gpic=UID=00000dbe99599ebf:T=1707453263:RT=1707453263:S=ALNI_Mb9GgY1P3ajnJWoTfNdoApFGGkjnA&eo_id_str=ID=4ffe203483a8e39b:T=1707453263:RT=1707453263:S=AA-AfjYCS-lMk2lE32loLmsVI6jM&prev_fmts=728x280,0x0&nras=2&correlator=258243914012&frm=20&pv=1&ga_vid=566796895.1707453263&ga_sid=1707453263&ga_hid=658293508&ga_fc=0&u_tz=0&u_his=2&u_h=900&u_w=1400&u_ah=900&u_aw=1400&u_cd=24&u_sd=1&dmc=12&adx=93&ady=1067&biw=1385&bih=885&scr_x=0&scr_y=0&eid=44759876,44759927,44759837,44808398,31080650,31080780,31080794,31080798,31080947,31080932,95324155,95324161,95324260&oid=2&pvsid=451703505265433&tmod=1734510754&uas=0&nvt=2&ref=https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687&fc=896&brdim=0,0,0,0,1400,0,1400,900,1400,900&vis=1&rsz=||s|&abl=NS&fu=1152&bc=31&bz=1&psd=W251bGwsbnVsbCxudWxsLDNd&ifi=3&uci=a!3&btvi=1&fsb=1&dtd=13","https://tpc.googlesyndication.com/generate_204?Ma0hJg","https://googleads.g.doubleclick.net/pagead/ads?client=ca-pub-4580185424743894&output=html&h=280&slotname=8585021723&adk=1660479718&adf=93774972&pi=t.ma~as.8585021723&w=728&fwrn=4&fwrnh=100&lmt=1707453263&rafmt=1&format=728x280&url=https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687&fwr=0&fwrattr=true&rh=90&rw=728&rpe=1&resp_fmts=3&wgl=1&dt=1707453263245&bpp=77&bdt=843&idt=194&shv=r20240207&mjsv=m202402010101&ptt=9&saldr=aa&abxe=1&correlator=258243914012&frm=20&pv=2&ga_vid=566796895.1707453263&ga_sid=1707453263&ga_hid=658293508&ga_fc=0&u_tz=0&u_his=2&u_h=900&u_w=1400&u_ah=900&u_aw=1400&u_cd=24&u_sd=1&dmc=18&adx=653&ady=170&biw=1385&bih=885&scr_x=0&scr_y=0&eid=44759876,44759927,44759837,44808398,31080650,31080780,31080794,31080798,31080947,31080932,95324155,95324161,95324260&oid=2&pvsid=451703505265433&tmod=1734510754&uas=0&nvt=2&ref=https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687&fc=640&brdim=0,0,0,0,1400,0,1400,900,1400,900&vis=1&rsz=d||eE|n&abl=XS&pfx=0&fu=1152&bc=31&bz=1&psd=W251bGwsbnVsbCxudWxsLDNd&ifi=1&uci=a!1&fsb=1&dtd=232","https://googleads.g.doubleclick.net/pagead/ads?client=ca-pub-4580185424743894&output=html&h=60&adk=809031717&adf=3536764724&pi=t.aa~a.897811002~rp.1&w=1200&fwrn=4&fwrnh=100&lmt=1707453264&rafmt=1&to=qs&pwprc=7999977537&format=1200x60&url=https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687&fwr=0&pra=3&rpe=1&resp_fmts=3&wgl=1&fa=40&dt=1707453264153&bpp=1&bdt=1752&idt=2&shv=r20240207&mjsv=m202402010101&ptt=9&saldr=aa&abxe=1&cookie=ID=6f17665e28a95831:T=17Lo-ySsTFszeicWuLCsm9BIHYA2isJaSryvoQutTtY.js","https://tpc.googlesyndication.com/pagead/js/r20240207/r20110914/client/qs_click_protection_fy2021.js","https://tpc.googlesyndication.com/pagead/js/r20240207/r20110914/client/window_focus_fy2021.js","https://www.googletagservices.com/activeview/js/current/ufs_web_display.js?cache=r20110914","https://widgets.outbrain.com/n2d/widget/widget.js","https://www.google.com/recaptcha/api2/aframe","https://widgets.outbrain.com/images/widgetIcons/achoice.svg","https://b1t-sadc1.zemanta.com/t/imp/impression/3ISXQSKAEREWELZ2TTI22JDKA6ALO2VW4NGH2V33UFZGAJBPHHAMGSUOXGQ6JY4WVMLA3YDY2FQ3IJ5EHLCPDVJVI3QTTVMBFN7ILSN4HQZBDO2L5N36TI42QN2LBFVKF7NDCNIFE7Y26BAIX56NNXVTSZ6HOVWAHYFITV5I5U3JAXEES3NO3C6YDMWHMINS6BRHRVD6FBEM7T6BLZWPVCW56RMESPQFQIMTKBSH5OTGUBJQCOKQVZMFSFHSJP4ZSAQQGQFXG3V2RNNMS4RLREHMN5J5CM5A75SCAMVOJGI3KM3FVJMXPUF5XF2ENTCXFY3OPXWGSFQNJZKTKM4NH6P7BN3BI6GIXCCMCSWKO7EPUHYQD3VQ/?","https://pagead2.googlesyndication.com/pagead/sodar?id=sodar2&v=225&li=gda_r20240207&jk=270668353561607453263:RT=1707453263:S=ALNI_MbnqExgMWZFGLUqm2t47h0qbA_iSw&gpic=UID=00000dbe99599ebf:T=1707453263:RT=1707453263:S=ALNI_Mb9GgY1P3ajnJWoTfNdoApFGGkjnA&eo_id_str=ID=4ffe203483a8e39b:T=1707453263:RT=1707453263:S=AA-AfjYCS-lMk2lE32loLmsVI6jM&prev_fmts=728x280,0x0&nras=2&correlator=258243914012&frm=20&pv=1&ga_vid=566796895.1707453263&ga_sid=1707453263&ga_hid=658293508&ga_fc=0&u_tz=0&u_his=2&u_h=900&u_w=1400&u_ah=900&u_aw=1400&u_cd=24&u_sd=1&dmc=12&adx=93&ady=1067&biw=1385&bih=885&scr_x=0&scr_y=0&eid=44759876,44759927,44759837,44808398,31080650,31080780,31080794,31080798,31080947,31080932,95324155,95324161,95324260&oid=2&pvsid=451703505265433&tmod=1734510754&uas=0&nvt=2&ref=https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687&fc=896&brdim=0,0,0,0,1400,0,1400,900,1400,900&vis=1&rsz=||s|&abl=NS&fu=1152&bc=31&bz=1&psd=W251bGwsbnVsbCxudWxsLDNd&ifi=3&uci=a!3&btvi=1&fsb=1&dtd=13","https://googleads.g.doubleclick.net/pagead/ads?client=ca-pub-4580185424743894&output=053&rc=","https://tpc.googlesyndication.com/generate_204?f-kKqA","https://pagead2.googlesyndication.com/pagead/sodar?id=sodar2&v=225&t=2&li=gda_r20240207&jk=2706683535616053&bg=!qKulq-TNAAaxkZ3akZE7ADQBe5WfOJLAR-hByTNpMygNqfipzscpCsxo3zclw3Nus2tAZieO-EN9HcF7W_IeMNqoqi9VAgAAAcJSAAAABWgBBwoATE9w5z1MYDrDxKZkMcPVOPhGzgSDpKooNCBwIyapA_VZtJ4NMFEvD3KuLmN8fbVjB3T1-Zi-CfwH8cGhYpdgWOR4hpPLM2onGT61ccWZAuS0SfPcRMA1T690V5emGS0bF10YpBv-CfAxdhFjD6YFRSx6jzFKQBawGlvc32kOSRus6uKIw6IJKocxXHT54p8MQEbmMV0WDkR0SeddRGopi6XcKOcVCCmvgZcg8TAaN18xYkzcLF6c3zrniG7n-U-xIRQitB8qeeL7XIjvJ3yUHY6G8NfmBA_Qrs2OqsG6UszK3HhWAn_LxzOWLV4SuahFnlxzN7rwlTvgl3dPw_27ZTCyjoYClLnx1Te9gKAq_L0608i8dUjXPVk21F9YR5oBuCNp2i-8KQwHBTgF19xOP8ibzmEwwKjrYAZiJshnTgTEHh1G2FDRXcnwj1eIZ64AYIAdNuP4IeERn3oYoeDWwJ7hZZwjH7L9PkVAESCfh19CQjDFZWReUneSNIFBskkAx7ep3Bmz-nen0fUfZTboP6smDvq_Um8bQQMzZg4wB65KhWVlEdBoBwOpQcAED2sesYVwmTilts-TYABVuJIqr8LjFA-mU-_gkrpLfCLBlVbmmtYNZwCfQfkbHAuaL_NRg09WFkRQyLQTvvaKyEVKohVmRYqwSfIX-OWr7cD4gqLUxY6CShT0bM-gF0Uv5KuPgOheYq10QcHhgN0LNaa7Slv3q4kHDXhtml&adk=1511961599&adf=2261577023&lmt=1707453263&plat=3:16,4:16,9:32776,16:8388608,17:32,24:32,25:32,30:1081344,32:32,41:32,42:32&format=0x0&url=https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687&pra=7&wgl=1&easpi=0&asro=0&aslmt=0.4&asamt=-1&asefa=1&aseiel=1~2~4~6&aslcwct=150&asacwct=25&dt=1707453263571&bpp=9&bdt=1170&idt=9&shv=r20240207&mjsv=m202402010101&ptt=9&saldr=aa&abxe=1&prev_fmts=728x280&nras=1&correlator=258243914012&frm=20&pv=1&ga_vid=566796895.1707453263&ga_sid=1707453263&ga_hid=658293508&ga_fc=0&u_tz=0&u_his=2&u_h=900&u_w=1400&u_ah=900&u_aw=1400&u_cd=24&u_sd=1&dmc=31&adx=-12245933&ady=-12245933&biw=1385&bih=885&scr_x=0&scr_y=0&eid=44759876,44759927,44759837,44808398,31080650,31080780,31080794,31080798,31080947,31080932,95324155,95324161,95324260&oid=2&pvsid=451703505265433&tmod=1734510754&uas=0&nvt=2&fsapi=1&ref=https://www.vasiljevski.com/forum/memberlist.php?mode=viewprofile&u=3560&sid=5a6b717de59c733d56d86de2fd9de687&fc=896&brdim=0,0,072U-V2l1iojUzC1a2dGX1LJF0gE0Gs2oaVyYP04ePTxUmvhj3RAszlkWqrQEMMAgtoNMcR_EHunzaGQO_NP2CHaYDrfgFhuD5dUUf2WYsXtkWMn8BiTiprNXkBtTFvFS7QD0z0BXdMtedAeOm8wCjTgu_gCX4rTZlA8P1p1ND6XBOieUSI_30no7wbEtBb_D2yRQR52HELj3V-g7mc1tCEMSqAMYFnfIwP_zd3X7pOIjax-6_KDWzLIQVVCFDYWIcJBE965lIt5AGqulIewNikx1Ohn5nqfM6TUITLarbWi_EVH-SU_PovtdnJmDm4BZ7C_bGPfNbs0VwBsGfhavjHLf7nJe4IwXnj7QF_vA","https://googleads.g.doubleclick.net/pagead/ads?client=ca-pub-4580185424743894&output=html&h=280&slotname=8585021723&adk=1660479718&adf=93774972&pi=t.ma~as.8585021723&w=728&fwrn=4&fwrnh=100&lmt=1707453251&rafmt=1&format=728x280&url=https://www.vasiljevski.com/forum/search.php?author_id=806&sr=posts&sid=5a6b717de59c733d56d86de2fd9de687&fwr=0&fwrattr=true&rh=90&rw=728&rpe=1&resp_fmts=3&wgl=1&dt=1707453250918&bpp=93&bdt=811&idt=249&shv=r20240207&mjsv=m202401310101&ptt=9&saldr=aa&abxe=1&correlator=5964033442789&frm=20&pv=2&ga_vid=1176706915.1707453251&ga_sid=1707453251&ga_hid=2140856768&ga_fc=0&u_tz=0&u_his=2&u_h=900&u_w=1400&u_ah=900&u_aw=1400&u_cd=24&u_sd=,0,1400,0,1400,900,1400,900&vis=1&rsz=||s|&abl=NS&fu=33792&bc=31&bz=1&psd=W251bGwsbnVsbCxudWxsLDNd&ifi=2&uci=a!2&fsb=1&dtd=32","https://tpc.googlesyndication.com/sodar/sodar2/225/runner.html","https://www.google.com/recaptcha/api2/aframe","https://googleads.g.doubleclick.net/pagead/html/r20240207/r20190131/zrt_lookup_fy2021.html"],"status":"success","timestamp":"20240209043422"}
1&dmc=29&adx=653&ady=170&biw=1385&bih=885&scr_x=0&scr_y=0&eid=44759876,44759927,44759837,44808397,31080794,31080886,31080947,44795921,95322433,95323760,95324155,95324161,21065724&oid=2&pvsid=2706683535616053&tmod=1681310640&uas=0&nvt=1&fc=640&brdim=0,0,0,0,1400,0,1400,900,1400,900&vis=1&rsz=d||eE|n&abl=XS&pfx=0&fu=1152&bc=31&bz=1&psd=W251bGwsbnVsbCxudWxsLDNd&ifi=1&uci=a!1&fsb=1&dtd=307","https://googleads.g.doubleclick.net/pagead/ads?client=ca-pub-4580185424743894&output=html&adk=1511961599&adf=2261577023&lmt=1707453251&plat=3:16,4:16,9:32776,16:8388608,17:32,24:32,25:32,30:1081344,32:32,41:32,42:32&format=0x0&url=https://www.vasiljevski.com/forum/search.php?author_id=806&sr=posts&sid=5a6b717de59c733d56d86de2fd9de687&pra=7&wgl=1&easpi=0&asro=0&aslmt=0.4&asamt=-1&asedf=0&asefa=1&aseiel=1~2~4~6&aslcwct=150&asacwct=25&dt=1707453251265&bpp=9&bdt=1159&idt=9&shv=r20240207&mjsv=m202401310101&ptt=9&saldr=aa&abxe=1&prev_fmts=728x280&nras=1&correlator=5964033442789&frm=20&pv=1&ga_vid=1176706915.1707453251&ga_sid=1707453251&ga_hid=2140856768&ga_fc=0&u_tz=0&u_his=2&u_h=900&u_w=1400&u_ah=900&u_aw=1400&u_cd=24&u_sd=1&dmc=16&adx=-12245933&ady=-12245933&biw=1385&bih=885&scr_x=0&scr_y=0&eid=44759876,44759927,44759837,44808397,31080794,31080886,31080947,44795921,95322433,95323760,95324155,95324161,21065724&oid=2&pvsid=2706683535616053&tmod=1681310640&uas=0&nvt=1&fsapi=1&fc=896&brdim=0,0,0,0,1400,0,1400,900,1400,900&vis=1&rsz=||s|&abl=NS&fu=33792&bc=31&bz=1&psd=W251bGwsbnVsbCxudWxsLDNd&ifi=2&uci=a!2&fsb=1&dtd=36","https://www.google.com/recaptcha/api2/aframe","https://googleads.g.doubleclick.net/pagead/html/r20240207/r20190131/zrt_lookup_fy2021.html","https://googleads.g.doubleclick.net/pagead/html/r20240207/r20110914/zrt_lookup_fy2021.html?fsb=1#RS-0-&adk=1511961598&client=ca-pub-4580185424743894&fa=8&ifi=3&uci=a!3"],"status":"success","timestamp":"20240209043409"}

It looks like one JSON object was written in the middle of another, as if two threads were appending to the same file at once.

overcast07 commented 7 months ago

Yeah, that does happen sometimes, but I guess I didn't think it was a significant problem. Based on a cursory search, I think this would be fixed by using lsof to check if the file is being written to so that write operations aren't executed simultaneously?

Some race conditions also occur with the .txt files, e.g. sometimes two different processes try to rm lock.txt at the same time, but I don't know if that causes adverse effects.