Submission stuck in pending state

phw commented 3 years ago

The submission https://api.acoustid.org/v2/submission_status?client=qkL7OGeRlR&id=602773672 and other submissions for this fingerprint are not being processed. E.g. submission 602889786 is for the same fingerprint, and also stuck.

Is there still some general issue with submissions, or is this something specific to this fingerprint?

See also the discussions at:

https://community.metabrainz.org/t/acoustid-issue/547046/24 https://community.metabrainz.org/t/performance-issues/545370

benjamin-dancecloud commented 2 years ago

I have noticed the same phenomenon with multiple clients since beginning of 2022. Old submissions are stuck as well as new ones. The statistics page at acoustid.org shows that there are additions. Is anyone able to get submissions through?

phw commented 2 years ago

@lalinsky That submission is still pending. Another newer one is submission 626731807 (see also this discussion).

I'd suspect there are quite a few submissions stuck in pending by now. Can there be anything seen why they are stuck?

ErikLevin commented 1 year ago

I'm also having this problem. No acoustIDs I've submitted via Picard since yesterday get through, and when I query the API they show up as Pending. Example: https://api.acoustid.org/v2/submission_status?client=v8pQ6oyB&clientversion=2.8.4&id=655022136

Contrary to earlier times when AcoustID has had problems, the processing is not reported as 0, the stats page is reporting that acoustIDs are being processed. https://acoustid.org/stats So there seems to be some bug that causes some submissions to be forever stuck as pending?

EDIT: I tried generating a new API key. It works for me now!

severincognito commented 1 year ago

I've been having this issue for about a week, changing keys/accounts/IP had no effect. Submitting using the API or picard has the same effect: all submissions stay "pending".

lalinsky commented 1 year ago

@severincognito Can you get me an ID that is pending? I see submissions being processed OK.

severincognito commented 1 year ago

@lalinsky A few ones: https://api.acoustid.org/v2/submission_status?client=rxygmyT9vo&clientversion=2.8.4&id=669292751 https://api.acoustid.org/v2/submission_status?client=rxygmyT9vo&clientversion=2.8.4&id=669364326 https://api.acoustid.org/v2/submission_status?client=rxygmyT9vo&clientversion=2.8.4&id=669502271 https://api.acoustid.org/v2/submission_status?client=rxygmyT9vo&clientversion=2.8.4&id=669616167

severincognito commented 1 year ago

This still occurs -- I thought it could be some temporary issue on the server (or server cache). If so, it's a timeout longer than 2 weeks. I tried again with two accounts / new keys, picard 2.8.5 & 2.9.0b, ... everything is still pending forever.

severincognito commented 1 year ago

Is there anything else I can do to help debug this? the picard -d log isn't sending any more helpful information besides the "pending" result of the API call.

mhendu commented 1 year ago

I've submitted a bunch of tracks that have this same issue. When the service is working most tracks get processed just fine but some end up getting 'stuck' for days, months or even years.

Example - this track I've submitted repeatedly over a very long period and it never processes for some reason:

https://api.acoustid.org/v2/lookup?client=wljW1pe8&duration.0=505&fingerprint.0=AQADtAkjKUkSSYmE_jhO_PBx-MRxnPBxwidwHCcOHz6O4zgBn_BxHD4OH8dx4vBxwnjw4sThw8dxnDjxw4dP4MGLE4cPn8BxnDh8-DiO48Thwydw-PAJnDhOnDBP-ASO48Thw8dxHCcOH4eP4zhx-DhhHMeJw4eP4zhOHD58HMdxHMeJ4_Dh4ziOkzgP8zhhPHhx4vDh4ziOE4ePw8dxnDh8-DiO48RxHMcJ8_CJAyeO4ziO4zhx-PBxHMeJw4eP4zhOHMdxHMeJw4eP4zhOHMdxHMdx-ISP4_Bxwnjw4sThw8dxHCcOHz6O48eJwzpOGIcPnzh8-ASO48RxHMfhwyeO4zhOmIdPwIdPHIcPn8CDFycOH4eP4zhx-Dh8HMeJw4dP4DhOHNZhGccJ8_CJw4eP4ziO4zhxHD58HMdx4vBxwjiOE8dxHIcPnzh8-DgOHz5xHMdxHCcOHz6Ow4dPHDhxHD58HAeOw8fh4zhOHMfx48SPE4cPyziO48Thw8dxHCcOHz6O4zgBHz5w-DhhHMeJ4ziBBy9OHD58HMdx4vDh4ziOE4cPH9dx_LiJw4dP4PDhE_AJH8fhw8dxHCcOHz6OGz9OHD58HMdx4vDh47hx3MTh44RxHCcOHz6O4zjh4_BxHMcJHMeJw4eP48Bx-Dh8HMeJw4eP4zhOHD58HMdx4vDh4zh8-MThw8dxHMdx4Dh8-DiO48QNHz6O47iJw8cJ48GLE4ePw8dxnDh8-DiO48RxHMfhwyfgwweO4zh8wMdxHMdxnDiO4ziOE4ePw8eDFycOHz6O4zhx-PBxHMeJw_CJ4ziOw4ePE4cPH8eB4ziO4zhOXPDhS8DhG_dx4hBlQnjw4sThw8dx3PBx44RP4DhOHBeOEz98HDd0-IR83LhwHMeFE4eP4zgOnziOC8dxnLgOH8ehH4dP6DiO4zj8wzz844dPiMchnsCDTzhx-PCFG4eP0zh0iCfw4MWJw8fh47jhH8cJn8CDTzhxGD6OHz6OGydOGDd-_PiPEyeOwzeOGzd83MRxXAKOCyd--DhuHOKhE8dx4rhwHDd84vANH4dPHB-O4_DhSzh8HKdx6BBP4MFxHD4OH8fhEzcOH8fxCycOH75w_PBxnIYOnxCO47hF4jxuHIdv3LhxwyeO4zhxPPiEE4dvHLfw4_CJ48IJHMcl_PBxHPpxiCeO48Pxwz8uHT5uwcfx44dPHA8-HIcPX7hx-DgNHYdPACasc0I55awTVjjrnBLWWSeEdcopZ51TjjHnlLDOOieUYMw5JZx1TgnrrHNKOCWcs0YIZ51TwjrrnHLKWeeUc9Y5JayzzilhnXXWOeuUsM46I4RjzDklrLPOKaecdU4J66xz1lkjhHPWWWeddU4J66xzSlhnnbPOOuucEtZZ56yzzjorhHXKMeacEtZZ55SwThjnjHNKOCWcdc4665Rw1lkjhBDWKcGYc8opZ51TTjnrnBLOOmesEcIpYZ111jnrlLDOOqecs85ZZ50STgnrlHDWWWedU8I6JZyzTgnrnFNOOeucdUYYYZxT1lnnlLDOOqeEddYJ4ZRz1jnrGHNOCeusc0pYZ51TQghnhHBKOCWEsE4J66xzSlghjHNKWGedU8IKK5xyzjqnhHXWCSuss85Z55SwzjnllLPOKWGddU4J66xzSlinhFPCOuusc04J66wTSlhnhVOOMeeUU846p4R11jnrrFNCCGedFcJZZ511zjrrrHPKKcacU8I665wS1lnnhHXWWaGcU8I656yzzjqnhFPCOMuYc0pYZ4V1wlknnXXOKGeVMEI666RzyllnhbPOOuucUM4qY4VizDkrhBDCCCGsYMw5JaxTzknBmHPKKWeFsU4w5pyQzihnnRPCOGGEMN455axQwlnnpHNGOeuUctZJZ50VTgkrHGPOKSGGdU4KxpxTTjkrhBXWCeGcEtYZ5ZwUzjpjlHROCSuEddZJxpxTzjplhZPOWeeMclYZKxxjziklnBBWWGeEEYIx55SwTjllBQ

I have others where the audio starts with a prolonged section of silence, and the fingerprint doesn't generate correctly it seems.

phw commented 9 months ago

@lalinsky here is another case that might be interesting https://api.acoustid.org/v2/submission_status?client=v8pQ6oyB&id=693297919

One specifically interesting part might be that the submitted fingerprint matches https://acoustid.org/track/419210c2-28a4-4409-bced-c8e4741b3d15 , but was submitted with a different length. Submitted was 263, the one one present on the AcoustID recording has 277, so above the 7 second similarity threshold.

Maybe this is related to why some fingerprints never get processed and end up pending?

In case it is helpful this is the fingerprint:

AQADtEmSZEo2TcNR5jjy50SPJuBx_MUE8_iRfDdCPR6eP_iBszl2-HguZId46bhQhMkz3C04H82O3piO5uh_pND0BXlSXNyDHyfOohdyeNj544WQRTcO_sHahcdRuYXhs0ct4hliE0m5XMb5hPiOlmiOc-mB0seLo0pyPEHd4_ARK1EeiAqP-PCPy_hzNOpwKcenHdfRnGvQZ0dO6EaYLzEmD-wkPIjExxYSPkSv4kqOh1GENxtCSnoKLaSQC_-FhlWOqjomaQ-YXMYaaQmRJ1A3-QjZormOPwmuXMTD4yLxKTl6G-4UMujp4yHxREHYhBTEnuiZB5fw5Tgi6WiQC1e_CHrS48hJFZWzbGia4xK_gF4eNDtC8oeeH9mjUbiO6wlOMRz6SLC2HodHGmUwpX4QPjr0HHmtoFmYCw9c4muDRqlevGhCMRdC7oUeaTHxK0dND09a6DvE_ZiU5Cl-IU9T1CK8I-UJ8fsROkmO2iwaPoxwMQ_xEE02wlOmIPSh50mK0JfQLEpRSSvew8fWIzyS_zjq9-ij48tRKeOJZg9yMdCOxroUnJI0RXiER4baJMjRciLCPMcF3c8QpsrRYyKaZ8fzo-mCB82VI1dGQv2Q57gO5h-absZz_HjR90dI6tCPfOiP5mHwj8YZNI9y4j-aH1fjIU_CINFNHPdRW0ejxbiatENBXQcVxqhF5AkPnQ_y4Et4fEGTbwgPPdGJPPSCUluM5hdOHN-OXknAk3CXI3VzJPpm9Dv-GJ2Gp8Ysonpy-DhyvUi-C-YvPBW-GD_Gg_zR1MUk5vjRH81IPJqCR4P5E7cU_Lh4BaGT49Qh5sH0FBkvvEe5ZJGwMZqOH11N9D-aisd_6EdPwReufijzHPdxdEeTRxmuRcT1BHls_NBWpHuOnsf7oJvhMM1xGmF-JJd27CmewMwl_JOKBs-LPA1UhUdkSYU_RxnqLQ7xaRseonoPtNGRc0Iy6TmatsUpHXdqtPoC_zPO4_vxFr06ITZ1_BJ0CU2GcBidCNfBvKKC5scehUeYU9B-hI1yfPgW4vcC_4FVBmXGI7KSI_k-MP8CX0oxUenQaTk8Gj98lDpy5hn0HnnRX7AVWejC4_jCo-KWCs1FFacmnBTOBF26GI6JH-kDzTpCRzuaMcuDH6d0jFSEo6bgHz8DdwgZ5dCP8Icf5aiqlXhyNPKko4yG-VuQLD3C-Tgf4sEXtC-8p0PX5eg1SUJo9Uje4cKl4yyJblwq-MK-46iP50LyHzn6ZTu-C1WnG4yXJEfzI4ceZ0qQL5kXUDX-4_TxDJd4PFEkMOFRizPy5EeyTPLBzNGBOvlw53BulPxx5COSickSuHvwE8zwyzid6Gh1bMoR6tHRp1B2I3xGMNfR_EkqjHqKKuWOhhHy4dHwotnKQQ9HeHyCXCmFskL9w-VGow89xDr0-LBC5nhyvEffHJ8knDnEH23wH_dRkmi6Bc9RU0ejH2dm5OKDdocpHj_qRWiDP4e3yqh3Bn8RroyEpsYbGfmNH08rfLvRMMsRrj_04TpyoT-8G21x7siPpEd__PgDR_iRA-oXXA9y3MSpB_kmQxeRr_hyXDoe7Xhx437wbfik5ShvHBH_oRHuREez-XiOkvhO-DsqTTPk56jaFFMe_MGhperR48cHXHnQHIou5fgRTgrc3TC54yz8o9Zx6jgf_EQvIswz6HKQR0mJH02OvrguTET64RB_XPA6EqmYHbWII8xzTHwEfQetb-i-Bd4jaCpe4dIPLeURaVrE40H9YnuMWpTxfAjHI3lIw_FioQ8THGeOXBOh5chybujxHjmlMDjED_2KcMzhNcOxKbnR28XtBVNyIX_gB1JO8oicGF9yVFSpocGLjxVx7fgroD-8Jyie40e-HzoRdi88-Tij9dib4ykPJjv2bfnQMQgTCnrXILyUw0zRbI5w-XgfPMnxxWbRw49Q-0g-OsJ35FKGMM8kVDQNPaPxD-cldDnUI9_gKfbRMhJxDjl0ZStCLkyxR1_h9RoqH91ONNuKJFyUy8i5TYIvXHrwMMezoLmPH2HeI7lLvCKDylFydLHQOEevHj8-eWhODu2ERwmDHz9CH-JDDZVII86eYX9QK0fJIIduhFaiw0zSMQJ14zt-sBqPpM2R71OKH9uOR1mkoFyOoz6O0EjwzEKv4T_M5Qu-EGcOdzn69bg0hNSLWzFqQ-fRH2FkGr9x_OiJXQdDSTmeRLyE4Q9yFlrUInRKXDqeB9uPswMTpTzhLFuD8sW-5Tg9bMhZQqoV_JiahIHD7cKP6ziaRjPe40LLHc21HT-ONsdviMyh_TjqHfahE_-O6Ud-PHzwHkw-olx4PDilG10j-EX4QxMTRLuU45tQiTrepDmuaXiLlDuSH0-E5kvRS8ePHg4lpISV7tB-fCfeCOEZlMl24bqI-EnRoBf0I8dfNEWf4T7CJ7BKqJpy-ESfDj96iER_9Dv-44cQHi2l4zBJ_Ohv9MgtJD86hseH3_iYx_BxZTn-Dk3-CD0eBn-OS_nRiFEVhFakHYf-iFD1dKim5DAt_EZ1He9wQr-FkjXh1-gR60Knwzt-5MvxQ6SKE39k_KkE89DxD4azH5q3I04kHX2CPjiuD3-MUzms8niXA_-F7ifiKQwAwkQAwHBQjCOOAQIAYYYIQBrxADgglGXECiMAAAQa5hQIRBDlkBFQACoIYgAZ4QgQTFiCFHUEAsMIAYQoIISDwAigkFFUGGAEEogoJBgzBBkBBAEGCGYEgEIh4BAQhAwBgCEGCCUEUY4AwDgACEkllAECEEEQQUoJAQA1zgAgFABESESUIAgBYoQABBAkEDAEAC2MIMgAJABACFBhHBCMMGAoghQBAZCAQhgFABBAEGIAIAADZgAAwAAihUDEAIEEAUpAQYwARBCBhALOOIAAoARZQJiGjiCDgAHCAWEQMhoh4IgmAClBASQAAOIAMKoJCCBCTCBhCGHQGGQcYoQAYiggBjACBCACEUEYAgIIA5BxCAGFAADGAIKAEQQRBAgAAAppkEBOIAENgUAiQASSAhhGmAIKOAOgMAJIQIRCyFBiBABAQqKEUIA9pIQAggihCABECAGMQEIRwRgyABiDgCHAEWQgEMAgCIRiSgEhBLAGJEWUAFIAwAQyAAhCEFAIIKEYNIAYwIglgijgCBCOAgWAQIIDaQghBCiFjRDGGUiJI4QJgARxDCCBHKPACGCMEgIAYQAyRAgBCESCAEsEQ0IgRghBTAkEIFMCAMGQFApYJZCIYghCkDCIAQQEUAI5AYVCTBBKBEDCAWYoAEhAIwQgRCBFgDUOOAksAAQaIIQQRAghgEDACKUIYEAYRJQhzBgiqAHEESCIBERQAAAwwCCOgDHAKQEsQUwRKAFwRBEnBDLIEaIAgUQYjA1rgghACANUAAgUcEoBQ60SShgCgGRIMEMEA0Y4ppgBzAjAEBQDGCYdU0AQRYgjwiBEhDQAKGEoEIAAAJBAQgBlHBjGSACEAogAQYgyDALLiEICGQCcYYQyAgRRjAOlMDFCAAeRAUAgQhAwwAojFAFAMMIEE0QAywQQBjjwjDDWEQAIwWAJJoAwgBFiGEAMGCAEAQA

Echelon666 commented 9 months ago

I care about this too.

phw commented 3 months ago

This issue keeps popping up. We got a report at PICARD-2932 which has two additional submissions being stuck in pending:

https://api.acoustid.org/v2/submission_status?client=rxygmyT9vo&id=712451957 https://api.acoustid.org/v2/submission_status?client=rxygmyT9vo&id=712451958

Here are the submitted details:

submission: 712451957
fingerprint: AQADtEmUaEkSRdFxHMcB4AAAEDiOA8CBAwcAAAAAAD8A_4CBA4TxwzgOmMfx44BxwPiPHzB-_Hjxg_hhAhde_PhxGHAP4wB-GAdM4Adw4AeOAwAA-PCBAzj8wwAOAACAA8QB4MIFAAcAAMeBAz4MAMctEAcAAAAAHDgAHMABAAAAAICPA8ZxHDiOw4AB4MABAAAAEId_AMbB4wAAAIYBwAcOuAcA-AcOHweOAzgAAAAAADiAA4ABAwAAAAeO4wAAwDBwHAAAAKBgAAdwHAdAAMYBA8AB4DgAAAcOAIABAwAIwCAoHDhAAMeBAwcAAAB-HAcAwDAAXACOA8QNAAAAAAAAAAAAEMAB4ADA4wB4AAAOAABAADiAAzAM4AdxHAAMHMbxAwAMHIAPAAB-GD4OHDgO4ACogzpAwAfggwcAGDBwwIdxAMZxGAeAAwYMAABwEPiBAweO4wBAAAAAwICPH8BhwMDBAzgOUIAPADgAAAYAAwBwAAcO44CBH8ZhAMABGAAOHwAIAMcB4AAOAAeAAwAOGMdhgMABAIAvHPBxADgAAACOw4APAAcAAAAOHDBgHAdAwDgOgzhw4MABAAYMAAAAHAdg_MAPAwAOA8YBwAcOHD4OHAdw4Dhw4gB-AAeAAz4O-MBxAAYM4MBx4AeOHwAA_4DxAwAAHIaPAz6MHwCAAwcAADAOHzgOAMBhGAcAGDiM48ABAARw4ACATkrnSitRukIJKwkyAlkgLQLCQCOoQJQgIBElBlhgEpRGSiuk1cpKY8y1UppzrbHGWGutttZMaa21VgnrzEJACaSQudZac6251lpzzrnWWmvNteYKa6axxpxnvTnnCnMtQsBsK7SV1kqllPJmWXOtudIYK43ZVljrrFnmWmutsOYqa6651lpzjjnWXLPMtVJaa64111phBULKJGWSteY5iyCyGilkrrTSWCuUsMJqq6yw1mprrjXnWmsB
duration: 215
mbid: 70f1fc85-8c06-4e40-854c-5e2c3876bfa4&

submission: 712451958
fingerprint: AQADtEmUaEmkKEuEw8dxHGiPBz0MoEAPHAcAAABwAMCBA8AP4AZwAAAAAAAAAABwHABgHAd8AIYBAAcuGDAAADBggDjgAzBwAAAAAABwSDgAAAKAAwAAHAcAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABwADgAAMABAAAAAAAAAAcAAAAAAAAAAAcAAAAAAACAAwAAADgOAACOAwAAAAcOAAAACACAQ8ABAAAAHDgAAAAAADhwAAAAACAOAAcAAABAAAAAAAAOAAAA4AAAAAAO4MABAAAAAABwAAAAAAAAAAAAAAAAAMcBAAAAAAAAAAAAAAAAAMcBAABw4AAOHAAAADgAEAcA8ABwAAeOAwfwHgdgwAcOAAAAADgAAACAA8CBAwcA3PgBAAAAADgAADgAADiAAzgAAMBxAAAAAACA4wAAADgOAMIBQAdxHAAAwIABADhwAADuAzhwAAAAGMJhQABgwADAAwCAw4ABAAAOHDBAGAAA4MABAAQAAAAAAAAAAMCBQwDgw5ABAABwADiAA8cBHMABAAcA4DDg4zgAAAAAAAAAHAAAHwcAGAAAAAcAY60kUzQtVBoAACFMumaZc7YaY50z1FAZO-ecc84555xzaghz1nPmPOccRiE7h50DZjghnBPCOSGcU8-Z85xQTjgnnBPqm3OeE8IL88xzzpzh1PlmAA
duration: 224
mbid: 014289d2-6c21-48ab-a7c1-e85ad6cd2037

acoustid / acoustid-server

Submission stuck in pending state #70