search

trudi-group / ipfs-tools

A collection of tools and schemas in Rust to analyze data on IPFS and BitSwap traces.
MIT License
9 stars 4 forks source link

Error while parsing lot-of-cid.txt #46

Open lgehr opened 1 year ago

lgehr commented 1 year ago 
Ignoring line 38075908 because of error Expected multicodec protobuf to have Serialization-tag, found Ipld tag (Line: bafibgqegd...)
Ignoring line 69999765 because of error Failed to parse multihash (Line: bafkrjaab2...)
Ignoring line 69999766 because of error Failed to parse multihash (Line: bafkrjaab2...)
Ignoring line 69999767 because of error Failed to parse multihash (Line: bafkrjaab2...)
Ignoring line 69999768 because of error Failed to parse multihash (Line: bafkrjaab2...)
Ignoring line 69999769 because of error Failed to parse multihash (Line: bafkrjaab2...)
Ignoring line 69999770 because of error Failed to parse multihash (Line: bafkrjaab3...)
Ignoring line 69999771 because of error Failed to parse multihash (Line: bafkrjaab3...)
Ignoring line 69999772 because of error Failed to parse multihash (Line: bafkrjaab3...)
Ignoring line 69999773 because of error Failed to parse multihash (Line: bafkrjaab4...)
Ignoring line 69999774 because of error Failed to parse multihash (Line: bafkrjaab4...)
Ignoring line 69999775 because of error Failed to parse multihash (Line: bafkrjaab5...)
Ignoring line 69999776 because of error Failed to parse multihash (Line: bafkrjaab6...)
Ignoring line 69999777 because of error Failed to parse multihash (Line: bafkrjaab6...)
Ignoring line 69999778 because of error Failed to parse multihash (Line: bafkrjaab6...)
Ignoring line 69999779 because of error Failed to parse multihash (Line: bafkrjaab6...)
Ignoring line 69999780 because of error Failed to parse multihash (Line: bafkrjaab7...)
Ignoring line 69999781 because of error Failed to parse multihash (Line: bafkrjaab7...)
Ignoring line 69999782 because of error Failed to parse multihash (Line: bafkrjaab7...)
Ignoring line 69999783 because of error Failed to parse multihash (Line: bafkrjaab7...)
Ignoring line 69999784 because of error Failed to parse multihash (Line: bafkrjaaba...)
Ignoring line 69999785 because of error Failed to parse multihash (Line: bafkrjaabb...)
Ignoring line 69999786 because of error Failed to parse multihash (Line: bafkrjaabb...)
Ignoring line 69999787 because of error Failed to parse multihash (Line: bafkrjaabc...)
Ignoring line 69999788 because of error Failed to parse multihash (Line: bafkrjaabc...)
Ignoring line 69999789 because of error Failed to parse multihash (Line: bafkrjaabc...)
Ignoring line 69999790 because of error Failed to parse multihash (Line: bafkrjaabd...)
Ignoring line 69999791 because of error Failed to parse multihash (Line: bafkrjaabe...)
Ignoring line 69999792 because of error Failed to parse multihash (Line: bafkrjaabf...)
Ignoring line 69999793 because of error Failed to parse multihash (Line: bafkrjaabf...)
Ignoring line 69999794 because of error Failed to parse multihash (Line: bafkrjaabg...)
Ignoring line 69999795 because of error Failed to parse multihash (Line: bafkrjaabh...)
Ignoring line 69999796 because of error Failed to parse multihash (Line: bafkrjaabh...)
Ignoring line 69999797 because of error Failed to parse multihash (Line: bafkrjaabi...)
Ignoring line 69999798 because of error Failed to parse multihash (Line: bafkrjaabi...)
Ignoring line 69999799 because of error Failed to parse multihash (Line: bafkrjaabj...)
Ignoring line 69999800 because of error Failed to parse multihash (Line: bafkrjaabk...)
Ignoring line 69999801 because of error Failed to parse multihash (Line: bafkrjaabk...)
Ignoring line 69999802 because of error Failed to parse multihash (Line: bafkrjaabl...)
Ignoring line 69999803 because of error Failed to parse multihash (Line: bafkrjaabl...)
Ignoring line 69999804 because of error Failed to parse multihash (Line: bafkrjaabl...)
Ignoring line 69999805 because of error Failed to parse multihash (Line: bafkrjaabl...)
Ignoring line 69999806 because of error Failed to parse multihash (Line: bafkrjaabm...)
Ignoring line 69999807 because of error Failed to parse multihash (Line: bafkrjaabm...)
Ignoring line 69999808 because of error Failed to parse multihash (Line: bafkrjaabm...)
Ignoring line 69999809 because of error Failed to parse multihash (Line: bafkrjaabn...)
Ignoring line 69999810 because of error Failed to parse multihash (Line: bafkrjaabo...)
Ignoring line 69999811 because of error Failed to parse multihash (Line: bafkrjaabo...)
Ignoring line 69999812 because of error Failed to parse multihash (Line: bafkrjaabp...)
Ignoring line 69999813 because of error Failed to parse multihash (Line: bafkrjaabp...)
Ignoring line 69999814 because of error Failed to parse multihash (Line: bafkrjaabp...)
Ignoring line 69999815 because of error Failed to parse multihash (Line: bafkrjaabq...)
Ignoring line 69999816 because of error Failed to parse multihash (Line: bafkrjaabq...)
Ignoring line 69999817 because of error Failed to parse multihash (Line: bafkrjaabr...)
Ignoring line 69999818 because of error Failed to parse multihash (Line: bafkrjaabr...)
Ignoring line 69999819 because of error Failed to parse multihash (Line: bafkrjaabr...)
Ignoring line 69999820 because of error Failed to parse multihash (Line: bafkrjaabr...)
Ignoring line 69999821 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999822 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999823 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999824 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999825 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999826 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999827 because of error Failed to parse multihash (Line: bafkrjaabs...)
Ignoring line 69999828 because of error Failed to parse multihash (Line: bafkrjaabt...)
Ignoring line 69999829 because of error Failed to parse multihash (Line: bafkrjaabt...)
Ignoring line 69999830 because of error Failed to parse multihash (Line: bafkrjaabt...)
Ignoring line 69999831 because of error Failed to parse multihash (Line: bafkrjaabt...)
Ignoring line 69999832 because of error Failed to parse multihash (Line: bafkrjaabu...)
Ignoring line 69999833 because of error Failed to parse multihash (Line: bafkrjaabu...)
Ignoring line 69999834 because of error Failed to parse multihash (Line: bafkrjaabu...)
Ignoring line 69999835 because of error Failed to parse multihash (Line: bafkrjaabu...)
Ignoring line 69999836 because of error Failed to parse multihash (Line: bafkrjaabu...)
Ignoring line 69999837 because of error Failed to parse multihash (Line: bafkrjaabv...)
Ignoring line 69999838 because of error Failed to parse multihash (Line: bafkrjaabv...)
Ignoring line 69999839 because of error Failed to parse multihash (Line: bafkrjaabv...)
Ignoring line 69999840 because of error Failed to parse multihash (Line: bafkrjaabw...)
Ignoring line 69999841 because of error Failed to parse multihash (Line: bafkrjaabw...)
Ignoring line 69999842 because of error Failed to parse multihash (Line: bafkrjaabx...)
Ignoring line 69999843 because of error Failed to parse multihash (Line: bafkrjaabx...)
Ignoring line 69999844 because of error Failed to parse multihash (Line: bafkrjaaby...)
Ignoring line 69999845 because of error Failed to parse multihash (Line: bafkrjaaby...)
Ignoring line 69999846 because of error Failed to parse multihash (Line: bafkrjaaby...)
Ignoring line 69999847 because of error Failed to parse multihash (Line: bafkrjaabz...)
Ignoring line 79764308 because of error unknown multicodec (Line: bagpniqivc...)
lgehr commented 1 year ago

If you test this on your machine i recommend using the release profile because the dev build takes ~30 min to run vs 3 min.

lgehr commented 1 year ago

The error prone cid`s are:

bafibgqegdbcnm4coqvz75q2nsz7cbph66pkcjt2ixyconxai6k6vrrzjoqzxcak6vwerzq6pdsotjnesms2ra5i3d746kn4tppcgwxlp6twmq
bafkrjaab26minkkj5jnikjq264xlpe3e74l3gcw2ygqberd452yursmk2wg536cuw4ghhcqz2tuuo44otur4u2qkqy4fa4vudrofinh4jpjopd5eedfddlssawz2hji5zp6l7bxfb2wansyvlswazgils554bk6isxmlbxxoxym3opxnfqcyozul462mjfdosd23p3pkqvk4cj6dqaf4o
bafkrjaab2achsqykzu62a2hpvvduru3qybbcteq6pwtzvopokbjhigr5fwucw3uvwhzslkkkm4whdhkhyq7ppebeexvkp5k65mhjpbzlq55irptyvdl37bsgi5x3naqmp7xtx6h3x72o7ygbq7rqelvzmx4ato44ivs7zqt6gknotrxa7n2qynfz2wbfvbk243khw3s4onkcc6455oo7s
bafkrjaab2f22vhh76zx6xe6nvrkmlm63jc4fdjuur3ui5nao5pwv4wcmr4jaz2hx74cllidg4xpxfn6n3kgjg4ttbzwzv2adsefz7wmnufawk3dwbwvblyv6xxkpimzpnxsvh5wwccxhgapij44kofwqkln3ewt76tfhqnhp5gaqhcqnqmazg5uuzzdxbtla43l6psg54m3pqytsc7jio
bafkrjaab2mh4xys4ixsixbzpm6rjxs3bzdmftvves6xircq5bl7o5auj4ikfolutkzdu7wwsq7oxrmnwbggtvuilu35srghb3s5xp6e6jgspeprzigwkihuyu4ts7gpwzyzqo2taptptkey5qnwfxxylfs7djjrav6d6qtageeequmgi7tfazy3rni2qdn7dkp56w2tufhmp2rsz7ulkm
bafkrjaab2np7xzvolawer4mtzcx62qz4pd3c4lxpufwp5mr42yc6bvsbme7rmquhjbad66fd53u7zwkskdkpnymuw4antyid6tlzi7m4qfux36hzf4zaqgzykmbl3d223grtp2jzlldytmwgioygxjbqkquvsoobofzc7bfdzwrepfwxfq2snbnqgey7fa5m6ombthur2dejiqpo6sak4
bafkrjaab3d4uif6iykvudh37mb6xfrsakhrihmrgekiew4qqx7f7cj3ajwkfscgndh2f3rdjeqp7ay4ufqyyqeedqzzgvl4mdwnp7yfbaqhl55cupoffjo4xb4tutqxifdejmvuhg2tagm5pibhms3fyz5m5w6ltf73atqaos5voms7s3chee7exw3dcqfl33vnza7sd3ntmnldurde6c
bafkrjaab3iavdjlqfo3pixgezkvduirh362lvss32qgwtc7y5kh3o5kyqecl5pwqkcglyfqct6azcwxjjcrhj3otxglic7wiaruwbb6et2l4kblkhvsksethgylswce6tgivyf4jcwvghkuz4k4cedulsqjxlbmojndl2degae6y3thchfw3aehdv6v55vrbgsslv6ei4ir2ceqwjjema
bafkrjaab3ypvycvq2uqdmgpkzpto7qbbhbofqfy7cq74t5aufqqcnzfnbfhlrq4wnnk3ymxbwv3oiw3y7rtt6bf4u67oxbyurl7ddcgk4qyrsqmxktamr3vg7djlcdthlzgqr76zhfealenpnkpvrlvi66sne6dhj52keecw6uafevsq6qicvs4ohdsrzbihdw5esuskhqkcyjkvksak4
bafkrjaab4bzys3nlq7vphu57pjtol7s34eugum3hxgtnp5slogmzmkhpvf6oatme2b4pqv3uarymcsjsvy4ns2b4ip7uohnvcsvrc5ssprey44q2sliso2v6jsze4pyzjmtjitu5megkim2kpyqzuk3iebhqmf4k6sjy2ax3xaqjh44v7swqn3xx3vwdb24bjrvo4k7sv637yhbimz5ao
bafkrjaab4qwjjgvv2er5houtu2ruhf5slkznjpod2xbl4fdprax7awcxitufzqmclkrgfgl46tw4vfzsrc6uukycifmsom2ayq65nj7jbm2dwcpzqcflx5a5yvygov7n7pspd6hugvirmfqe4t7af4yz34c7twxz6cbixg5e4o2ckwljykrfqx3idv2ir2p7k7dugxwqv6uz5eumcv7ni
bafkrjaab55oqt4dsklwkensgvt7kkz6b7ltfb6bunhftr6hoqyhyu6o3zpdu4b54plcctckrvr5bttz24r2hepd4h6bbtoy3qhf7b4f2cudfvhgynsj7nipz5i7ptpiqntqcwcv62iiphgnkome7u36yp7urxuqinw56zmf7vpfatyv64756owe3e4csobctraku575qwsrpvsqkoqtjw
bafkrjaab6mobk5bgwc7nyeic3esw4goi6bz47pfvdskio4v67l6kx6hqodbl5b7amfht7lf3re3o6joykjvkuhzzgd2fjqawvyot7tqvpwgkqcnhcm2llrd363r3trmmq7kp2s3ax7pkajmp7sza3gc6tfqyfez2tpmo34wghwxk3vyqfvrojzroxhu6cybi7k222k77s5thntu5x737c
bafkrjaab6sjgmhj3ffpub6g3j6je46qey7hboye67n57jvk6r4huptyjch4djt3ldsan7gdjleqpf752oogq5htvtw6dshvxtp3swpklut4z22oe6jwtgm7t2oy2c6syfexz3b64erlp735b45byg4zjozpaogzrehsz5chl2bk5b53mhfte4rsc27ucndplkkeftk7byifmxfjbgs7xo
bafkrjaab6wy7eslhsndzfwh5zurmfm5youwnaxg3mybjhshelgxa77tl6fwnth22eaghix4ycc2kkngsts5qrcud67dqmzvcqrdpcygpanrrik6qi4azfe3g3tqzxqo4hzlxsfhu2xfggf56duzhda3nig5hayjo7gtjisohnpl5dfc3thgh2qwsisz5y44226bequtu3ikmd4nboctqe
bafkrjaab6z52d4gqjj32cfqscxoiet3ra2fh64i2mrmlpx7fbbp7bqe4jexqwb6c3xsyhdyjwp6nkpqgzpdpjdcb3o7tp2mhuy6d5cdqzlvfguspnmf2mnargvd7w4j777prxejo44vrjgdmwe6qqy55qfsg6yyskme7lory6z5izc45ih6ccmlghuaz3cuavy44rjpyfrqa2byfs3ycc
bafkrjaab7ci6jl5y5rel75t52pxzm2t7ah5h7utp7u3fhv5jtm63jd4rrip66ivu5nprl7nxwu2injcgnvvfcmgejllqnwpzdt3fjj7vb3zc6jx2m6h63kyjsuzp4voolztsl53lprsr2tdnwqffbkjnssr3a6klz2ijxu6lqx6yogfisl5gichadmfnmlywyx7tveda4ucgcwjg4rqik
bafkrjaab7hl7q6bjcg6ss4joboyfdolwuokspuukhhyti4hxtaiquql53tqkcv4yiln54y6wg43txuprir3bizjrcsldw3kiayo2ydw2cszswwmjsqjq4xjwrzf7zbl2i34pcrzke74y3dkuxv4y72lz74dy4lb5eyoiqpzp5umphedbjsccevmdebrlhh6zmjbiobfwh2tw75gevauo4
bafkrjaab7mof6ugrnakqkclnt3td6fbs6bjcl4kti34gmtq4wooy4awsacoiwzpit3geb5oau6vh33t346jl5prhnzk3dg3rjpfkvoqgkan5pi5jkfm7qgcvewif6ofw6rjak44ui6zvg7j6gtybxric7syeorcqortn5d655hu35enwa2vrmrcjqlou7nmt7riwhrscfrfa6r5cpj346
bafkrjaab7xqpev77i27xe6hd5czpaj2ucfrxqifg42u2dhicflwknxphtmfjvihbrxcu3vsicp424p5e5i76bl5icpaqd43dya3a6g3xli4x5c3qnrobvnmwqm2wpvm4sdxmyznpvlox6tik5nff2nmu6qy52gpx3t4c3rim76purab3v64fkwh3cfbhv2lo634hv2l6cpfxb6d5rckoa
bafkrjaaba4tqrq7vyyz4apkg7w6mpfk7kyurask6p3iqpsrgkvsueif2nxpf5xtc7szrjglcbshkxpkom4oua3ygxgjkfr7wbuu53h6cpfrynetgr4uuyew5f24ehi23timslnggihspt67gzhxxhvmloqljn2chilqqdxsuxxemjguwlppefqt7qdp3s75rfe5mzmoorefwcqno3lnps
bafkrjaabb2yn636ylvryxu43wrzurcaj4vke2sc3mqxs56rq3uvarbz6bckwikd4fk77nydhodxw3jdhlytwpyf2fq7d2melh6boipdx4cdp2asqgdomwxnmdlqfrncj4oq5kaxcbuti3jzkqw3ag3hbtloepiajpfag6nvkxxyb4r7k7u7jlmlfb7vbsgsknk2crbkqxx5li66flvr46
bafkrjaabbuuceyxbwi76zzlk4jetnpgofo65budw4d3nifxvuqqtuozja2um5chichubkd7ffkxuubm3lz4nidjqlpb6gso3qeh52gy4dpfyyzq7twpxudh5cmfy7myierajkcsa6c32k7gjbitukqdliqjirbpkwfnp4r7qww3wc6xftrfqrpsscvmwfgdty6pv7pjqogvxjstvyobfu
bafkrjaabc4stoocne2cn4sx3tpund4w6zrne7nex6ifod5wq3qkqh522wm7dlfnczg2pgqqpeq2wfvo4tlkrhq3czvnlja63i6szplfcgy3yjpux6xoc673cf77kfjpohzyy6usx6trqt64b4bf7jkopjfxwrobxcwmrp4sdsnr6my6qsgwbk2et6awgf2pgavp6dvnupojvsgt4ev6ve
bafkrjaabchblsjftzgiwxin6rt5zmxkoj7npvjsezwnsfp2i6pyswmdbmb3hxhiomqnyydk44udphqgwwyhyuqzvjpapk67ehin2hc5dp2usgbksoruse7labhs3qjptndhjneuorq3oivsgdt7ab6mlvqywyx3kf3ianzf67kjgdljczd4ydbk2one5wjuqriwfnqxztgx3hq4a57c4k
bafkrjaabcjlz2mc2qkoo6x6drr2xysbqm6b3lepso7jlawvs2kyc3gj4i3oi6dxvryb2ou22d3fedcurkykyi34amo7x4ishflnqfdanthjwewmq7gmmvgxv2mj2ixici53u6nwj35jdlgjdt3vcmirdp6ysn3446tx4fz6fr2smw6fl7p7kq7e57mcbh6uclrhcfd6e5ub3ldriwhsss
bafkrjaabdpwrrirar3j7bnw5a4lh7bmt26i7izhfmbavd2vu25qecne3wm3p65otp63q47kbdul56pbp5pxeyelr7f2ub4wrky3bct5oxmti2ay75shl3uumgfsnxn44ghvvj4euittyw6thpri3y5dgmcchqdcn4bbqh452kksghko32q3p7j73ozhugi7s76qtl7dmnaohiodzxatig
bafkrjaabe7uygecw5t4iutgpzxscdshoaffqtjbuj7ir4okn3h2zzvgt3r3g3hwlli6xwkejyxc2wkq2zzsl3v3iz6klofiqcm2s5azw3mbytst7svrkqgmsoxqk6pysp5qoto2ucr4ct4cfc655i2qthtiuokmux2abtmqofqlousjedsqab642rh5u7vdbwtcch3bxs5p2b3bhhr27o
bafkrjaabfl6x4isgu3kukboqirav7x3mq736zqpkq2dpclomeyh2ikwjuzxoiq6y52sj5nv6qc5xacrqn2i3azup5l5uk4dxqhq5f7kizkepih5vrpdbux2gd46gx7xj37r6xwykfjxxi36mffb47iomsxlubsjj2kzagsql4uyxokqva5hr72yy7ikprzfqisf7y6p3dioeaiiuhitts
bafkrjaabfwmyhcd63ae45ryqpc42bxj6c7rirddgvv6x6lzvlxw66ej33e4zwh2b24r7lz2mtxqdp5yncvxh7t25jtlqmru7ver2aykqru5fgger46xuks44efhscauuw5k4k266wuqzbl3dhw3dqps6b6bnrofkf42pvkmdsgjrimya5d2tdawvkdgqdjjzqjdn6rzspw6hyuqndr6sq
bafkrjaabgmzb2cbcmxkwus3ppxi6dand7mrdbf2r4o5cdvskvj4bn7k5qcgwkufp7hjdu5xziudxzggxv442musjafvfpl7kmo34bzxxu4tm33pd6ckxvr5cghd5ur5pmzksd2cqvf2nrfkhsgntiiydpqouqvn4ry5w5cnityr3qcytbyucioku7muq2iv7slfptbakztmx7qmitzazi
bafkrjaabhvsmpiwhkjohkvkcqn2e3m4u45lsur4cpbvhav5vqatio655y72riz6pzwprynq2cjd4kfi3qlqkyusxtzjbjreyym2lox45gso3setgoxx74zidx4qrsnl2pv75zvorcdy4wdxrjih2jyctluhapqq6fmqz7lprxpo3h7oh4efhdup7emenkuljtlrugllfsyfi4d2s2h6x2
bafkrjaabhw7pszxha3a2x7ip7jdhzxteyfyweoaryb6gvp3a4wvf6t2yecvmhi65xppliat7vsvtudwsmteoexcqjjqccahjtvfqdipzz7j4ibjtji4us6rkus24hir7ecwmd3kquti25uivumk3chmd5xhjhmuibci65t5mdmhzltungh3fgbxdzbamp36xndvxbm6eqpt5vxkqrsbjs
bafkrjaabilzuiivhvojtftqjqye4igm5gpymlvwsyyvxeysbr76vwix75vqq4h3wgxw6ik5eo4ysbe72ddxk5j764nbnvqckvwcftcuvocanb6dktcryja4ah2kv2cwrbdggdpuhwppqzw5txeqbj6j4eyxmkdgf6ztpmo5wbdo6v2puobmr7b236euiiy3omikshlm4nmtgzxelotln6
bafkrjaabinyuktxepzw75rju3nr562by5nrbts4bqcjlebz3nurv3ft4ujvbmbuyi3x6iorpjw4emu7amk3k52s5fptacuj3fgdez73dmt2cwom2lcmafcv7p5efd7hki7eraxan4j63l4ny5tepvxsbtx6u273fjbe25jvkva5ckus4vlnkhntvgxis7yjwx67kkftn3fgyerwdjrzzk
bafkrjaabjww267stgmqmpy45e7dy6wiamcvts3uz66jue3hq7b6yknxgkyv46z6a7y5btfsox2sofpfybzrpxspmamdgokcopzwrqcrvgqw5bysgnsl27gygc2z4vc5jrk6rgjunuqqlczwoypnuzzu7k3zhdm4g65qkqfpres7dgzefrxkyyak3amaze6pmobdblwine52pe522unkay
bafkrjaabkpwwrlk5snzer2awqcjow56ftq7mfnpletwkwefds4slf32oddtk5jhg5mtgopq74oos3gk4rvkcv6bi3t4mbphnhuv5vw7df236tfsl3vbivldqwody5ugbdggeaheklej6zt7dcvxwli3lt3kfmeerts4kda2ax66u65zuemgzr6x4c7mc23u3yann2f3rr2qiv5ro2vjl4
bafkrjaabkqypcu3evxn7se7leoeolovlg6dhlcn2tqfytcip5ackhpnaci4bjrkyis6rgec3rcji6t6mgdlwkj7xmhymf3w5kziip5f4bp24jppf6jcmlxq3ds3dia6k56twxlknpzgfpztc627zhk6op7x2qca7stsfquuui6crityxffsvgrvpsehjf7o5fnxv5pdf6joohsec2ae2e
bafkrjaablosdvvajaf7qnwyssdideyedm2r6y6z2tatmy2f2hodjgoyzpfo5yjhylwjkt3l4vd3plyujth2jfjizaa2lw4hpfmtdg4i6wh3ozepetwnyitwrppty6dwt72t6cnifrnwcfehmv7ndadrabz7ds4djdg42egcyimqjlwepynuwux43qs335o5vdlzmrrmvby2y2pj3vqepi
bafkrjaablosp7kdkky23ox4shwurin2mbdmg2zlkihszrb5e5hd7b3z7sw2uaw6skjtwaux2tf63u2kwiecilji6j7ws3l74mkij6bduwxtwuzcdjsgopdoe6xcur5gaf2brad3awxv75m3ucunlxwiqlq54eyw6gheyba2nnahfzotezgsngdq2oxelndkudmdrdvxjmabdiw7nitke6
bafkrjaablqn34rauui3dma5alscs7spwpsyuyi5rualeu6wtoh3pxqj5zwp5rf6m7yuqorskruvogv53xcnunh3vhwysgus4ipvjfyxz3cjamlhq3hb6xmyxgnlelrgwn6be2rxgznc6sntdb6tswgf7ufek2zo4oidzjpphafcnjbx5vil6bo57cqqpzn4ixgp7nrgxwczrd75s5cq3w
bafkrjaablzx34djyymore6itgmjt7c2mwayu5wq2gbxysvfpc7iikadz2govgjduu74mbnaeji66y67dedbnvuiujwe4hojqnesxcufcf7xn5dgd4j7gu2wop3wutycwlegp55do6ccdyrs7q3rgqqfujhkr3abizfeswds3dku5ebvjz2jdgynamllnqh4qpg7z5txlndx5f57epphgw
bafkrjaabmqongcmxpzpw7ue26n4gn62va5c7ny2vdpmhxiujfoqv7jsrocv7rtfpoqlduwnuuec7jh2s7uxyasssqxb3faprmmo4anxk2seljfiywhydfs6zyhk4daonwhssnd2nkwcsfhbtaq5oilb7lbzi2wgdmxrcvcdq3lzk2yqlljv4ber5wantb5qskrfqivf6ovoodiiryi2ho
bafkrjaabmqscs2f5g7ziuvkvmunc74yad6rwsgjaninx7arheion5ngzyfgj2qoveg53m4vo5wuac2uo2ft2ewovxlcksdrlnzszzbrvz3kdm6xqhssze4ci47lou4ulhkbspoki3urygcgcwuvti34fo3jxkzehahk2vavm5urxy7bzt6j4veybrkzq7joxtzs23qz5yobivygx5dvwm
bafkrjaabmtp5enxurs7kzjq3tvdopvrfufa2eiywblbuxjht3ehdjmf5era4ywet5zipfah7o4du2x5s5km26byne5hdkmirx6eojsxn3gmzknvmnkefupoxsfiheytbaajzv3f4d3swjtfzovyzeeeed6oq4jtadwznso5bszerk3t64tjeo3sgk5eq6wglxha6jkixzajlsl52akxxy
bafkrjaabn6ytfgvfzk226od6pazil6j7scurcbht7drtjbb32xb4hzvjlli7smqlquwxclrcsxdsebfobcat3ij7t2wx7gtt6ytgklz33t5cfgdnlx7zy636sud7uufbrfjyxegsfqnfk3aarab2rw2i6xhrcgakywyaeb2sdui254oxat4jl3cmumx46mso4old5x4elymexma4247bm
bafkrjaabojsihd337m3347sp5vhx2iwpprvm3seivdblxdybeqeaqk4pjvesocw5zrah356aur3m6sskneb53ehcb5rn6odfocaqf2fgjw2lv5plwjximp7cwrpffrntldmv25yblaxjttpaxukw4aymshbhec7wpxme4h3qqe5uxdqinlskpvlex2z7246r37z4lfcks7fxwaxb3tph6
bafkrjaabour3dl5gf3kabnpxwk2uakharuuthnt3jkj4c4pffonuy5kylyuv2qkw2agpl3em7pq5kyjrifwdua6il6tcwzlwt4r3ayykbsvdfewea34cc2umepeat72ik46jm43ajvl57wbrmn6nityb4yv4gyqheeto2g3nrqhuwz3i3rnocymlqaihf4xy6adfjsh3c22h6qgm6372o
bafkrjaabpbp3t2qjnbikvwi4rpeowgoeqynfzkm6dilyxltflgrm3tzjcq6ctdbqimlsfaiwe5afvrr3wqxnpmddciyepclosr4ysq4whpo456jsurc3bopsu7b3zxw6t657kgepeho7qlihn7cz44pauvmzufywytnilue4lmwnblvu2rk6wetndc3ohzogjkebtafzalronuyvitx4m
bafkrjaabpcvnsi4abi7co5reyh4yr77fkh2g4jcki4yu7sdnos6r5nw6vxluw42krnvaw7kbb7fejnpgazrx4gb2hmlpixzr6mx3wczqvt3s5bs7rceomzb2nritbqqdyjypwsojcnraacpjjwqfnooruw6ilcl45alryad5bn36ztctg4bwvehgngc772a2x72gg2wk36j254ihrkvts
bafkrjaabpznhocdmi4dvt6fmps7uomby2et4ukvtjifvtsma3mssugvixjaeps7e7pyeiqsaqmkoq23wdqgpfregmftobg3b6riq7jh65rq276hvrnn4guzl5phxilrmjotg54d7ewyfjit4mttfd6qmt3cric4ishtxjbuxluzbizomu3nlx33zbdz4pjhr3zs2bsxyhaiqr37janwgy
bafkrjaabqj3e7sdsc33njrtbfyj5yhxzoso5qnujzrodx2hmiqqp3bhcekakcq7uqw7s2del4nhecjokjbvcklzfwwy2aohit6rigb74fwbh6tnvzve5pgxm6ceuu4l45lnzoapkde2dw7yxc5h4av7epjqe67g3loajq7kvqgfxp5e3ly7pyiqw4mp7zig73bzmdngqrchgdmzw7xmly
bafkrjaabqmhs326kalqqyxvcidxp2fqwoilsv6uy7pgbjcxz42lesas7lwkorhg3m6prdwt237flrwfvcntv4dqtmgecfwogytqmk2yirzzsj3ml4wdygqu4fwloayvalkelk43lomrn45loumlwyvff6lqisv7rk5vdas5x6kdff5z63jibiqott2egvtq6tdkd6dh23bpndkh2c5fl4
bafkrjaabrbgcb4xr5enczavftcdhf25hl3zs6ta3bighqsa26lrh4cyo6d62jufsyylab5f3erzk2nkwyd7l3xndia73jr57bkdgbyowtszkb3ch3wg3p4rt24s57ateb3glxftcech2efezlnua5hmepono36wcistbica7k6ua7hslto3y73fidor3sstbf6su7rplhd2d2v4v6fnua
bafkrjaabrc5tqnqyzgdfbkx6md2eostu2zm7x2znklb5x2f3z642bjr4jyro7tgiy3gop5gcbyvltmnviclper36ulb7azpkip23f6wjf3hli5rdcdogbnxcwok33ciup5qgucktp2wxkkzjvlgykmafa565bghj6lw64xpqfi6mdrmxquzmntci2l5jevcmhoh7cidxcyumtcb6boejs
bafkrjaabrnfvreb4js4x24cqtx7pj3zv7ffa2kgmrrvvlzql5mcmf2n7bipaichk2gtqgpva4hyjpvlbghj7tuw4asjcbbzepuvxug72zhrtwgglckgsieyksjwdos5loiu3jdehnnj2qa67modkjwrkxj63ypqmde2qmkj55je6yndnqzqwvcw6ihx763zkc3frher6vily72ihapwvw
bafkrjaabrvx7b25udj7ijxthjgv3crnpsgxjhccknj7przgjswcj6v7s4it5byv6x6h4vzwwlu6lixiicpojwzcgrxh6gjccm5nnk2lvuwwvzp2jfywq644xe6633xhzmneo6yxs2douoksco6w7q6zu3lsa4sadqwscsnni57ioozcb5okgfviswtteoke4cllsk25wfkmck35fimrpy
bafkrjaabs2onqjlgad7hgxy62avnhtjlzlzbid5nvusynr27chman2pcwgnkvqfsyp3hxc3al6q3gh2nq55cfmylnr7quss3nftz5nlbwbhdaggn5r3vvksphxndw6pntngzz2xp5rvtfaz7vhzbxokfttadhqc7rpzw5hqbpt6ozad72fnhtsmubwg2fmqn5tdhvt2izxob4yashpy3q
bafkrjaabs3bw6qbv7x3t7cafketctededzfuk4pmvgfun7vydq224mxq7vjxq7c5cnl7cjp73swqag23cvvhiyr77rp756a5w2xho3qsgdlupyh6lpf6q5xu44widqhuueg5gikmmr7yg3i6a2faly5dtld4y3qgmknqdoekwlamrhk6zcrp2smdjc7wbvbeclvshjhppeuipuuchn2ru
bafkrjaabs5qy43peeiio4uzm4p6y623g5xfm72xxmidjvna5h27j4p3exoa4b4wy3ggrtivavkpcd6f4l5hiqeo2ahpcwfkfoawawnejnvoz6bna6u3rwnwbw77n3pewvwhxre6l764e5hotqdhamdt2nlwlvvuhj2bfbfqigdr5kttgidifncicvj52mhp5yrgndi5c6vxx2tjzrjva4
bafkrjaabs6ufivhughjp7ir5gwtxfvntr6jvz3dwxytmcla4g42vypmhhtank76lk2pcina36tdjmyiukg5xjogx2yueeidytvgfeaxjoqm7oh4ib3ctbrxigwn46zh6rc6fecb7voj5xdyisrul47n66mdzgnz33ogutte6ym746gin4myw6fghpbfspvk37abeklxwqam7qe7gnjfby
bafkrjaabsfgydvyc4tg2nwl7mbmseio2kukoevaxnypkocgfvqrtgpqa6por3ghridlyyhd324hqsm7e36v7fyx3mpkkxsb5uocrlvi36tnb746il2wkbqgao4apkxsrzsfl4jwv2x55yr6v3czwc6k6rpqt2iumwagkplmmo6u2ax4knixeemjy72uhz7kyokpjbazayikehzvpsqdha
bafkrjaabspxi3ihqmcxor6bn7kcproo3kdu2eh62ivivh3uh3tei64rrv6fv5se5is4a6v2j3plvoy5zpvxwuvny7gf6ea3rdufuwj5rt3ki3p76sxowtyys5baxefyvcr4he2lkah7nj33m2fryuzz2y7il2lszz64wthxaag3r4gwlowx5yo65tsmv5jt46zvskq6353i7jqlbzx7i2
bafkrjaabsveesdqkexsnplmar7t3xx3a5msbku3pk5wuhitcpgzlcinet762mprvga4podf7v6oq4ogmyanznar4hmwtuzfxvg2drowcq47uoyzwq2hhgm4lxudsclyb5sg3yhq2jm2gk4sgg5d4wyib7lguinio6ia2v5lsugbkr4zxog5jqeyqtp7x6qu4gpkxg62zmgexxua4s36dk
bafkrjaabtdzdj2uipqf44e5kps26p7vgsr3d27hkfyanttdqvxrcbnfdwhh2ljq62dbi3hjhth26gw3ydor6e72dtq3oyifltuoaivx2yjygabqvvwdim6z353n3jogibmr4tmtzyief3tr2fjilywepqwelvniuncccpb4snovu5irarg2p53u6dfaw6svclra2agaatvphupcsl2hye
bafkrjaabtfbsabq2w5ztdefvoqzgol5qf7q5bongd3c5ccblhvubottraocci4helnupfawxmnqoscn3naiw22nfms2ionxdntonfsxwmb4fmhwxk55efguwvmjvmba3geu5eakho3ck6xdfgfosxogwu2uabe3uhlv3y3g24v6rihbfdmhgeullx7bzmv4ihtlfqaiayyedwprlhgjvu
bafkrjaabtns3a3b5l6zmlhcftagzdjh5tztyjvtr6gbfvb5szwwoegoj3cnixkwh3xsfpajcfz3oua2ax5qykjimirlvlqou34l2ank5jeqt3k7yfqt43ddfzvixobmtscbnfhfqzdwnsrnbz4cvo72m5zdbhkbqgtlkhvb6kzw26ctd2qwvvvhth3axal5pwsrkdy4b7zbf2kcei7aqs
bafkrjaabttusp7tdukbbfqfy2ga77myc2i3m5wve7p3w7jpwmy3zke6gwnvxydzwloflj4c5nga3yzzw2nsghtqe3uvkhy2dy5swuoejrmmv6fezvkjwx4zxfkhwqx7yiyljnikqdc2lx5xwfr7gm5qn7ze4lpzq6v3isghmgbteuq4mnlw4jgzt4qoltlyprj73dly6mvozbov573xm4
bafkrjaabuat5xjpar5yrpg3sicloxw6z5hkkw62j6i7ckzmimmekd6g4q5a2xagncif5hb4xx7pgakodladw52lwogudgwgl5c3n3zctlgozifjwzk3q6umdxowyqxwj3e5jw7lib22abxgem2mpfunb23schct2cllclb7xylyvi37h2e6rxdo7lmtem2muph7ieb3dfxxbolrpzml5y
bafkrjaabulevb72acnnyftyanljthege6itynyw6wra6ky2swtqxxhbmwrz42lgnuquh3vmvsmqziacosbeh4gv3bdk5zd76fvhiro6azfki3i3krkctubwr5u7b4pyemfzhnny7jduj5hh3klppruewcpearhdzo2ci7tqel2mcp2s2az75qdygsv6vzdtkmslsbzy4e2bj3plbaulhk
bafkrjaabur3wnqen6uqhvtuwgtfddqg6v6o3t4qtozy47xiiugx5xaotdvsla2sbqi5fi3ncfyx2hzdsiwh6bmphv5urepvyc2v427r4uf4wie2zfhe7kqyv6mocljevfoymv247mtrfcp5rupeerwyyflkw2s34v2oev5a7mk4624xdzo7ycf3zmc2rzuol3gv4ddv3y73hsvtmlgwgm
bafkrjaabuwve6ttsvmnefjksk3rjc2j4xxqepc37xjaiedpjnn5jge6abtpwo275uutsbk4nxfwyla4iulaaw2w6wxvpfzymef5xrrzlppiqjkmj7n7sfhjo522iwcguuv2ymf4hmvhl2mvcy4a3cgkef2mvmogmoxytrwtig6sqmxmf5vg3tuku2chor2yethwh7gbunrq2ta5xfwfp2
bafkrjaabuxbhmsvdec7oj3shjzcfd5qet77t3j2vasfccyelj2gc7ii3drgrcbcjoolbiu6z2m63kjlvoh45e2vjhakwoxpxbpur62xfm5fbinlipwj5mejcon7cdlvmo2qmzjmffmk3ea2soe2vnpn2robhyrppsyuv5p4zaq24qjgc5ltpjwfcujroykoi5brn5lgg5hfmfw7jjk24i
bafkrjaabv4yykzkfqnpjlr2vgqx4ugocz5nklosz3rrvbmoieqriwkzwlnyd4d5gbwnc25ezq6vi2mwudklhanxi5kozw77rdow3lopubx7f7i3254ay2btpivjxrvsovfxkpm5xeocrax2lr3grsxyxzoau5v7qklbgeq3osptpzsjyx3ea7rmkuveephpa6snys3ifqkg26na2q3mvg
bafkrjaabvpgwyqflkork5kcubgtdbofqyyo5noioxdb2eajy6h3u3xhxvnxqqdr56dqx7p5ylgu5s63dhxgegwdwamkvfsel7pmsffqhqi2b6jkuanxbpj5d3f32ars3bov3kci7rmuqch7npiet2rmgj5utkskx6ucgw5u37ocs3sfrn2f6l5bwpny6hkvkdnyrmux7uqgkvpk5owc26
bafkrjaabvuwzyzwwgujot24texn3gdhkjt2oy6b4rp6zrbzrjkk322kw7v7renxd63sb6lxlji5mkvplbaphb6ccurepo74chocnqtjlau7t7cllfzi26cv43njowjll6w2gbmnaxweqxq7izlbmujw3nwbb4734uzul37olduc447yy4vkvysmqvakngasg7kdboqljqacwbalzl5g7o
bafkrjaabwsyby5m52ns2oz6a2qtbn2jgoobe64rnktwwgrdke4sus4ku22qzchlrubqcgwj24pld66b6ec7npdeo4lloh3epzhlmurdf7hopz66nx6hnecrdw72dmmvg6ndwlyxvwsz6bxzeqsk3aztnros6jax6twzmkduz7udzyosdegzxefl7ghx4vda22z3byyix2knmc573mj7hy
bafkrjaabwtu2phnslnji2dyn37p2h64zsxvip2hk6ox6erfmenl3ede5jzb22bdv3dzbs4sj654ekv3ozz2yjxhfms4zytkeyzl5mwaqiqualfhg4mzsh2pvsecmvhza5gjcsujynychhrvye37ubufoe43aa5odjlj6i32rigjap46ibbjmwdi5ylgjg2nnydbbdk3knu7zbcsj75ezg
bafkrjaabxq3ymjerz3jzs3dsrcmwngipjm2ftdfvex3ybsz6eboasa4ekkipe3ps6leo6pg4hgzllufebwi5hkddeer66azuxbbefga6xcstg4od2lzonnguwcqhxzunjryaujtbmswojvfhlgwy4twb56dmf7szk6hu5erw4vp3vzakaqhr57dlhersb5qt7uu5aukhedjlpmutvegj6
bafkrjaabxyta7sqzwcfwunl4zdxsplz37utijxqydv7bprleauutz2ukmoedobajglkrrogulseaybisqjydtmt6ifvexn5jd2hmlkgcqhonqg3cfmmltdl3xxd3blfptgiadk6qnfdygfevdmughdsvgc3qmtdkzmg65pma4inurciecgqiwjez62sy4zaa6jd3pibcxttbx4tv4umna
bafkrjaabyaexwlkfqy2nmcavj7pean4egnc2eozub7b5kfz5el44dveegpkt3ebj47awjbm25wksxpuz7x5jqpcegn2vg4i4mswvjp4t276jgj5vpcrvx4z3or63xj2r4aj2ie76kh7jaicfdholvv4vk7aecwn6v7wyywv3o75klemp7ksx25ursgydvjcnqjg5dc7lh33a7g4fv5hgu
bafkrjaabylpfivacrci6wgruxbt5a2mclmxanv6yzdc3ga2lxmccukl6z7nxyndyfexexku353rc2epxwqbvapzfff3u76wzbv322gdt7bu6hqk6qo4o4dij7yfp562kj5ljiko7dtb56eajka74raxouf7bcap34o4l4kbqj4gnutglzylsulhntybhftlwnvumxvdusjd2owkbk2ypq
bafkrjaabyxxol6kv46bk4dbysrf5t6uggtc6dy7f6j3bj7ozjgt5qngdd445puhypnqr6fnxgoz6gyw4bufgs7ddif66jezeluvqdkt7qzm3ffae3d2hutstviilxd6zdw3ij77pjcxcnxdhvmuroigjbk5xxtt4hunxteklmfoiztnw7xsbsovetr3pulzgrbyy63m36doreep7fqqjo
bafkrjaabztqgwedqpisnzrn6qyzyxf6chlz463f2dp2g6z4oyih7oy2fcvtgf2hpfojril3hxwn76tcigscopf4jo6nmdyxa7ysracnrnrvsegamiukjk3w3svagnp2b6ssngbntorcbbzp2h2l6ol7df7ea3qsb6bfg2c43mxtqcrpbre3l4nymfrc3b7pffe7iyy6lo7sh4yjmgpgl2
bagpniqivcqm2hr7jtgbnrjlgn3w3cncfnbefr4ojou
mrd0ll4r commented 1 year ago

There is a tool at https://cid.ipfs.tech/, which parses most of these. It seems like the first one really has "protobuf" as multicodec. The ones in between are SHA3-512, which we should be able to parse somehow. The last line really seems to be invalid.

mrd0ll4r commented 1 year ago

I'm not sure how we should handle the "protobuf" case. Maybe we really should ignore it, like we're doing now. I have no clue what these are for, I hope it's not many.

lgehr commented 1 year ago

I started from below and also found the last one to be invalid. Cid::try_from(line) seems to fail on the second last line

mrd0ll4r commented 1 year ago

I wonder if the issue is the size limitation of the Multihash crate (see here)? If you debug-print the error (see comment on the PR), and add more .context() in some places, we should maybe be able to figure out what's going on.

If this is a problem with the multihash crate, so be it. We'll more forward with the PR for now, and maybe rewrite some stuff later, but I don't want to drag this out forever :)

lgehr commented 1 year ago

I already added context and looked at the backtrace and came to the conclusion that the error is in the cid crate. I did not dig deeper.

mrd0ll4r commented 1 year ago

We could try using a larger CidGeneric. If the SHA3 problems really are about digest size, this should fix those.