bodo-hugo-barwich
commented
2 years ago I can confirm that this continues to happening:
2021/08/07 12:58:52 I release: Processing /CPAN/authors/id/N/NE/NEILB/enum-1.12.tar.gz
2021/08/07 12:58:52 F release: /CPAN/authors/id/N/NE/NEILB/enum-1.12.tar.gz [Request] ** [http://elasticsearch:9200]-[400] [mapper_parsing_exception] failed to parse [version], called from sub Search::Elasticsearch::Role::Client::Direct::__ANON__ at /usr/local/lib/perl5/site_perl/5.30.1/ElasticSearchX/Model/Document/Role.pm line 94. With vars: {'body' => {'status' => 400,'error' => {'type' => 'mapper_parsing_exception','caused_by' => {'reason' => 'For input string: "1.12"','type' => 'number_format_exception'},'root_cause' => [{'reason' => 'failed to parse [version]','type' => 'mapper_parsing_exception'}],'reason' => 'failed to parse [version]'}},'request' => {'method' => 'POST','ignore' => [],'mime_type' => 'application/json','qs' => {'refresh' => 1},'body' => {'checksum_sha256' => '69a7a891cd3888ed8b02c5e99a1f489f92a62ec351c0bc7894fd7bd7d1447ea9','license' => ['perl_5'],'authorized' => bless( do{\(my $o = 1)}, 'JSON::PP::Boolean' ),'version' => '1.12','checksum_md5' => 'a89225b8c1f5925fefc7788baeedcaa9','resources' => {'homepage' => 'https://github.com/neilb/enum','bugtracker' => {'web' => 'https://github.com/neilb/enum/issues'},'repository' => {'type' => 'git','web' => 'https://github.com/neilb/enum','url' => 'https://github.com/neilb/enum.git'}},'metadata' => {'generated_by' => 'Dist::Zilla version 6.017, CPAN::Meta::Converter version 2.150010','x_serialization_backend' => 'Cpanel::JSON::XS version 4.24','author' => ['Byron Brummer <zenin@bawdycaste.org>'],'abstract' => 'C style enumerated types and bitmask flags in Perl','release_status' => 'stable','x_generated_by_perl' => 'v5.28.2','name' => 'enum','no_index' => {'directory' => ['t','xt','inc','local','perl5','fatlib','example','blib','examples','eg']},'dynamic_config' => 0,'resources' => {'homepage' => 'https://github.com/neilb/enum','bugtracker' => {'web' => 'https://github.com/neilb/enum/issues'},'repository' => {'type' => 'git','web' => 'https://github.com/neilb/enum','url' => 'https://github.com/neilb/enum.git'}},'prereqs' => {'test' => {'requires' => {'Test::More' => '0.88','vars' => '0'}},'runtime' => {'requires' => {'strict' => '0','Carp' => '0','warnings' => '0','perl' => '5.006'}},'configure' => {'requires' => {'ExtUtils::MakeMaker' => '0'}}},'x_spdx_expression' => 'Artistic-1.0-Perl OR GPL-1.0-or-later','license' => ['perl_5'],'meta-spec' => {'url' => 'http://search.cpan.org/perldoc?CPAN::Meta::Spec','version' => 2},'version' => '1.12'},'deprecated' => bless( do{\(my $o = 0)}, 'JSON::PP::Boolean' ),'dependency' => [{'relationship' => 'requires','module' => 'warnings','phase' => 'runtime','version' => '0'},{'version' => '5.006','phase' => 'runtime','module' => 'perl','relationship' => 'requires'},{'module' => 'Carp','relationship' => 'requires','phase' => 'runtime','version' => '0'},{'version' => '0','phase' => 'runtime','relationship' => 'requires','module' => 'strict'},{'phase' => 'configure','relationship' => 'requires','module' => 'ExtUtils::MakeMaker','version' => '0'},{'version' => '0.88','phase' => 'test','module' => 'Test::More','relationship' => 'requires'},{'phase' => 'test','relationship' => 'requires','module' => 'vars','version' => '0'}],'stat' => {'mtime' => 1628062109,'size' => 14908,'mode' => 33204},'provides' => [],'distribution' => 'enum','maturity' => 'released','date' => '2021-08-04T07:28:29','archive' => 'enum-1.12.tar.gz','status' => 'cpan','id' => 'Rw43bHK51O5F928NMaSOeCsxP34','name' => 'enum-1.12','version_numified' => '1.12','first' => $VAR1->{'request'}{'body'}{'deprecated'},'abstract' => 'C style enumerated types and bitmask flags in Perl','author' => 'NEILB'},'path' => '/cpan/release/Rw43bHK51O5F928NMaSOeCsxP34','serialize' => 'std'},'status_code' => 400}From the error message
{'body' => {
'status' => 400,
'error' => {
'type' => 'mapper_parsing_exception',
'caused_by' => {
'reason' => 'For input string: "1.12"',
'type' => 'number_format_exception'
},
'root_cause' => [{
'reason' => 'failed to parse [version]',
'type' => 'mapper_parsing_exception'
}],
'reason' => 'failed to parse [version]'}}I suppose this has to do with the Index Structure. Numeric Fields in ElasticSearch
From inside the Docker Cluster the ElasticSearch shows that it has different indices:
root@8c2828626bf5:/metacpan-api# curl -XGET 'elasticsearch_test:9200/_cat/indices'
yellow open cover 1 1 0 0 159b 159b
yellow open cpan_v1_01 1 1 0 0 159b 159b
yellow open contributor 1 1 0 0 159b 159b
yellow open cpan 5 1 11 5 79.9kb 79.9kb
yellow open user 1 1 0 0 159b 159b The index cpan happens to have a field cpan.file.properties.version which is a long which is supposed to accept Integer Values while the module version is mostly a Float Value like version = 1.12.
Which results that the actual index has only 11 documents indexed:
root@8c2828626bf5:/metacpan-api# curl -XGET 'elasticsearch_test:9200/cpan_v1_01/_count?pretty=true'
{
"count" : 0,
"_shards" : {
"total" : 1,
"successful" : 1,
"failed" : 0
}
}
root@8c2828626bf5:/metacpan-api# curl -XGET 'elasticsearch_test:9200/cpan/_count?pretty=true'
{
"count" : 11,
"_shards" : {
"total" : 5,
"successful" : 5,
"failed" : 0
}
}those with a even Version Number
oalders
waterkip
ssoriche
I have a minicpan volume and wanted to index it via index-cpan.sh, but it seems to fail:
It happens somewhere in the lib/MetaCPAN/Model/Release.pm code, but I'm unable to pinpoint it.
The command that I execute is:
Perhaps this is the wrong repository for the bug report, but I read a large disclaimer on the metacpan-api repo for filing issues and my guess is you don't have this issue there otherwise things would be broken on the live platform. So it either has something to do with the docker-compose infra or it is an actual bug.