LibreCat / Catmandu

Catmandu - a data processing toolkit
https://librecat.org
175 stars 31 forks source link

support Windows #63

Closed nics closed 9 years ago

nics commented 10 years ago

Catmandu.pm fails on Win. Probably just because of the different file system structure.

jorol commented 10 years ago

Which branch, dev or master?

I run Catmandu on several Windows boxes with Strawberry Perl http://strawberryperl.com/ without problems.

nics commented 10 years ago

Hi jorol

in both branches a test fails on windows

http://www.cpantesters.org/cpan/report/712aaa83-6bf4-1014-bd0f-689f6833a163

From: jorol notifications@github.com<mailto:notifications@github.com> Reply-To: LibreCat/Catmandu reply@reply.github.com<mailto:reply@reply.github.com> Date: Friday 4 April 2014 17:29 To: LibreCat/Catmandu Catmandu@noreply.github.com<mailto:Catmandu@noreply.github.com> Cc: Nicolas Steenlant nicolas.steenlant@gmail.com<mailto:nicolas.steenlant@gmail.com> Subject: Re: [Catmandu] support Windows (#63)

Which branch, dev or master?

I run Catmandu on several Windows boxes with Strawberry Perl http://strawberryperl.com/ without problems.

— Reply to this email directly or view it on GitHubhttps://github.com/LibreCat/Catmandu/issues/63#issuecomment-39577720.

jorol commented 10 years ago

I´ve tested the current dev-Branch.

OS: Win7 64bit Perl: v5.18.1 (Strawberry Perl)

Results:

t\Catmandu-Addable.t .............. ok
t\Catmandu-ArrayIterator.t ........ ok
t\Catmandu-Bag.t .................. ok
t\Catmandu-Buffer.t ............... ok
t\Catmandu-CLI.t .................. ok
t\Catmandu-Cmd-config.t ........... 
Dubious, test returned 2 (wstat 512, 0x200)
Failed 2/9 subtests 
t\Catmandu-Cmd-convert.t .......... ok
t\Catmandu-Cmd-count.t ............ 
Dubious, test returned 2 (wstat 512, 0x200)
Failed 2/5 subtests 
t\Catmandu-Cmd-data.t ............. ok
t\Catmandu-Cmd-delete.t ........... 
Dubious, test returned 1 (wstat 256, 0x100)
Failed 1/5 subtests 
t\Catmandu-Cmd-export.t ........... 
Dubious, test returned 255 (wstat 65280, 0xff00)
All 2 subtests passed 
t\Catmandu-Cmd-import.t ........... ok
t\Catmandu-Cmd-move.t ............. 
Dubious, test returned 2 (wstat 512, 0x200)
Failed 2/4 subtests 
t\Catmandu-Cmd.t .................. 
Dubious, test returned 2 (wstat 512, 0x200)
Failed 2/14 subtests 
t\Catmandu-Counter.t .............. ok
t\Catmandu-Env.t .................. 
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 1/4 subtests 
t\Catmandu-Error.t ................ ok
t\Catmandu-Exporter-CSV.t ......... ok
t\Catmandu-Exporter-JSON.t ........ ok
t\Catmandu-Exporter-RIS.t ......... ok
t\Catmandu-Exporter-YAML.t ........ ok
t\Catmandu-Exporter.t ............. ok
t\Catmandu-Fix-Base.t ............. ok
t\Catmandu-Fix-Condition.t ........ ok
t\Catmandu-Fix-add_field.t ........ ok
t\Catmandu-Fix-add_to_store.t ..... ok
t\Catmandu-Fix-append.t ........... ok
t\Catmandu-Fix-array.t ............ ok
t\Catmandu-Fix-capitalize.t ....... ok
t\Catmandu-Fix-clone.t ............ ok
t\Catmandu-Fix-collapse.t ......... ok
t\Catmandu-Fix-copy_field.t ....... ok
t\Catmandu-Fix-count.t ............ ok
t\Catmandu-Fix-downcase.t ......... ok
t\Catmandu-Fix-expand.t ........... ok
t\Catmandu-Fix-expand_date.t ...... ok
t\Catmandu-Fix-from_json.t ........ ok
t\Catmandu-Fix-hash.t ............. ok
t\Catmandu-Fix-join_field.t ....... ok
t\Catmandu-Fix-lookup.t ........... ok
t\Catmandu-Fix-lookup_in_store.t .. 
Dubious, test returned 255 (wstat 65280, 0xff00)
All 2 subtests passed 
t\Catmandu-Fix-move_field.t ....... ok
t\Catmandu-Fix-nothing.t .......... ok
t\Catmandu-Fix-prepend.t .......... ok
t\Catmandu-Fix-remove_field.t ..... ok
t\Catmandu-Fix-replace_all.t ...... ok
t\Catmandu-Fix-retain_field.t ..... ok
t\Catmandu-Fix-set_field.t ........ ok
t\Catmandu-Fix-sort_field.t ....... ok
t\Catmandu-Fix-split_field.t ...... ok
t\Catmandu-Fix-substring.t ........ ok
t\Catmandu-Fix-sum.t .............. ok
t\Catmandu-Fix-to_json.t .......... ok
t\Catmandu-Fix-trim.t ............. ok
t\Catmandu-Fix-upcase.t ........... ok
t\Catmandu-Fix.t .................. ok
t\Catmandu-Fixable.t .............. ok
t\Catmandu-Hits.t ................. ok
t\Catmandu-Importer-CSV.t ......... ok
t\Catmandu-Importer-JSON.t ........ ok
t\Catmandu-Importer-Mock.t ........ ok
t\Catmandu-Importer-YAML.t ........ ok
t\Catmandu-Importer.t ............. ok
t\Catmandu-Iterable.t ............. ok
t\Catmandu-Iterator.t ............. ok
t\Catmandu-Paged.t ................ ok
t\Catmandu-Pluggable.t ............ ok
t\Catmandu-Plugin-Datestamps.t .... ok
t\Catmandu-Plugin-Versioning.t .... ok
t\Catmandu-Sane.t ................. ok
t\Catmandu-Searchable.t ........... ok
t\Catmandu-Serializer.t ........... ok
t\Catmandu-Store-Hash.t ........... ok
t\Catmandu-Store.t ................ ok
t\Catmandu-Util.t ................. ok
t\Catmandu.t ...................... 
Dubious, test returned 255 (wstat 65280, 0xff00)
Failed 2/15 subtests 

Test Summary Report
-------------------
t\Catmandu-Cmd-config.t         (Wstat: 512 Tests: 9 Failed: 2)
  Failed tests:  4, 7
  Non-zero exit status: 2
t\Catmandu-Cmd-count.t          (Wstat: 512 Tests: 5 Failed: 2)
  Failed tests:  3-4
  Non-zero exit status: 2
t\Catmandu-Cmd-delete.t         (Wstat: 256 Tests: 5 Failed: 1)
  Failed test:  4
  Non-zero exit status: 1
t\Catmandu-Cmd-export.t         (Wstat: 65280 Tests: 2 Failed: 0)
  Non-zero exit status: 255
  Parse errors: No plan found in TAP output
t\Catmandu-Cmd-move.t           (Wstat: 512 Tests: 4 Failed: 2)
  Failed tests:  3-4
  Non-zero exit status: 2
t\Catmandu-Cmd.t                (Wstat: 512 Tests: 14 Failed: 2)
  Failed tests:  12, 14
  Non-zero exit status: 2
t\Catmandu-Env.t                (Wstat: 65280 Tests: 4 Failed: 1)
  Failed test:  4
  Non-zero exit status: 255
  Parse errors: No plan found in TAP output
t\Catmandu-Fix-lookup_in_store.t (Wstat: 65280 Tests: 2 Failed: 0)
  Non-zero exit status: 255
  Parse errors: No plan found in TAP output
t\Catmandu.t                    (Wstat: 65280 Tests: 15 Failed: 2)
  Failed tests:  10, 15
  Non-zero exit status: 255
  Parse errors: No plan found in TAP output
Files=76, Tests=1005, 45 wallclock secs ( 0.41 usr +  0.19 sys =  0.59 CPU)
Result: FAIL

There is also a warning for Regexp::Grammar for my version of Perl:

Warning: Regexp::Grammars is currently unsupported under Perl 5.18.

Perl 5.18 changed how 'qr' constant overloadings are parsed and the
scope in which they are subsequently compiled. This change currently
make it impossible to reliably create 'qr' overloadings that inject
code blocks into a regex, as it prevents the overloaded regexes from
compiling properly in many cases, even with an explicit 'use re
"eval"' in scope.

These problems have been reported, and the brave volunteers of P5P are
currently working on fixes. However, these will not be available until
at least 5.18.2.

Because Regexp::Grammars relies on 'qr' overloads to inject code blocks
into regexes, the module is curently not compatible with Perl 5.18. It
may continue to work in some limited cases, but is no longer reliable.

At present, if you rely on Regexp::Grammars for your parsing needs, your
alternatives are either not to upgrade to Perl 5.18, to livce with the
problems until they are resolved (in Perl 5.18.2, we hope), or else to
consider switching to another parsing system, such as Marpa.

We deeply regret that Regexp::Grammars cannot currently be maintained
completelt due to these backwards-incompatible changes and bugs in
Perl 5.18.

I make a test with an other version of Win and Perl tomorrow.

jorol commented 10 years ago

Got same results for

OS: Win7 32bit Perl: v5.18.2 (Strawberry Perl)

nics commented 10 years ago

Hi jorol,

thanks for looking into this i’m almost finished rewriting the parser in Marpa


Nicolas Steenlant - software developer University Library Ghent Rozier 9 - 9000 Ghent - Belgium nicolas.steenlant@ugent.bemailto:nicolas.steenlant@ugent.be +32 (0)9 264 39 18

From: jorol notifications@github.com<mailto:notifications@github.com> Reply-To: LibreCat/Catmandu reply@reply.github.com<mailto:reply@reply.github.com> Date: Monday 7 April 2014 18:14 To: LibreCat/Catmandu Catmandu@noreply.github.com<mailto:Catmandu@noreply.github.com> Cc: Nicolas Steenlant nicolas.steenlant@gmail.com<mailto:nicolas.steenlant@gmail.com> Subject: Re: [Catmandu] support Windows (#63)

I´ve tested the current dev-Branch.

OS: Win7 64bit Perl: v5.18.1 (Strawberry Perl)

Results:

t\Catmandu-Addable.t .............. ok t\Catmandu-ArrayIterator.t ........ ok t\Catmandu-Bag.t .................. ok t\Catmandu-Buffer.t ............... ok t\Catmandu-CLI.t .................. ok t\Catmandu-Cmd-config.t ........... Dubious, test returned 2 (wstat 512, 0x200) Failed 2/9 subtests t\Catmandu-Cmd-convert.t .......... ok t\Catmandu-Cmd-count.t ............ Dubious, test returned 2 (wstat 512, 0x200) Failed 2/5 subtests t\Catmandu-Cmd-data.t ............. ok t\Catmandu-Cmd-delete.t ........... Dubious, test returned 1 (wstat 256, 0x100) Failed 1/5 subtests t\Catmandu-Cmd-export.t ........... Dubious, test returned 255 (wstat 65280, 0xff00) All 2 subtests passed t\Catmandu-Cmd-import.t ........... ok t\Catmandu-Cmd-move.t ............. Dubious, test returned 2 (wstat 512, 0x200) Failed 2/4 subtests t\Catmandu-Cmd.t .................. Dubious, test returned 2 (wstat 512, 0x200) Failed 2/14 subtests t\Catmandu-Counter.t .............. ok t\Catmandu-Env.t .................. Dubious, test returned 255 (wstat 65280, 0xff00) Failed 1/4 subtests t\Catmandu-Error.t ................ ok t\Catmandu-Exporter-CSV.t ......... ok t\Catmandu-Exporter-JSON.t ........ ok t\Catmandu-Exporter-RIS.t ......... ok t\Catmandu-Exporter-YAML.t ........ ok t\Catmandu-Exporter.t ............. ok t\Catmandu-Fix-Base.t ............. ok t\Catmandu-Fix-Condition.t ........ ok t\Catmandu-Fix-add_field.t ........ ok t\Catmandu-Fix-add_to_store.t ..... ok t\Catmandu-Fix-append.t ........... ok t\Catmandu-Fix-array.t ............ ok t\Catmandu-Fix-capitalize.t ....... ok t\Catmandu-Fix-clone.t ............ ok t\Catmandu-Fix-collapse.t ......... ok t\Catmandu-Fix-copy_field.t ....... ok t\Catmandu-Fix-count.t ............ ok t\Catmandu-Fix-downcase.t ......... ok t\Catmandu-Fix-expand.t ........... ok t\Catmandu-Fix-expand_date.t ...... ok t\Catmandu-Fix-from_json.t ........ ok t\Catmandu-Fix-hash.t ............. ok t\Catmandu-Fix-join_field.t ....... ok t\Catmandu-Fix-lookup.t ........... ok t\Catmandu-Fix-lookup_in_store.t .. Dubious, test returned 255 (wstat 65280, 0xff00) All 2 subtests passed t\Catmandu-Fix-move_field.t ....... ok t\Catmandu-Fix-nothing.t .......... ok t\Catmandu-Fix-prepend.t .......... ok t\Catmandu-Fix-remove_field.t ..... ok t\Catmandu-Fix-replace_all.t ...... ok t\Catmandu-Fix-retain_field.t ..... ok t\Catmandu-Fix-set_field.t ........ ok t\Catmandu-Fix-sort_field.t ....... ok t\Catmandu-Fix-split_field.t ...... ok t\Catmandu-Fix-substring.t ........ ok t\Catmandu-Fix-sum.t .............. ok t\Catmandu-Fix-to_json.t .......... ok t\Catmandu-Fix-trim.t ............. ok t\Catmandu-Fix-upcase.t ........... ok t\Catmandu-Fix.t .................. ok t\Catmandu-Fixable.t .............. ok t\Catmandu-Hits.t ................. ok t\Catmandu-Importer-CSV.t ......... ok t\Catmandu-Importer-JSON.t ........ ok t\Catmandu-Importer-Mock.t ........ ok t\Catmandu-Importer-YAML.t ........ ok t\Catmandu-Importer.t ............. ok t\Catmandu-Iterable.t ............. ok t\Catmandu-Iterator.t ............. ok t\Catmandu-Paged.t ................ ok t\Catmandu-Pluggable.t ............ ok t\Catmandu-Plugin-Datestamps.t .... ok t\Catmandu-Plugin-Versioning.t .... ok t\Catmandu-Sane.t ................. ok t\Catmandu-Searchable.t ........... ok t\Catmandu-Serializer.t ........... ok t\Catmandu-Store-Hash.t ........... ok t\Catmandu-Store.t ................ ok t\Catmandu-Util.t ................. ok t\Catmandu.t ...................... Dubious, test returned 255 (wstat 65280, 0xff00) Failed 2/15 subtests

Test Summary Report

t\Catmandu-Cmd-config.t (Wstat: 512 Tests: 9 Failed: 2) Failed tests: 4, 7 Non-zero exit status: 2 t\Catmandu-Cmd-count.t (Wstat: 512 Tests: 5 Failed: 2) Failed tests: 3-4 Non-zero exit status: 2 t\Catmandu-Cmd-delete.t (Wstat: 256 Tests: 5 Failed: 1) Failed test: 4 Non-zero exit status: 1 t\Catmandu-Cmd-export.t (Wstat: 65280 Tests: 2 Failed: 0) Non-zero exit status: 255 Parse errors: No plan found in TAP output t\Catmandu-Cmd-move.t (Wstat: 512 Tests: 4 Failed: 2) Failed tests: 3-4 Non-zero exit status: 2 t\Catmandu-Cmd.t (Wstat: 512 Tests: 14 Failed: 2) Failed tests: 12, 14 Non-zero exit status: 2 t\Catmandu-Env.t (Wstat: 65280 Tests: 4 Failed: 1) Failed test: 4 Non-zero exit status: 255 Parse errors: No plan found in TAP output t\Catmandu-Fix-lookup_in_store.t (Wstat: 65280 Tests: 2 Failed: 0) Non-zero exit status: 255 Parse errors: No plan found in TAP output t\Catmandu.t (Wstat: 65280 Tests: 15 Failed: 2) Failed tests: 10, 15 Non-zero exit status: 255 Parse errors: No plan found in TAP output Files=76, Tests=1005, 45 wallclock secs ( 0.41 usr + 0.19 sys = 0.59 CPU) Result: FAIL

There is also a warning for Regexp::Grammar for my version of Perl:

Warning: Regexp::Grammars is currently unsupported under Perl 5.18.

Perl 5.18 changed how 'qr' constant overloadings are parsed and the scope in which they are subsequently compiled. This change currently make it impossible to reliably create 'qr' overloadings that inject code blocks into a regex, as it prevents the overloaded regexes from compiling properly in many cases, even with an explicit 'use re "eval"' in scope.

These problems have been reported, and the brave volunteers of P5P are currently working on fixes. However, these will not be available until at least 5.18.2.

Because Regexp::Grammars relies on 'qr' overloads to inject code blocks into regexes, the module is curently not compatible with Perl 5.18. It may continue to work in some limited cases, but is no longer reliable.

At present, if you rely on Regexp::Grammars for your parsing needs, your alternatives are either not to upgrade to Perl 5.18, to livce with the problems until they are resolved (in Perl 5.18.2, we hope), or else to consider switching to another parsing system, such as Marpa.

We deeply regret that Regexp::Grammars cannot currently be maintained completelt due to these backwards-incompatible changes and bugs in Perl 5.18.

I make a test with an other version of Win and Perl tomorrow.

— Reply to this email directly or view it on GitHubhttps://github.com/LibreCat/Catmandu/issues/63#issuecomment-39750396.

pietsch commented 10 years ago

Hi nics,

Marpa looks cool, but it made me think … If you need an Earley-style parser (which is typically used for parsing natural languages) to parse your artificial language, then perhaps your artificial language is ill-designed. So it may be wiser to constrain the fix language than to re-implement the parser in a framework that allows highly complex grammars. Otherwise you could just allow plain English as the fix language, and good luck with that.

vpeil commented 9 years ago

has this been solved?

this looks ok: http://www.cpantesters.org/distro/C/Catmandu.html?oncpan=1&distmat=1&version=0.9301&grade=2

close?

jorol commented 9 years ago

Did a fresh install on WIndows 7 without problems.