search

librasteve / raku-Dan-Polars

Raku Polars binding
Artistic License 2.0
5 stars 2 forks source link

Transfer performance #7

Open librasteve opened 2 years ago

librasteve commented 2 years ago

20:37 discord-raku-bot @japhb I got a CBOR file -- how do I read it in Raku? Using slurp with ":bin" ? 20:49 discord-raku-bot @japhp Yeah, I got it working. And, yes, the CBOR utilization gives me the fastest ingestion of ≈700MB CSV file in Raku.

Some use cases require data transfer - such as using the Rust fast read_csv to import a DataFrame from disk like this:

use Dan;
use Dan::Polars;

my \df = DataFrame.new;
df.read_csv("/tmp/docdir/1mSalesRecords.csv");

say ~df.Dan-DataFrame;   #cast Dan::Polars::DataFrame to raku Dan::DataFrame

A blog post on transfer performance is forthcoming...

japhb commented 2 years ago

Out of curiosity, did you ever write said blog post? If so, what's the link?

librasteve commented 2 years ago

Not yet - I am still wrestling with the basic functions - performance is taking a back seat to correct behaviour for now...

japhb commented 2 years ago

Wise choice. :grin:

ispyhumanfly commented 1 year ago

Hey all, glad this module exists. Looking forward to working with this.

librasteve commented 1 year ago

Appreciate the feedback ... I have been stuck with a nasty Rust issue for a while, but I think that that is now resolved.