Currently, for reading various file formats, we do this:
auto opts = cudf::io::xxx_reader_options::builder(cudf::io::source_info{input_data_source_info})
.some_options(...)
...
.build();
auto output = read_xxx(opts);
When we have a large number of options to specify and have different datasources, it would be very burdensome to set the parameters repeatedly for every datasource.
We can avoid doing so by separating datasource from reading options. By doing so, we can just set the reading parameters once, then reuse the options instance multiple times:
auto opts = cudf::io::xxx_reader_options::builder(cudf::io::source_info{input_data_source_info})
.some_options(...)
...
.build();
auto output1 = read_xxx(source1, opts);
auto output2 = read_xxx(source2, opts);
....
Currently, for reading various file formats, we do this:
When we have a large number of options to specify and have different datasources, it would be very burdensome to set the parameters repeatedly for every datasource.
We can avoid doing so by separating datasource from reading options. By doing so, we can just set the reading parameters once, then reuse the options instance multiple times: