mattcasters / pentaho-pdi-dataset

Set of PDI plugins to more easily work with data sets. We also want to provide unit testing capabilities through input data sets and golden data sets.
Apache License 2.0
30 stars 13 forks source link

Test data from text files #27

Closed diethardsteiner closed 5 years ago

diethardsteiner commented 5 years ago

As a developer I’d like to source my unit test data directly from CSV/text files. I tried to use H2 for this, however, it requires one connection by file which is inconvinient - there does not seem to be an option to configure a connection to point to a folder full of csv/text files (see also here). For this reason, can you please implement an option to directly source unit test data from csv/text files?

diethardsteiner commented 5 years ago

Excellent, thanks a lot! Just for everyone's info: The folder containing the CSV files can be specified on a dataset group level.

mattcasters commented 5 years ago

Actually, it can now be configured on the Environment level. This makes it super easy to configure your projects.