cardillo / joinery

Data frames for Java
https://joinery.sh
GNU General Public License v3.0
695 stars 167 forks source link

10x time different on loading a csv file by jar or in the joinery project. #116

Open darkread opened 2 years ago

darkread commented 2 years ago

a 460k records csv named 1.csv

  1. Test 1:in the joinery project Or Shell mode

I git clone joinery ,add Code in the main function image DataFrame df = DataFrame.readCsv("1.csv"); pass 5X sec or run it in shell mode java -jar .\joinery-dataframe-1.10-jar-with-dependencies.jar shell image pass 5X sec

  1. Test2: use joinery-dataframe jar in my test project

I complie and package the joinery joinery-dataframe-1.11-SNAPSHOT.jar ,And build a new project and run DataFrame df = DataFrame.readCsv("1.csv"); like below: image pass 5XX sec

  1. Test3: use joinery-dataframe jar by maven building

I build by maven like

<dependency>
  <groupId>sh.joinery</groupId>
  <artifactId>joinery-dataframe</artifactId>
  <version>1.10</version>
</dependency>

pass 5XX sec