search

pharo-spec / Spec

Spec is a framework in Pharo for describing user interfaces.
MIT License
61 stars 63 forks source link

Inspect a big data frame is slow (add lazy display of contents?) #1440

Closed hernanmd closed 1 year ago

hernanmd commented 1 year ago

In Pharo 11 with DataFrame package loaded and this CSV file

AndreasSystemProfiler spyOn: [ 
  (DataFrame 
    readFromCsv: 'assembly_summary_refseq.txt' asFileReference
    withSeparator: Character tab
    skip: 1) inspect ]

Reporting - 342,268 tallies, 48,085 msec. Here is the complete report: df-spy-results.txt

To compare, the same code in R:

df <- read.csv("assembly_summary_refseq.txt",  quote = "", sep = '\t', header = T, skip = 1)
system.time(View(df))

With following timings of opening the DataFrame (1st and 2nd execution): 

  user  system elapsed 
  0.023   0.000   0.024 
  0.000   0.000   0.001
hernanmd commented 1 year ago

Closed as this does not seem to be an issue related with Spec.