mukunku / ParquetViewer

Simple Windows desktop application for viewing & querying Apache Parquet files
GNU General Public License v3.0
687 stars 82 forks source link

[FEAT] IO Unblock? #101

Closed sequencerr closed 4 months ago

sequencerr commented 4 months ago

I'm just viewing file. Why it's blocked?( Maybe better read to memory and release?

While opened file in app:

[Error: EBUSY: resource busy or locked, open 'C:\df.parquet'] {
  errno: -4082,
  code: 'EBUSY',
  syscall: 'open',
  path: 'C:\df.parquet'
}
mukunku commented 4 months ago

Parquet files are usually multiple gigabytes in size. So the program is optimized for those use cases. I don't have any plans to add logic to load the entire file into memory so we don't acquire a read lock on it.