search

rpbouman / huey

A UI for DuckDB
MIT License
181 stars 14 forks source link

TransactionContext Error: Failed to commit: File is not opened in write mode. #86

Open dash-awake opened 3 months ago

dash-awake commented 3 months ago

I am trying to load a large duckdb file (700MB), and the UI errors out with the following message "TransactionContext Error: Failed to commit: File is not opened in write mode.".

The file is writable on the file system. I am using a Mac, and I start the UI after cloning the repo. Is there a workaround for this?

Screenshot 2024-05-22 at 9 18 35 AM
rpbouman commented 3 months ago

Hi! Thanks for your interest in Huey.

What kind of file is it? Would it be possible to share it? If not, could you try to cut the file in half and try to load that?

For testing I often use the large volume taxi trip data dataset (https://www.nyc.gov/site/tlc/about/tlc-trip-record-data.page). Those are 450 MB Parquet files, and I can open multiple of those at once without issue.

If curring in half does work then I suspect it is an issue with duckdb wasm. The workaround in that case would be to indeed cut the files in half. When loading in Huey, Huey will detect whether files have the same column layout (names + datatypes), and offer you to analyze either the individual files, or a union of all those files, effectively allowing you to analyze the entire dataset.