mukunku / ParquetViewer

Simple Windows desktop application for viewing & querying Apache Parquet files
GNU General Public License v3.0
754 stars 91 forks source link

[FEATURE-REQUEST] Support for Map datatype #3

Closed rr-on-gh closed 1 year ago

rr-on-gh commented 5 years ago

Currently there is no support for data structures like Map, Lists etc. and an error message is thrown when such files are opened. Can Map datatype be supported?

mukunku commented 5 years ago

Can you please share the error message shown? Even if the utility can't display these types I believe it can be changed so that it at least shows the other non Map/List fields.

rr-on-gh commented 5 years ago

I'll paste the error message in a bit. So the file can still be loaded by not selecting the field that has Map values when the file is first loaded. I was wondering if support to view Map could be added. I guess it doesn't fit well UI-wise in the current tabular format. but even if we could just build a string out of the Map and show that as column, it would be helpful.

ShubhamBelwal commented 5 years ago

image

I get this message when I try to open a file containing Map type columns.

ShubhamBelwal commented 5 years ago

Any update on the support for Map Types?

pdesmarets commented 5 years ago

I am also interested in seeing support for logical types. Actually all possible data types...

mith-emsa commented 4 years ago

I would also be interested in support for map types, as well as struct types. Do you think you will support this soon?

mukunku commented 4 years ago

Can you share a sample file? That would be very helpful.

pdesmarets commented 4 years ago

There are all kinds of sample files of different nature here https://github.com/apache/parquet-testing/tree/master/data

mukunku commented 3 years ago

Just an update: In the newer versions it should be possible to open a file with unsupported field types but the unsupported fields cannot be selected for display in the UI still, for now.

mukunku commented 3 years ago

List and Array type supported has been added #37. Hopefully will add MAP some time soon as well.

Still no Map support. Sorry 😞

mukunku commented 1 year ago

Non-nested map and list support is available now with v2.7.0

Going to call that a win and close out this issue.