-
### Component(s)
exporter/file
### Is your feature request related to a problem? Please describe.
Parquet Format:
Parquet is a columnar storage file format optimized for big data processing framew…
-
**Abstract**
Columnar storage is a core component of a modern data analytics system. Although many database management systems (DBMSs) have proprietary storage formats, most provide extensive suppo…
-
Say, if there is a `bool` in struct. When columnar storage is used wouldn't it be more useful that we can make use of every single bit rather than using a byte for a bool? Rust compiler optimizes stru…
-
### What problem does the new feature solve?
Supports inserting/querying JSON data.
### What does the feature do?
Support for JSON data format will be divided into several stages:
1. Add n…
-
[Columnar storage](https://github.com/citusdata/citus/tree/main/src/backend/columnar) page lists a lot of format limitations, including
> No support for foreign keys, unique constraints, or exclusi…
-
Parquet is a columnar storage file format that is commonly used in the context of big data processing frameworks, such as Apache Spark and Apache Hive. The format is designed to be highly efficient fo…
-
> Refer to roadmap [2023](https://github.com/StarRocks/starrocks/issues/16445) [2022](https://github.com/StarRocks/starrocks/issues/1244)
# Shared-data & StarOS
- Align with all functionalities…
-
As great and universal as json is for exchanging messages, the fact that Singer tap -> target communication requires a record-oriented json format is a big drawback (at least for me), as the unnecessa…
-
Current implementation just blinding writes a whole pages into the disk. Row serialization into page is also very simple and non-optimal right now.
This requires more research into how do the seria…
-
Hi
I want to use lance file format for serializing some graphs is build.
I am curios to learn more about how the columnar format with fast random access helps here ?
For example currently i was t…