mjakubowski84 parquet4s issues

mjakubowski84 / parquet4s

Read and write Parquet in Scala. Use Scala classes as schema. No need to start a cluster.

https://mjakubowski84.github.io/parquet4s/

MIT License

283 stars 65 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Incorrect filtering of nested partitions

#363 egorsmth closed 1 week ago
1
Introduce isNull and isNotNull filters. Dependency upgrades.

#362 mjakubowski84 closed 1 week ago
0
Improvements in FS2's viaParquet and in custom readers in Akka/Pekko and FS2

#361 mjakubowski84 closed 1 week ago
0
How to filter based on null in data?

#360 egorsmth closed 1 week ago
3
Writing to S3 on a docker-image

#359 ymichels closed 1 month ago
1
Why reading a lot of partitioning files is slow

#358 egorsmth closed 1 month ago
4
Default partitions

#357 mjakubowski84 closed 3 months ago
0
Custom viaParquet in Akka/Pekko

#356 mjakubowski84 closed 3 months ago
1
Support url-encoding in partition values

#355 mjakubowski84 closed 4 months ago
0
ProjectionSchema self-inconsistency with partitioned source

#354 dpogibelskiy opened 4 months ago
3
partitioning incompatibility with spark

#353 dpogibelskiy closed 3 months ago
3
Partitions with nested directories return zero rows

#352 egorsmth closed 4 months ago
1
feat(akkaPekko): Retry mechanism for ParquetPartitioningFlow

#351 utkuaydn opened 5 months ago
4
feat(akkaPekko): Retry mechanism for ParquetPartitioningFlow

#350 utkuaydn closed 1 month ago
0
Possiblity to write avro IndexedRecords to Parquet using ParquetStreams

#349 dahiyahimanshu closed 3 months ago
4
Upgrades Parquet to v1.14

#348 mjakubowski84 closed 6 months ago
0
Efficent way to read big files?

#347 egorsmth closed 6 months ago
2
Align Stats & ParquetReader

#346 mjakubowski84 closed 6 months ago
0
Support vectored io introduced in Parquet 1.14

#345 mjakubowski84 closed 5 months ago
1
[Question] Is there a mechanism to detect when the `rotatingWriter` finishes writing to a file and to be notified of the file that was written?

#344 calvinlfer closed 6 months ago
1
Eager partition filtering. Record filters.

#343 mjakubowski84 closed 9 months ago
0
Partition path improvements

#342 mjakubowski84 closed 9 months ago
0
[Question] get a listing of parquet files?

#341 calvinlfer closed 6 months ago
4
Parallel reading of Parquet file

#340 mjakubowski84 closed 9 months ago
1
Bugfix: support reading decimals encoded as long values

#339 mjakubowski84 closed 9 months ago
0
Incorrect value after reading parquet

#338 JstFlip closed 9 months ago
7
Expose partitions as a nested Stream for FS2

#337 calvinlfer closed 9 months ago
0
Feature request: Expose partitions as a `Stream[F, Stream[F, Record]]` for FS2

#336 calvinlfer closed 9 months ago
5
Update akka/pekko partition path generation to avoid unnecessary object creation

#335 sndnv closed 9 months ago
0
Draft: Migrate timestamp codecs to Instant

#334 flipp5b opened 10 months ago
0
[RFC] Refactor timestamp codecs

#333 flipp5b opened 10 months ago
2
[akka/pekko] Too many paths created during record partitioning

#332 sndnv closed 9 months ago
2
Add codecs for Instant. Fix Nanos format for Timestamp and LocalDateTime

#331 flipp5b closed 10 months ago
5
chore(core): use extends AnyVal for wrapper class

#330 i10416 closed 10 months ago
0
Feat(core): make path filter configurable

#329 i10416 opened 11 months ago
0
ParquetSchemaResolver test fails on recent JVMs

#328 i10416 closed 10 months ago
1
Unsure how to use for 'semiauto' approach

#327 stacycurl closed 9 months ago
2
fix: do not cross-build scalapb module against akka/pekko

#326 mjakubowski84 closed 11 months ago
0
compatible parquet-hadoop with spark3.1

#325 conderls closed 9 months ago
3
Protobuf enums deserialisation

#324 struong closed 12 months ago
3
missing tail records of large(~193M) parquet files

#323 conderls closed 1 year ago
4
Do not publish a pekko/akko versions of scapapb module

#322 mjakubowski84 closed 11 months ago
1
Reading from gcs bucket

#321 Nabil272 closed 11 months ago
1
Fixes projection over multiple columns of a nested object

#320 mjakubowski84 closed 1 year ago
0
`ParquetReader.projectedGeneric` does not work when selecting more than one column from a same group

#319 tyoras closed 1 year ago
5
mjakubowski84#313 Add pekko support

#318 utkuaydn closed 1 year ago
1
adding logging messages to binaryFromDecimal function

#317 IoTier closed 1 year ago
0
Is it possible to write a file without Akka or Fs2 integration?

#316 kell18 closed 1 year ago
2
Custom core reader as simple iterable

#315 mjakubowski84 closed 1 year ago
0
Test, fix and refactor ScalaPB support. Add custom readers.

#314 mjakubowski84 closed 1 year ago
0