apache datafusion-comet issues

apache / datafusion-comet

Apache DataFusion Comet Spark Accelerator

https://datafusion.apache.org/comet

Apache License 2.0

919 stars 186 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

chore: Minor code cleanup in native scan type checking

#1537 andygrove opened 7 hours ago
1
`native_datafusion` scan is only enabled when `spark.comet.exec.enabled` is set

#1536 andygrove opened 7 hours ago
3
chore: Re-enable GitHub discussions

#1535 andygrove opened 8 hours ago
1
chore: [FOLLOWUP] Drop support for Spark 3.3 (EOL)

#1534 kazuyukitanimura opened 11 hours ago
1
GitHub discussions have been disabled

#1533 andygrove opened 1 day ago
0
chore: re-enable GitHub discussions

#1532 andygrove closed 1 day ago
1
Write blog post for Comet 0.7.0 release

#1531 andygrove opened 1 day ago
0
chore: Prepare for 0.8.0 development

#1530 andygrove closed 1 day ago
1
chore: Drop support for Spark 3.3 (EOL)

#1529 andygrove closed 1 day ago
3
chore: fix issue in release process

#1528 andygrove closed 1 day ago
1
docs: Add changelog for 0.7.0 release

#1527 andygrove opened 2 days ago
0
Follow on to check that ANSI tests for decimal div are working as intended

#1526 andygrove opened 2 days ago
0
docs: various improvements to tuning guide

#1525 andygrove opened 2 days ago
2
docs: Update configuration guide to show optional configs

#1524 andygrove closed 2 days ago
1
Investigate TPC-H q4 hanging when not enough memory is allocated

#1523 andygrove opened 2 days ago
0
fix: Taking slicing into account when writing BooleanBuffers as fast-encoding format

#1522 Kontinuation opened 2 days ago
1
Do we have plans to support remote shuffle services, such as Apache Celeborn?

#1521 dpengpeng opened 2 days ago
1
Incorrect null handling in fast shuffle encoder

#1520 andygrove opened 3 days ago
2
Unable to run TPC-H benchmarks using on-heap mode and default settings

#1519 andygrove opened 3 days ago
4
Create integration tests that can run against a Spark cluster

#1518 andygrove opened 3 days ago
0
chore: Use Datafusion's existing empty stream

#1517 EmilyMatt closed 2 days ago
1
Use datafusion::physical_plan::EmptyRecordBatchStream in shuffle_writer

#1516 EmilyMatt closed 2 days ago
0
Enable hdfs test(s) in ci

#1515 parthchandra opened 3 days ago
3
chore: Remove all subdependencies

#1514 EmilyMatt closed 1 day ago
7
Remove all Cargo sub-dependencies?

#1513 EmilyMatt closed 1 day ago
3
fix: check overflow for decimal integral division

#1512 wForget closed 2 days ago
1
chore: Reimplement ShuffleWriterExec using interleave_record_batch

#1511 Kontinuation opened 3 days ago
8
Publish official Docker images to Docker Hub under Apache account

#1510 andygrove opened 3 days ago
4
Require Comet 0.6 Docker image for Spark 3.5.5

#1509 RaghavendraGanesh opened 3 days ago
1
Add information about SortExec memory/spill issues in tuning guide

#1508 andygrove opened 3 days ago
0
Builds failing due to Maven Central rate limits

#1507 andygrove opened 3 days ago
1
Incorrect results for `div` expression

#1506 andygrove closed 2 days ago
2
Columnar shuffle does not use memory pool when off-heap is disabled

#1505 andygrove closed 3 days ago
0
fix: Fix regression in choosing correct memory allocator in columnar shuffle

#1504 andygrove closed 2 days ago
3
minor: Remove hard-coded config default

#1503 andygrove closed 3 days ago
1
ignore: testing something

#1502 andygrove closed 4 days ago
0
Github Actions get stuck for `SPARK-48037: Fix SortShuffleWriter lacks shuffle write related metrics`

#1501 kazuyukitanimura opened 4 days ago
0
Add dictionary support for read-side padding

#1500 andygrove closed 4 days ago
0
The Comet compiled on the Ubuntu operating system cannot run on CentOS 7

#1499 dpengpeng closed 2 days ago
4
chore: Remove num partitions from repartitioner

#1498 EmilyMatt closed 4 days ago
3
Single partition shuffle should not use partition buffers

#1497 EmilyMatt opened 4 days ago
0
fix: PartitionBuffers should not have their own MemoryConsumer

#1496 EmilyMatt closed 4 days ago
1
PartitionBuffers should not have their own MemoryConsumer

#1495 EmilyMatt closed 4 days ago
0
fix: use common implementation of handling object store and hdfs urls for native_datafusion and native_iceberg_compat

#1494 parthchandra closed 2 days ago
2
chore: revert "Upgrade to Spark 3.5.4 (#1471)"

#1493 andygrove closed 4 days ago
3
PR builds failing in Spark SQL tests with org.xerial.snappy import issue

#1492 andygrove closed 5 days ago
2
chore: Stop disabling readside padding in TPC stability suite

#1491 andygrove closed 4 days ago
1
Chore: simplify array related functions impl

#1490 kazantsev-maksim opened 1 week ago
0
Test `native_datafusion` and `native_iceberg_compat` with Spark SQL tests

#1489 andygrove opened 1 week ago
0
`ParquetEncryptionITCase` fails with `native_iceberg_compat`

#1488 andygrove opened 1 week ago
0