-
Notifications
You must be signed in to change notification settings - Fork 375
OpenSep 15, 2026
Due by September 30, 2026
•Last updated 35% complete
List view
0 of 66 selected 0 issues of 66 selected
Drop support for Spark 3.4
enhancementNew feature or requestNew feature or requestpriority:lowMinor issues, test failures, tooling, cosmeticMinor issues, test failures, tooling, cosmeticStatus: Open.#4329 In apache/datafusion-comet;feat: support kurtosis aggregate
area:aggregationHash aggregates, aggregate expressionsHash aggregates, aggregate expressionsarea:expressionsExpression evaluationExpression evaluationenhancementNew feature or requestNew feature or requestStatus: Open (in progress).apache/datafusion-cometnumber 4818#4818 In apache/datafusion-comet;Row-level Parquet filter pushdown regresses uncorrelated-predicate scans (TPC-H Q6 +80%)
area:scanParquet scan / data readingParquet scan / data readingenhancementNew feature or requestNew feature or requestStatus: Open.#4988 In apache/datafusion-comet;feat: enable CometLocalTableScanExec by default
area:scanParquet scan / data readingParquet scan / data readingenhancementNew feature or requestNew feature or requestStatus: Draft (not ready).apache/datafusion-cometnumber 4393#4393 In apache/datafusion-comet;[EPIC] Planner, serde, and optimizer rule performance audit
enhancementNew feature or requestNew feature or requestStatus: Open.#5199 In apache/datafusion-comet;Shuffle performance audit: candidate optimizations needing investigation
area:shuffleShuffle (JVM and native)Shuffle (JVM and native)enhancementNew feature or requestNew feature or requestStatus: Open.#5198 In apache/datafusion-comet;Do not accelerate a query stage that contains a columnar-to-row fallback (enable whole-stage revert by default)
enhancementNew feature or requestNew feature or requestStatus: Open.#5207 In apache/datafusion-comet;Use DataFusion
unnest_outerinstead of Comet implementaionenhancementNew feature or requestNew feature or requestpriority:mediumFunctional bugs, performance regressions, broken featuresFunctional bugs, performance regressions, broken featuresStatus: Open.#5210 In apache/datafusion-comet;[EPIC] Memory pool and accounting audit sweep
area:ffiArrow FFI / JNI boundaryArrow FFI / JNI boundaryarea:shuffleShuffle (JVM and native)Shuffle (JVM and native)bugSomething isn't workingSomething isn't workingpriority:highCrashes, panics, segfaults, major functional breakageCrashes, panics, segfaults, major functional breakageStatus: Open.#5212 In apache/datafusion-comet;perf: memoize Comet-subtree check in EliminateRedundantTransitions
enhancementNew feature or requestNew feature or requestStatus: Open (in progress).apache/datafusion-cometnumber 5213#5213 In apache/datafusion-comet;perf: skip DecimalPrecision.promote's rewrite when there is no decimal arithmetic
enhancementNew feature or requestNew feature or requestStatus: Open (in progress).apache/datafusion-cometnumber 5216#5216 In apache/datafusion-comet;[EPIC] cast from string: trim semantics diverge from Spark across all numeric, datetime and boolean targets
area:expressionsExpression evaluationExpression evaluationbugSomething isn't workingSomething isn't workingpriority:criticalData corruption, silent wrong results, security issuesData corruption, silent wrong results, security issuesStatus: Open.#5149 In apache/datafusion-comet;Hashing a CalendarInterval value fails with "Unsupported data type in hasher: Interval(MonthDayNano)"
area:expressionsExpression evaluationExpression evaluationbugSomething isn't workingSomething isn't workingpriority:highCrashes, panics, segfaults, major functional breakageCrashes, panics, segfaults, major functional breakageStatus: Open.#5059 In apache/datafusion-comet;Null CalendarInterval literal throws native exception instead of evaluating to null
area:expressionsExpression evaluationExpression evaluationbugSomething isn't workingSomething isn't workingpriority:highCrashes, panics, segfaults, major functional breakageCrashes, panics, segfaults, major functional breakageStatus: Open.#5058 In apache/datafusion-comet;Native Parquet schema-on-read diverges from Spark for ANSI interval targets
area:scanParquet scan / data readingParquet scan / data readingbugSomething isn't workingSomething isn't workingpriority:mediumFunctional bugs, performance regressions, broken featuresFunctional bugs, performance regressions, broken featuresStatus: Open.#5188 In apache/datafusion-comet;fix: string-to-timestamp does not trim ISO control characters, and leading '+' returns null under ANSI
area:expressionsExpression evaluationExpression evaluationbugSomething isn't workingSomething isn't workingpriority:mediumFunctional bugs, performance regressions, broken featuresFunctional bugs, performance regressions, broken featuresStatus: Open.#5165 In apache/datafusion-comet;[Bug] Native make_interval overflows valid time components or loses seconds precision
area:expressionsExpression evaluationExpression evaluationbugSomething isn't workingSomething isn't workingpriority:mediumFunctional bugs, performance regressions, broken featuresFunctional bugs, performance regressions, broken featuresStatus: Open.#5131 In apache/datafusion-comet;[EPIC] ANSI mode audit follow-ups (vs Spark 4.1.1)
area:expressionsExpression evaluationExpression evaluationbugSomething isn't workingSomething isn't workingpriority:mediumFunctional bugs, performance regressions, broken featuresFunctional bugs, performance regressions, broken featuresStatus: Open.#5078 In apache/datafusion-comet;Native ANSI errors raised as Arrow errors bypass SparkError conversion (wide decimal, decimal divide, decimal-to-decimal cast)
area:expressionsExpression evaluationExpression evaluationbugSomething isn't workingSomething isn't workingpriority:mediumFunctional bugs, performance regressions, broken featuresFunctional bugs, performance regressions, broken featuresStatus: Open.#5072 In apache/datafusion-comet;cast_map_to_map drops entries null buffer and ignores target sorted flag
area:expressionsExpression evaluationExpression evaluationbugSomething isn't workingSomething isn't workingpriority:lowMinor issues, test failures, tooling, cosmeticMinor issues, test failures, tooling, cosmeticStatus: Open.#5097 In apache/datafusion-comet;fix: fall back to Spark for negative-scale decimal casts and arithmetic
area:expressionsExpression evaluationExpression evaluationbugSomething isn't workingSomething isn't workingStatus: Open (in progress).Add mode to run Comet planning but execute with Spark, so users can assess potential Comet coverage
enhancementNew feature or requestNew feature or requestStatus: Open.#5335 In apache/datafusion-comet;Use end to end microbenchmarks to prevent performance regressions between releases
area:ciCI/CD, GitHub Actions, build toolingCI/CD, GitHub Actions, build toolingenhancementNew feature or requestNew feature or requestStatus: Open.#5373 In apache/datafusion-comet;Task input metrics are unreliable when a native block mixes a native scan with a JVM input
area:scanParquet scan / data readingParquet scan / data readingbugSomething isn't workingSomething isn't workingpriority:mediumFunctional bugs, performance regressions, broken featuresFunctional bugs, performance regressions, broken featuresStatus: Open.#5336 In apache/datafusion-comet;NegativeExpr::get_propertiesreports child ordering and range unchangedarea:expressionsExpression evaluationExpression evaluationbugSomething isn't workingSomething isn't workingpriority:mediumFunctional bugs, performance regressions, broken featuresFunctional bugs, performance regressions, broken featuresStatus: Open.#5330 In apache/datafusion-comet;