Skip to content

Default values doesn't work with native_datafusion #3515

@comphead

Description

@comphead

Describe the bug

During DF52 migration #3046 the test
select column with default value stopped to work. The default values are not applied

  == Results ==
  !== Correct Answer - 1 ==   == Spark Answer - 1 ==
   struct<col2:boolean>       struct<col2:boolean>
  ![true]                     [null] (QueryTest.scala:244)

The reason DF expects default values to be sent before Column expressions to replace respective value by column name, however currently Comet sends default values after Column

Steps to reproduce

make core && RUST_BACKTRACE=1 COMET_PARQUET_SCAN_IMPL=native_datafusion ./mvnw test -Dsuites="org.apache.comet.CometFuzzTestSuite select column with default value"

Expected behavior

No response

Additional context

No response

Metadata

Metadata

Assignees

Labels

bugSomething isn't working

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions