Skip to content

[GLUTEN-9288][VL] Enable array_prepend function for spark 3.5+#9305

Merged
philo-he merged 5 commits into
apache:mainfrom
dcoliversun:gluten-9288
Apr 15, 2025
Merged

[GLUTEN-9288][VL] Enable array_prepend function for spark 3.5+#9305
philo-he merged 5 commits into
apache:mainfrom
dcoliversun:gluten-9288

Conversation

@dcoliversun

Copy link
Copy Markdown
Contributor

What changes were proposed in this pull request?

This PR aims to enable array_prepend function for spark3.5+.

(Fixes: #9288)

How was this patch tested?

Unit test.

@github-actions github-actions Bot added CORE works for Gluten Core VELOX CLICKHOUSE labels Apr 13, 2025
@github-actions

Copy link
Copy Markdown
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@dcoliversun

dcoliversun commented Apr 14, 2025

Copy link
Copy Markdown
Contributor Author

cc @philo-he @jinchengchenghh Could you please have a review for this? Thanks

@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@philo-he philo-he left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good! Just two trivial comments. Thanks!

original: Expression): ExpressionTransformer = {
children match {
case Seq(left, posExpr, right, _) if posExpr.original == Literal(1) =>
// transformer to array_prepend implement in velox

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nit: remove this comment or rephrase it like: Transformer for array_prepend. (follow community comment style: capitalize initial letter and end up with period).

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Update with Transformer for array_prepend.

@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

1 similar comment
@github-actions

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@philo-he philo-he left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks!

@philo-he philo-he merged commit dd5a1a9 into apache:main Apr 15, 2025
@dcoliversun dcoliversun deleted the gluten-9288 branch April 15, 2025 04:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CORE works for Gluten Core VELOX

2 participants