Skip to content

[GLUTEN-10618][VL] Update input iterator metrics name to include more details#10619

Merged
marin-ma merged 2 commits into
apache:mainfrom
marin-ma:modify-input-iterator-metrics
Sep 8, 2025
Merged

[GLUTEN-10618][VL] Update input iterator metrics name to include more details#10619
marin-ma merged 2 commits into
apache:mainfrom
marin-ma:modify-input-iterator-metrics

Conversation

@marin-ma

@marin-ma marin-ma commented Sep 3, 2025

Copy link
Copy Markdown
Contributor

No description provided.

@github-actions github-actions Bot added CORE works for Gluten Core VELOX CLICKHOUSE labels Sep 3, 2025
@github-actions

github-actions Bot commented Sep 3, 2025

Copy link
Copy Markdown
@github-actions

github-actions Bot commented Sep 3, 2025

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

// For input from shuffle, the time of shuffle read is inclusive to the metrics.
SQLMetrics.createNanoTimingMetric(
sparkContext,
"time of input iterator (shuffle read time inclusive)")

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

name is too long. Can you rename it as "time of reducer input"

// For input from broadcast, the time of broadcasting is exclusive.
SQLMetrics.createNanoTimingMetric(
sparkContext,
"time of input iterator (broadcast time exclusive)")

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

change to "time of broadcast input"

// For other occasions, e.g. fallback, union, the time of the previous pipeline is inclusive.
SQLMetrics.createNanoTimingMetric(
sparkContext,
"time of input iterator (previous pipeline time inclusive)")

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

time of operator input

@github-actions

github-actions Bot commented Sep 8, 2025

Copy link
Copy Markdown

Run Gluten Clickhouse CI on x86

@marin-ma marin-ma merged commit 736e71b into apache:main Sep 8, 2025
98 of 100 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

CLICKHOUSE CORE works for Gluten Core VELOX

2 participants