Skip to content

misc(events-processor) Refactor processors to easily allow new pipelines #606

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
wants to merge 1 commit into
base: main
Choose a base branch
from
Open

misc(events-processor) Refactor processors to easily allow new pipelines #606

wants to merge 1 commit into from

Conversation

@vincent-pochet
Copy link
Contributor

@vincent-pochet vincent-pochet commented Oct 14, 2025 •
edited
Loading

Context

This PR is part of the Pre-aggregation epic

The main goal of this feature is to setup a complete aggregation pipeline that will be leveraged to compute the customer usage without re-querying the full set of events.

Description

This PR refactor the current event processing pipeline, in order to ease the creation of new pipelines for:

  • The re-enrichment of existing events in order to backfill the events_enriched_expanded table on clickhouse
  • The re-processing of events in case of change on plan configuration (updated/added/removed charge or charge filters)
@vincent-pochet vincent-pochet mentioned this pull request Oct 14, 2025
Open
@vincent-pochet vincent-pochet changed the title misc(events-processor) Refactor processors to allow adding new pipelines Oct 17, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

2 participants

@vincent-pochet