Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Allow multiple columns in RegexTransformIngestor. #1838

Merged

Conversation

aaronweeden
Copy link
Contributor

@aaronweeden aaronweeden commented May 8, 2024

NOTE: This PR should not be merged unless ubccr/xdmod-ondemand#50 is also merged; otherwise xdmod-ondemand ingestion will break.

Description

This PR allows the RegexTransformIngestor to transform multiple columns.

Motivation and Context

This enables ubccr/xdmod-ondemand#50, specifically the ability to transform app, request_path, reverse_proxy_host, and reverse_proxy_port in the same pipeline action (ondemand.log-ingestion.normalize-staging).

Tests performed

I tested ingesting logs on my port on xdmod-dev with the changes from ubccr/xdmod-ondemand#50 and the PRs on which it depends.

Checklist:

  • The pull request description is suitable for a Changelog entry
  • The milestone is set correctly on the pull request
  • The appropriate labels have been added to the pull request

@aaronweeden aaronweeden added the enhancement Enhancement of the functionality of an existing feature label May 8, 2024
@aaronweeden aaronweeden added this to the 11.0.0 milestone May 8, 2024
@aaronweeden aaronweeden force-pushed the allow-multiple-regex-transforms branch 2 times, most recently from 7b2d0bf to 23bdcc5 Compare May 8, 2024 18:46
@aaronweeden aaronweeden added the Open OnDemand Specific changes for Open OnDemand Integration label May 13, 2024
@aaronweeden aaronweeden force-pushed the allow-multiple-regex-transforms branch from 23bdcc5 to 75f094e Compare May 13, 2024 13:18
@aaronweeden aaronweeden force-pushed the allow-multiple-regex-transforms branch 3 times, most recently from 37cb1bf to f65d4ef Compare May 14, 2024 13:13
@aaronweeden aaronweeden marked this pull request as ready for review May 14, 2024 13:13
@aaronweeden aaronweeden changed the title Allow multiple columns and multiple files in RegexTransformIngestor. Allow multiple columns in RegexTransformIngestor. May 14, 2024
@aaronweeden aaronweeden force-pushed the allow-multiple-regex-transforms branch 7 times, most recently from b4b61c9 to f604ab9 Compare May 15, 2024 15:18
@aaronweeden aaronweeden force-pushed the allow-multiple-regex-transforms branch 4 times, most recently from b68dbdf to 27fac1f Compare May 24, 2024 14:46
@aaronweeden aaronweeden force-pushed the allow-multiple-regex-transforms branch from 27fac1f to 7bdfdcf Compare June 11, 2024 17:11
@aaronweeden aaronweeden merged commit b07b800 into ubccr:xdmod11.0 Jun 11, 2024
4 checks passed
@aaronweeden aaronweeden deleted the allow-multiple-regex-transforms branch June 11, 2024 17:46
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
enhancement Enhancement of the functionality of an existing feature Open OnDemand Specific changes for Open OnDemand Integration
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants