Skip to content

Refactor container enrichers#629

Merged
Mitch Dawson (mitchdawson1982) merged 28 commits intomainfrom
container-transformer-refactor
Feb 6, 2026
Merged

Refactor container enrichers#629
Mitch Dawson (mitchdawson1982) merged 28 commits intomainfrom
container-transformer-refactor

Conversation

@mitchdawson1982
Copy link
Copy Markdown
Contributor

@mitchdawson1982 Mitch Dawson (mitchdawson1982) commented Jan 26, 2026

The existing EnrichContainerTransformer appears to have only been applied to Glue & Postgres ingestions. This PR refactors this enricher into 3 seperate ones for ownership, properties and tags. This approach maintains relationships between databases and schemas in the postgresql ingestion.

There is currently user research on going in dev limiting the ability to test other in ingestions.

Tested on:

  • postgres_hmpps_calculate_release_dates
  • glue_common_platform
  • glue_contracts
  • glue_courts_criminal
  • glue_courts_family
  • glue_dlpes
  • glue_fines
  • glue_just_link
  • glue_sop
  • glue_xhibit_preprocessed

@mitchdawson1982 Mitch Dawson (mitchdawson1982) marked this pull request as ready for review February 3, 2026 11:55
…_container_transformer.py to streamline code
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Nice job!

@mitchdawson1982 Mitch Dawson (mitchdawson1982) merged commit 4d3486f into main Feb 6, 2026
2 of 3 checks passed
@mitchdawson1982 Mitch Dawson (mitchdawson1982) deleted the container-transformer-refactor branch February 6, 2026 16:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants