Skip to content

Commit

Permalink
chore: imrpove collapse_urns description
Browse files Browse the repository at this point in the history
  • Loading branch information
Dimitri GRISARD committed Jan 26, 2024
1 parent 440e9f4 commit dd51020
Showing 1 changed file with 4 additions and 1 deletion.
Original file line number Diff line number Diff line change
Expand Up @@ -302,7 +302,10 @@ class ElasticsearchSourceConfig(PlatformInstanceConfigMixin, EnvConfigMixin):
description="Configs to ingest data profiles from ElasticSearch.",
)
collapse_urns: CollapseUrns = Field(
default_factory=CollapseUrns, description="Urn of collapse."
default_factory=CollapseUrns,
description="""List of regex patterns to remove from the name of the URN. All of the indices before removal of URNs are considered as the same dataset. These are applied in order for each URN.
The main case where you would want to have multiple of these if the name where you are trying to remove suffix from have different formats.
e.g. ending with -YYYY-MM-DD as well as ending -epochtime would require you to have 2 regex patterns to remove the suffixes across all URNs.""",
)

def is_profiling_enabled(self) -> bool:
Expand Down

0 comments on commit dd51020

Please sign in to comment.