feat(ingest/bigquery): Support for View Labels

[ethan-cartwright]

Checklist

• The PR conforms to DataHub's Contributing Guideline (particularly Commit Message Format)
• Links to related issues (if applicable)
• Tests for the changes have been added/updated (if applicable)
• Docs related to the changes have been added/updated (if applicable). If a new feature has been added a Usage Guide has been added for the same.
• For any breaking change/potential downtime/deprecation/big changes an entry has been made in Updating DataHub

[ethan-cartwright]

todo: add option_name = "labels" to retrieve labels in the views query in the queries.py eg.

SELECT
  t.table_catalog as table_catalog,
  t.table_schema as table_schema,
  t.table_name as table_name,
  t.table_type as table_type,
  t.creation_time as created,
  ts.last_modified_time as last_altered,
  tos.OPTION_VALUE as comment,
  t.is_insertable_into,
  t.ddl as view_definition,
  ts.row_count,
  ts.size_bytes
FROM
  `acryl-staging.ethan_test_dataset.INFORMATION_SCHEMA.TABLES` t
  JOIN `acryl-staging.ethan_test_dataset.__TABLES__` as ts ON ts.table_id = t.TABLE_NAME
  LEFT JOIN `acryl-staging.ethan_test_dataset.INFORMATION_SCHEMA.TABLE_OPTIONS` as tos ON t.table_schema = tos.table_schema
  AND t.TABLE_NAME = tos.TABLE_NAME
  AND tos.OPTION_NAME = "labels"
WHERE
  table_type in ('VIEW', 'MATERIALIZED_VIEW')
  AND t.table_name = 'account_types'
ORDER BY
  table_schema ASC,
  table_name ASC;

[ethan-cartwright]

[asikowitz]

Just some style comments. Otherwise LGTM although would like a second look on the SQL query

[asikowitz]

Suggested change

	# Find all matches in the labels string
	matches = re.findall(pattern, labels_str)
	labels_dict = {key: value for key, value in matches}
	return labels_dict
	# Map ?? to ??
	return dict(re.findall(pattern, labels_str))

I don't actually know what the keys and values of the returned dict represent. Let's document that somewhere

[ethan-cartwright]

Just some style comments. Otherwise LGTM although would like a second look on the SQL query

@hsheth2 can you take a look?

[ethan-cartwright]

Just some style comments. Otherwise LGTM although would like a second look on the SQL query

@hsheth2 can you take a look?

Harshal took a look and gave the go ahead. https://acryldata.slack.com/archives/C02ENS87APK/p1718410928205629?thread_ts=1718392351.832049&cid=C02ENS87APK

[anshbansal]

Airflow problem is separate