Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Test failure: test_delete_ws_groups_should_delete_renamed_and_reflected_groups_only #3319

Open
github-actions bot opened this issue Nov 18, 2024 · 1 comment
Open

Test failure: test_delete_ws_groups_should_delete_renamed_and_reflected_groups_only #3319

github-actions bot opened this issue Nov 18, 2024 · 1 comment
Labels
bug Something isn't working

Comments

@github-actions
Copy link

❌ test_delete_ws_groups_should_delete_renamed_and_reflected_groups_only: TimeoutError: Timed out after 0:05:00 (5m22.528s) 
TimeoutError: Timed out after 0:05:00
[gw2] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:20 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sefv6.groups] fetching groups inventory
05:20 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 629, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sefv6`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:20 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sefv6.groups] crawling new set of snapshot data for groups
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 81 account groups
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
05:20 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sefv6.groups] found 1 new records for groups
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration...
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 WARNING [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 738951303176656 (renamed to ucx-temp-ucx_G2qmb-ra78a57ebf)
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 738951303176656 (renamed to ucx-temp-ucx_G2qmb-ra78a57ebf)
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete.
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 81 account groups
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:20 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sefv6.groups] fetching groups inventory
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration...
05:20 ERROR [databricks.labs.ucx.workspace_access.groups] Skipping ucx_G2qmb-ra78a57ebf: group already exists in workspace
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
05:20 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sefv6.groups] fetching groups inventory
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Starting to remove 1 migrated workspace groups...
05:20 WARNING [databricks.labs.ucx.workspace_access.groups] Not deleting group ucx-temp-ucx_G2qmb-ra78a57ebf(id=738951303176656) (originally ucx_G2qmb-ra78a57ebf): its migrated account group (ucx_G2qmb-ra78a57ebf) cannot be found.
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration omitted all 0 workspace groups; assuming deleted.
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:20 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sefv6.groups] fetching groups inventory
05:20 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 629, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_sefv6`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
05:20 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sefv6.groups] crawling new set of snapshot data for groups
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 81 account groups
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
05:20 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sefv6.groups] found 1 new records for groups
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration...
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 WARNING [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group still has old name; still waiting for rename to take effect: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx_G2qmb-ra78a57ebf (id=738951303176656) -> ucx-temp-ucx_G2qmb-ra78a57ebf
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 738951303176656 (renamed to ucx-temp-ucx_G2qmb-ra78a57ebf)
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 738951303176656 (renamed to ucx-temp-ucx_G2qmb-ra78a57ebf)
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete.
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 81 account groups
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
05:20 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sefv6.groups] fetching groups inventory
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration...
05:20 ERROR [databricks.labs.ucx.workspace_access.groups] Skipping ucx_G2qmb-ra78a57ebf: group already exists in workspace
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
05:20 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_sefv6.groups] fetching groups inventory
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Starting to remove 1 migrated workspace groups...
05:20 WARNING [databricks.labs.ucx.workspace_access.groups] Not deleting group ucx-temp-ucx_G2qmb-ra78a57ebf(id=738951303176656) (originally ucx_G2qmb-ra78a57ebf): its migrated account group (ucx_G2qmb-ra78a57ebf) cannot be found.
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
05:20 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
05:20 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration omitted all 0 workspace groups; assuming deleted.
[gw2] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #272
@github-actions github-actions bot added the bug Something isn't working label Nov 18, 2024
@github-actions GitHub Actions
Copy link
Author

❌ test_delete_ws_groups_should_delete_renamed_and_reflected_groups_only: TimeoutError: Timed out after 0:05:00 (5m27.293s) 
TimeoutError: Timed out after 0:05:00
[gw8] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 6 WorkspaceGroup
08:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_skdnh.groups] fetching groups inventory
08:35 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 673, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_skdnh`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
08:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_skdnh.groups] crawling new set of snapshot data for groups
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 6 WorkspaceGroup
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 82 account groups
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
08:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_skdnh.groups] found 1 new records for groups
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration...
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx_G9t0l-ra78a57f8a (id=839969125692788) -> ucx-temp-ucx_G9t0l-ra78a57f8a
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G9t0l-ra78a57f8a (id=839969125692788) -> ucx-temp-ucx_G9t0l-ra78a57f8a
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G9t0l-ra78a57f8a (id=839969125692788) -> ucx-temp-ucx_G9t0l-ra78a57f8a
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx_G9t0l-ra78a57f8a (id=839969125692788) -> ucx-temp-ucx_G9t0l-ra78a57f8a
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 839969125692788 (renamed to ucx-temp-ucx_G9t0l-ra78a57f8a)
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 839969125692788 (renamed to ucx-temp-ucx_G9t0l-ra78a57f8a)
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete.
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 81 account groups
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
08:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_skdnh.groups] fetching groups inventory
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration...
08:35 ERROR [databricks.labs.ucx.workspace_access.groups] Skipping ucx_G9t0l-ra78a57f8a: group already exists in workspace
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
08:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_skdnh.groups] fetching groups inventory
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Starting to remove 1 migrated workspace groups...
08:35 WARNING [databricks.labs.ucx.workspace_access.groups] Not deleting group ucx-temp-ucx_G9t0l-ra78a57f8a(id=839969125692788) (originally ucx_G9t0l-ra78a57f8a): its migrated account group (ucx_G9t0l-ra78a57f8a) cannot be found.
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 65 WorkspaceGroup
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 65 WorkspaceGroup
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration omitted all 0 workspace groups; assuming deleted.
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 6 WorkspaceGroup
08:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_skdnh.groups] fetching groups inventory
08:35 DEBUG [databricks.labs.ucx.framework.crawlers] Inventory table not found
Traceback (most recent call last):
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/framework/crawlers.py", line 152, in _snapshot
    cached_results = list(fetcher())
  File "/home/runner/work/ucx/ucx/src/databricks/labs/ucx/workspace_access/groups.py", line 673, in _try_fetch
    for row in self._sql_backend.fetch(f"SELECT * FROM {escape_sql_identifier(self.full_name)}"):
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 344, in fetch_all
    execute_response = self.execute(
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 268, in execute
    self._raise_if_needed(status)
  File "/home/runner/work/ucx/ucx/.venv/lib/python3.10/site-packages/databricks/labs/lsql/core.py", line 478, in _raise_if_needed
    raise NotFound(error_message)
databricks.sdk.errors.platform.NotFound: [TABLE_OR_VIEW_NOT_FOUND] The table or view `hive_metastore`.`dummy_skdnh`.`groups` cannot be found. Verify the spelling and correctness of the schema and catalog.
If you did not qualify the name with a schema, verify the current_schema() output, or qualify the name with the correct schema and catalog.
To tolerate the error on drop use DROP VIEW IF EXISTS or DROP TABLE IF EXISTS. SQLSTATE: 42P01; line 1 pos 14
08:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_skdnh.groups] crawling new set of snapshot data for groups
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 6 WorkspaceGroup
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 82 account groups
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Group listing provided, a subset of all groups will be migrated
08:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_skdnh.groups] found 1 new records for groups
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Starting to rename 1 groups for migration...
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Renaming group: ucx_G9t0l-ra78a57f8a (id=839969125692788) -> ucx-temp-ucx_G9t0l-ra78a57f8a
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G9t0l-ra78a57f8a (id=839969125692788) -> ucx-temp-ucx_G9t0l-ra78a57f8a
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename has possibly taken effect: ucx_G9t0l-ra78a57f8a (id=839969125692788) -> ucx-temp-ucx_G9t0l-ra78a57f8a
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group rename is assumed complete: ucx_G9t0l-ra78a57f8a (id=839969125692788) -> ucx-temp-ucx_G9t0l-ra78a57f8a
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 839969125692788 (renamed to ucx-temp-ucx_G9t0l-ra78a57f8a)
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 64 WorkspaceGroup
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration reflects renamed group: 839969125692788 (renamed to ucx-temp-ucx_G9t0l-ra78a57f8a)
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration showed all 1 renamed groups; assuming complete.
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing account groups with id,displayName,externalId...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 81 account groups
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName,meta,externalId,members,roles,entitlements ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 5 WorkspaceGroup
08:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_skdnh.groups] fetching groups inventory
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Starting to reflect 1 account groups into workspace for migration...
08:35 ERROR [databricks.labs.ucx.workspace_access.groups] Skipping ucx_G9t0l-ra78a57f8a: group already exists in workspace
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=Group) with id,displayName,externalId,meta ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 59 Group
08:35 DEBUG [databricks.labs.ucx.framework.crawlers] [hive_metastore.dummy_skdnh.groups] fetching groups inventory
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Starting to remove 1 migrated workspace groups...
08:35 WARNING [databricks.labs.ucx.workspace_access.groups] Not deleting group ucx-temp-ucx_G9t0l-ra78a57f8a(id=839969125692788) (originally ucx_G9t0l-ra78a57f8a): its migrated account group (ucx_G9t0l-ra78a57f8a) cannot be found.
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 65 WorkspaceGroup
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Listing workspace groups (resource_type=WorkspaceGroup) with id,displayName ...
08:35 INFO [databricks.labs.ucx.workspace_access.groups] Found 65 WorkspaceGroup
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration does not contain any of the 0 deleted workspace groups; possibly deleted.
08:35 DEBUG [databricks.labs.ucx.workspace_access.groups] Group enumeration omitted all 0 workspace groups; assuming deleted.
[gw8] linux -- Python 3.10.15 /home/runner/work/ucx/ucx/.venv/bin/python

Running from nightly #278

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
bug Something isn't working
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
0 participants