[BUG]: BadRequest is not handled in TableMigrationStatusRefresher

[nfx]

Is there an existing issue for this?

• I have searched the existing issues

Current Behavior

BadRequest: DS_FAILED_REQUEST_TO_OPEN_DS_SERVER: Failed request to sharing server
Endpoint: ...
Method: GET
HTTP Code: 403
Status Line: 403
Body: {"error_code":"PERMISSION_DENIED","message":"User does not have SELECT on Share 'customer_azure_billing_share'.","details":[{"@type":"type.googleapis.com/google.rpc.RequestInfo","request_id":"...","serving_data":""}]}
[Trace Id: e3d01b9439952df6a282966935e5af3f]

Expected Behavior

No response

Steps To Reproduce

No response

Cloud

AWS

Operating System

macOS

Version

latest via Databricks CLI

Relevant log output

File /local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/labs/ucx/hive_metastore/table_migration_status.py:91, in TableMigrationStatusRefresher.get_seen_tables(self)
     89 def get_seen_tables(self) -> dict[str, str]:
     90     seen_tables: dict[str, str] = {}
---> 91     for schema in self._iter_schemas():
     92         try:
     93             # ws.tables.list returns Iterator[TableInfo], so we need to convert it to a list in order to catch the exception
     94             tables = list(self._ws.tables.list(catalog_name=schema.catalog_name, schema_name=schema.name))

File /local_disk0/.ephemeral_nfs/cluster_libraries/python/lib/python3.10/site-packages/databricks/labs/ucx/hive_metastore/table_migration_status.py:159, in TableMigrationStatusRefresher._iter_schemas(self)
    157 for catalog in self._ws.catalogs.list():
    158     try:
--> 159         yield from self._ws.schemas.list(catalog_name=catalog.name)
    160     except NotFound:
    161         logger.warning(f"Catalog {catalog.name} no longer exists. Skipping checking its migration status.")