Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Failure during catalog upsert leads to inconsistent state #23557

Open
piotrrzysko opened this issue Sep 25, 2024 · 1 comment
Open

Failure during catalog upsert leads to inconsistent state #23557

piotrrzysko opened this issue Sep 25, 2024 · 1 comment

Comments

@piotrrzysko
Copy link
Member

In CoordinatorDynamicCatalogManager, when a new catalog is created, the in-memory map storing active catalogs is updated before calling CatalogStore to upsert the catalog:

activeCatalogs.put(catalogName, catalog.getCatalog());
catalogStore.addOrReplaceCatalog(catalogProperties);

If the upsert fails (for example, if FileCatalogStore throws an exception due to an inability to store the catalog's properties), the catalog is still considered active, even though it hasn't been persisted.

@hashhar
Copy link
Member

hashhar commented Sep 27, 2024

FYI @dain. We'll propose a fix and send a PR for this soon.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

No branches or pull requests

2 participants