Skip to content

Conversation

@dingo4dev
Copy link
Contributor

@dingo4devdingo4dev commented Oct 16, 2025

Rationale for this change

This PR introduces support for multi-part namespaces, enabling more flexible and organized data layouts. This feature allows users to structure their tables within nested hierarchies (e.g., ('database', 'schema', 'table')), which is a common pattern in many data warehouse systems.

The level of support varies depending on the underlying catalog implementation. Here's a summary of the changes:

Catalog ImplementationMulti-Part Namespace SupportNotes
REST Catalog✅ YesFully supports multi-part namespaces as defined by the REST spec.
DynamoDB Catalog✅ YesThe namespace is represented as a composite key.
File Catalog✅ YesNamespace parts are mapped to directory hierarchies in the file system.
In-Memory Catalog✅ YesSupports multi-part namespaces for testing purposes.
Hive Catalog❌ NoSpark and Hive Metastore do not support multi-part namespaces.
Glue Catalog❌ NoUses AWS Glue databases which do not support multi-part namespaces.

closes#2240

Are these changes tested?

Are there any user-facing changes?

@dingo4devdingo4dev changed the title feat: Add support for multi-part namespacesfeat: add support for multipart namespacesOct 16, 2025
@dingo4devdingo4devforce-pushed the feat/mutipart-namesapce branch from 52d7283 to c8cf40aCompareNovember 12, 2025 16:40
Enables catalogs to support hierarchical organization of tables through multi-part namespaces. Introduces changes to the Catalog class and its implementations (DynamoDB, REST, SQL) to handle multi-part namespaces. A new document is added to explain the usage of the multi-part namespace feature. enable multipart namespace Multipart namespace efers to a namespace that is structured with multiple levels or parts and default separated by a delmiiter dot (`.`)
improved type handling and added utility methods
@dingo4devdingo4devforce-pushed the feat/mutipart-namesapce branch from 215bd58 to cc97382CompareNovember 13, 2025 11:37
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Feature Request] Add Support for Multipart Namespace

1 participant

@dingo4dev