Google Data Catalog

GoogleData catalog

GCP Data Catalog is rapidly taking over the metadata management services, availability being on the google cloud. The google cloud platform is quite widely used for metadata management.

In the case of GCP, the data catalog is managed by Google Cloud and is a centralized service. It builds and manages an optimized index for searching data assets such as datasets, views, tables, files, streams, and spreadsheets. It uses the metadata of these assets to build up the index. Update or storage of assets causes the metadata to be updated or created and later be changed in the source systems.

Features

Serverless: Fully managed and scalable metadata management service; requires no infrastructure to set up or manage, allowing you to focus on your business.

Metadata as a service: Metadata management service for cataloging data assets via custom APIs and the UI, thereby providing a unified view of data wherever it is.

Central catalog: A flexible and powerful cataloging system for capturing both technical metadata (automatically) as well as business metadata (tags) in a structured format.

Search and discovery: A simple and easy-to-use UI with powerful structured search capabilities to quickly and easily find data assets; powered by the same Google search technology that supports Gmail and Drive.

Schematized metadata: Supports schematized tags (e.g., Enum, Bool, DateTime) and not just simple text tags—providing organizations rich and organized business metadata.

Cloud DLP integration: Discovers and classifies sensitive data, providing intelligence and helping to simplify the process of governing your data.

On-prem connectors: Ingest technical metadata from non-Google Cloud data assets to Data Catalog for a unified view of all your data assets.

Cloud IAM integration: Provides access-level controls and honors source ACLs for read, write, and search for the data assets; giving you enterprise-grade access control.

Governance: Offers a strong security and compliance foundation with Cloud DLP and Cloud IAM integrations.

Official website

Tutorial and documentation

Enter your contact information to continue reading