Data Mesh Manager

Architecture

Data Mesh Manager is a Software as a Service (SaaS) or self-hosted application.

Users interact with the Data Mesh Manager website to discover data products, manage data contracts, request and approve access, and create and track governance policies. Data Mesh Manager sends notifications to users, e.g., when a new data usage agreement was requested.

Data Mesh Manager has an extensive API to integrate with other application and for data platform automation. As a key design principle, for security reasons, no connections are established into the customer's network. All connections are initiated by the customer and data is pushed to the Data Mesh Manager or polled for events.

Integrations

While Data Mesh Manager can be used fully standalone and all data can be updated manually, some automation is recommended.

  1. A component that pushes static data products and data contracts to Data Mesh Manager if they are stored in a Git repository, e.g., as part as a CI/CD pipeline step.
  2. The Data Contract CLI or other data quality engines that verify that data products comply with the data contract and send test results to Data Mesh Manager
  3. A component that synchronizes data assets from the data platform or from a data catalog to Data Mesh Manager
  4. A component that subscribes to events that triggers further automation in the data platform, e.g., to grant permissions or to notify consumers

All resources can have links to point the user to the specialized software systems, such as a data catalog, documentation, data platforms, notebooks, or dashboards.