AI - Magda
Empowering organizations with easy and automated data management through Magda's dynamic platform, leveraging AI technology for advanced metadata discovery and authorization.
- Name
- Magda -https://github.com/magda-io/magda
- Last Audited At
About Magda
Magda is a dynamic data management platform that develops solutions for easy and automated data cataloguing and authorization using AI technology. The company's primary focus revolves around the Registry, an unopinionated datastore built on Postgres, where records are stored as JSON documents called aspects. Magda offers services for managing datasets and distributions with a range of aspects, enabling advanced metadata management and discovery.
Under development at Magda is an automated data cataloguing process that aims to produce high-quality metadata, a policy-based authorization system built on Open Policy Agent, and storage for datasets. The Registry's core functionality includes the use of Minions – services that listen for changes or new records, perform operations, and write results back to the registry.
Minions are responsible for tasks such as checking for broken links, managing quality ratings, and more. Magda also provides Search functionality, where datasets and distributions in the Registry are indexed and searched using ElasticSearch. Lastly, Connectors facilitate data ingestion from external sources by copying their metadata into the Registry, expanding the scope of searchable information.