SEDIMARK Logo

A Data Orchestrator to Manage the SEDIMARK Ecosystem

SEDIMARK · February 26, 2024
Data Orchestrator Screenshot Mage.AI

Data has become a growing business of the utmost importance in the recent years of IoT technological expansion, driving crucial decision-making systems at the EU and global level, impacting all domains: industry, politics and economy, society and individuals, as well as the environment.

As the volume of instreaming data being collected, stored and processed is constantly expanding, most systems and techniques to absorb efficiently, appropriately and in a scalable manner such data, are lacking or rapidly overwhelmed by the technological revolutions. Furthermore, of great concern, the quantity of circulating private and sensitive information linked to individuals and organizations. Consequently, the data is insufficiently managed and maintained, too often misunderstood due to its complexity, lacking in high quality standards, ill-adapted to large-scale AI analytics, which in turn leads to inappropriate handling, sharing and misuse of data across borders and domains, even though they conform to European RGPD and FAIR* principles!  

For this reason, SEDIMARK uses a data orchestrator called “Mage.ai” to : (i) better organize integration of multiple data sources, applications, toolboxes, services and systems, (ii) render scalable the data workflows to improve performance and reduce bottlenecks, (iii) ensure data consistency, harmony and highest quality, (iv) guarantee data privacy and security compliant with EU regulations by anonymization and decentralized systems, and finally to (v) minimize and mitigate potential risks by automating schedules for data and system maintenance, monitoring and alerting procedures. On top of all, the orchestrator enables all actors of the data to easily manage, adapt and visualize the data situation. 

(*) Findable easily, Accessible, Interoperable, Reusable

Subscribe to SEDIMARK!

* required

🌟 Exciting news! Our "Novel Data Connector Tool based on DLT for decentralized data and services marketplace" is also featured on the @StartUpEU Innovation Radar! 🚀 Explore it on 👉 https://innovation-radar.ec.europa.eu/innovation/56723

UCD participated in ADBIS 2024 held in Bayonne, France. @ucddublin presented a paper entitled “Entity Matching with Large Language Models as Weak and Strong labellers”, discussing the results of the data curation activities of SEDIMARK for improving the quality of datasets.

High-quality metadata is key to better dataset recommendations! 🚀 SEDIMARK is working on novel techniques to enhance dataset metadata, improving discoverability and UX. Check out how enriched metadata is transforming dataset recommender systems!
🌐

Load More
crossmenu