Exploring cutting-edge data ecosystems: A comprehensive analysis

Basic Glitch@sh.itjust.works · 19 days

Data-driven innovation has recently changed the mindset in data sharing from centralized architectures and monolithic data exploitation by data providers (data platforms) to decentralized architectures and different data sharing options among all involved participants (data ecosystems).

Differences between the various data ecosystems are not clear, making it hard to choose the most suitable for each use case, negatively impacting their adoption. Since the domain is growing fast, a review of the state-of-the-art data ecosystem initiatives is needed to analyze what each initiative offers, identify collaboration prospects, and highlight features for improvement and open research topics. In this paper, we review the state-of-the-art data ecosystem initiatives, describe their innovative aspects, compare their technical and business features, and identify open research challenges. We aim to assist practitioners in choosing the most suitable data ecosystem for their use cases and scientists to explore emerging research opportunities.

madnificent@lemmy.world · 19 days

Interesting read. I’ve glanced over sections and read others.

I’ve been involved in the use of some of these frameworks. They are good reference frameworks but they are most often overly heavy to get started and/or the implementation is most often not supporting what the marketing material suggests.

Good integration projects start from limited partners with limited datasets exchanging with each other knowing they want to exchange with more partners in the future. Limited can be two to seven and they can even be in the same organisation. Perhaps it works with more, I have not been involved in that. They contain only the necessary roles and know how they’ll expand. These frameworks are great to get the expansion options in place. However, to get something going we’ve seen that a cheap and structurally correct solution to data sharing gets the ball running more quickly and for longer, then an expensive and heavy project which needs all sorts of approvals (even if it would be superior).

Projects that start with the weight of all the roles filled in by different actors need substantial funding to get started and I don’t think they generally last after funding dried up. Projects faking their way through the extra roles and providing the most limited interpretation of some of these roles with the project having some (even vague) shared benefit seem to survive past the grant stage.

Get some basics right and get going is my advice. Identifiers, shared and extensible data models, and a clear way of sharing data.

I like these frameworks, they help set the stage, but my gosh do they see problems where there are none when a project is just getting started.

Basic Glitch@sh.itjust.works · 18 days

I must confess to this not being in my wheelhouse at all. I just started reading about the. esterday and I’m very interested in them as a people empowerment middle finger to the oligarchy

No idea how realistic this is but I find the idea of people eventually using these to achieve complete data sovereignty very interesting.

https://www.coalitioncommunitiescolor.org/ccc-news/2025/9/17/coming-soon-portlands-newest-digital-community-garden

I do appreciate hearing from people who actually understand what it’s saying though

madnificent@lemmy.world · 12 days

Our experience so far shows that using Linked Data can give you many apps that work together on parts of the data.

Depend on semantic data models (vocabularies of URIs such as foaf), use triples in your applications, and share these same triples whilst looking at the serialisation (such as xml, jsonld, ttl) as an implementation detail, and you’re a long way towards interoperable apps and information sharing.

If you have many interoperable apps and they can share data, then you’ve went a good distance towards and open market where software can compete. If the data is also openy available to you (as it should) then you took large steps towards sovereignty too. You’ll have a choice of applications to use and you can easily move the data between the applications.

Feel free to ask questions should you have any.

Basic Glitch@sh.itjust.works · 2 days

What about community data ecosystems, and community AI partnerships?

https://www.healthjustice.co/wp-content/uploads/2025/11/2Flow-chart-Health-Justice-NEW-UPDATE-26-oct.pdf

https://www.sciencedirect.com/science/article/pii/S002965542500199X