Shouldn't data be open and free?
Much data is open. Platforms like Reddit and LinkedIn have made large volumes of
data available or accessible at various points, and open datasets remain a valuable
resource. But not all data is open, not all open data is structured for training,
and assembling it from dozens of scattered sources is expensive work. The point is,
to get all the data, in one package, to make specific training scenarios easy.
AIDC used to operate under a different name — what changed?
Yes, we started as a non-profit data distribution platform. Over time it became
clear that a sustainable commercial model — with proper auditing, licensing
infrastructure, and active marketing — would do more for the data ecosystem than
a non-profit could. We transitioned to AIDC as a commercial marketplace while
keeping our commitment to the data community. We will be actively contributing to
open source focused on data transformation making it easier to convert data from
various sources to better structures, such as JSON and JSONL for training purposes.