Responsible Dataset Creation and Governance: Public Domain 12M

Submit
Responsible Dataset Creation and Governance: Public Domain 12Msubstack.com
substack.com

Responsible dataset creation and governance: Public domain 12M

AI summary of the linked article

Spawning has released Public Domain 12M (PD12M), a dataset of 12.4 million PD/CC0 image-caption pairs for training text-to-image models, available through Hugging Face. The company says it built the dataset from nearly 40 million PD/CC0 images on Source.Plus, filtering them by criteria including dimensions, safety scores, aesthetic scores, and human review, and checking them against the Do Not Train registry, which returned 0 matches. The images are hosted on AWS Open Data, a setup the article says reduces hosting costs for web hosts and allows versioned corrections, such as swapping out images flagged by Source.Plus users. A smaller subset, PD3M, contains 3.3 million images, and both are released under the CDLA-Permissive-2.0 license.

No comments yetWhat caught your eye? Start the discussion.