Close Menu
Technology Mag

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    I’m an Outdoor Writer. I’m Shopping These 55 Deals From REI’s 4th of July Sale

    July 5, 2025

    Samsung is about to find out if Ultra is enough

    July 5, 2025

    Everything You Can Do in the Photoshop Mobile App

    July 5, 2025
    Facebook X (Twitter) Instagram
    Subscribe
    Technology Mag
    Facebook X (Twitter) Instagram YouTube
    • Home
    • News
    • Business
    • Games
    • Gear
    • Reviews
    • Science
    • Security
    • Trending
    • Press Release
    Technology Mag
    Home » AI image training dataset found to include child sexual abuse imagery
    News

    AI image training dataset found to include child sexual abuse imagery

    News RoomBy News RoomDecember 20, 20232 Mins Read
    Facebook Twitter Pinterest LinkedIn Reddit WhatsApp Email

    LAION-5B, a dataset used by Stable Diffusion creator Stability AI and Google’s Imagen image generators, included at least 1,679 illegal images scraped from social media posts and popular adult websites. 

    The researchers began combing through the LAION dataset in September 2023 to investigate how much, if any, child sexual abuse material (CSAM) was present. They looked through hashes or the image’s identifiers. These were sent to CSAM detection platforms like PhotoDNA and verified by the Canadian Centre for Child Protection. 

    The dataset does not keep repositories of the images, according to the LAION website. It indexes the internet and contains links to images and alt text that it scrapes. 

    LAION, the nonprofit that manages the dataset, told Bloomberg it has a “zero-tolerance” policy for harmful content and would temporarily remove the datasets online. Stability AI told the publication that it has guidelines against the misuse of its platforms. The company said that while it trained its models with LAION-5B, it focused on a portion of the dataset and fine-tuned it for safety. 

    Stanford’s researchers said the presence of CSAM does not necessarily influence the output of models trained on the dataset. Still, there’s always the possibility the model learned something from the images. 

    “The presence of repeated identical instances of CSAM is also problematic, particularly due to its reinforcement of images of specific victims,” the report said. 

    The researchers acknowledged it would be difficult to fully remove the problematic content, especially from the AI models trained on it. They recommended that models trained on LAION-5B, such as Stable Diffusion 1.5, “should be deprecated and distribution ceased where feasible.” Google released a new version of Imagen but has not made public which dataset it trained on. 

    US attorneys general have called on Congress to set up a committee to investigate the impact of AI on child exploitation and prohibit the creation of AI-generated CSAM. 

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp Reddit Email
    Previous ArticleLamborghini’s Revuelto Is the Outstanding Hybrid of 2023
    Next Article Everything You Need to Work From Home Like a Pro

    Related Posts

    Samsung is about to find out if Ultra is enough

    July 5, 2025

    The Ploopy Knob is an open-source control dial for your PC

    July 4, 2025

    Laid-off workers should use AI to manage their emotions, says Xbox exec

    July 4, 2025

    Fairphone 6 gets a 10/10 on repairability

    July 4, 2025

    New Galaxy Z Fold 7 leaks may give first real look at Samsung’s slimmer foldable

    July 4, 2025

    This is not a tattoo robot

    July 4, 2025
    Our Picks

    Samsung is about to find out if Ultra is enough

    July 5, 2025

    Everything You Can Do in the Photoshop Mobile App

    July 5, 2025

    The Promise and Peril of Digital Security in the Age of Dictatorship

    July 5, 2025

    The Ploopy Knob is an open-source control dial for your PC

    July 4, 2025
    • Facebook
    • Twitter
    • Pinterest
    • Instagram
    • YouTube
    • Vimeo
    Don't Miss
    News

    Laid-off workers should use AI to manage their emotions, says Xbox exec

    By News RoomJuly 4, 2025

    The sweeping layoffs announced by Microsoft this week have been especially hard on its gaming…

    Despite Protests, Elon Musk Secures Air Permit for xAI

    July 4, 2025

    This Is Why Tesla’s Robotaxi Launch Needed Human Babysitters

    July 4, 2025

    Fairphone 6 gets a 10/10 on repairability

    July 4, 2025
    Facebook X (Twitter) Instagram Pinterest
    • Privacy Policy
    • Terms of use
    • Advertise
    • Contact
    © 2025 Technology Mag. All Rights Reserved.

    Type above and press Enter to search. Press Esc to cancel.