Close Menu
Technology Mag

    Subscribe to Updates

    Get the latest creative news from FooBar about art, design and business.

    What's Hot

    Chatbots can be manipulated through flattery and peer pressure

    August 31, 2025

    The Verge’s favorite gifts for book lovers

    August 31, 2025

    Meta is struggling to rein in its AI chatbots

    August 31, 2025
    Facebook X (Twitter) Instagram
    Subscribe
    Technology Mag
    Facebook X (Twitter) Instagram YouTube
    • Home
    • News
    • Business
    • Games
    • Gear
    • Reviews
    • Science
    • Security
    • Trending
    • Press Release
    Technology Mag
    Home » AI image training dataset found to include child sexual abuse imagery
    News

    AI image training dataset found to include child sexual abuse imagery

    News RoomBy News RoomDecember 20, 20232 Mins Read
    Facebook Twitter Pinterest LinkedIn Reddit WhatsApp Email

    LAION-5B, a dataset used by Stable Diffusion creator Stability AI and Google’s Imagen image generators, included at least 1,679 illegal images scraped from social media posts and popular adult websites. 

    The researchers began combing through the LAION dataset in September 2023 to investigate how much, if any, child sexual abuse material (CSAM) was present. They looked through hashes or the image’s identifiers. These were sent to CSAM detection platforms like PhotoDNA and verified by the Canadian Centre for Child Protection. 

    The dataset does not keep repositories of the images, according to the LAION website. It indexes the internet and contains links to images and alt text that it scrapes. 

    LAION, the nonprofit that manages the dataset, told Bloomberg it has a “zero-tolerance” policy for harmful content and would temporarily remove the datasets online. Stability AI told the publication that it has guidelines against the misuse of its platforms. The company said that while it trained its models with LAION-5B, it focused on a portion of the dataset and fine-tuned it for safety. 

    Stanford’s researchers said the presence of CSAM does not necessarily influence the output of models trained on the dataset. Still, there’s always the possibility the model learned something from the images. 

    “The presence of repeated identical instances of CSAM is also problematic, particularly due to its reinforcement of images of specific victims,” the report said. 

    The researchers acknowledged it would be difficult to fully remove the problematic content, especially from the AI models trained on it. They recommended that models trained on LAION-5B, such as Stable Diffusion 1.5, “should be deprecated and distribution ceased where feasible.” Google released a new version of Imagen but has not made public which dataset it trained on. 

    US attorneys general have called on Congress to set up a committee to investigate the impact of AI on child exploitation and prohibit the creation of AI-generated CSAM. 

    Share. Facebook Twitter Pinterest LinkedIn WhatsApp Reddit Email
    Previous ArticleLamborghini’s Revuelto Is the Outstanding Hybrid of 2023
    Next Article Everything You Need to Work From Home Like a Pro

    Related Posts

    Chatbots can be manipulated through flattery and peer pressure

    August 31, 2025

    The Verge’s favorite gifts for book lovers

    August 31, 2025

    Meta is struggling to rein in its AI chatbots

    August 31, 2025

    AI agents are science fiction not yet ready for primetime

    August 31, 2025

    Verizon’s ‘software issue’ has disconnected many wireless customers across the US

    August 30, 2025

    No, a Windows update probably didn’t brick your SSD

    August 30, 2025
    Our Picks

    The Verge’s favorite gifts for book lovers

    August 31, 2025

    Meta is struggling to rein in its AI chatbots

    August 31, 2025

    AI agents are science fiction not yet ready for primetime

    August 31, 2025

    How to See the Total Lunar Eclipse and Blood Moon on September 7

    August 31, 2025
    • Facebook
    • Twitter
    • Pinterest
    • Instagram
    • YouTube
    • Vimeo
    Don't Miss
    News

    Verizon’s ‘software issue’ has disconnected many wireless customers across the US

    By News RoomAugust 30, 2025

    Verizon has confirmed to customers in stores and online that its network is having an…

    No, a Windows update probably didn’t brick your SSD

    August 30, 2025

    The 20 best Labor Day deals you can grab for $100 or less

    August 30, 2025

    SpaceX Starship Finally Pulls Off a Successful Test Flight

    August 30, 2025
    Facebook X (Twitter) Instagram Pinterest
    • Privacy Policy
    • Terms of use
    • Advertise
    • Contact
    © 2025 Technology Mag. All Rights Reserved.

    Type above and press Enter to search. Press Esc to cancel.