Google Debuts Troll-Fighting AI Tool to Moderate Online Comments

Image Credit: Google Jigsaw.

Trolls are commonplace online, with close to a third of American internet users witnessing harassment online and nearly half personally experiencing it. To help combat internet trolls, Google’s technology incubator Jigsaw and Counter Abuse Technology Team last Friday launched Perspective, “an early-stage technology that uses machine learning to help identify toxic comments,” according to the blog post announcement.

Perspective works by reviewing comments and scoring them based on how similar they are to comments that are typically considered negative or “toxic,” the blog post explained. “To learn how to spot potentially toxic language, Perspective examined hundreds of thousands of comments that had been labeled by human reviewers. Each time Perspective finds new examples of potentially toxic comments, or is provided with corrections from users, it can get better at scoring future comments.”

Available through an API, Perspective is intended for members of the Digital News Initiative and other publishers and platforms. The New York Times, The Economist and more news organizations have already tested Perspective for their comment sections and found that it has significantly reduced labor-intensive work for staff, who have to sort through tens of thousands of comments each day.

Ultimately, however, publishers can decide what to do with the API, Google’s Conversation AI product manager told Wired. The tool could easily be adopted for higher education and K–12 district websites, social media pages and anywhere else comment sections exist, as a way to prevent online harassment and cyberbullying. Google said in the post that it hopes the tool will help improve conversations online.

Perspective is available in the TensorFlow open source library and Google’s Cloud Machine Learning Platform. It is in the early stages of research and development and interested developers can request API access.

To learn more, visit the Google blog.

About the Author

Sri Ravipati is Web producer for THE Journal and Campus Technology. She can be reached at [email protected].

Featured

  • AI microchip, a cybersecurity shield with a lock, a dollar coin, and a laptop with financial graphs connected by dotted lines

    Survey: Generative AI Surpasses Cybersecurity in 2025 Tech Budgets

    Global IT leaders are placing bigger bets on generative artificial intelligence than cybersecurity in 2025, according to new research by Amazon Web Services (AWS).

  • two large brackets facing each other with various arrows, circles, and rectangles flowing between them

    1EdTech Partners with DXtera to Support Ed Tech Interoperability

    1EdTech Consortium and DXtera Institute have announced a partnership aimed at improving access to learning data in postsecondary and higher education.

  • stacks of glowing digital documents with circuit patterns and data streams

    Mistral AI Introduces AI-Powered OCR

    French AI startup Mistral AI has launched Mistral OCR, an advanced optical character recognition (OCR) API designed to convert printed and scanned documents into digital files with "unprecedented accuracy."

  • The AI Show

    Register for Free to Attend the World's Greatest Show for All Things AI in EDU

    The AI Show @ ASU+GSV, held April 5–7, 2025, at the San Diego Convention Center, is a free event designed to help educators, students, and parents navigate AI's role in education. Featuring hands-on workshops, AI-powered networking, live demos from 125+ EdTech exhibitors, and keynote speakers like Colin Kaepernick and Stevie Van Zandt, the event offers practical insights into AI-driven teaching, learning, and career opportunities. Attendees will gain actionable strategies to integrate AI into classrooms while exploring innovations that promote equity, accessibility, and student success.