// MODEL OPTIMIZATION AND PROMPT SYNTAX TERM

Disinformation

False information deliberately created and spread to deceive or manipulate people.

Disinformation — illustration from Wikipedia
Image via Wikipedia

TECHNICAL DEFINITION

Disinformation is intentionally false or misleading information strategically created and propagated with the explicit goal of deceiving, manipulating, or causing harm, often for political or financial gain, and can be generated or amplified by sophisticated AI tools.

BACKGROUND

Generative artificial intelligence (GenAI) is a subfield of artificial intelligence (AI) that uses generative models to generate text, images, videos, audio, software code or other forms of data. These models learn the underlying patterns and structures of their training data, and use them to generate new data in response to input, which often takes the form of natural language prompts.

READ MORE ON WIKIPEDIA

SYNONYMS & ALIASES

  • Propaganda
  • Fake news (pejorative)
  • Deception
  • Manipulation

USAGE NOTE

Combating disinformation is a major challenge, with AI being used both to create and detect it.

DEVELOPERS

Organizations developing technology related to Disinformation.

  • Blackbird.AI

    An AI-driven platform that specializes in detecting and analyzing disinformation, harmful narratives, and information manipulation. Their technology aims to provide early warnings and insights into how adversarial narratives are constructed and spread online.

  • Graphika

    A research company that uses AI to map and analyze complex online networks. They are renowned for identifying and dissecting state-sponsored disinformation campaigns, providing detailed analysis on the tactics, techniques, and procedures of malicious actors.

  • ActiveFence

    A company that provides trust and safety solutions for online platforms. Their AI technology is used to detect and mitigate a wide range of harmful content in real-time, including disinformation, hate speech, and extremism, across various languages and formats.

  • NewsGuard

    An organization that rates the credibility of news and information websites. While relying on human journalists for analysis, they use AI tools to monitor and identify new sources of misinformation and track the spread of false narratives across the web.

  • Jigsaw (Google)

    A unit within Google that functions as a technology incubator to tackle threats to open societies. They develop tools and conduct research on topics like disinformation, online harassment, and censorship, using AI to understand and counter these problems.

  • OpenAI

    A leading AI research and deployment company that develops large language models. A significant part of their work is focused on AI safety and alignment, including developing techniques to detect AI-generated content and prevent their models from being used to create and spread disinformation at scale.

  • DARPA

    The Defense Advanced Research Projects Agency of the U.S. Department of Defense. DARPA funds and manages research programs like Semantic Forensics (SemaFor) and Media Forensics (MediFor), which aim to develop advanced AI technologies to automatically detect, attribute, and characterize disinformation.

  • Microsoft Threat Analysis Center (MTAC)

    A center within Microsoft that tracks and disrupts foreign state-sponsored cyber threats, including covert influence operations and disinformation campaigns. They use AI and data analysis to identify and expose actors spreading disinformation.

RELATED TERMS IN AI ETHICS & SAFETY