Influence Ops Records

How they are detected

How platforms detect fake networks

Last checked 24 October 2026 · 10 sources

Short answer

Platforms describe a mix of expert investigations and automated detection. Meta says investigators identify the behaviours and signatures of a network and then automate detection of them 1. Meta and OpenAI both say they look at patterns of behaviour, not single posts or single prompts 2,6. Many cases start from tips. Meta said Google Threat Intelligence Group shared information that helped start one 2025 investigation 3. Companies share threat indicators with each other and publish them for researchers 4,6.
Fake accounts Meta says it blocks
Millions every day, often within minutes of creation, per its 2021 report 1
Meta focus
Behaviour, not content 2
OpenAI focus
Patterns of threat actor behaviour, not isolated model interactions 6
TikTok operations disrupted, first four months of 2024
15, with 3,001 associated accounts 7
TikTok operations disrupted, October 2024
9, with 486 accounts 8

Investigations and automation

Meta's May 2021 report said expert investigations are hard to scale. Its investigators identify the behaviours and signatures of a network and then automate detection of them 1. The same report said Meta finds and blocks millions of fake accounts every day, often within minutes of creation 1.

Meta said most CIB networks it disrupted in the year before that report had fake accounts that were already disabled before investigators began work 1. OpenAI said in May 2024 that its own AI tools let investigations finish in days rather than weeks or months 5.

Behaviour, not content

Meta says it focuses on behaviour when it investigates and takes down these campaigns, not on the content they post 2. OpenAI said in its October 2025 report that its approach focuses on patterns of threat actor behaviour rather than isolated model interactions 6.

Operators make mistakes that help investigators. OpenAI reported in May 2024 that some operators posted model refusal messages in public 5.

Tips and shared indicators

  • Peer tips: Meta said Google Threat Intelligence Group shared information that helped start its investigation of an Iran network reported in May 2025 3.
  • Internal work: Meta said the Romania network in the same report was found through an internal investigation 3.
  • Public indicators: Meta points readers of its Q4 2024 report to a GitHub repository of threat indicators 4.
  • Industry sharing: OpenAI said in October 2025 that it shared indicators with industry partners and that indicators in its casework overlapped with a Trellix report 6.
  • Research and law enforcement: Meta's 2021 report said it shares information with independent researchers, industry peers and law enforcement 1.

Networks that come back

Removed networks often try to return. TikTok said on 23 May 2024 that its new covert influence operations report would include new information about operations it had previously removed 7. In December 2024 TikTok reported 9 operations disrupted in October, comprising 486 accounts, and 3 in November, comprising 154 accounts 8. The same post reported further accounts linked to previously disrupted networks that tried to re-establish themselves 8.

Meta reported in December 2025 that operators of a network aimed at sub-Saharan Africa, which it said was likely working on behalf of individuals in Russia, came back after removal using fake accounts 9.

What detection says about reach

Detection reports often record small audiences. Google said in January 2023 that most DRAGONBRIDGE channels had 0 subscribers when disrupted and over 80% of its videos had fewer than 100 views 10. Meta cautions that sharing a network's links or interacting with it is not enough to attribute accounts to a campaign without corroborating evidence 3.

Common questions

Do platforms find networks by checking whether posts are false?

Meta says it focuses on behaviour, not the content posted 2. OpenAI says it looks at patterns of behaviour, not isolated interactions 6.

Do companies share what they find?

Yes. Meta publishes threat indicators on GitHub 4, and OpenAI said it shared indicators with industry partners in 2025 6.

How fast are fake accounts removed?

Meta's 2021 report said it blocks millions of fake accounts every day, often within minutes of creation 1.

Do removed networks come back?

Some do. TikTok reported accounts linked to previously disrupted networks trying to re-establish themselves 8, and Meta reported a network aimed at sub-Saharan Africa that returned after removal 9.

Rules and charges change. Check the official source linked on this page before you pay or travel. Spotted an error? Email hello@influenceopsrecords.com.

Sources

  1. Meta: The State of Influence Operations 2017-2020 (May 2021)
  2. Meta: What We Saw on Our Platforms During 2024's Global Elections (3 December 2024)
  3. Meta: Adversarial Threat Report, First Quarter 2025 (May 2025)
  4. Meta: Q4 2024 Adversarial Threat Report (February 2025)
  5. OpenAI: Disrupting deceptive uses of AI by covert influence operations (30 May 2024)
  6. OpenAI: Disrupting malicious uses of AI: an update (October 2025)
  7. TikTok: Strengthening our approach to countering influence attempts (23 May 2024)
  8. TikTok: Bringing even more transparency to how we protect our platform (18 December 2024)
  9. Meta: Adversarial Threat Report, Second and Third Quarter 2025 (December 2025)
  10. Google Threat Analysis Group: Over 50,000 instances of DRAGONBRIDGE activity disrupted in 2022 (26 January 2023)

Related