How they are detected
How platforms detect fake networks
Short answer
- Fake accounts Meta says it blocks
- Millions every day, often within minutes of creation, per its 2021 report 1
- Meta focus
- Behaviour, not content 2
- OpenAI focus
- Patterns of threat actor behaviour, not isolated model interactions 6
- TikTok operations disrupted, first four months of 2024
- 15, with 3,001 associated accounts 7
- TikTok operations disrupted, October 2024
- 9, with 486 accounts 8
Investigations and automation
Meta's May 2021 report said expert investigations are hard to scale. Its investigators identify the behaviours and signatures of a network and then automate detection of them 1. The same report said Meta finds and blocks millions of fake accounts every day, often within minutes of creation 1.
Meta said most CIB networks it disrupted in the year before that report had fake accounts that were already disabled before investigators began work 1. OpenAI said in May 2024 that its own AI tools let investigations finish in days rather than weeks or months 5.
Behaviour, not content
Meta says it focuses on behaviour when it investigates and takes down these campaigns, not on the content they post 2. OpenAI said in its October 2025 report that its approach focuses on patterns of threat actor behaviour rather than isolated model interactions 6.
Operators make mistakes that help investigators. OpenAI reported in May 2024 that some operators posted model refusal messages in public 5.
Tips and shared indicators
- Peer tips: Meta said Google Threat Intelligence Group shared information that helped start its investigation of an Iran network reported in May 2025 3.
- Internal work: Meta said the Romania network in the same report was found through an internal investigation 3.
- Public indicators: Meta points readers of its Q4 2024 report to a GitHub repository of threat indicators 4.
- Industry sharing: OpenAI said in October 2025 that it shared indicators with industry partners and that indicators in its casework overlapped with a Trellix report 6.
- Research and law enforcement: Meta's 2021 report said it shares information with independent researchers, industry peers and law enforcement 1.
Networks that come back
Removed networks often try to return. TikTok said on 23 May 2024 that its new covert influence operations report would include new information about operations it had previously removed 7. In December 2024 TikTok reported 9 operations disrupted in October, comprising 486 accounts, and 3 in November, comprising 154 accounts 8. The same post reported further accounts linked to previously disrupted networks that tried to re-establish themselves 8.
Meta reported in December 2025 that operators of a network aimed at sub-Saharan Africa, which it said was likely working on behalf of individuals in Russia, came back after removal using fake accounts 9.
What detection says about reach
Detection reports often record small audiences. Google said in January 2023 that most DRAGONBRIDGE channels had 0 subscribers when disrupted and over 80% of its videos had fewer than 100 views 10. Meta cautions that sharing a network's links or interacting with it is not enough to attribute accounts to a campaign without corroborating evidence 3.
Common questions
Do platforms find networks by checking whether posts are false?
Meta says it focuses on behaviour, not the content posted 2. OpenAI says it looks at patterns of behaviour, not isolated interactions 6.
Do companies share what they find?
Yes. Meta publishes threat indicators on GitHub 4, and OpenAI said it shared indicators with industry partners in 2025 6.
How fast are fake accounts removed?
Meta's 2021 report said it blocks millions of fake accounts every day, often within minutes of creation 1.
Rules and charges change. Check the official source linked on this page before you pay or travel. Spotted an error? Email hello@influenceopsrecords.com.
Sources
- Meta: The State of Influence Operations 2017-2020 (May 2021)
- Meta: What We Saw on Our Platforms During 2024's Global Elections (3 December 2024)
- Meta: Adversarial Threat Report, First Quarter 2025 (May 2025)
- Meta: Q4 2024 Adversarial Threat Report (February 2025)
- OpenAI: Disrupting deceptive uses of AI by covert influence operations (30 May 2024)
- OpenAI: Disrupting malicious uses of AI: an update (October 2025)
- TikTok: Strengthening our approach to countering influence attempts (23 May 2024)
- TikTok: Bringing even more transparency to how we protect our platform (18 December 2024)
- Meta: Adversarial Threat Report, Second and Third Quarter 2025 (December 2025)
- Google Threat Analysis Group: Over 50,000 instances of DRAGONBRIDGE activity disrupted in 2022 (26 January 2023)
Related
- How attribution of influence operations works
How Meta, Google, OpenAI, Microsoft, X and the EEAS word attribution, from country of origin to named entities, and what terms like likely and linked mean.
- What coordinated inauthentic behaviour means
How Meta defines coordinated inauthentic behaviour, how X, TikTok, Bluesky and Microsoft word similar rules, and what Meta has reported since 2017.
- How to read a takedown report
What the counts, follower figures, ad spend, origin labels, impact scores and threat indicators in Meta, OpenAI, Google and EEAS reports mean.
- Research datasets on influence operations
Public datasets and archives on influence operations from Meta, Google, OpenAI, the EEAS, Princeton and Oxford, with what each covers and its period.