I argue that user reports belong at the center of platform threat detection, because perpetrators often reveal intent to people who know them and most of the variables that move an assessment sit off-platform. I review the threat-assessment literature on perpetrator heterogeneity, the eight warning behaviors, and the six-stage path to intended violence.
I review the threat-assessment literature on perpetrator heterogeneity, the eight warning behaviors, and the six-stage path to intended violence, and I argue that platforms detect threats best when users report concerns and automated systems route and triage those reports. User reports belong at the center of platform threat detection, because perpetrators often reveal intent to people who know them (Silver, Horgan, & Gill, 2018) and most of the variables that move an assessment sit off-platform.
Mother Jones recorded 51 mass shootings in the United States from 2008 to 2017, 2.4 times the 21 it recorded from 1998 to 2007; the most recent decade accounted for 57% of the mass shootings it recorded across the three decades from 1988 to 2017 (Office for Victims of Crime, 2018). The FBI counted 250 active shooter incidents between 2000 and 2017, with 2,217 people killed or wounded, not counting the shooters (Federal Bureau of Investigation, 2018). The volume justifies the research interest; researchers have not produced a profile.
Thompson and Kyle (2005) characterize these offenders by low self-esteem; Palermo (1997) reads them as psychopathic; Hempel, Meloy, and Richards (1999) and Virtanen (2013) read them as narcissistic. Bondü and Scheithauer (2015) and Wike and Fraser (2009) document characterological heterogeneity at a scale that defeats single-construct typologies. Lankford (2013) finds that the age and attack-location differences between rampage shooters, workplace shooters, school shooters, and suicide terrorists are mostly superficial, and Ferguson, Coulson, and Barnett (2011) find that youthful mass murderers resemble adult perpetrators more than they differ from them. Fox and Levin (2003) suggest that researchers have neglected mass murder partly because police usually neutralize the perpetrator quickly, so the case presents no ongoing threat to investigate. Most perpetrators do not survive the event, so no one can conduct a traditional post-event psychological assessment.
Seung-Hui Cho killed 32 people at Virginia Tech in 2007; Anders Breivik killed 77 across two locations in Norway in 2011. Both left manifestos. Cho’s reads as raw, affective, personal injury, in lines like “Vandalizing my heart wasn’t enough for you. Raping my soul wasn’t enough for you.” Breivik’s runs more than 1,500 pages, with chapter headings like “Modern Aftermath of the Crusades” and “US and European Nationalist Rhetorical Differences.” The two attacks share an outcome and almost nothing else.
I expect a classifier built on a single perpetrator template to miss most of the population it targets.
Government and academic researchers have found that most perpetrators plan their attacks and display identifiable pre-attack behaviors (Fein, Vossekuil, & Holden, 1998; U.S. Secret Service & U.S. Department of Education, 2004). Silver, Simons, and Craun (2018) studied 63 active shooters from 2000 to 2013 and documented how long the planning ran and how often the shooters told someone.
| Figure | What the FBI study measured |
|---|---|
| 63 | Active shooters in the study, 2000 to 2013 |
| 77% | Shooters who spent a week or longer planning the attack, among the 34 whose planning time could be determined |
| 88% | Shooters aged 17 and younger who leaked intent to commit violence (51% of adult shooters did) |
| 30% | Shooters who created a legacy token, a communication prepared before the attack to claim credit and state a motive (19 of 63) |
The week-long planning window gives detection somewhere to work. Silver, Horgan, and Gill (2018) found that 67 of 115 public mass murderers leaked their intent before the attack, and in 36 of those cases the leakage reached family or friends. Detection that waits for a direct threat to law enforcement will miss most cases; perpetrators more often tell friends, classmates, or online audiences.
Meloy, Hoffmann, Guldimann, and James (2012) propose eight essential warning behaviors, acute, dynamic, and particularly toxic changes in behavior that signal accelerating risk and call for an operational response. Calhoun and Weston (2003, 2015) describe the path to intended violence as a discrete six-stage sequence (grievance, ideation, research and planning, preparation, breach, and attack). The eight behaviors do not occur uniformly across the six stages, and most threat-assessment work maps each behavior to the stages where it tends to appear.
Pathway behavior is research, planning, preparation, or implementation of an attack (Calhoun & Weston, 2003). Fixation is increasingly pathological preoccupation with a person or cause (Mullen et al., 2009). Identification is the psychological desire to be a “pseudocommando” (Dietz, 1986), to adopt a warrior mentality and associate closely with weapons or military paraphernalia (Hempel, Meloy, & Richards, 1999), to identify with previous attackers, or to identify as an agent of a cause. Novel aggression is an act of violence unrelated to the attack, committed for the first time, testing the subject’s capacity for the act. Energy burst is an increase in the frequency or variety of activities tied to the target. Leakage is communication to a third party of intent to harm. Direct threat is communication of a direct threat to the target or to law enforcement beforehand. Last resort is increasing desperation expressed in word or deed.
People often prefer words that alarm over actions that harm, so an assessor reading a threatening statement separates its content from its context. The first question is whether the statement is direct (delivered to the potential target) or indirect (delivered to a third party); the second is whether the statement is a threat or an ultimatum. Ultimatums attach conditions and read as warnings or attempts at manipulation; threats attach no conditions.
A person who threatens a target directly is often venting desperation, and the target’s fear can release the speaker’s charge in place of the act. Assessors worry more about indirect threats delivered to third parties, because those threats bypass that release.
Late-appearing threats tend to be more concerning than early ones. Early threats tend to be emotional reactions to an immediate upset, while late threats tend to follow a deliberative process in which the speaker has already considered and rejected other options.
Threat-assessment risk management weighs the probability that an event will occur, which assessors call the threat, against the potential impact of the event, which assessors call the risk. Assessors demand more intervention for a low-probability event as its potential impact rises. The combinations produce a familiar 2x2.
Burglary of an unoccupied home is low threat and low risk; the likelihood is low for most homeowners, the impact is bounded, and locked doors usually suffice. A school shooting, for most communities, is low threat and high risk; consequences are catastrophic, and the probability for any one school stays low. A well-armed individual who has communicated credible intent to commit a mass shooting at a specific, accessible elementary school is high threat and high risk; the assessor rates both probability and impact as high and responds immediately.
I use the matrix as a decision aid because it holds the assessor to two separate estimates, how likely the event is and how bad it would be. An assessor who conflates them commits one of the two characteristic failures of threat work, treating every catastrophic scenario as imminent or dismissing every statistically uncommon scenario as negligible.
Towers, Gomez-Lievano, Khan, Mubayi, and Castillo-Chavez (2015) modeled mass killings with firearms and school shootings as contagion processes and found that each incident raises the probability of another for an average of 13 days. Highly publicized watershed events can inspire attacks for far longer; in the 16 years after the 1999 Columbine shooting, Follman and Andrews (2015) counted at least 74 plots or attacks across 30 states that drew on it. The contagion does not require the original attacker to have used a platform, because the cultural event itself carries the influence.
For platform threat-assessment workflows, the operational implication is asymmetric staffing, since report volume tends to spike with cultural events. The post-watershed window is also where automated false-positive rates spike; the volume of users discussing the event surges, discussion is not intent, and pattern-matching on surface features in a contagion window over-flags users who are discussing the news.
Assessors need warning signs, risk factors, stabilizing factors, and precipitating events, and those variables seldom all appear on-platform. Collateral data sources tend to be essential. Platform teams that rely only on their own telemetry work from an incomplete record.
The characterological heterogeneity that defeats single-profile classifiers also defeats list-based automated detection. Each behavior marks a different position on the pathway, and a single behavior late in the pathway warrants a more urgent response than several behaviors at the early end; a system that counts behaviors without weighting their positions inverts that logic and dilutes the operational response.
Users of a platform with millions of participants bring contextual interpretation at scale. A user reading a friend’s post knows the prior six months of that person’s behavior, the relationship history, the in-group jokes, and the affective baseline. A friend reading the post recognizes that a person’s pattern has changed; an automated system receives one comment and a numeric vector. I would position automation as the support layer for human judgment.
Teams can keep clear, low-friction reporting channels open for users and let automated systems route, triage, and surface those reports for analysis. Teams can also staff for elevated reporting volume in the 13 days after a watershed event. The people who know a person are best placed to recognize when that person has become dangerous.