SupportsField experiment · 2024
Heiding et al. — IEEE Access, 12
Click-through was 19-28% for generic control phishing, 30-44% for GPT-4 generated emails, 69-79% for emails designed by hand using the V-Triad cognitive-bias rules, and 43-81% for GPT-4 combined with the V-Triad. Large language models were also fairly good at detecting phishing intent, sometimes beating humans, and cut attacker costs.
SupportsField experiment · 2024
Heiding et al. — arXiv:2412.00586
Fully AI-automated spear-phishing emails drew a 54% click-through rate, matching human experts (54%) and far above arbitrary control phishing (12%), a big jump from comparable AI results a year earlier. The AI's reconnaissance profiles were accurate and useful for 88% of targets, and AI can raise attacker profitability up to 50-fold at scale.
SupportsQualitative · 2020
Wash — Proceedings of the ACM on Human-Computer Interaction (CSCW)
Experts detect phishing in three stages: making sense of the email and noticing small discrepancies, becoming suspicious when something (usually a link asking for action) triggers the phishing explanation, then investigating and deleting or reporting. Training should build this sensemaking process, not just checklists.
SupportsLab experiment · 2019
Parsons et al. — International Journal of Human-Computer Studies
In a role-play study of 985 people, emails using consistency and reciprocity were most effective while scarcity and social proof were least effective. People who scored as susceptible to a given principle were usually more fooled by emails using it, and age, computer time, social-proof susceptibility and impulsivity predicted detection ability.
SupportsMixed methods · 2018
Williams et al. — International Journal of Human-Computer Studies
Across a simulation sent to about 62,000 employees, emails carrying authority cues raised the likelihood of clicking a suspicious link. Focus groups pointed to workplace factors, such as routine email habits and work pressures, that shape whether employees fall for spear phishing.
SupportsLab experiment · 2018
Vishwanath et al. — Communication Research, 45(8), 1146-1166
Because training effects fade as people slip back into email routines, the authors built a model (SCAM) combining conscious cognitive processing, preconscious suspicion and habitual, automatic email use, and tested it across two phishing experiments. Email habits emerged as a key predictor of susceptibility alongside cognitive processing.
SupportsMixed methods · 2018
Vance et al. — MIS Quarterly, 42(2), 355-380
Attention to repeated security warnings declined measurably in the brain across a workweek, partially recovering between days. In the field, adherence to permission warnings fell over three weeks, while warnings whose appearance varied (polymorphic designs) substantially reduced this habituation.
SupportsQualitative · 2016
Stanton et al. — IT Professional, 18(5)
Although the interviews never asked about fatigue, over half of the 40 participants described it: resignation, loss of control, fatalism, risk minimization and decision avoidance. This fatigue fed their sense that following security advice has little benefit.
SupportsConceptual · 2015
Bada et al. — International Conference on Cyber Security for Sustainable Society, 2015 (arXiv:1901.02672, posted 2019)
Awareness campaigns fail when they only provide information: people must be able to understand and apply advice and be motivated to act, which requires attitude and intention change. Reviews persuasion techniques, including fear appeals, and lists factors behind campaign success or failure.
SupportsSurvey · 2010
Siponen & Vance — MIS Quarterly, 34(3), 487-502
Employees' rationalizations for rule-breaking ('neutralization' techniques from criminology) explained intentions to violate security policy better than deterrence theory's sanctions. The authors argue policies should address these rationalizations.
SupportsConceptual · 2009
Herley — Proceedings of the 2009 New Security Paradigms Workshop (NSPW '09)
Argues that users ignoring security advice is economically rational: advice imposes large, constant effort costs while its benefits are often speculative. For example, the time cost of everyone checking URLs would dwarf all phishing losses.
SupportsMixed methods · 1999
Adams & Sasse — Communications of the ACM, 42(12)
Insecure password practices (e.g., writing passwords down, linking passwords) stemmed from memory overload and poorly designed policies, not user carelessness. Security departments that withheld information and treated users as a threat worsened motivation and compliance.