From Evidence to Decisions: Interview-Based Study of Reporting Practices in Defensive Cyber Operations

Authors

DOI:

https://doi.org/10.34190/eccws.25.1.4839

Keywords:

incident response, defensive cyber operation, stakeholder, human-dimension, analytics, reporting

Abstract

Defensive cyber operations (DCO) missions demand rapid decision-making under active digital threats. Established doctrine and industry standards provide technical procedures for handling incidents. However, they offer little guidance on how reporting artifacts, such as data analytics, visualization, and briefs, are produced, adapted, and communicated for decision-making. To address this gap, we conducted an empirical investigation of reporting practices in DCO through semi-structured interviews with 15 cybersecurity practitioners (managers, analysts, infrastructure technicians, and developers) engaged in incident response and threat hunting. We derived a three-dimensional model of the reporting lifecycle structured around reporting roles, purpose, and operational timeline that characterizes how network data and analytic outputs are represented in reporting artifacts such as templates, risk matrices, and briefs under time pressure and organizational constraints. Our findings highlight how reporting is shaped by trust, audience language, and the balance of standardized and flexible templates. We point to the need for traceability-linked modules, audience-aware data analytics and visualization tools, and playbooks that incorporate reporting artifacts with flexible guidance in DCO.

Author Biographies

Justin Raynor

Justin Raynor is a U.S. Air Force Lieutenant Colonel with experience leading cybersecurity and space operations teams, including assignments with the Air Force Research Laboratory, Air Force Life Cycle Management Center, the National Reconnaissance Office, and U.S. Cyber Command. He earned a PhD in Cybersecurity (data visualization focus) from Northeastern University and previously taught in the Department of Computer and Cyber Sciences at the U.S. Air Force Academy. His research studies how practitioners create and use data and visualizations for decision-making. 

Bijesh Shrestha, United States Military Academy

Bijesh Shrestha is a Major in the U.S. Army and a Research Scientist at the Army Cyber Institute, focusing on AI operations and deployment in security-sensitive settings. He is also a PhD candidate in Data Science at Worcester Polytechnic Institute, where his dissertation develops an evaluation-first approach for AI-enabled tools in real analytic workflows. He holds an M.S. in Applied Mathematics from the Naval Postgraduate School, focusing on cryptography and network science, and brings experience across offensive and defensive cyber operations. 

Cody Dunne, Northeastern University, Boston, United States of America

Cody Dunne is an Associate Professor in the Khoury Vis Lab at Northeastern University. His work spans information visualization and HCI, with an emphasis on making network relationships readable and understandable, including layered network visualizations. He builds and evaluates visualization techniques and tools with users, drawing on both algorithmic methods and HCI study approaches.

Melanie Tory, The Roux Institute at Northeastern University

Melanie Tory is Director of Human Data Interaction Research at Northeastern’s Roux Institute and a Professor of the Practice with appointments in the Khoury College of Computer Sciences and the College of Arts, Media and Design. Her research focuses on visualization and human-data interaction to help people and organizations do more with data, including work bridging visualization and AI. 

Lane Harrison, Worcester Polytechnic Institute

Lane Harrison is an Associate Professor of Computer Science at Worcester Polytechnic Institute and directs the Visualization and Information Equity Lab (VIEW). His research leverages computational, cognitive, and perceptual methods to understand how people interpret visualizations and to develop guidance for effective visual analytics systems.

Downloads

Published

2026-06-15