SEBench: A Cross-Framework Strategy Execution Benchmark Inspired by TaPS

Inspired by TaPS (Pauloski et al., 2024), create a Strategy Execution Benchmark (SEBench) with a unified interface and a library of synthetic “portfolio DAGs” and real cases (e.g., South African banks, airports, seaports). Plug-ins enable running the same scenarios under OKR, 5W2H, CADAP, PPM, and capability-based execution. While frameworks are often promoted via case vignettes or surveys, head-to-head, standardized comparisons are rare. SEBench introduces reproducibility, common metrics (time-to-alignment, decision latency, replan overhead, engagement, outcome variance), and robustness tests under disruptions. It mirrors computational sciences’ move to rigorous framework evaluation and applies NLP to auto-code artifacts. It also integrates e-governance levers as controllable factors. Potential impacts include an empirical foundation for choosing and tailoring execution approaches and acceleration of cumulative, replicable strategy execution research.

References:

1. Drivers of strategy implementation on the banking sector in South Africa. Kelebogile Sibongile Tshabalala, D. H. Boikanyo, Godknows Gomwe (2024). International Journal of Business Ecosystem & Strategy (2687-2293).
2. Strategy Implementation Drivers and Performance of Kenya Airport Authority: A Case of Moi International Airport Mombasa County, Kenya. Nahashon Mwaura Mwangi, Njeri Njuguna (2023). International Journal of Business Management, Entrepreneurship and Innovation.
3. TaPS: A Performance Evaluation Suite for Task-based Execution Frameworks. J. G. Pauloski, Valérie Hayot-Sasson, Maxime Gonthier, Nathaniel Hudson, Haochen Pan, Sicheng Zhou, Ian T. Foster, Kyle Chard (2024). IEEE International Conference on e-Science.
4. The application of 5W2H management model in the construction of enterprise economic and strategic management system. Lei Luo, Qingyu Hong, Ming Zhong (2024). Applied Mathematics and Nonlinear Sciences.
5. Examining the impact of e-governance on organizational strategy execution in the Jordanian ICT industry. Azzam A. Abou-Moghli, Maryam Shatem (2024). Problems and Perspectives in Management.
6. Strategy Execution through Enterprise Architecture: Capability-based Management as a Foundation for Successful (Digital) Transformations. Jonas Van Riel (2022). International Conference on Advanced Information Systems Engineering.
7. Research on Optimization of Enterprise Strategy Execution Based on Objectives and Key Results Method (OKR). Youpeng Zhao (2024). Academic Journal of Business & Management.
8. A Comprehensive Framework for Strategy Execution: CADAP Strategy Execution Framework. Aneek Choudhury, P.N. Ram Kumar, Ramesh Krishnan (2025). IIM Kozhikode Society & Management Review.
9. Creating competitive advantage from strategy through execution: leading modern approaches in project portfolio management. Joseph G. Mews (2025). SAM Advanced Management Journal.
10. Identifying The Critical Factors Affecting Strategy Execution in Egyptian Seaports. ايه الجارحي (2023). المجلة العلمية للبحوث والدراسات التجارية.