Whetting the SWORD: Detecting Workarounds by Using Active Learning and Logistic Regression

Wouter van der Waal, Inge van de Weerd, Saskia Haitjema, Teus Kappen, Hajo A. Reijers

Research output: Chapter in Book/Report/Conference proceedingConference contributionAcademicpeer-review

Abstract

In many organizations, especially in healthcare, workers may work around prescribed procedures. Detecting these workarounds can give insights into difficulties concerning the procedures, which in turn can be used to improve them. Previous studies have shown that workarounds may be discovered from an event log using a set of predefined patterns such as the duration of a trace or the number of resources involved in one. However, domain experts may find it difficult to evaluate and monitor results if there are multiple patterns that indicate workarounds. Training a model that merges the features is often difficult because there are no available datasets covering workarounds. Labeling traces generally requires a lot of time from domain experts. In addition, this would have to be repeated for every new domain, company, or even department since the types of workarounds that occur may differ strongly between them. In this work, we propose to combine the features using a Logistic Regression model and train through Active Learning. In a case study at a hospital, we find that after training the model on only 10 to 15 traces, it stabilizes with an approximate F1 score of.75. This shows that we create and train a model that can detect workarounds well without requiring a large amount of labeled data or a lot of time from a domain expert.

Original languageEnglish
Title of host publicationProceedings of the 57th Annual Hawaii International Conference on System Sciences, HICSS 2024
EditorsTung X. Bui
PublisherIEEE
Pages3687-3696
Number of pages10
ISBN (Electronic)978-099813317-1
Publication statusPublished - 2024
Event57th Annual Hawaii International Conference on System Sciences, HICSS 2024 - Honolulu, United States
Duration: 3 Jan 20246 Jan 2024

Conference

Conference57th Annual Hawaii International Conference on System Sciences, HICSS 2024
Country/TerritoryUnited States
CityHonolulu
Period3/01/246/01/24

Keywords

  • Active Learning
  • Event log
  • Logistic Regression
  • Process Mining
  • Workarounds

Fingerprint

Dive into the research topics of 'Whetting the SWORD: Detecting Workarounds by Using Active Learning and Logistic Regression'. Together they form a unique fingerprint.

Cite this