Workflow Management Systems Benchmarking : Unfulfilled Expectations and Lessons Learned

Faculty/Professorship: Distributed Systems  
Author(s): Wirtz, Guido  ; Lenhard, Jörg; Harrer, Simon ; Geiger, Matthias ; Pautasso, Cesare
Title of the compilation: Proceedings: 39th International Conference on Software Engineering Companion (ICSE-C), 2017 IEEE/ACM
Corporate Body: 39th International Conference on Software Engineering (ICSE), Poster Track, Buenos Aires, Argentina, May 20-28, 2017
Publisher Information: IEEE
Year of publication: 2017
Pages: Online-Ressource
Language(s): English
DOI: 10.1109/ICSE-C.2017.126
Workflow Management Systems (WfMSs) are a type of middleware that enables the execution of automated business processes. Users rely on WfMSs to construct flexible and easily maintainable software systems. Significant effort has been invested into standardising languages for business processes execution, with standards such as the Web Services Business Process Execution Language 2.0 or the Business Process Model and Notation 2.0. Standardisation aims at avoiding vendor lockin and enabling WfMS users to compare different systems. The reality is that, despite standardisation efforts, different independent research initiatives show that objectively comparing WfMSs is still challenging. As a result, WfMS users are likely to discover unfulfilled expectations while evaluating and using these systems. In this work, we discuss the findings of two research initiatives dealing with WfMSs benchmarking, presenting unfulfilled expectations and lessons learned concerning WfMSs’ usability, reliability, and portability. Our goal is to provide advice for practitioners implementing or planning to use WfMSs.
Keywords: Workflow Management Systems, Standards, Lessons Learned, Evaluation Research
Type: Conferenceobject
Year of publication: 24. November 2017