Workflow Management Systems Benchmarking : Unfulfilled Expectations and Lessons Learned
Wirtz, Guido; Lenhard, Jörg; Harrer, Simon; u. a. (2017): „Workflow Management Systems Benchmarking : Unfulfilled Expectations and Lessons Learned“. IEEE doi: 10.1109/ICSE-C.2017.126.
Title of the compilation:
Proceedings: 39th International Conference on Software Engineering Companion (ICSE-C), 2017 IEEE/ACM
39th International Conference on Software Engineering (ICSE), Poster Track, Buenos Aires, Argentina, May 20-28, 2017
Year of publication:
Workflow Management Systems (WfMSs) are a type of middleware that enables the execution of automated business processes. Users rely on WfMSs to construct flexible and easily maintainable software systems. Significant effort has been invested into standardising languages for business processes execution, with standards such as the Web Services Business Process Execution Language 2.0 or the Business Process Model and Notation 2.0. Standardisation aims at avoiding vendor lockin and enabling WfMS users to compare different systems. The reality is that, despite standardisation efforts, different independent research initiatives show that objectively comparing WfMSs is still challenging. As a result, WfMS users are likely to discover unfulfilled expectations while evaluating and using these systems. In this work, we discuss the findings of two research initiatives dealing with WfMSs benchmarking, presenting unfulfilled expectations and lessons learned concerning WfMSs’ usability, reliability, and portability. Our goal is to provide advice for practitioners implementing or planning to use WfMSs.
Workflow Management Systems, Standards, Lessons Learned, Evaluation Research
November 24, 2017