Multi-Media and Web-based Evaluation of Design Artifacts - Syntactic, Semantic and Pragmatic Quality of Process Models

Evaluation of design artifacts is of crucial importance in design science research (DSR). A plethora of evaluation approaches and methods can be found in literature; nevertheless, little work has been done so far to investigate the relation between the evaluation strategies, methods and techniques in DSR evaluations. Prototype implementations, together with case studies seem to be dominant and the technique of choice to evaluate, often complex artifacts. This paper goes beyond the common approach in DSR, and presents a multi-media and web-based DSR evaluation approach focussing on syntactic, semantic and pragmatic quality. We present the definition of evaluation criteria, the selection of evaluation methods and the findings and experiences gained. The results of this paper can support other design science re-search approaches concerned with the evaluation of concepts or process models.