Proposing the use of an 'Advocatus Diaboli' as a Pragmatic Approach to Improve Transparency in Qualitative Data Analysis and Reporting

Research output: Chapter in Book/Report/Conference proceedingsConference contributionpeer-review

Abstract

Qualitative data analysis is widely adopted for user evaluation, not only in the Visualisation community but also related communities, such as Human-Computer Interaction and Augmented and Virtual Reality. However, the data analysis process is often not clearly described and the results are often simply listed in the form of in-teresting quotes from or summaries of quotes that were uttered by study participants. This position paper proposes an early concept for the use of a researcher as an 'Advocatus Diaboli', or devil's advocate, to try to disprove the results of the data analysis by looking for quotes that contradict the findings or leading questions and task designs. Whatever this devil's advocate finds can then be used to reiterate on the findings and the analysis process to form more suitable theories. On the other hand, researchers are enabled to clarify why they did not include this in their theory. This process could increase transparency in the qualitative data analysis process and increase trust in these findings, while being mindful of the necessary resources.

Original languageEnglish
Title of host publicationProceedings - 2024 IEEE Evaluation and Beyond - Methodological Approaches for Visualization, BELIV 2024
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages1-4
Number of pages4
ISBN (Electronic)9798331528461
DOIs
Publication statusPublished - 2024
Event2024 IEEE Evaluation and Beyond - Methodological Approaches for Visualization, BELIV 2024 - St. Pete Beach, United States
Duration: 14 Oct 2024 → …

Publication series

NameProceedings - 2024 IEEE Evaluation and Beyond - Methodological Approaches for Visualization, BELIV 2024

Conference

Conference2024 IEEE Evaluation and Beyond - Methodological Approaches for Visualization, BELIV 2024
Country/TerritoryUnited States
CitySt. Pete Beach
Period14.10.2024 → …

Keywords

  • evaluation methodology
  • Qualitative data analysis

Fingerprint

Dive into the research topics of 'Proposing the use of an 'Advocatus Diaboli' as a Pragmatic Approach to Improve Transparency in Qualitative Data Analysis and Reporting'. Together they form a unique fingerprint.

Cite this