A Rule Based Data Cleansing Pipeline for Automated Data Import in the Context of Social Clubs

Andreas Pointner, Martin Harrer

Research output: Chapter in Book/Report/Conference proceedingsConference contributionpeer-review

Abstract

Managing the member data of social clubs can be a tedious task. However, there are software solutions available that can help streamline this process. This although means, that existing member data, that is often in the form of text-based data formats like CSV, or semi-structured formats like XML, or Excel needs to be imported in those tools. Unfortunately, the data in these formats may contain errors, inconsistencies, and missing values, which can compromise the usability of this data. In this work, a rule-based data cleansing pipeline designed to clean, enrich, and transform social club member data into a suitable format for import into software solutions is presented. The approach is evaluated on a small data sample and shows promising results for such an application scenario.

Original languageEnglish
Title of host publicationInternational Conference on Electrical, Computer, Communications and Mechatronics Engineering, ICECCME 2023
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9798350322972
DOIs
Publication statusPublished - 2023
Event2023 International Conference on Electrical, Computer, Communications and Mechatronics Engineering, ICECCME 2023 - Tenerife, Canary Islands, Spain
Duration: 19 Jul 202321 Jul 2023

Publication series

NameInternational Conference on Electrical, Computer, Communications and Mechatronics Engineering, ICECCME 2023

Conference

Conference2023 International Conference on Electrical, Computer, Communications and Mechatronics Engineering, ICECCME 2023
Country/TerritorySpain
CityTenerife, Canary Islands
Period19.07.202321.07.2023

Keywords

  • Data Cleansing
  • Data Import
  • Pipeline

Fingerprint

Dive into the research topics of 'A Rule Based Data Cleansing Pipeline for Automated Data Import in the Context of Social Clubs'. Together they form a unique fingerprint.

Cite this