Web Scraping: Collecting and Retrieving Data from the Web

Roman Egger, Markus Kroner, Andreas Stöckl

Research output: Chapter in Book/Report/Conference proceedingsChapter

17 Citations (Scopus)

Abstract

In this chapter, a number of tools for crawling websites are presented, and an example using hotel ratings has been adopted in order to specifically show how these can be extracted from a rating platform. For this purpose, Python with the library ``BeautifulSoup'' is used. Other program packages include Scrapy and Selenium, with which more complex applications can be realized. In addition to the technical aspects of web scraping, the legal framework of this process will also be discussed.
Original languageEnglish
Title of host publicationApplied Data Science in Tourism: Interdisciplinary Approaches, Methodologies, and Applications
EditorsRoman Egger
Place of PublicationCham
PublisherSpringer
Pages67-82
Number of pages16
ISBN (Print)978-3-030-88389-8
DOIs
Publication statusPublished - Jan 2022

Publication series

NameTourism on the Verge
VolumePart F1051
ISSN (Print)2366-2611
ISSN (Electronic)2366-262X

Keywords

  • BeautifulSoup
  • Open Data
  • Web crawling
  • Web scraping
  • Website parsing

Cite this