Web scrapping and storing data in a database, a case study of the used cars market

Abstract

Data are omnipresent on the Internet. Searching the web for useful data and information has become a routine job. The data on the sites can be found in tables, articles, comments, nested in different HTML tags, etc. Gathering a large amount of data from the web is not an easy task, but it is a good way to collect information which can be used in further analyzes. In this paper we will deal with the process of web scraping data from different locations on the Internet and their storage in a database, for the purpose of collecting and analyzing data of the used cars market.