Organizing your data
Scraping, methods and tools for business intelligence

To organize your data, you need to understand the notions of structured, unstructured and semi-structured. Data homogeneity is imperative, and this is where the notion of structuring comes into play.

Aggregating data from several sources brings us face to face with the notions of formats, Mac, PC, Linux. In this field, there are thousands of formats that are more or less compatible with each other, depending on the publisher, and whether they are proprietary or royalty-free.

In addition, each user's input must be taken into account: for example, Paris, PARIS, paris, apris, are all variants in the creation of a CITY, Ville, VILLE_France or VILLE_FRANCE or PAYS_VILLE heading, as are numerical inputs such as 0.1; 1.0; 1.

The difficulty comes with the desire to automate the process, when updating data means constantly...