Dmytro Lytvyn's blog
A blog about Data Warehouse, Data Platform and other related things
-
DWH, part 3: SQL Code Generator
As we found out in the previous article, to properly populate each table in the DWH, while checking for duplicates, storing changes history etc., we have to write a lot of SQL code. Fortunately, this code will mostly be the same, and therefore we can automate this with some kind...
-
DWH, part 2: Architecture
Let’s quickly recall the requirements to the DWH we came up with in the first article: DWH must be a separate system with SQL interface, holding the information from various data sources. The tables structure in the DWH should preferably be as close as possible to that of the source...
-
DWH, part 1: Requirements
So, Data Warehouse. Before we start discussing the architecture and technical implementation, we need to agree on our expectations from it and put together a list of requirements. OK Google, define Data Warehouse. Data warehouse (DW or DWH) is a system used for reporting and data analysis, and is considered...