Music List Data Warehousing And Data Integration

The project was related to digital media data storage, which included tables like artists, albums, media tracks, invoices, and customers. The main goal of the project was to create a data warehouse from the database in star schema using the ETL process visually in Pentaho Data Integration tool and performing the operations like duplicate detection and other data profiling techniques including completeness analysis, String analysis, Referential Integrity, and value distribution. Moreover, writing some SQL queries to test the data warehouse which supported the slowly changing dimension was challenging part of the project. Apart from that, data analysis through MDX query in Saiku Analytics was also done.