Reverse engineer an existing ETL and data warehouse to provide specs for building the same data warehouse into Azure SQL Data Warehouse in under a month, prior to termination of the contract for the old system. Also provided guidance on effective ETL practices as well as identifying and repairing a number of problems in source data processing.
Complete Data Pipeline using Azure Functions & Python to deliver data from learning & certification systems to SQL Server for use in reporting, as well as URL triggered functions to provision users and mediate their access to the Klipfolio reporting platform.
New data warehouse with multi-lingual dashboards built in Birst from scratch; data acquisition via S3 with limited ETL inside Birst.
Reimplement existing beverage wholesale data warehouse in Birst, obtaining sales data from 3 separate sales systems & conforming that with customer, product and sales forecast data as well as integrating freight estimates and freight costs, which weren't in the old system. The new environment processes daily data loads in less than half an hour, compared to the old system's 6+ hour cycle, and vastly improves query times.