Case Study: Streaming Data Integration

By intelia | @intelia | March 10

intelia provided Google Cloud expertise, guidance, technical oversight, software development and quality assurance to deliver a solution to provide the customer with real-time streaming data integration into their Data Warehouse, including transformation and views to support business reporting.

The challenge

A leading logistics provider in Australia identified that a large number of customers were under-declaring/over-declaring on parcels, resulting in revenue leakage and annual losses. The solution built on GCP establishes the data foundation layer by automating incorrect declaration data and enabling the business to perform analytics and understand and track potential revenue recovery.

The solution

intelia (working closely with the customer’s team) designed, built, and tested the solution on GCP utilising Pub/Sub, Dataflow, and Bigquery. This solution provides the customer with real-time streaming data integration into their Data Warehouse (Bigquery) as well as transformation (using DBT) and a number of views to support business reporting.

The results

Today the customer is now able to use near real-time data to accurately analyse revenue variance data and provide reports to the wider business to begin addressing these issues.

About the customer

A leading logistics provider in Australia with over 400 million parcels delivered per year.

Industry: Logistics & Transportation

Primary project location: Australia