Case Study: TDM Data Masking

By intelia | @intelia | January 23, 2023

The Test Data Management team of an Australian large logistics organisation was aiming to significantly reduce the time taken to provide non-prod environments to the wider business as well as ensure PII data was masked correctly and use something other than IBM technology.

The challenge

The customer has several non-production environments which are used for application development, testing, system maintenance and support being refreshed with production data. Recreating these environments was manual and effort intensive and costly. There was an immediate requirement to mask selected personal data at scale and velocity, in a seamless and automated end-to-end process.

The solution

intelia, in collaboration with the customer’s Test Data Management team, were able to design and build a GCP solution with the use of Big Query(Federated Queries, Views and Dynamic SQL) Dataflow (Data Transfer) and Cloud Composer (Data Orchestration) based on a metadata-driven architecture. The implemented solution is flexible enough to add additional GCP OLTP (transactional) data sources.

The results

The customer’s Test Data Management Team now have a modern, cloud-native data masking solution in GCP, that can easily be leveraged from similar source systems at scale and speed with end-to-end automation. The time taken to stand up and bring down environments now mean the team has a highly flexible and efficient way to do this at scale.