OUR WORK

Immediate Results

DATA WAREHOUSE MIGRATION

June 2019

This project was for the leading marketing company Indicia. One of their large revenue generators was a procurement system which linked the sellers of goods to potential buyers. The problem was it was hosted on legacy systems that needed to be brought up-to-date. We were involved in writing code to facilitate the transfer of data from their legacy warehouse to Amazon's Redshift warehouse in the cloud.

To learn more, contact us today.

DATA PIPELINE BUILDING

November 2018

In the consulting industry, each situation is unique and requires a specific set of solutions. For this project, we helped our client, the leading financial services company Natwest, move a large IFRS9 and Basel regulatory reporting system from SAS to Amazon's Athena data store. As well as the data migration, hundreds of SAS code modules were re-written using Apache Spark to run on the cloud.

SETTING UP POSTGRES DATABASES & ETL PROCESSES ON AWS

Jan-Dec 2021

For this project, in partnership with data analytics company Verisk and their general insurance business team, we set up two Aurora RDS Postgres databases and established a number of ETL pipelines to feed data into them. This was a huge benefit to that particular team who now had a modern, agile data mart on which to grow their business.

DEALING WITH (REALLY) BIG DATA

Jan 2022 - Jun 2023

For this project, in partnership with energy consultancy Wood Mackenzie we helped them source, curate, and process colossal wind & solar data sets containing hundreds of billions of records.

The primary data store used was AWS Athena with AWS Glue & Batch to load the data. Job loading and processing were orchestrated with AWS Step