Data and API Development Case Study

Dsposal was contracted to build an API for MRW, the market-leading trade press organisation for the recycling and waste management industry. MRW have had a longstanding and popular printed directory which they wanted to modernise and improve by moving online. Dsposal’s work with the Environment Agency’s Public Registers API and focus on promoting compliance complimented MRW’s objectives of ensuring that waste companies featured on their directory were licensed and permitted.  

The programming interface was to give access of Dsposal’s directory data (powered by the EA’s API) combined with MRW’s own data which covers more than just waste companies, such as plant and machinery, professional services and trade bodies. This feed would then populate their directory so that their users could search for services within the resources, recycling and waste industries. Companies feature on the directory for free with the option to enhance their listing for greater impact and reach. 

Objectives of the Project

The core objective of this work was to develop an Application Programming Interface (API) built to OAuth 2.0 standards so that the technical team at MRW can call the Dsposal database to populate their directory with well-structured data.

A secondary objective was to load all MRW’s flat directory data into our 3NF database to create a complete dataset that combined their data with our data powered by the EA’s API.

Research

Technical and user discovery was completed by our CTO, Georgios Rovolis.  This included investigation into MRW’s technical needs and the requirements of the API working closely with the MRW team.

Technical Build

Once the research had been completed CIO, Tom Passmore, built ELT packages to load the flat data into the Azure SQL database. Mapping tables and indexes had to be created to match MRW’s data with that within Dsposal. These tables and indexes kept query times as low as possible. To add richness to the data, stored procedures were produced to add additional information.

Working in parallel Georgios Rovolis built the API and documentation that allows the technical team at MRW to work with and implement the tool.  Below is a list of technologies used to build the final API: 

Usability Testing was completed by Tom Passmore and Georgios Rovolis. Hotfixes were released by Georgios Rovolis.

Image of the MRW Directory Data Pipeline

Outcome

Upon the release of the MRW Directory the service was an immediate success.  Data from Dsposal's databases quickly and easily flowed to MRW’s Directory. 

Screen Capture MRW Directory

Feedback

“Dsposal granted MRW a great deal of expertise and commitment in delivering the directory. Each stage of the process ran smoothly and technical details were clearly explained along the way. MRW now has the most comprehensive and up-to-date directory of its kind in the UK and this would not have been possible without Dsposal.” - Corin Williams, editor, MRW