SPR Fashions High-Capacity Consumer Identity Matching and Management System For Infutor Data Solutions
Infutor Data Solutions provides its clients with accurate and extensive consumer identity information, enabling them to create a powerful, single consumer profile. Marketers and product developers lean on Infutor to help them fill in key consumer data and intelligence to improve customer acquisition, reach, retention, conversions, and ROI. Infutor envisioned an entirely new service and product to offer its clients: a way for them to upload millions of consumer records and, within hours, receive a file containing matched records for targeted marketing campaigns. This new service would fill in the missing pieces of information they need to refine their target audiences.
Infutor sought SPR’s expertise to help bring its visionary concept to life through the development of a High Capacity Batch system or HCB.
Facilitating the Client’s Vision
SPR helped Infutor define its goals by actively engaging the client daily and asking questions about what their vision of the product was, thereby allowing them to narrow their focus and better structure product development. In addition, the SPR team provided knowledge and expertise regarding AWS systems and tooling to assist them in adopting best practices for this project as well as for subsequent use throughout Infutor.
The project was designed to achieve Infutor’s goals by employing AWS tools including Lambda, S3, SSM, Serverless AuroraDB, and the Python AWS SDK to provide ease of resource management as well as highly available and scalable infrastructure. The biggest challenge was building an automated build pipeline from greenfield. Previously, the client was using manually updated CloudFormation templates to change environments. SPR implemented Terraform to allow them to quickly build and destroy environments without requiring manual steps. The team also used HashiCorp Terraform to acquire AWS resources and Jenkins to manage deployment.
Delivering Beyond the Build
True to the SPR Way of constantly striving to deliver beyond the build for our clients, the HCB project team provided Infutor with significant value beyond just the HCB project. Although technically 'out of scope' for the project, the SPR team designed and developed an entire automated infrastructure and CI/CD buildout that Infutor can implement on subsequent endeavors. Previously, infrastructure buildout consisted of many manual steps, resulting in potential errors and delays in spinning up new environments. The system developed by SPR significantly reduces manual steps and will allow Infutor to create new environments in a very short amount of time.
In addition, the SPR team developed an installable "service package" consisting of reusable functions predicated on the AWS Boto3 SDK.
Positive Feedback All the Way Around
The feedback has been positive regarding product performance as well as SPR team cultural fit within Infutor. SPR helped to streamline the client’s deployment pipeline and helped the client significantly streamline existing technology.
As of project end, the High Capacity Batch product was able to successfully process a file containing 240+ million records in just hours with nearly 100% accuracy – a significant decrease from pre-existing systems.
AWS: S3, EC2, Lambda, SSM, SecretsManager, Boto3, Serverless AuroraDB
Apache Airflow, HashiCorp Terraform