Transforming data management: a success story with Lord Abbett
Infrastructure Redesign
About this project
Montrose Software collaborated with Lord Abbett, a leading investment firm, to analyze and improve a large and complex ETL system. This involved optimizing system performance, automating regression testing, and addressing the challenges posed by an evolving metadata structure in a critical bucketing tool. The results included a 40% performance improvement, enhanced data integrity, and a more streamlined and human-readable metadata system.
scope
Region
New Jersey, United States of America
scope
Region
New Jersey, United States of America
Project team
4 Developers
Tech stack
Java
Python
Azure SQL Server
Batch Script
Perl
About Lord Abbett
Since its founding in 1929, Lord Abbett has maintained a singular focus on managing money. As an investment-led, investor-focused firm, Lord Abbett evaluates every decision from an investment perspective, striving to achieve superior long-term investment performance for its clients. The firm currently manages over $140 billion in assets.
~$199B
assets under management
184
investments professionals
200+
institutional clients
51
partners
The challenge
- Improve the performance of a complex ETL system.
- Simplify the bucketing tool's metadata structure to minimize errors.
- Ensure the integrity and consistency of data through automation and optimization.
Key functionalities
ETL system optimization
Grouped ETL steps based on their nature and replaced standalone scripts with a common metadata-driven tool. This optimization led to over a 40% increase in system performance.
Automated regression tool
Developed and integrated an automated regression testing tool to ensure the integrity of results, which became part of the system’s nightly runs.
Metadata structuring
Extracted the custom metadata language interpreter from the bucketing tool, identified configuration inconsistencies and duplications, and created a human-readable data structure to enforce data integrity.
Project workflow overview
Related case study
Efficient data management: optimizing Lord Abbett's ratings process
Finance
View
Technologies used:
Get in touch
Contact Us