Live · Part of Leveler
DataBrew
Integrating difficult source data into trustworthy services.
DataBrew is part of the Leveler ecosystem. I led engineering of its data APIs and ingestion pipelines for Nigerian market, financial and government datasets.
Live data services within Leveler
DataBrew is live within Leveler. I built ingestion and validation pipelines and data APIs; API response times measured below 70 ms in load testing. That figure applies to the measured setup rather than every endpoint or production workload.
My contribution
- Integrated market-data sources and built cleaning and validation pipelines for inconsistent upstream records.
- Organized incoming information into consistent datasets exposed to applications and developers through APIs.
- Load-tested API responses at under 70 ms in the measured test setup.
The problem and decisions
Keeping data dependable meant establishing repeatable transformations, clear failure handling and predictable contracts at the API boundary. I treated upstream irregularities as a platform concern, not something every client should need to solve.