Batch Processing
CCI has used the “Big Data” infrastructure to solve a major telecommunication company’s data processing bottleneck for reporting purposes. Call center tracking data had grown exponentially pushing up against a performance limitation causing a 48 hour delay in availability of the data for external application in the data warehouse staging systems. The scale issues in ETL and in the central data stores were forcing the organization to either compromise on data requirements reducing both scope and granularity of the data collected or committing sizable amounts of capital to expand infrastructure with diminishing returns on performance.
CCI delivered a fully integrated, highly scalable, and low-cost ETL solution based on Hadoop “Big Data” infrastructure to support their growing data needs. The system ingests data from workflow database, transform it, stores it in high volume store, and exports it to various data marts in time for generation of business reports. It runs on low-cost commodity hardware on clustered instances within the corporate cloud, and is projected to provide a linear growth path with minimal performance impact.