Apple
Involvement:
- ThirdEye helped Apple migrate their Teradata based Data Warehouse to a Hadoop based one.
- Components from Apple’s Teradata stack was chipped away and migrated to the new Hadoop stack.
- The team comprised of 11 data engineers, lead by Aparajeeta Das and Pranab Ghosh.
- Developed a Hadoop data warehouse on 500+ nodes cluster operating in an on-premise cloud.
- Migrated Apple’s production services from Teradata to this Hadoop based DW.
- Transformed, analyzed & migrated 500+ terabytes of data.
- Responsible for operational performance tunings.
Technologies Used: Apache Hadoop, MapReduce, Hive, Pig, HBase, SQL, ETL,Teradata.
- Deployed end-to-end system infrastructure for iRadio EDW.
- Delivered and managed iAd performance Metrics for Apple Business Units on Hadoop and Teradata platforms.
- Migrated iCloud and Game Centre end to end reporting applications from Teradata to Hadoop (300+ TB of data).
- iAd Data Modeling – initiated from scratch and completed all levels of Models.
- Fine-tuned several processes on Teradata or on Hadoop side as per business stakeholders need.
- Setup Sandbox environment for data discovery for data scientists.
- Benchmarked various products for suitability of various requirements for Apple internal consumption.
- Setup infrastructure in fraud detection and management in Billing and other Apple iTunes data.
Note: Apple was an indirect customer as the contract was through Infosys.