Data Engineer (Scala Spark)
About Position
Scala Spark Requirement
What You’ll Do
- Work on new features development, RTB tickets.
- Create a design document for any enhancement or feature request in platform.
- Estimate the effort required for building / integrating capabilities, get approval from PM/EM/Architect.
- Create epics / stories for each of work items and detailed plan of action.
- Ensure code coverage, FMEA and end-to-end testing is planned for each feature/enhancement made.
- Development works (PRs) needs to be reviewed by leads / managers before presenting in Sprint demos before releasing it to prod.
- Actively monitor the released features in Dev /Pre-Prod and Prod environments for couple of days to certify expected functionality.
Expertise You’ll Bring
Must have: Spark / Spark Streaming hands-on, In Depth understanding of Spark Internals, Spark configuration, Spark Memory Management, Scala, Databricks.
Good to have: Python, AWS (S3, EC2, EMR, IAM, Athena, Lambda), Kafka, Hive, Kubernetes (Spark on Kubernetes), Docker.
Benefits
- Competitive salary and benefits package.
Culture focused on talent development with quarterly promotion cycles and company-sponsored higher education and certifications.
- Opportunity to work with cutting-edge technologies.
- Employee engagement initiatives such as project parties, flexible work hours, and Long Service awards.
- Annual health check-ups.
- Insurance coverage: group term life, personal accident, and Mediclaim hospitalization for self, spouse, two children, and parents.
Our company fosters a values-driven and people centric work environment that enables our employees to:
- Accelerate growth, both professionally and personally.
- Impact the world in powerful, positive ways, using the latest technologies.
- Enjoy collaborative innovation, with diversity and work-life wellbeing at the core.
- Unlock global opportunities to work and learn with the industry’s best.
Let’s unleash your full potential. See Beyond, Rise Above
Job Features
Job Category | Full Time |