Create Alert

Data Engineer - Lead

Apply now »

Posted On: 5 Mar 2026

Location: Noida, UP, India

Company: Iris Software

Why Join Iris?
Are you ready to do the best work of your career at one of India’s Top 25 Best Workplaces in IT industry? Do you want to grow in an award-winning culture that truly values your talent and ambitions?
Join Iris Software — one of the fastest-growing IT services companies — where you own and shape your success story.
 
About Us  
At Iris Software, our vision is to be our client’s most trusted technology partner, and the first choice for the industry’s top professionals to realize their full potential.
With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services.
Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.

Working with Us
At Iris, every role is more than a job — it’s a launchpad for growth.
Our Employee Value Proposition, “Build Your Future. Own Your Journey.” reflects our belief that people thrive when they have ownership of their career and the right opportunities to shape it.
We foster a culture where your potential is valued, your voice matters, and your work creates real impact. With cutting-edge projects, personalized career development, continuous learning and mentorship, we support you to grow and become your best — both personally and professionally.
Curious what it’s like to work at Iris? Head to this video for an inside look at the people, the passion, and the possibilities. Watch it here.

Job Description

Core Technologies

Apache Spark (Core, SQL, Structured Streaming), PySpark, Databricks (AWS/Azure), Advanced SQL 

DevOps & CI/CD

Jenkins, Git/GitHub/Bitbucket

Programming

Python, SQL, Java/Scala (Nice to have)

Cloud & Infrastructure

AWS (S3, EMR, EC2, IAM, CloudWatch)/Azure- Preferred, Databricks Runtime & Cluster Management- Preferred

Streaming & Integration

Apache Kafka, Snowflake integration (preferred)(Nice to have), Airflow (preferred)(Nice to have)

 Technology and qualifications will be same,  please include below point also 

  • Perform Spark performance tuning
  • DAG analysis
  • Shuffle optimization
  • Partition strategies
  • Executor/memory tuning

Mandatory Competencies

Big Data - Big Data - Pyspark
Data Science and Machine Learning - Data Science and Machine Learning - Databricks
Data Science and Machine Learning - Data Science and Machine Learning - Apache Spark
Data Science and Machine Learning - Data Science and Machine Learning - Python
Database - Database Programming - SQL
Cloud - AWS - AWS S3, S3 glacier, AWS EBS
DevOps/Configuration Mgmt - DevOps/Configuration Mgmt - GitLab,Github, Bitbucket
DevOps/Configuration Mgmt - DevOps/Configuration Mgmt - Jenkins
Beh - Communication and collaboration

Perks and Benefits for Irisians
Iris provides world-class benefits for a personalized employee experience. These benefits are designed to support financial, health and well-being needs of Irisians for a holistic professional and personal growth. Click here to view the benefits.

Apply now »