Create Alert

Lead - Data Engineer

Apply now »

Posted On: 22 Feb 2025

Location: Noida, UP, India

Company: Iris Software

Why Join Us?
Are you inspired to grow your career at one of India’s Top 25 Best Workplaces in IT industry? Do you want to do the best work of your life at one of the fastest growing IT services companies? Do you aspire to thrive in an award-winning work culture that values your talent and career aspirations? It’s happening right here at Iris Software.

 

About Iris Software
At Iris Software, our vision is to be our client’s most trusted technology partner, and the first choice for the industry’s top professionals to realize their full potential. With over 4,300 associates across India, U.S.A, and Canada, we help our enterprise clients thrive with technology-enabled transformation across financial services, healthcare, transportation & logistics, and professional services.

Our work covers complex, mission-critical applications with the latest technologies, such as high-value complex Application & Product Engineering, Data & Analytics, Cloud, DevOps, Data & MLOps, Quality Engineering, and Business Automation.

 

Working at Iris
Be valued, be inspired, be your best.
At Iris Software, we invest in and create a culture where colleagues feel valued, can explore their potential, and have opportunities to grow.
Our employee value proposition (EVP) is about “Being Your Best” – as a professional and person. It is about being challenged by work that inspires us, being empowered to excel and grow in your career, and being part of a culture where talent is valued. We’re a place where everyone can discover and be their best version.

Job Description

Manage cloud data lake development and deployment on AWS /Databricks.

  • Databricks Platform Admin: Manage and create workspaces, configure cloud resources, view usage data, and manage account identities, settings, and subscriptions in Databricks

Development responsibilities:

  • Optimize data pipelines for performance and efficiency.
  • Work with Databricks clusters and configuration management tools.
  • Use appropriate tools in the cloud data lake development and deployment. Developing/implementing cloud infrastructure to support current and future business needs.
  • Provide technical expertise and ownership in the diagnosis and resolution of issues.
  • Ensure all cloud solutions exhibit a higher level of cost efficiency, performance, security, scalability, and reliability.

Technical Skills:

  • Experience & Proficiency with Databricks platform - Delta Lake storage, Spark (PySpark, Spark SQL). Must be well versed with Databricks Lakehouse, Unity Catalog concept and its implementation in enterprise environments.
  • Familiarity of data design pattern - medallion architecture to organize data in a Lakehouse.
  • Experience & Proficiency with AWS Data Services – S3, Glue, Athena, Redshift etc.| Airflow scheduling
  • Proficiency in SQL and experience with relational databases.
  • Proficiency in at least one programming language (e.g., Python, Java) for data processing and scripting.
  • Experience with DevOps practices - AWS DevOps for CI/CD, Terraform/CDK for infrastructure as code

•    Good understanding of data principles, Cloud Data Lake design & development including data ingestion, data modeling and data distribution.

Jira:

•   Proficient in using Jira for managing projects and tracking progress.

Other Skills:

  • Strong communication and interpersonal skills.
  • Collaborate with data stewards, data owners, and IT teams for effective implementation
  • Understanding of business processes and terminology
  • Experienced with Scrum and Agile Methodologies

Qualification

  • Bachelor’s degree in information technology or a related field. Equivalent experience may be considered.
  • Overall experience of 8-12 years in Data Engineering

Mandatory Competencies

Database - SQL
Python - Python
Java - Core JAVA
Others - Micro services
Data Science - Databricks
Big Data - PySpark
Big Data - SPARK
Data on Cloud - AWS S3
DevOps - CI/CD
DevOps - Terraform
Agile - Scrum Master
Beh - Communication and collaboration

Perks and Benefits for Irisians

At Iris Software, we offer world-class benefits designed to support the financial, health and well-being needs of our associates to help achieve harmony between their professional and personal growth. From comprehensive health insurance and competitive salaries to flexible work arrangements and ongoing learning opportunities, we're committed to providing a supportive and rewarding work environment.
Join us and experience the difference of working at a company that values its employees' success and happiness.

Apply now »