Share this Job

Big Data Engineer

Apply now »

Date: 18-Jan-2023

Location: Noida, India

Company: Iris software

Job Description


The position is for an ETL developer with flare in Big Data Tech stack as it is for a migration project.

The person needs to have a good foundation on ETL, DB and knowledge to work independently on Big Data Tech Stacks like Spark sql, writing spark jobs, python, etc.


Key Responsibilities:

• Design/implement data objects using DWH methodologies including Oracle or similar relational database tools (Spark SQL, Hive), SQL and PL/SQL and Python development

• Collaborate with project teams to refine functional requirements and translate into technical architecture/design

• Continuously monitor/tune database performance identifying potential issues/opportunities for improvement and outline recommendations to improve performance

• Oversee change management process for database objects across multiple projects

• Accountable for delivery of the database objects through SIT, UAT and Production



• Strong experience/advanced knowledge of designing conceptual, logical & physical data models and generating initial Data Definition Language

• Very strong database design/development experience using Oracle 12C/19C

• Experience in writing Spark-SQL and other Big Data Tech Stacks is preferred.

• Expert in SQL & PL/SQL modules such as packages, procedures, functions and other database objects including performance tuning concepts.

• Experience in Python.

• Experience in Talend DI is an added advantage.

• Excellent oral/written communication and ability to work independently in a fast paced environment.

# Years of Experience: 6 to 8 yrs.

Job Summary

Job Code - 20-D-00 (Big Data)
Exp- 6-7 Years
Location- NCR


Role Based Competencies

Tech - Requirement Management S/W
Tech - NFR
Tech - High level design
Tech - Code quality and coding standards
Beh - Result Orientation
Tech - Code Reviews
Tech - Build Management
Tech - Unit Testing
Beh - Information Seeking
Tech - Agile Methodology
Tech - Analytical \ Problem Solving
Beh - Communication
Beh - Customer Orientation
Beh - Collaboration

Mandatory Competencies

Big Data - SPARK
Python - Python
ETL - Datastage
Big Data - Hive

Good to Have Competencies