Big Data Engineer

Job Description

JD:

The position is for an ETL developer with flare in Big Data Tech stack as it is for a migration project.

The person needs to have a good foundation on ETL, DB and knowledge to work independently on Big Data Tech Stacks like Spark sql, writing spark jobs, python, etc.

Key Responsibilities:

• Design/implement data objects using DWH methodologies including Oracle or similar relational database tools (Spark SQL, Hive), SQL and PL/SQL and Python development

• Collaborate with project teams to refine functional requirements and translate into technical architecture/design

• Continuously monitor/tune database performance identifying potential issues/opportunities for improvement and outline recommendations to improve performance

• Oversee change management process for database objects across multiple projects

• Accountable for delivery of the database objects through SIT, UAT and Production

Qualifications:

• Strong experience/advanced knowledge of designing conceptual, logical & physical data models and generating initial Data Definition Language

• Very strong database design/development experience using Oracle 12C/19C

• Experience in writing Spark-SQL and other Big Data Tech Stacks is preferred.

• Expert in SQL & PL/SQL modules such as packages, procedures, functions and other database objects including performance tuning concepts.

• Experience in Python.

• Experience in Talend DI is an added advantage.

• Excellent oral/written communication and ability to work independently in a fast paced environment.

# Years of Experience: 6 to 8 yrs.

Job Summary

Job Code - 20-D-00 (Big Data)
Exp- 6-7 Years
Location- NCR

Role Based Competencies

Mandatory Competencies

Good to Have Competencies