Detailed Job Description:
Requires 3+ years of experience with PySpark– we will conduct white board coding test to review your skills.
Requires 4-5 years of experience with Spark – we will conduct white board coding test to review your skills.
Requires 5-6 years of experience with Python – we will conduct white board coding test to review your skills.
8-9+ years of experience with Hadoop/ big data.
10+ years of ETL experience nice-to-have (Informatica, SSIS, Talend, Datastage.
3-5 years Hands on experience with Python.
1-2 years’ experience with Airflow.- Airflow-related automation design.
Very strong with Complex Spark SQL + Complex SQL queries and SQL Joins.
Databricks experience is nice-to-have.
2-3 years of Azure cloud experience.
Understand denorm/normalization.
Experience required: 10 Years
Reference : Sr. Data Engineer jobs
Source: http://jobrealtime.com/jobs/technology/sr-data-engineer_i11653
Jobs Real Time 