Data Engineer with Spark

by Jobs Real Time

Position:- Data Engineer with Spark and Python| AR- 245274

Location:- McLean, VA. (Day-1 Onsite| 3 days Onsite & 2 Days remote) 

 

 

Job Description

New – Spark/Python Developer ? 7-8 Years. ( Must be strong in Spark with
Python experience)

 

Develop, program, and maintain applications using the Apache Spark open
source framework

Work with different aspects of the Spark ecosystem, including Spark SQL,
DataFrames, Datasets, and streaming

Spark Developer must have strong programming skills in Java, Scala, or
Python

Familiar with big data processing tools and techniques

Proven experience as a Spark Developer or a related role

Strong programming skills in Java, Scala, or Python

Familiarity with big data processing tools and techniques

Experience with the Hadoop ecosystem

Good understanding of distributed systems

Experience with streaming data platforms

Excellent analytical and problem-solving skills

 

Key Skills:

Java springboot with microservice architecture knowledge

REST/GraphQL

Mongo

k8s (preferably EKS)

TDD, ATDD

Java/Python Spark

AWS: s3, Lambda, Step Function, AMQ, SNS, SQS, CloudWatch Events

Reference : Data Engineer with Spark jobs
Source: http://jobrealtime.com/jobs/technology/data-engineer-with-spark_i19938

Leave a comment