Bigdata Engineer

Position: Bigdata Engineer

Location: Dearborn, MI

Type: Contract

 

Job Description:

 

Responsibilities:

The Big Data Developer / Data Engineer will provide expertise in a wide range
of technical areas, including but not limited to: Cloudera Hadoop ecosystem.
Routine responsibilities include:

 

·        Conduct POCs (proof of concept) and pilots to try new solutions and
provide summary of results

·        Participate in detailed technical design, development,
implementation and support of Big Data applications                 

·        Maintain standards compliance and ensure development artifacts are
in alignment with patterns/ frameworks designed by software engineering teams

 

Qualifications:

?                  Bachelor’s degree in Computer Science or related field

?                  Familiarity with Spark programming paradigms (batch and
stream-processing). Understanding of different data abstraction objects used in
spark for different use cases, use of optimal data format and other
optimization techniques.

?                  Strong programming skills in at least one of the following
languages: Java, Scala. Familiarity with a scripting language like Python as
well as Unix/Linux shells

?                  Strong knowledge of writing optimized Spark and Hive sql
and experience to tune poor performing queries.

?                  Outstanding programming and debugging skills. Strong
knowledge of common algorithms and data structures.

?                  Experience with Java and/or Scala, preferably with Spring
framework. 3+ years preferred.

?                  Strong experience with SQL and relational databases like
PostgreSQL, MySQL, SQL Server or Oracle.

?                  Familiarity with one or more stream processing / queuing
technologies like Spark Streaming, Kafka, Kinesis, Flink, etc. preferred.

?                  Familiarity and prior experience with Agile / Scrum
development methodologies

?                  Prior eXtreme Programming (XP) disciplines including
paired programming and Test-first/Test Driven Development (TDD)

?                  Prior Experience deploying to cloud platforms, preferably
Pivotal Cloud Foundry or Cloud Foundry

?                  Prior experience in Continuous Integration/Continuous
Delivery tools and pipelines such as Jenkins, Maven, Gradle, etc.

 

Reference : Bigdata Engineer jobs
Source: http://jobrealtime.com/jobs/technology/bigdata-engineer_i15030