Hadoop – Module / Technical Lead

Job Description

The candidate is expected to play lead / consultant who can interact with the customer, work with teams (local or remote) and lead the technical or business discussions in key meetings. An ideal candidate must have been involved in this role, where she/he has led the design/implementation of several complex data-oriented solutions on Azure/AWS Data Platform

The role is a combination of design/implementation and consulting with hands-on experience. It will require one to envision, design, and implement the technical solution working with customer and internal technical team.

Primary Skills – Hadoop, Hive, Spark and Python or Scala or Java

  • Experience – 4 to 11 years
  • Excellent verbal and written communication. Should be able to speak confidently throughout the conversation
  • Experience working with customer Business/IT team
  • Mandatory to have end-to-end experience working in a Hadoop Data environment (Dev, QA, and Prod) with large data sets (Petabytes).
  • Experience with MapReduce code builds and deployments for data sourcing and loads into the Hadoop ecosystem
  • Very comfortable with HIVE and HIVEQL
  • Comfortable with the broader Hadoop ecosystem – HDFS, Yarn, Ambari, Zookeeper, Presto
  • Experience working on Apache Spark creating data processing jobs and running them on Spark clusters
  • Data migration experience from Hadoop On-Prem to HDInsights preferred
  • Knowledge of challenges faced in converting MapReduce jobs to Spark
  • Must have worked on several projects in the big data space
  • Hands-on with experience with
    • Cloudera Hadoop 5.x
    • Hadoop experience: 2-4 years
    • Spark experience – 2-4 years
    • Python and/or Java/ or Scala

    Apply Here