want to join an elite group that accelerates innovation? Start here.

Tell SkillStorm about yourself and what you want to achieve in your career. Then we’ll let you know if your next step is becoming a tried-and-true Stormer.

Q

Interested in Hiring Exceptional Tech Talent?

Start here

Q

Interested in Hiring Exceptional Tech Talent?

Start here



want to join an elite group that accelerates innovation?

Start here



Q

Accelerate Your Career

Whether you’re a college graduate, military veteran, or an experienced pro, we can train you, we can upskill you, we can put you to work.

We are storming the marketplace with the highly skilled, experienced, and certified professionals that businesses need.

Find your perfect job.

Big Data Hadoop Engineer

SkillStorm is seeking a Big Data Hadoop Engineer our client in Jersey City, NJ OR Charlotte, NC OR Pennington, NJ. Candidates must be able to work on SkillStorm's W2; not a C2C position. EOE, including disability/vets.

Description:

  • Senior Big Data Hadoop Engineer

Position Summary:

  • Data Platform Services OMNI initiative is looking for a Hadoop Engineer who will be responsible for development of the OMNI Big Data Platform. The ideal candidate is someone who has hands-on experience developing in the Hadoop, Cloudera data environment. The candidate will be working with agile teams and responsible for all aspects of SDLC.
  • Exhibits strong knowledge of data structures and Big data modeling.
  • Experience in Hadoop/HDFS/SPARK concepts and ability to write Spark Dataset, Data frame & HiveQL jobs.
  • Proven understanding with Hadoop, Spark, Hive and ability to write Shell scripting.
  • Familiarity with data loading tools like Sqoop, Flume and Kafka. Knowledge of workflow/schedulers like Oozie.
  • Good aptitude in multi-threading and concurrency concept. Loading data from disparate data source sets.
  • Added advantage with certifications like Cloudera Developer (CCA175), Spark & Hive/Administrator Certifications added advantage.
  • Hands on experience with NO SQL databases. Ability to analyze, identify issues with existing cluster, suggest architectural design changes.
  • Ability/Knowledge to implement Data Management and Governance in Hadoop Platform.

Responsibilities:

  • Experience in Apache Hadoop/Spark development
  • Well versed in Linux Environment
  • Extensive experience in application development
  • Excellent analytical and business process flows, design and diagrams skills
  • Strong Collaboration and Team skills
  • Proven history of delivering against agreed objectives
  • Demonstrated problem solving skills
  • Ability to pick up new concepts and apply to knowledge
  • Ability to coordinate competing priorities
  • Ability to work in diverse team environments that are local and remote
  • Strong Communication skills (Verbal and Written)
  • Work with minimal supervision

Primary Skill:

  • Hadoop

Required Skills:

  • Bachelor's degree from an accredited college or university with 5+ years hands on experience in coding for the following Hadoop Eco System:
  • Hadoop
  • Spark
  • Spark-SQL
  • Hive on Tez, Hive 3.x
  • Impala
  • Oozie
  • Job Scheduler (i.e. like Autosys)
  • Shell Scripting

Desired Skills:

  • Java, Python, Scala, Py-Spark
  • Kafka
  • HBASE
  • Restful Services
  • Machine Learning/Predictive analytical
  • Spark streaming

Years of Experience Required:

  • 5+

Top Required IT/Technical Skill-Sets:

  • Hadoop
  • Spark
  • Hive on Tez, Hive 3.x
  • Spark-SQL
  • Impala
  • Oozie
  • Job Scheduler (i.e. like Autosys)
  • Shell Scripting

#LI-DNI

Similar Jobs

Business / Data Analyst

Contract job in Jersey City

Business / Data Analyst

Contract job in Jersey City

DevOps Engineer / SRE

Contract job in Jersey City

CI/CD Engineer

Contract job in Jersey City

Sr. Systems Engineer

Direct Hire job in New York

Entry Level Software Engineer

Contract job in New York City

Hadoop / Python Developer

Contract job in Pennington

Systems Engineer

Contract job in Pennington

Systems Engineer

Contract job in Pennington

Job Application for
Big Data Hadoop Engineer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Join the Stormer Community and prepare to advance