want to join an elite group that accelerates innovation? Start here.

Tell SkillStorm about yourself and what you want to achieve in your career. Then we’ll let you know if your next step is becoming a tried-and-true Stormer.

Q

Interested in Hiring Exceptional Tech Talent?

Start here

Q

Interested in Hiring Exceptional Tech Talent?

Start here



want to join an elite group that accelerates innovation?

Start here



Q

Accelerate Your Career

Whether you’re a college graduate, military veteran, or an experienced pro, we can train you, we can upskill you, we can put you to work.

We are storming the marketplace with the highly skilled, experienced, and certified professionals that businesses need.

Find your perfect job.

Data Engineer

SkillStorm is seeking a Data / Hadoop Engineer for our client in Charlotte, NC OR Richardson TX, OR Richmond VA. Candidates must be able to work on SkillStorm's W2; not a C2C position. EOE, including disability/vets.

Job Description:

  • Infrastructure Information Services is looking for top talent to design and build best-in-class Data Management and Integration Services capability over Infrastructure/ITSM data using Hadoop Architecture. The Data Engineer will innovate and transform the systems integration landscape for the Technology Infrastructure organization, while following industry best practices and providing capability maturity in support of Enterprise Data Management standards. The ideal candidate has solid experience in Data Warehousing and Master Data Management Design and Development. Candidate should have a strong understanding of data management concepts and applied DW/MDM development of DB-level routines and objects. Candidate should have experience in migrating traditional Relational Database Management System (RDBMS) to a Hadoop based architecture. In addition, have hands on experience developing in many of the Apache Hadoop based tools. It involves hands-on development and support of integrations with multiple systems and ensuring accuracy and quality of data by implementing business and technical reconciliations. Candidate needs to be able to understand macro level requirements and convert them into actionable tasks to deliver a technically sound product. Candidate should be able to work in teams in a collaborative manner.
  • Analyze current RDBMS Master Data Management platform including orchestrations, workflows, transformations, and help designing a scalable platform based on Hadoop for structured and semi-structure big data.
  • Ability to reengineer traditional batch-based database system and stored procedures using Big Data services using expert level skills in Apache NiFi and Apache Kafka.
  • Developing and implementing data processes using Spark Steaming including using Spark DataFrames, Spark SQL, Spark MLlib.
  • Deploying Apache HBase and applying its capabilities supporting OLTP applications.
  • Accomplished development experience using Apache Flink.
  • Ability to manage multiple priorities

Required Skills:

  • 10+ years of total IT experience
  • At least 5 years of experience developing for Data Warehousing, Data Marts, and/or Master Data Management
  • Deep experience on Hadoop including NiFi, Kafka, Flink, Spark, HBase, HIVE and HDFS.
  • Solid experience implementing trained machine learning models using Spark Streaming and Apache Flink.
  • Programming experience Python, PySpark, Spark SQL
  • Exposure to Relational Database Management Systems using Oracle, DB2 or SQL Server
  • Possesses and demonstrates deep knowledge of the Hadoop Ecosystem
  • Experienced exposure to Hadoop ecosystem
  • Object oriented programming concepts
  • Expert SQL skills
  • Experience in SDLC and best practices for development
  • Ability to work against mid-level design documentation, take it to a low-level design, and deliver a solution that meets the success criteria
  • Knowledge of packaging and promotion practices for maintaining code in development, test, and production

Desired Skills:

  • Primary Skill: Apache NiFi Secondary Skill: Confluent Kafka Tertiary Skill: HBase

#LI-DNI

Similar Jobs

Data Engineer

Contract job in Charlotte

Data Engineer / Python Developer

Contract job in Charlotte

Big Data Engineer

Contract job in Charlotte

Data Scientist

Contract job in Charlotte

Data Modeler

Contract job in Charlotte

Data Architect

Contract job in Charlotte

Data Manager

Contract job in Charlotte

Data Analyst

Contract job in Charlotte

Data / ETL Developer

Contract job in Charlotte

Job Application for
Data Engineer

All qualified applicants will receive consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or status as a protected veteran.

Join the Stormer Community and prepare to advance