We are storming the marketplace with the highly skilled, experienced, and certified professionals that businesses need.

Find your perfect job.

Spark Developer (Closed)

SkillStorm is seeking a Spark Developer for our client in Charlotte, NC. Candidates must be able to work on SkillStorm's W2; not a C2C position. EOE, including disability/vets.

Summary:

  • Hands on Apache Spark expert with experience in implementing complex distributed compute systems with generic capabilities using Apache Spark, having deep knowledge of spark internals and python expertise.
  • 7+ years of relevant experience.
  • This role will work with our interpreter guru to ensure the execution DAG is built with Spark in mind – reduce/eliminate impedance mismatch.
  • This role will also be heavily engaged in training/educating current team members.

Job Description:

  • Global Risk Analytics (GRA) technology group is looking for a talented Apache Spark programmer Guru to join our growing team.
  • We are building the next generation platform for model development and execution for our business partners.
  • The vision for this platform is to provide generic capabilities to author workflows that will run model execution and related processes at scale on our internal compute grid.
  • The platform is meant to provide a high degree of abstraction where model developers will define the data they want to bring in, the processing of the data, and the results, all via generic constructs provided by the platform.
  • The platform will be built from the ground up with distributed compute designed in as a core concept, such that all workloads will be distributed optimally with minimal input from model developers who will author workflows.
  • This is a hands-on, individual contributor role which will be focused on building and optimizing the distributed compute strategy of the execution DAG. This role will require knowledge of Apache Spark internals, beyond being an expert user of the Spark API.
  • This is an exciting opportunity that will exercise the distributed programming mettle of the most skilled Apache Spark Guru.

Required Skills and Experience:

  • Experience in implementing complex distributed compute systems with generic capabilities using Apache Spark.
  • Deep knowledge on Apache Spark internals.
  • Ability to come up with a strategy factory that can dynamically create an execution plan for optimal distributed compute on a Spark grid for varying workloads.
  • Knowledge of Advanced Algorithms and Graph Theory
  • Deep Python expertise
  • Advanced degree in computer science or mathematics
  • 7+ years of relevant experience
  • Nice to have
  • Apache Spark committer
  • Experience in building a software product/platform/framework from ground up

Other Skills:

  • Strong Problem Solving and trouble shooting skills
  • Being able work under pressure and tight deadlines
  • Being able to take pride in writing elegant code with industry standards
  • Experience in Test Driven Development

#LI-DNI

Similar Jobs

Business Event Analyst

Contract job in Charlotte

Technical Design Lead

Contract job in Charlotte