the smart solution for Pasadena jobs

Spark Data Engineer

Company: Red Ventures
Location: Pasadena
Posted on: June 12, 2018

Job Description:

Spark Data Engineer
Pasadena, CA

The mission of our data team at Red Ventures to make data easy-to-use for everyone. We are hiring Spark Engineers who are excited to overcome challenges, work with the latest AWS technologies, and continue making our data better.

Our Spark Engineer will be a key part of building our data infrastructure; this includes using Spark for streaming applications and/or as an ETL tool, Data Aggregation, Column Operations, User Defined Functions, Caching and using the Spark UI to analyze behavior and performance.

You will join a team of highly skilled engineers who design, develop and automate high-quality, scalable solutions across the entire data lifecycle, from raw data to powerful insights and analytics. Basically, we are using Spark as our universal program on how we are transferring data across multiple platforms.

If you want to be a part of a dynamic team solving business problems using data, this is the role for you. Skills:

  • Spark, working in RDDs and DataFrames/Datasets API (with emphasis on DataFrames) to query and perform data manipulation
  • Spark Structured Streaming
  • Experience building large scale Spark applications, ideally with either Batch processing and/or Streaming processing
  • Scala would be ideal but a solid knowledge of Java is also acceptable
  • Experience in SparkSQL (Broadcast Joins)
  • Experience with cloud computing platforms, we use AWS (Kinesis, S3, Lambda, DynamoDB)
  • Has experience with ANSI SQL relational database (Oracle, SQL, Postgres, MySQL) Nice to haves:
    • Linux common working knowledge, including navigating through the file system and simple bash scripting
    • General knowledge of distributed systems and distributed data processing frameworks
    • Experience with Storm, Kafka, or Cassandra is a plus
    • Knowledge about agile software processes

      About Red Ventures:

      Red Ventures is a leading digital consumer choice platform based in Charlotte, North Carolina. Through deeply integrated brand partnerships and consumer-facing assets, Red Ventures connects online customers with products and services across high-growth industries including home services, financial services, and healthcare. Founded in 2000, Red Ventures has more than 3,500 employees in offices across the Carolinas, California, Seattle, Washington, and Sao Paulo, Brazil.

      Apply Now - provided by Dice Agile, ANSI, API, Bash, Database, Java, Lifecycle, Linux, MySQL, mysql, Oracle, SQL

      Keywords: Red Ventures, Pasadena, Spark Data Engineer, Engineering, Pasadena, California

      Click here to apply!

      Didn't find what you're looking for? Search again!

      I'm looking for
      in category

Other Engineering Jobs

Space Propulsion Mechanical Engineer 4
Description: At Northrop Grumman, our employees have incredible opportunities to work on revolutionary systems in air and space that impact people ----------s lives around the world today, and for generations to come. (more...)
Company: Northrop Grumman
Location: Redondo Beach
Posted on: 06/19/2018

Diesel Mechanic
Description: br br ul br br br br Job Title Diesel Mechanic Location Montebello, CA Department Fleet Maintenance FLSA Status Non-Exempt Shifts hiring Full-time Pay Grade 2,500 sign on bonus br br (more...)
Company: LifeLine Ambulance (CA)
Location: Montebello
Posted on: 06/19/2018

Engineer Electronics 3
Description: At Northrop Grumman we develop cutting-edge technology that preserves freedom and advances human discovery. Our pioneering and inventive spirit has enabled us to be at the forefront of many technological (more...)
Company: Northrop Grumman
Location: Redondo Beach
Posted on: 06/19/2018

Combustion Process Lead Engineer
Description: Requisition Number 18-0015 Post Date 4/3/2018 Job Family Research Development Title Combustion Process Lead Engineer City Woodland Hills State CA DescriptionOverview The Combustion Process Lead Engineer (more...)
Company: Gas Technology Institute
Location: Woodland Hills
Posted on: 06/19/2018

devops engineer
Description: At Entertainment Partners we help to power--Oscar-winning films, Emmy-winning shows, and Clio-winning commercials. Feel the--satisfaction of doing work that directly impacts the most exciting industry (more...)
Company: Entertainment Partners
Location: Burbank
Posted on: 06/19/2018

Sr. Hardware Engineer
Description: The Sr. Hardware Engineer serves as a member of the Consumer Premise Engineering Technical Review Board and oversees the specification, analysis, design, testing and validation of AT T Consumer Premise (more...)
Company: AT&T
Location: El Segundo
Posted on: 06/19/2018

Applications Engineer, II
Description: Job Description and Requirements br br THIS POSITION IS ELIGIBLE UNDER THE TERMS OF THE EMPLOYEE REFERRAL PROGRAM ERP : br br Provide technical and engineering insight and direction to support (more...)
Company: Synopsys
Location: San Diego
Posted on: 06/19/2018

Senior Project Engineer
Description: Join one of the Top Growing General Contractors in the San Diego Area. They have the area's most high profile projects and an Awesome company Culture.Lead by some the most highly successful industry veterans (more...)
Company: LavaRock LLC
Location: San Diego
Posted on: 06/19/2018

Engineer II
Description: Engineer II Shire is the leading global biotechnology company focused on serving people with rare diseases and other highly specialized conditions. We strive to develop best-in-class products, many of (more...)
Company: Shire Pharmaceuticals
Location: Los Angeles
Posted on: 06/19/2018

Indoor Cycling Mechanic / Facility Assistant
Description: Join the Team Aura Looking for Indoor cycling bike mechanic able to work mid day and --weekends.Recognized as one of Los Angeles' leading fitness studios Aura Cycle and Aura Yoga are hiring We are looking (more...)
Company: Aura Cycle
Location: Los Angeles
Posted on: 06/20/2018

Log In or Create An Account


Forgot password?

Find us on Facebook

Find us on LinkedIn

Get the latest California jobs by following @recnetCA on Twitter!

Pasadena RSS job feeds