Big Data Developer

  • Data & Analytics
  • Jersey City, United States

Big Data Developer

Job description

Who we are

At Appeagle, we are building software to help online sellers make informed decisions by delivering actionable data and insights. We’re a team of problem solvers and overachievers who seek out others who are also passionate and relentless at their respective crafts. We’re growing rapidly and focused on creating a tight-knit group of people that enjoy each other’s company. We work hard not because we’re told to, but because we genuinely love what we do. We believe wholeheartedly in a work/life balance and taking care of our most valuable asset - our people.

Who we're looking for 

We are looking for an engineer who is excited to build big data platforms for processing large data sets, design data warehousing and collect and load data from many sources. You will be able to amplify our product’s intelligence and advance customer performance metrics, all while working with the latest, leading-edge cloud-based technologies.


If you are both a team player and independently resourceful, you will have the opportunity to lead us into the next generation of data-driven software. You have exceptional attention to detail, have an inquisitive approach to problem-solving, and are able to maintain focus on the larger picture. As a member of the Analytics team, you will focus on the mission-critical use of data in the support of Appeagle’s business and partners.


What you'll do

  • Support analysis initiatives by configuring AWS EMR clusters, Data Pipeline, Spark and other big data systems
  • Coordinate adding new data sources, and design and manage data lake
  • Design storage schemes in various AWS technologies
  • Monitor and troubleshoot data flows, ETL/ELT’s, and maintenance processes
  • Guarantee integrity of data in big data systems


What you'll bring

  • MapReduce and Hadoop experience (HDFS)
  • Experience with data warehousing (OLAP)
  • Extract Transform and Load (ETL) development and maintenance experience
  • Experience with data modeling
  • Understand business requirements and translate into technical specifications
  • Clearly communicate analysis results and recommendations
  • Collaborate and take ownership of work
  • At least 3 years relevant business intelligence/data warehouse experience
  • Experience with Amazon AWS data tools like EMR and Data pipeline
  • Experience with Spark, Hive, Pig or other MapReduce languages
  • Experience with Linux/UNIX, Python, Perl or Ruby
  • Experience with machine learning or statistical analysis
  • Experience with database/SQL performance tuning


What you'll get

  • 401k plan with company match
  • Weekly catered lunch and Friday happy hours
  • Half-day Friday’s - year round!
  • Fully stocked kitchen with great coffee and snacks
  • Flexible vacation policy and paid holidays
  • Paid parental/family leave
  • Health, vision and dental coverage
  • Commuter benefits
  • Fitness reimbursements
  • Company sponsored events


Join our team as we prepare to move to our brand new headquarters located on the Jersey City waterfront, just a 4-minute train ride from lower Manhattan.