Data Applications Engineer - Data Intelligence Team
SpotX is the leading global video advertising platform that enables media owners and publishers to monetize premium content across desktop, mobile and connected TV devices.
Visit our About Us page to learn more.
Company: SpotX, Inc.
Requisition ID: 23110
SpotX is seeking a highly talented Data Applications Engineer who can be an important part of our growing Data Intelligence team located in Broomfield, CO. We are a dynamic but casual environment with highly talented peers. The most successful team members are versatile, methodical and enjoy focusing on new challenges.
At SpotX, we process and store over 50 billion events per day which means you will need to bring your experience in crafting and working with an architecture capable of handling hundreds of thousands of events per second. Currently we are producing around 60TB of new data a day which is among one of the highest producers of data in our industry.
We need someone who is interested in working with incredibly big data on a daily basis and helping develop performant applications and pipelines to support Data Science and Business Intelligence initiatives. If this sounds like you, please apply!
Making an immediate impact:
- Data Application development and implementation
- Standing up automated ETL tasks to transform and curate existing data
- Working closely with Data Scientists to help build out automated machine learning pipelines
- Loading disparate data sets and performing analysis of vast data stores
- Developing new tools and technologies in the video ad serving space
- Participate in daily standup meetings and all meetings of the agile SDLC: planning, application design, estimation, retrospectives, demos, etc.
Needed SpotX’er talents:
- 1+ years experience working in big data
- Linux knowledge & database experiences (SQL, etc.)
- Experience building big data pipelines in Spark
- Experience working on Hadoop clusters
- Ability to program in a variety of languages (e.g., Python, Scala, Java)
- Experience working with Hive, YARN, and/or MapReduce-style frameworks
- Object-oriented programming skills
- Ability to work with several applications at once
- Excellent debugging and troubleshooting skills
Bonus SpotX’er talents:
- Strong experience with Scala
- Experience with ingesting data from HDFS to Druid
- Experience running queries on multiple PB of data
- Experience using Airflow to automate large ETL jobs
- Experience working on a Cloudera cluster
- Continuous deployment experience (e.g., Jenkins, Puppet, Nexus)
SpotX Perks:
- Work-life balance
- Unlimited PTO (work it out with your team first!), company closed from Christmas to New Years
- Make a real difference - your code reaches millions of people as soon as you release it
- Work in a fun, casual, team environment – flip flops OK
- Frisbees and foosball tables
- Benefits such as medical, dental and 401(k)