Lead Data Engineer
Overview
The Gogo Business Aviation Lead Data Engineer is responsible for building and maintaining robust data pipelines, data integrity, creation of data monitoring tools, and overall performance and continuous improvement of Gogo’s Unified Data Platform (UDP). The LDE provides key insights or trends supported by data to make recommendations on new or existing services and operational efficiencies. The LDE is also responsible for prioritizing projects and managing resources based on business objectives across a team of talented engineers.
Additionally, the Lead Data Engineer will serve as an analytics advocate ensuring that all performance monitoring and analysis capabilities are in place to support Analytics operations downstream. You will play a collaborative role throughout the organization to ensure that the appropriate solutions are made available to Gogo BA customers and to our internal partners.
COME ON BOARD THE GOGO BUSINESS AVIATION MARKET INTELLIGENCE TEAM!
How will you make a difference?
Responsibilities
- Lead and support a team of engineers to meet or exceed technical objectives
- Develop and implement data acquisition and integration pipelines
- Meet or exceed UDP uptime goals and complete any pipeline failures within the established Service Level Agreement (SLA) targets
- Automate data ingestion or processing systems from either primary or secondary data sources and maintain databases/data systems as needed
- Filter and “clean” data, develop custom parsing/processors, review computer-generated logs, printouts, and performance indicators to identify and debug code-related issues
- Map and prioritize technical objectives to support the business across a team of engineers
- Represent the Market Intelligence team in quarterly Scaled Agile Program Increment (PI) Planning to understand stakeholder business requirements, translate into technical development requirements to achieve the desired Company Sprint objectives
- Build relationships with key stakeholders to gain deep understanding of their business to ensure you develop metrics and OKRs consistent with their requirements and priorities
- Where appropriate, increase MI team’s efficiency by developing and educating key stakeholders about available “self service tools” to ensure data is quickly and readily available to them without MI team intervention needed
- Promote Document Driven Development – all projects in production are thoroughly documented and easily accessible
- Conduct critical analysis of key performance indicators to aid with continuous improvement efforts related to network quality and performance
- Identify, analyze, and interpret trends or patterns in complex data sets
- Locate and define new process improvement opportunities
- Support and encourage professional growth within a team of talented engineers
Qualifications
- Bachelor’s Degree or higher in computer science, telecommunications, mathematics or related technical field or equivalent work experience
- 3+ years of experience in a Lead Data Engineering role
Required Skills, Experience and Talents
- Solid knowledge of Object-Oriented Programing in Python is a must
- Strong SQL skills
- Experience working with APIs
- 2+ years of experience working with AWS technologies (Lambda, EMR, EC2, Redshift, S3 etc.)
- Ability to build and optimize data sets, 'big data' data pipelines and architectures
- Experience using big data technologies (Hadoop, Hive, Spark, EMR, EC2, Airflow, etc.)
- Knowledge of data management fundamentals and data storage principles
- Ability to perform root cause analysis on external and internal processes and data to identify opportunities for improvement and answer questions
- Ability to build processes that support data transformation, workload management, data structures, dependency and metadata
- Proficient in data preparation; including automating systems for sourcing, acquisition, integration, and validation of data integrity
- Analytical skills with the ability to collect, organize, analyze, and disseminate significant amounts of information with attention to detail and accuracy
- Report writing, and ability to present and translate complex technical issues to non-technical audiences
- Effective communicator with the ability to work with various stakeholders to understand business processes and conduct deep dives into new and existing data sources as needed
- Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, code reviews, source management, build processes, testing, and operations
- Meticulous commitment to documentation of all UDP data engineering acquisition and pipelines for troubleshooting and business continuity
- Ability to work independently to clarify requests, collect and process data from new and existing sources, and work with other groups to understand underlying issues, driving towards completion of stated goals, seeking information and guidance where required
- Effectively prioritize tasks and projects
- Tactfully challenge decisions or assumptions that are not consistent with data
Desired Skills, Experience and Talents
- Familiarity with Scala
- Experience with workflow management and scheduling, preferably with Apache Airflow
- Previous experience managing a data cloud migration within an existing enterprise platform
- Experience creating or using entity relationship diagrams, or other database documentation methods, to facilitate database development
- Experience in operating data quality frameworks and procedures to improve data quality across the organization
- Salesforce knowledge
- Previous experience working in a wireless network carrier operational environment
Equal Pay Disclosure(s)
Colorado Equal Pay Statement: Disclosure required by sb19-085 (8-5-20) of the minimum salary compensation for this role to be located in the state of Colorado.
Base Pay:
124,800.00 - 156,000.00 USD Annual
Target Annual Short-Term Incentive:
Bonus Plan at 10% (% of Annualized Base Pay)
Eligible for Incentive Stock Program:
Yes
Benefits:
Gogo offers competitive benefits including medical, dental and vision coverage with plans that can fit each employee’s needs. We offer an immediate vesting 401k plan, paid time off and volunteer time off. Employees have the option to participate in an Employee Stock Purchase Plan. Visit the Careers page on our website for more information at www.gogoair.com/careers.
--- --- ---
Gogo is an Equal Opportunity Employer and Affirmative Action Employer and works in compliance with both federal and state laws. We are committed to the concept of Equal Employment opportunity.
Qualified candidates will be considered for employment regardless of race, color, religion, age, sex, national origin, marital status, medical condition, or disability.
The EEO is the law and is available here.
Gogo participates in E-Verify ( English and Spanish ).
Right to Work Statement ( English and Spanish ).