Data Engineer III - Spectrum Reach
Spectrum Reach (www.spectrumreach.com) grows businesses of all sizes with custom, multiscreen advertising solutions, backed by the power of TV, data, innovation, community experts, and unforgettable creative.
JOB SUMMARY
Responsible for maintaining scalable, reliable, consistent and repeatable systems that support data operations for Reporting, Analytics, Applications, and Data Science by gathering and processing raw data at scale. Profiles data to measure quality, integrity, accuracy, and completeness and delivers solutions by developing, testing, and implementing code and scripts. Develop data set processes for data modeling, mining, and consumption.
MAJOR DUTIES AND RESPONSIBILITIES
- Actively and consistently supports all efforts to simplify and enhance the customer experience.
- Create and maintain scalable, reliable, consistent and repeatable systems that support data operations for Reporting, Analytics, and Applications for Business Intelligence.
- Gather and process raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.).
- Use ETL processes in order to maintain, improve, clean, and manipulate data.
- Profile data to measure quality, integrity, accuracy, and completeness.
- Develop and implement tools, scripts, queries, and applications for ETL/ELT and data operations.
- Design, build, and automate Business Intelligence Data Pipelines.
- Deliver solutions by developing, testing, and implementing code and scripts.
- Produce reports and uphold data delivery schedules.
- Manage life cycle of multiple data sources.
- Work closely with stakeholders on the data demand side (Analysts and BI Developers).
- Increase speed to delivery by implementing workload/workflow automation solutions.
- Perform other duties as assigned.
REQUIRED QUALIFICATIONS
- Ability to use a wide variety of open source technologies and cloud services
- Advanced coding/scripting experience using Python
- Basic experience with R, shell scripts
- Advanced experience with SQL
- Basic experience with Tableau, Looker, Alteryx, and ETL techniques
- Basic background in Linux/Unix/CentOS installation and administration; Windows experience preferred
- Experience with cloud technology like AWS
- Basic knowledge in data storage that demonstrates knowledge of when to use a file system, relational database (i.e. Snowflake), or NoSQL variant
- Experience with Spark
- Basic familiarity with JavaScript API, Rest API or Data Extract APIs
- Basic experience receiving, converting, and cleansing big data
- Basic experience with data workflow/data prep platforms, such as Airflow, Infomatica, Pentaho, or Talend
- Ability to identify and resolve end-to-end performance, network, server, and platform issues
- Attention to detail with the ability to effectively prioritize and execute multiple tasks
Education
Degree in an engineering discipline or computer science, or related field, or with equivalent experience.
Related Work Experience
- Hands-on working experience with RDBMS, SQL, scripting, and coding
- Linux/Unix/CentOS system admin 1
PREFERRED QUALIFICATIONS
- Advanced coding/scripting experience using Python, shell scripts
- Basic experience with data workflow/data prep platforms, such as Airflow
- Basic knowledge of best practices and IT operations in an always-up, always-available service
- Basic experience receiving, converting, and cleansing big data
- Basic experience with visualization or BI tools, such as Tableau and Looker
- Basic experience receiving, converting, and cleansing data
- Basic knowledge of best practices and IT operations in an always-up, always-available service
WORKING CONDITIONS
Office environment
Travel depending upon project needs
EGN318 317777 317777BR
Here, employees don't just have jobs, they build careers. That's why we believe in offering a comprehensive package that rewards employees for their contributions to our success, supports all aspects of their well-being, and delivers real value at every stage of life.
The pay for this position has a salary range of
$78,900.00 to $139,500.00. The actual salary offer will carefully consider a wide range of factors, including your skills, qualifications, experience and location. Also, certain positions are eligible for additional forms of compensation such as bonuses.