About DAT

DAT is an award-winning employer of choice and a next-generation SaaS technology company that has been at the leading edge of innovation in transportation supply chain logistics for 44 years. We continue to transform the industry year over year, by deploying a suite of software solutions to millions of customers every day - customers who depend on DAT for the most relevant data and most accurate insights to help them make smarter business decisions and run their companies more profitably. We operate the largest marketplace of its kind in North America, with 227 million freight posts in 2021, and a database of $126 billion of annual global shipment market transaction data. We have co-headquarters in Portland, OR and Denver, CO, and additional offices in MO, TX, and Bangalore, India. For additional information, see www.DAT.com/company.

The Opportunity

DAT Software & Analytics is seeking a Data Engineering Team Lead to join our Data and Engineering team in either our Denver, CO or Beaverton, OR remote.  

This can be a fully remote, work from home opportunity.  It is open to applicants who are full time residents of the following states:  AK, AL, AR, AZ, CA, CO, CT, DC, FL, GA, HI, ID, IL, IN, KS, KY, LA, MA, ME, MI, MN, MT, MO, NC, ND, NE, NH, NJ, NM, NY, OK, OR, PA, RI, SC, TN, TX, UT, VA, VT, WA, WI, WV.  **We are unable to hire in the following states: DE, IA, MD, MS** 

This position can also work in-office if preferred. We currently have a hybrid model in place, in office 2-3x/week in either our Beaverton, Oregon or Denver, Colorado office.

DAT’s industry dominant network of carriers, brokers and shippers makes our data an immensely valuable asset to the industry, making the data engineering team an important and exciting place to work.

The Data Engineering Team Lead is a hands-on, working lead for a team ranging from traditional ETL & SQL solutions to cloud infrastructure, data streaming services, and serverless data processing solutions. In this role you will be part of a supportive, collaborative, and diverse team responsible for exploring, making recommendations,  implementing, and supporting enterprise data solutions. Your solutions will range from data science enablement to traditional data warehousing in our Snowflake data warehouse to building data pipelines that support customer-facing web-scale products. But we aren’t just looking for a technologist. We’re looking for someone who makes those around them better, makes the team work better together. 

What You’ll Do

• Lead, coach, and mentor individuals on the team, seeking ways to improve how the team functions
• Lead the team through balancing ad-hoc requests from stakeholders with planned work, ensuring the team is working effectively
• Teach Agile concepts to the team and help them grow, evolve, and self organize
• Work with the principal data engineer and data engineering manager to:
• ensure the team has technical direction and the tools it needs to succeed
• coordinate plans across all functions and stakeholders
• Working closely with product teams and data scientists to determine how to capture, persist, and maintain data
• Building distributed, scalable, and reliable data pipelines that ingest and process data at scale with ever diminishing time processing windows
• Leverage AWS to deliver efficient, cloud-native solutions
• Identifying opportunities in our data landscape where we need data enrichment
• Identifying and making recommendations on data storage solutions using alternate  technologies
• Analyzing  and recommending alternate persistence solutions 
• Serving as a resource for the Data Sciences team by partnering with them to make production quality and supportable solutions 
• Gathering requirements from analysts and the larger business community to optimize, unify, and simplify data according to business needs
• Working either independently on projects or in collaborative teams depending upon the needs of the effort
• Participate in our data analyst community of practice and represent the EDS team as an expert, teacher, and advocate for good data governance and useful documentation.

The Skills You’ll Need

• Experience leading with SCRUM, XP, or Kanban with a deep understanding of the principals behind Agile - not just performing the ceremonies
• Exceptional ELT/ETL background with data transformation and operational experience  
• Strong SQL Proficiency with, including analytic queries and other complex use cases
• Experience with SQL Query Tuning, data investigation, and optimization
• Experience with Snowflake cloud data warehouse administration. 
• Experience modeling star schemas and other summary objects based on business requirements
• Experience building large data stores, modern data warehouses, or advanced data processing solutions
• Experience with AWS tools and infrastructure.  Particularly in regards to s3 storage, data pipelines, and serverless AWS compute services (e.g. Lambdas)
• Deployment pipeline and infrastructure as code and deployment pipeline experience on a cloud platform. 

Bonus Skills

• Experience building data warehouse solutions in Snowflake
• Understanding of Oracle, SQL Server, Mongo, and other database systems
• Scripting experience with Powershell and Python
• Experience with WhereScape RED ELT Software
• Experience with Terraform, AWS (Lambda, Kafka, Glue, Kinesis Firehose, Airflow)
• Understanding of modern data warehouse architectures such as data vault

(Colorado only) In accordance with the Colorado Equal Pay for Equal Work Act, the minimum salary for this role is $120,000.00 + benefits. The maximum compensation for this role can vary significantly depending on your job-related skills and experience.

DAT embraces the value of a diverse workforce and believes it is a core strength of our company that we encourage those values in every DAT employee, at every level of our organization, regardless of tenure or rank. We provide equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state, and local laws.

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor’s legal duty to furnish information. 41 CFR 60-1.35(c)

#LI-PP1

#LI- Remote