Build, test, and maintain batch and event-driven data pipelines and ETL/ELT workflows. Transform and validate large datasets, troubleshoot data-quality issues, improve workflow reliability, and support platform modernization. Collaborate with engineering, product, and data stakeholders while following strong practices for version control, testing, monitoring, documentation, and code review. The role may occasionally require work outside standard business hours.
At LightBox, we strive to not only equip confident, data-driven decisions across sectors, but to also enrich lives by bringing people, information, and technology together. As a company with a wide range of clients, we believe a diverse workforce is crucial to success. Our commitment to inclusion across race, gender, age, religion, identity, and experience is the foundation upon which we operate and connect with our customers and the communities in which we work.
With our expertise, we are producing the best available data, workflow tools, technology, and analytics to support everyone making a real estate decision. There has never been a better time to make an impact and we invite you to join us on this journey.
LightBox is a leading provider of data and workflow solutions across commercial real estate and location intelligence. Our solutions deliver the depth, speed and accuracy that enable insights to over 50,000 brokers, 1,000 banks and lenders, 1,000 law firms and 5,000 environmental consulting and engineering firms.
With our expertise, we are producing the best available data, workflow tools, technology, and analytics to support everyone making a real estate decision. There has never been a better time to make an impact and we invite you to join us on this journey.
LightBox is a leading provider of data and workflow solutions across commercial real estate and location intelligence. Our solutions deliver the depth, speed and accuracy that enable insights to over 50,000 brokers, 1,000 banks and lenders, 1,000 law firms and 5,000 environmental consulting and engineering firms.
Data Engineer
Data Integration Team | LightBox
Department
Data Integration
Reports to
Manager, Data Engineering
Position OverviewLightBox is seeking a Data Engineer to join the Data Integration team. This role designs, builds, and maintains reliable data pipelines, data-intensive applications, and AI-enabled automation that support LightBox products. The successful candidate will work with large, diverse datasets and partner with engineering, product, and data stakeholders to deliver trusted, scalable data solutions.
This is a hands-on role for a mid-career engineer who enjoys solving practical data problems and taking ownership of well-defined work with support from the team.What You Will Do· Build, test, and maintain batch and event-driven data pipelines and ETL/ELT workflows.· Transform, validate, and organize data for product features and downstream consumers.· Investigate pipeline and data-quality issues, troubleshoot root causes, and implement fixes.· Improve existing workflows for reliability, efficiency, and maintainability; support platform modernization.· Work with engineering, product, and data stakeholders to understand requirements and deliver solutions.· Follow team practices for version control, code review, testing, monitoring, and documentation.What You BringRequired qualifications:
- Bachelor's degree in Computer Science, Engineering, or a related field, or equivalent practical experience.
- 2+ years of relevant industry experience including building and maintaining production ETLs.
- High proficiency in at least one SQL dialect, Python, and at least one scalable data processing framework (Spark, DuckDB, Polars, etc.)
- Experience designing, building, and operating batch and/or event-driven data pipelines.
- Experience with a workflow orchestration platform (Prefect, Airflow, Dagster, etc.), and familiarity with distributed data processing.
- Experience with cloud data and infrastructure services in AWS and/or GCP.
- Familiarity with modern data storage formats and technologies, including Apache Parquet and Delta Lake.
- Working knowledge of GitHub workflows, including pull requests, code review, branching, and CI/CD automation with GitHub Actions.
- Clear communication, curiosity, and a collaborative approach to problem-solving.
Bonus qualifications:
- Experience using Codex or other LLM-assisted development tools to generate and refine code from specifications, with strong code-review and testing practices.
- Experience processing large scale geospatial or location-based data.
- Experience with data modeling and designing data solutions for multiple product or business use cases.
- Experience supporting production data workflows with monitoring, alerting, and incident-response practices.
This job description summarizes the primary responsibilities and qualifications for the role. Responsibilities may change as business needs evolve. The role may occasionally require work outside standard business hours to meet deadlines or support customers and production operations.
LightBox is an equal opportunity employer. We are committed to providing equal employment opportunities to all employees and applicants without regard to protected characteristics under applicable law.
We thank all applicants in advance for their interest in this position, however, only those selected for an interview will be contacted.
This job description is a general listing of the required tasks and expectations of the position and in no way implies that the duties listed above are the employee’s only responsibilities. The employee is expected to perform other tasks, responsibilities and training as instructed by their supervisors. Duties and responsibilities may change at any time with or without notice.
This position may require additional hours outside of the standard work schedule including occasional holiday, evening and/or weekend hours in order to meet deadlines or to accommodate customers.
LightBox and all its holding companies are an equal opportunity/affirmative action employer. It is the policy of the LightBox and its holding companies to prohibit discrimination of any type and to afford equal employment opportunities to employees and applicants, without regard to race, color, religion, sex, national origin, age, disability, or veteran status.
LightBox is committed to providing an accessible recruitment process. Accommodations are available upon request for candidates taking part in all aspects of the selection process. If you require an accommodation, please let us know and we will work with you to meet your needs.
NO TELEPHONE CALLS OR AGENCY SOLICITATION PLEASE.
Similar Jobs
Financial Services
Leads data engineering within an agile team, designing secure and scalable data platforms, pipelines, architectures, storage, access, analytics, governance, backup, and recovery strategies. Develops advanced data models, evaluates security controls, documents best practices, and drives responsible AI-assisted engineering adoption. Provides technical leadership through architecture decisions, mentoring, cross-team influence, and operational support using Python, Databricks, Spark, AWS, and modern lakehouse patterns.
Top Skills:
SparkAWSDatabricksLakehouse ArchitecturesNosql DatabasesPythonRelational DatabasesStreaming Architectures
Information Technology • Software • Analytics • PropTech
Build AI platform infrastructure and developer tooling, including API gateways, model routing, integrations, observability, retrieval, caching, and model-serving systems. Develop APIs, microservices, SDKs, and internal tools that connect proprietary real estate data and AI models to production applications. Collaborate with ML engineers, contribute to architecture decisions, and own features through deployment and monitoring.
Top Skills:
AWSAws BedrockCi/CdDockerGCPKubernetesLitellmModel Context Protocol (Mcp)Node.jsOpenrouterPythonTypescript
Social Media
Leads the design and delivery of scalable infrastructure data systems, including ingestion pipelines, transformations, data models, and services for usage, cost, ownership, and planning. Establishes technical direction, data contracts, quality controls, monitoring, and operational processes while leading cross-functional initiatives and mentoring engineers. Uses AI responsibly to improve development and data-quality workflows while validating outputs and protecting sensitive information.
Top Skills:
AWSDbtPythonSQL
What you need to know about the Colorado Tech Scene
With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.
Key Facts About Colorado Tech
- Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
- Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
- Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
- Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
- Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
- Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute
