Washington University in St. Louis Logo

Washington University in St. Louis

C-BRAIN Data Engineer (Remote) - Neurology

Posted 4 Hours Ago
Be an Early Applicant
Remote
Hiring Remotely in USA
75K-129K Annually
Mid level
Remote
Hiring Remotely in USA
75K-129K Annually
Mid level
Builds and maintains scalable data pipelines and cloud infrastructure supporting an AI biomedical research platform. Responsibilities include ingesting, harmonizing, validating, and documenting multimodal neurodegeneration datasets; managing cloud storage, compute, permissions, and costs; implementing de-identification and data governance workflows; supporting research data repositories and AI/ML teams; and maintaining data lineage, catalogs, and technical documentation. The role requires strong Python and SQL skills, software engineering discipline, cloud experience, and neurodegeneration research data expertise.
The summary above was generated by AI
LocationRemote, US Scheduled Hours40

Position SummaryThe C-BRAIN Data Engineer is a key technical member of the C-BRAIN team responsible for designing, building, and maintaining the data infrastructure that powers C-BRAIN's AI tools. Reporting to the C-BRAIN Chief Technology Officer (CTO), this role is responsible for all aspects of data ingestion, pipeline development, data harmonization, and cloud infrastructure management — ensuring that high-quality, analysis-ready data is available to C-BRAIN's AI tools and research teams. C-BRAIN is building an AI Biomedical Research Scientist platform that integrates diverse multi-institutional datasets (including NACC, ADNI, and consortium member data contributions). The Data Engineer will be central to building the technical infrastructure that makes this platform possible, working in close partnership with the CTO, the Senior Technical Product Manager, and external data science collaborators. This is not a standard data pipeline position. The Data Engineer is building the technical backbone of an AI biomedical research platform — infrastructure that must ingest and harmonize multi-modal neurodegeneration datasets at consortium scale and serve as the data foundation for agentic AI tools including InsightEngine and OpenScientist. The ideal candidate brings software engineering discipline, strong cloud platform experience, and demonstrated knowledge of neurodegeneration or biomedical research data. Domain knowledge is a prerequisite, not a nice-to-have; C-BRAIN-specific context will be provided, but neurodegeneration data experience and software engineering fundamentals will not.

Job Description

Primary Duties & Responsibilities:

Data Pipeline Development and Maintenance

  • Designs, builds, tests, and maintains scalable data ingestion pipelines to ingest consortium member datasets from diverse sources and formats into the C-BRAIN data infrastructure.
  • Develops and maintains ETL/ELT workflows using tools such as Apache Spark, dbt, Airflow, or equivalent; ensure pipelines are robust, well-documented, and auditable.
  • Implements automated pipeline monitoring and alerting; troubleshoot and resolves pipeline failures in a timely manner.
  • Works collaboratively with the CTO and data science teams to understand data requirements for AI tool development and translates those requirements into technical pipeline specifications.
  • Maintains version control for all pipeline code and infrastructure configurations; follows software engineering best practices including code review and documentation.
  • Integrates and processes multi-modal data including omics (genomics, transcriptomics, proteomics), neuroimaging (PET, MRI), longitudinal clinical records, and digital pathology — reconciling differences in data type, format, spatial resolution, and dimensionality into unified analytical frameworks.
  • Identifies where cross-modal integration produces genuine signal versus where it introduces noise or artifact; establishes ground truth benchmarks for downstream AI use.

Data Infrastructure and Cloud Operations

  • Manages and optimizes the C-BRAIN data infrastructure: storage accounts, computes resources, data lakes, and access controls.
  • Implements and maintains data access controls and permissions aligned with DUA requirements and WashU data governance policies.
  • Collaborates with the CTO on cloud architecture decisions; contributes to infrastructure planning for Phase 2 scale-up including foundation model compute requirements.
  • Monitors infrastructure costs, resource utilization, and performance; identifies and implements optimization opportunities.
  • Supports the deployment of C-BRAIN AI tools on cloud-based platforms; coordinates with technical teams on infrastructure requirements.
  • Ensures all data handling complies with DUA terms and applicable PHI de-identification requirements; implements, documents, and maintains de-identification workflows for each incoming dataset.
  • Uploads curated datasets to ADDI/AD Workbench and other designated repositories (NIAGADS, GP2, or equivalent) as directed; manages access controls within the platform to ensure data is accessible only by authorized users and tools.

Data Harmonization and Quality

  • Develops and implements data harmonization procedures to integrate datasets from multiple sources (NACC, ADNI, consortium member contributions) into a unified, analysis-ready format.
  • Implements data quality validation checks at ingestion and transformation stages; documents data quality issues and coordinates resolution with data providers.
  • Maintains comprehensive data lineage documentation: tracks data from source to consumption, documents all transformations, and ensures reproducibility.
  • Collaborates with research scientists and the AD, Scientific to understand scientific data requirements and ensures data products meet research use case specifications.
  • Aligns incoming datasets to established biomedical data standards including AD Workbench, ADDI, NIAGADS, and GP2; builds and maintains data dictionaries and metadata records for each ingested dataset.

DUA Technical Support and Data Delivery

  • Provides technical input on Data Use Agreements: defines technical specifications for data format, delivery method, transfer protocols, and storage requirements in coordination with the Senior Technical Product Manager.
  • Confirms receipt of contributed datasets, validates format and completeness against DUA specifications, and logs acceptance in the DUA register.
  • Flags data quality, completeness, or format issues to the Senior Technical Product Manager and CTO for follow-up with data contributors.
  • Supports technical aspects of the data delivery monitoring process: tracks expected deliveries, confirms receipt, and maintains data delivery logs.
  • Supports beta testing of data ingestion tools and provides structured feedback to development partners; maintains clear, reproducible documentation so pipeline processes can be audited and transferred.

Documentation and Reporting

  • Maintains comprehensive technical documentation for all pipelines, infrastructure configurations, and data architecture decisions in the C-BRAIN documentation repository.
  • Develops and maintains a C-BRAIN data catalog: documents available datasets, data dictionaries, lineage, and access procedures.
  • Contributes technical content to C-BRAIN progress reports, Steering Committee materials, and grants reporting as requested by the CTO or Senior Technical Product Manager.

Working Conditions:

Office environment (remote or hybrid per current Washington University policies). Occasional on-site presence required for team meetings and consortium events.


Job Location/Working Conditions

  • Normal office environment
  • Occasional on-site presence required for in-person meetings, team meetings, and consortium events.

Physical Effort

  • Typically working at desk or table
  • Repetitive wrist, hand or finger movement
  • Ability to move to on and off-campus locations
  • Primarily sedentary with standard computer use.

Equipment

  • Office equipment

The above statements are intended to describe the general nature and level of work performed by people assigned to this classification. They are not intended to be construed as an exhaustive list of all job duties performed by the personnel so classified. Management reserves the right to revise or amend duties at any time.

Required Qualifications

Education:

Bachelor's degree


Certifications/Professional Licenses:

No specific certification/professional license is required for this position.


Work Experience:

Relevant Experience (3 Years)


Skills:

Not Applicable


Driver's License:

A driver's license is not required for this position.

More About This Job

Required Qualifications:

  • Bachelor's degree in Computer Science, Data Science, Bioinformatics, Engineering, or a closely related field.
  • Three years of hands-on data engineering experience, including design and development of data pipelines and ETL/ELT workflows in a production or research environment.
  • Demonstrated proficiency in Python and SQL.
  • Experience with cloud data platforms: Microsoft Azure preferred (AWS or GCP also acceptable). Familiarity with cloud storage, compute, and access control management.
  • Experience working with complex, multi-source datasets requiring integration, harmonization, and quality validation.
  • Demonstrated software engineering background: production-grade Python with version control (Git), code review practices, and automated testing. This role requires engineering discipline and the ability to build maintainable, auditable code — scripting proficiency alone is insufficient.
  • Experience working with at least two of the following biomedical data modalities: omics (genomics, transcriptomics, proteomics), neuroimaging (PET, MRI), digital pathology, or longitudinal clinical/EHR data.
  • Demonstrated experience working with neurodegeneration or Alzheimer’s disease research datasets. Familiarity with the neurodegeneration data landscape — NACC, ADNI, and/or AD/ADRD repositories — and sufficient understanding of the biological context to communicate meaningfully with research scientists. Biomedical informatics experience without neurodegeneration domain knowledge is insufficient for this role.

Preferred Qualifications

  • Experience working with biomedical, clinical, or research datasets in an academic medical center, research university, or life sciences organization.
  • Experience with research data repositories such as ADDI, Synapse, Terra, or NACC/ADNI data platforms.
  • Experience with one or more of: Apache Spark, dbt, Airflow, Azure Data Factory, or equivalent ETL/ELT frameworks.
  • Familiarity with data governance frameworks, data use agreements, or federated data architectures.
  • Experience supporting AI/ML or data science teams as a data engineering partner: understanding how data products are consumed by model training and inference pipelines.
  • Experience with NAIRR or other research cloud computing platforms.
  • Experience with data catalog tools, data lineage platforms, or metadata management.
  • Familiarity with de-identification standards and privacy-preserving data techniques relevant to biomedical research.
  • Master’s or PhD in Computer Science, Data Science, Bioinformatics, Biomedical Informatics, or a related field.
  • Familiarity with agentic AI frameworks and how curated datasets feed retrieval-augmented generation (RAG) or LLM-based co-scientist systems (e.g., LangGraph, DSPy, or equivalent).
  • Experience with NLP techniques relevant to biomedical data: named entity recognition, natural language inference, or knowledge graph construction.
  • Knowledge of graph data structures and graph platforms (Neo4j, Amazon Neptune, or equivalent) for representing multi-modal biomedical relationships.
  • Track record of cross-disciplinary collaboration between computational and experimental or clinical teams.
  • Metadata Repository
  • Cloud Computing Platform
  • Computer Science
  • Data Engineering
  • Federated Identity Management
  • Research Databases

Preferred Qualifications

Education:

Master's degree, PhD or terminal degree or combination of education and experience may substitute for minimum education.


Certifications/Professional Licenses:

No additional certification/professional licenses unless stated elsewhere in the job posting.


Work Experience:

No additional work experience unless stated elsewhere in the job posting.

Skills:

Academic Disciplines, AI Frameworks, Apache Airflow, Apache Spark, Apache Synapse, Azure Data Factory, Bioinformatics, Biomedical Data, Biomedical Informatics, Catalog Management, Data ETL, Data Governance Framework, Data Lineage, Data Management, Data Management Platforms, Data Pipelines, Data Privacy Protection, Data Science, Data Security Management, Data Standards, dbt Core, Generative AI, Graph Databases, Machine Learning (ML), Medical Centers

GradeG14

Salary Range$75,200.00 - $128,800.00 / Annually

The salary range reflects base salaries paid for positions in a given job grade across the University. Individual rates within the range will be determined by factors including one's qualifications and performance, equity with others in the department, market rates for positions within the same grade and department budget.

Questions

For frequently asked questions about the application process, please refer to our External Applicant FAQ.

Accommodation

If you are unable to use our online application system and would like an accommodation, please email [email protected] or call the dedicated accommodation inquiry number at 314-935-1149 and leave a voicemail with the nature of your request.

All qualified individuals must be able to perform the essential functions of the position satisfactorily and, if requested, reasonable accommodations will be made to enable employees with disabilities to perform the essential functions of their job, absent undue hardship.

Pre-Employment ScreeningAll external candidates receiving an offer for employment will be required to submit to pre-employment screening for this position. The screenings will include criminal background check and, as applicable for the position, other background checks, drug screen, an employment and education or licensure/certification verification, physical examination, certain vaccinations and/or governmental registry checks. All offers are contingent upon successful completion of required screening.

Benefits Statement

Personal

  • Up to 22 days of vacation, 10 recognized holidays, and sick time.

  • Competitive health insurance packages with priority appointments and lower copays/coinsurance.

  • Take advantage of our free Metro transit U-Pass for eligible employees.

  • WashU provides eligible employees with a defined contribution (403(b)) Retirement Savings Plan, which combines employee contributions and university contributions starting at 7%.

Wellness

  • Wellness challenges, annual health screenings, mental health resources, mindfulness programs and courses, employee assistance program (EAP), financial resources, access to dietitians, and more!

Family

  • We offer 4 weeks of caregiver leave to bond with your new child. Family care resources are also available for your continued childcare needs. Need adult care? We’ve got you covered.

  • WashU covers the cost of tuition for you and your family, including dependent undergraduate-level college tuition up to 100% at WashU and 40% elsewhere after seven years with us.

For policies, detailed benefits, and eligibility, please visit: https://hr.wustl.edu/benefits/

EEO StatementWashington University in St. Louis is committed to the principles and practices of equal employment opportunity. It is the University’s policy to provide equal opportunity and access to persons in all job titles without regard to race, ethnicity, color, national origin, citizenship (where prohibited by federal law), age, religion, sex, sexual orientation, gender identity or expression, disability, protected veteran status, or genetic information.

Similar Jobs

9 Minutes Ago
Easy Apply
Remote or Hybrid
Easy Apply
170K-190K Annually
Senior level
170K-190K Annually
Senior level
Fintech • Information Technology • Software • Financial Services
Design and build Alloy’s go-to-market technology architecture, including CRM integrations, iPaaS automations, data pipelines, and workflow improvements. Develop SQL, Python, and JavaScript scripts for data manipulation and automation; monitor data quality and system performance; support reporting and BI dashboards; troubleshoot integration issues; and advise on GTM technology, vendors, and build-versus-buy decisions. Partner with RevOps, Sales, Marketing, Customer Success, IT, and leadership to translate business needs into scalable technical solutions.
Top Skills: APIsChurnzeroDbtGainsightGongHookJavaScriptLookerN8NOutreachPythonSalesforceSalesloftSQLTableauTray.IoWorkatoZapier
10 Minutes Ago
Remote or Hybrid
85K-105K Annually
Senior level
85K-105K Annually
Senior level
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Supports NBCUniversal’s ad sales systems by owning tickets, troubleshooting software, integrations, calculations, and backend data issues. Monitors systems, manages defects, documents procedures, coordinates with vendors and engineering teams, and recommends process improvements and automation. The role provides stakeholder communication, incident management, alerting and logging guidance, and occasional evening and rotating weekend on-call coverage during special events.
Top Skills: Ai ToolsAPIsData StreamsMicroservicesRobotic Process Automation (Rpa)ScriptingSQLTest Automation
10 Minutes Ago
Remote or Hybrid
165K-210K Annually
Senior level
165K-210K Annually
Senior level
AdTech • Cloud • Digital Media • Information Technology • News + Entertainment • App development
Leads automation engineering for NBCUniversal’s data collaboration platform. Designs AI agents, RAG workflows, reusable tools, APIs, and production-grade Python services supporting audience activation, measurement, and reporting. Establishes agent evaluation, monitoring, reliability, testing, and safety standards. Oversees clean room libraries and scalable data workflows while partnering across product, engineering, operations, and data platform teams. Hires, mentors, and develops software and AI engineers and drives technical direction, maintainability, and operational excellence.
Top Skills: Ci/CdDatabricksDatabricks Clean RoomsHabuLangchainLanggraphLiverampLlmsPythonRetrieval-Augmented Generation (Rag)SnowflakeSnowflake Clean RoomsSnowflake CortexVector Databases

What you need to know about the Colorado Tech Scene

With a business-friendly climate and research universities like CU Boulder and Colorado State, Colorado has made a name for itself as a startup ecosystem. The state boasts a skilled workforce and high quality of life thanks to its affordable housing, vibrant cultural scene and unparalleled opportunities for outdoor recreation. Colorado is also home to the National Renewable Energy Laboratory, helping cement its status as a hub for renewable energy innovation.

Key Facts About Colorado Tech

  • Number of Tech Workers: 260,000; 8.5% of overall workforce (2024 CompTIA survey)
  • Major Tech Employers: Lockheed Martin, Century Link, Comcast, BAE Systems, Level 3
  • Key Industries: Software, artificial intelligence, aerospace, e-commerce, fintech, healthtech
  • Funding Landscape: $4.9 billion in VC funding in 2024 (Pitchbook)
  • Notable Investors: Access Venture Partners, Ridgeline Ventures, Techstars, Blackhorn Ventures
  • Research Centers and Universities: Colorado School of Mines, University of Colorado Boulder, University of Denver, Colorado State University, Mesa Laboratory, Space Science Institute, National Center for Atmospheric Research, National Renewable Energy Laboratory, Gottlieb Institute

Sign up now Access later

Create Free Account

Please log in or sign up to report this job.

Create Free Account