SLDS Data Engineer
- Location
- CO, US
- Employment
- Contract
- Level
- Senior
- Experience
- 5+ years
- Job function
- Software/Internet/AI › Data & Analytics › Data Engineer
Posted Nov 18, 2026Last confirmed open Nov 19, 2026
About this role
Data Engineer – Snowflake, Informatica CDGC, ETL/ELT & Azure DevOps
Job Details
SEO-Friendly Job Title: Data Engineer – Snowflake ETL/ELT, Informatica CDGC, Terraform & Azure DevOps
Job Title: SLDS Data Engineer
Location: Colorado (Remote)
Work Arrangement: Remote / Telecommuting
Employment Type: Temporary / Contract
Contract Duration: 6 Months
Estimated Start Date: January 4, 2027
Estimated End Date: June 30, 2027
Candidate Pay Rate: $65/hr W2
Number of Openings: 1
Submission Deadline: November 24, 2026
Working Schedule: Monday–Friday, 8 hours per day
Working Hours: 8:00 AM – 5:00 PM MST
Position Overview
The Data Engineer will be responsible for implementing and maintaining data pipelines, transformations, and data integration processes within a Statewide Longitudinal Data System (SLDS).
This position focuses on translating data architecture designs into technical solutions using Snowflake and Informatica. The selected candidate will work with data from multiple state agencies and third-party sources, transforming raw data into structured, reliable, and harmonized datasets for analytical and reporting purposes.
The Data Engineer will collaborate with Data Architects, Data Scientists, Visualization Designers, Operations Engineers, and external implementation partners to develop automated ETL/ELT pipelines, implement data quality controls, perform identity matching, and maintain production data operations.
The role will initially involve knowledge transfer and collaboration with an existing implementation partner, followed by progressively assuming responsibility for production operations and ongoing maintenance of the data foundation and analytics layer.
The successful candidate will also support data governance, privacy compliance, performance optimization, testing, documentation, and release management.
Education Requirement
No specific educational qualification was provided.
Required Skills / Experience
- Minimum 5 years of demonstrated experience building, orchestrating, and optimizing complex ETL/ELT data pipelines and transformation logic natively within the Snowflake platform.
- Minimum 1 year of hands-on experience with Informatica Cloud Data Governance and Catalog (CDGC), including metadata management, data profiling, cataloging, and automated data quality validation.
- Minimum 1 year of experience utilizing Terraform for Infrastructure as Code (IaC), including provisioning, configuring, and maintaining cloud infrastructure and resources.
- Demonstrated proficiency implementing automated build, test, and release deployment pipelines using Azure DevOps.
- Expert proficiency with Git and version control workflows, including branching strategies, pull requests, automated merge checks, and code reviews.
- Strong experience developing, maintaining, and troubleshooting data pipelines and transformation processes.
- Ability to perform data validation, cleansing, reconciliation, and quality checks.
- Ability to work with structured data from multiple source systems and integrate it into analytical data platforms.
- Must currently reside within the State of Colorado for the duration of the engagement.
Preferred Skills / Experience
- Prior experience working with public-sector data systems.
- Experience with longitudinal education and workforce data systems, such as CDE, CDHE, CDLE, CDEC, and National Student Clearinghouse.
- Experience with record linkage, entity resolution, and deterministic or probabilistic identity matching across disparate public records.
- Familiarity with federal and state student/workforce privacy regulations, including FERPA and COPPA.
- Familiarity with cell suppression standards and data privacy requirements.
- Experience authoring and executing structured test plans using Azure Test Plans.
Job Responsibilities
1. Data Ingestion & Pipeline Engineering
- Design, develop, test, and deploy automated ETL/data pipelines using Informatica and Snowflake.
- Ingest data from partner state agencies and third-party sources into a common data model.
- Develop data mappings and transformation processes based on established technical specifications.
- Build and maintain scheduled data ingestion workflows.
- Validate incoming data files and resolve data loading issues.
2.
Data Transformation & Analytics Layer
Support
- Transform raw agency data into harmonized, linked longitudinal records.
- Develop and maintain analytics-layer data models.
- Follow established naming conventions, data modeling standards, and architecture specifications.
- Maintain production views, tables, and transformation objects.
- Support enhancements to reporting metrics and analytical datasets.
3. Record Linkage & Identity Matching
- Execute internal record-matching processes to connect newly ingested agency records with existing student and workforce profiles.
- Handle matching exceptions and cross-agency data reconciliation.
- Maintain identity-matching routines and related documentation.
4. Production Operations & Incident Management
- Monitor scheduled data feed executions and pipeline operations.
- Troubleshoot failed jobs and resolve data loading issues.
- Reload late, corrected, or malformed data files.
- Reconcile source-file row counts against loaded records.
- Rebuild downstream data objects when required.
- Maintain operational procedures and runbooks.
- Respond to ad-hoc data inquiries and export requests.
5. Data Quality & Governance
- Implement L1 structural and format validation checks.
- Implement L2 completeness and de-duplication checks.
- Implement L3 referential integrity and business logic validation.
- Maintain layout-change detection and audit trails.
- Enforce data privacy requirements, suppression rules, and applicable compliance standards, including FERPA, COPPA, ADA, and state statutes.
6. Performance Optimization
- Optimize Snowflake query execution, warehouse compute, and pipeline performance.
- Identify and tune heavily used data models and performance bottlenecks.
- Improve processing efficiency, cost, and latency.
- Support ongoing maintenance of the data platform.
7. Testing & Release Management
- Develop and execute manual and automated test cases using Azure Test Plans.
- Record testing evidence and resolve defects before production deployment.
- Participate in peer code reviews.
- Follow release processes across Development, Test, UAT, and Production environments.
- Maintain release documentation and change logs.
- Use Azure DevOps for development and deployment coordination.
8. Collaboration & Knowledge Transfer
- Work with external implementation partners during knowledge transfer and operational transition.
- Shadow existing engineering teams and participate in co-running production feed cycles.
- Gradually assume independent responsibility for production operations.
- Collaborate with Data Architects on physical and logical data models.
- Support Data Scientists and Visualization Designers by integrating new data sources for Tableau dashboards.
- Coordinate with Operations Engineers on Snowflake compute management, warehouse auto-shutdown, user permissions, and CI/CD pipelines.
Ideal Candidate
The ideal candidate is an experienced Data Engineer with strong hands-on expertise in Snowflake ETL/ELT development, Informatica CDGC, Terraform, Azure DevOps, and Git.
The candidate should have experience building and maintaining complex data pipelines, integrating data from multiple sources, implementing data quality controls, and supporting production data environments.
Experience with public-sector, education, or workforce data systems and longitudinal record matching will be beneficial.
The candidate must be comfortable collaborating with external implementation partners, participating in knowledge transfer, troubleshooting production issues, and progressively taking ownership of operational data engineering responsibilities.
Important
Candidates must currently reside in Colorado throughout the engagement. Remote work is permitted, with a strong preference for candidates located in the Denver Metro area.
Prefer to apply directly?
Apply on Vision Square Inc