Data Engineer
Posted: 01/19/2026
Job Number: dUR4cmVsbnJtTzV4K1V4NHpnZ2UrUT09
Pay Rate: 60-65 Hourly USD
Job Description
Job Summary
We are seeking a hands-on Data Engineer with strong development experience, specializing in Python-based data engineering, Metadata ETL pipelines, APIs, and lineage connectors. The ideal candidate will work on building and maintaining metadata-driven data pipelines, enabling end-to-end data traceability, governance, and integration across enterprise data platforms.
This role requires a practitioner mindset—someone who actively builds, debugs, and enhances data pipelines rather than operating only at a design or coordination level.
Key Responsibilities
Primary / Required Skills
Desired / Nice-to-Have Skills
Qualifications
We are seeking a hands-on Data Engineer with strong development experience, specializing in Python-based data engineering, Metadata ETL pipelines, APIs, and lineage connectors. The ideal candidate will work on building and maintaining metadata-driven data pipelines, enabling end-to-end data traceability, governance, and integration across enterprise data platforms.
This role requires a practitioner mindset—someone who actively builds, debugs, and enhances data pipelines rather than operating only at a design or coordination level.
Key Responsibilities
-
Design, develop, and maintain Python-based ETL/ELT pipelines with a strong focus on metadata capture and propagation.
-
Build and enhance metadata ETL workflows to extract, transform, and load technical and business metadata from source systems, pipelines, and analytics platforms.
-
Develop and integrate RESTful APIs to expose metadata, lineage, and operational data to downstream systems and tools.
-
Implement and support data lineage connectors to enable source-to-target and end-to-end lineage across data pipelines, applications, and analytics layers.
-
Ensure metadata accuracy, consistency, and completeness across data ingestion, transformation, and consumption layers.
-
Collaborate with data governance, analytics, and engineering teams to align metadata and lineage solutions with enterprise standards.
-
Troubleshoot and resolve issues related to metadata ingestion, lineage gaps, and pipeline failures.
-
Support documentation, operational readiness, and ongoing enhancements to metadata and lineage solutions.
-
Follow best practices for code quality, version control, testing, and deployment.
Primary / Required Skills
-
Strong hands-on development experience in Python
-
Experience building ETL/ELT pipelines, with emphasis on metadata-driven processing
-
Hands-on experience developing and consuming REST APIs
-
Practical experience implementing or supporting data lineage connectors (custom or tool-based)
-
Solid understanding of data pipelines, transformations, and data flow tracing
-
Experience working in enterprise data environments
Desired / Nice-to-Have Skills
-
Exposure to metadata management or data catalog platforms (e.g., Collibra, Alation, Apache Atlas, OpenLineage)
-
Experience with workflow orchestration tools (Airflow, Prefect, Dagster, etc.)
-
Familiarity with data governance, data quality, or regulatory-driven environments
-
Experience working with cloud data platforms (AWS, Azure, or GCP)
-
Knowledge of SQL and common data storage formats (Parquet, JSON, Avro)
Qualifications
-
Bachelor’s degree in Computer Science, Engineering, or a related field (or equivalent practical experience)
-
5+ years of experience as a Data Engineer or in a similar hands-on data development role
-
Strong problem-solving skills with a focus on reliability and scalability
-
Ability to work collaboratively in cross-functional teams
-
Clear communication skills and attention to detail