Chief Data Pipeline Architect

A Job to Build and Deliver AI-Ready Datasets Job Description:

Our company is looking for a Data Engineer who can work with the DevSecOps and Data Science teams. The selected candidate will be responsible for building and maintaining end-to-end data pipelines using Airflow, Spark, dbt, and Iceberg.

• Ingest and normalize structured and unstructured data for analytics and AI/ML use cases.

Required Skills and Qualifications:

The ideal candidate should have 4+ years of experience in Data Engineering or Analytics Engineering. They should be proficient in SQL and Python and have experience in modular, version-controlled transformations.

• Hands-on experience with Apache Airflow, Apache Spark, and data lake frameworks.
• Strong understanding of ETL/ELT design, data modeling, and governance.
• Familiar with AWS services and cloud-native data architectures.

Benefits:

As a Data Engineer at our company, you will have the opportunity to work on challenging projects and collaborate with experienced professionals in the field.

Others:

We offer a competitive compensation package, including benefits and opportunities for growth and development.