Lead - Data Engineer

Role Overview

We are seeking a lead Data Engineer to lead the on-site deployment and implementation of Data Catalog for an enterprise client. This is a customer-facing role that requires a blend of deep data engineering expertise and the maturity to manage client conversations independently. The successful candidate will own the technical delivery on the ground, working directly with the client's stakeholders to ensure a smooth and successful deployment.

Key Responsibilities

1. Lead the end-to-end on-site deployment, configuration, and implementation Data Catalog.
2. Serve as the primary technical point of contact for the client, managing day-to-day conversations and translating business requirements into technical solutions.
3. Architect and validate data engineering solutions on big data platforms, ensuring scalability, performance, and alignment with client needs.
4. Integrate Data Catalog with existing data sources, pipelines, and the broader data ecosystem, including metadata and lineage tooling.
5. Provide technical guidance, troubleshooting, and best-practice recommendations throughout the engagement.
6. Document the deployment, configurations, and hand-over materials for the client team.

Required Skills and Experience

1. Must have 7+ years of experience in data engineering,
2. Must have extensive hands-on expertise with Hadoop and PySpark
3. Must have Strong experience with the Cloudera platform and the broader Hadoop ecosystem.
4. Working knowledge of Apache Atlas for metadata management, data lineage, and governance.
5. Proven track record of designing and deploying large-scale data engineering solutions.
6. Demonstrated ability to handle customer-facing conversations and manage stakeholders independently.
7. Excellent communication and problem-solving skills.

Preferred / Nice to Have

1. Prior experience delivering on-site or consulting engagements.
2. Broader familiarity with the Talend suite and data governance / metadata management practices.
3. Relevant certifications in Cloudera, or cloud data platforms.