Lead Data Engineer

The client is seeking a full-time Lead Data Engineer to support our manufacturing clients’ large-scale digital transformation.

Duties and Responsibilities: 

• Demonstrate skills in abstract development frameworks
• Demonstrate accountability to assigned work & timelines
• Demonstrated leadership skills.
• Demonstrated technical competency for the role.
• Demonstrated timely delivery on assigned tasks and effective communication on project status and escalation when needed.

Education and Experience: 

• 12+ Years or equivalent degree + experience  

Required Skills/Certifications: 

• Estimating and Planning
• Work breakdown for the team.
• Data pipelines
• Data Transformations
• Code/Unit Test
• PR & Code Reviews
• Performance & Load Testing
• Functional & Regression Testing
• Tier 2 support/consulting
• Production Support
• Functional ask to Technical design.
• Data Engineering
• Agile Methodologies
• CI/CD
• Metadata driven frameworks.
• Technical documentation
• Azure Synapse Spark
• Python
• Complex SQL

Parquet & Delta file processing

ETL Optimizations

Azure DevOps