- Company Name
- Crimson Limited
- Job Title
- Senior Data Engineer
- Job Description
-
Job Title: Senior Data Engineer
Role Summary:
Lead the architecture, development, and optimization of a secure, high‑performance Azure‑based data platform. Design scalable pipelines, data models, and lakes; enforce governance and compliance; drive continuous improvement and innovation in Azure data services.
Expectations:
- Deliver end‑to‑end data engineering solutions that meet business and regulatory standards.
- Mentor junior engineers and foster best practices across cross‑functional teams.
- Collaborate with data scientists, analysts, and stakeholders to translate business needs into technical designs.
Key Responsibilities:
- Design, build, and maintain Azure Data Factory pipelines, Databricks jobs, and Synapse analytics solutions.
- Develop and optimize scalable data models, warehouses, and lake architecture (Azure Synapse, Data Lake Storage).
- Enforce data governance, security, and compliance (GDPR, DPA) through robust policies and catalog governance.
- Implement CI/CD pipelines and infrastructure as code (Terraform, Bicep, ARM) via Azure DevOps.
- Monitor, optimize, and troubleshoot data platform performance, cost, and reliability.
- Produce clear technical documentation and knowledge base contributions.
- Evaluate and integrate emerging Azure data technologies to enhance platform capabilities.
Required Skills:
- Advanced expertise in Azure Databricks (Unity Catalog, DLT, cluster management).
- Strong proficiency with Azure Data Factory, Synapse Analytics, Data Lake Storage, Stream Analytics, Event Hubs.
- Programming languages: Python, Scala, C#, .NET, and SQL (T‑SQL).
- Data modeling, quality, and metadata management.
- CI/CD & IaC using Azure DevOps, Terraform.
- Excellent analytical, communication, and stakeholder engagement.
- Exposure to machine learning engineering is advantageous.
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Engineering, or related field (preferred).
- Azure Data Engineer Associate or Azure Solutions Architect certification (desirable).
Burton upon trent, United kingdom
Hybrid
Senior
04-12-2025