- Company Name
- e-QUADRA
- Job Title
- Data Engineer (H/F)
- Job Description
-
**Job Title**
Data Engineer (M/F)
**Role Summary**
Design, develop, and maintain scalable data pipelines and analytical platforms in a modern cloud environment. Drive the industrialisation of data processes, ensuring data quality, security, and performance across the organization.
**Expectations**
- Deliver reliable, scalable solutions with minimal hand‑off.
- Communicate clearly with cross‑functional teams and stakeholders.
- Adhere to Agile practices and continuous improvement cycles.
- Maintain thorough documentation and knowledge sharing.
**Key Responsibilities**
- Build and maintain Azure-based data pipelines, Lakehouse, and Spark notebooks.
- Optimize Spark / PySpark transformations for data cleaning and enrichment.
- Automate data flows using Power Automate (SFTP, SharePoint, Outlook, Teams).
- Contribute to Power BI dataset design, dataflows, and model development.
- Schedule, monitor, and put production jobs into service (CI/CD, Git).
- Implement DevOps practices: version control, CI/CD, and deployment automation.
- Ensure data lineage, governance, and quality controls; enforce security rules (RLS, secure endpoints).
- Document technical solutions, processes, and operational hand‑books.
- Diagnose and resolve production incidents (Tier 2/3 support).
- Participate in technology scouting, knowledge sharing, and continuous improvement.
**Required Skills**
- Microsoft Fabric ecosystem (Lakehouse, Pipelines, Spark Notebooks).
- Spark / PySpark – advanced coding and optimisation.
- Azure Data Lake, Azure Data Factory, or Synapse analytics.
- Strong Python and SQL (complex queries, optimisation).
- Power Automate integration (SFTP, SharePoint, Teams).
- Familiarity with Power BI datasets, dataflows, and modelling.
- DevOps: Git, CI/CD pipelines.
- Scheduling and monitoring of batch processes.
- Agile methodologies (Scrum, Kanban).
**Required Education & Certifications**
- Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related field (≥ 3 years of experience).
- Experience in Azure cloud data engineering.
- Certifications such as Microsoft Certified: Azure Data Engineer Associate are a plus.