Skills

Apache Airflow Monitoring Databases apache AWS Agile

Job Specifications

Job Title: Data Engineer

Location: Ottawa, ON

Hybrid. Up to 2 times a week.

Pay Rate: $90-$95 depending on experience.

Must Have:

10 years of strong experience designing and developing ETL/ELT pipelines and managing end-to-end data workflow processing.
5–8 years of hands-on experience with cloud-based data platforms, preferably AWS.
5–8 years of experience working with unstructured text data, including documents, APIs, and industry standards.
Solid understanding of semantic search concepts, embeddings, vector databases, and effective chunking strategies.
Experience using Apache Airflow (or similar tools) for workflow orchestration, dependency management, retries, and monitoring.
3–5 years of experience supporting AI/ML or Generative AI solutions.
3–5 years of experience working in Agile delivery environments.

Responsibilities:

Develop and maintain data ingestion pipelines for both structured and unstructured sources on AWS.
Normalize, enrich, and convert data into semantic and vector-ready formats using AWS Bedrock Knowledge Bases.
Support knowledge-base-driven architectures powering AI assistants and agents.
Collaborate with architects and developers on designing data schemas and establishing data contracts.
Identify and resolve issues related to data quality, performance, and completeness.
Implement automation for data enrichment to enhance overall data quality.
Manage both rapid ingestion pipelines for demos and long-term, governed production pipelines.

Note: AI-enabled tools may be used to sort applications based on job-related criteria. All AI generated results are vetted by our team and the decision of which candidates move forward is always made by a human.

About the Company

Established in 1981, Bevertec is a Canadian based IT firm that provides both professional IT staffing services and IT banking solutions to hundreds of satisfied clients in over 38 countries. As a leader in information technology, we offer a unique combination of services by focusing on two core areas: * IT Staffing and Professional Staffing Services * Software Solutions for the Banking and Finance Sector Bevertec utilizes its innovative IT recruitment solutions for clients in industries which include and are not limited... Know more