Skills

SQL Monitoring Organization Google Cloud Platform Recruitment GCP Hadoop

Job Specifications

Job Title: Senior Data Engineer

Location: Toronto, ON (4x onsite a week)

Employment Type: Contract

Pay Rate: CAD$45 - $50/HR INC

Job Description

We are looking for an experienced Senior Data Engineer with strong expertise in the Hadoop ecosystem and Google Cloud Platform, particularly GCP Dataproc.

The ideal candidate will have hands-on experience in modernizing data platforms, optimizing large-scale data processing workloads, and migrating Hive-based workloads to BigQuery.

Required Qualifications

6–10+ years of experience working within the Hadoop ecosystem, with deep expertise in Hive, Hive Metastore, and GCP Dataproc.
Strong hands-on experience with Dataproc Serverless, BigQuery, Google Cloud Storage (GCS), Cloud Composer, and Cloud Logging/Monitoring.
Solid understanding of table formats (Parquet, ORC), partitioning/bucketing strategies, and query performance optimization.
Proven experience migrating Hive datasets, tables, and SQL queries to BigQuery, including handling syntax differences, functions, UDFs, and performance tuning.
Strong knowledge of Security/IAM best practices, service accounts, and network/security controls; ability to operate within strict organization-level policies.

Nice-to-Have Skills

Familiarity with Dataproc Metastore vs. standalone Hive Metastore, and experience with Glue or other metadata/catalog services.
Exposure to data quality frameworks and lineage tools (e.g., OpenLineage, Collibra).
A FinOps mindset, including experience managing quotas, reservations, and cost governance for Dataproc and BigQuery workloads.

Disclaimer: AI tools may assist in the recruitment process; however, all hiring decisions are made by the recruitment team based on a comprehensive evaluation of candidates.

About the Company

AarornTech is a Guelph, ON based disruptive technology boutique firm specializing in Intelligent process automation development and consulting, we provide Managed RPA as a service, cloud based ready to configure Bots and end to end development and maintenance of process automation. We also support various small and large organizations (Banks, Telecom, Insurance) with their disruptive technology needs within Robotics Process Automation (RPA), Machine Learning (ML), Artificial Intelligence (AI), Blockchain, QA Automation, Perf... Know more