- Company Name
- WB Solutions LLC
- Job Title
- AI Quality Engineer
- Job Description
-
Job Title: AI Quality Engineer
Role Summary:
Responsible for designing, executing, and maintaining comprehensive testing and validation frameworks for AI services, ensuring model integrity, data quality, and compliance with governance standards across machine learning, agentic workflows, and RPA solutions.
Expectations:
- Minimum 5 years in Software Quality Engineering with 2 + years focused on AI/ML testing and UiPath automation.
- Strong background in data validation, model performance metrics, bias mitigation, and adversarial testing.
- Ability to work cross‑functionally with AI, data science, and automation teams to deliver high‑quality AI deployments.
Key Responsibilities:
- Define and execute end‑to‑end testing and validation frameworks for AI models, agentic workflows, and automation solutions.
- Conduct data quality audits to verify training/testing datasets for bias, noise, and completeness.
- Perform model performance testing using metrics such as Precision‑Recall, F1‑score, and Mean Absolute Error.
- Execute adversarial testing (prompt injections, perturbed inputs) to evaluate model robustness.
- Monitor production models for concept drift, data drift, and bias, implementing real‑time observability.
- Champion fairness and ethical standards, ensuring outputs remain non‑discriminatory over time.
- Serve as primary gatekeeper for AI governance and compliance per internal standards.
- Design test cases and strategic test plans for UiPath RPA solutions, covering both new deployments and existing systems.
- Document defects, manage lifecycle, and verify resolution.
- Validate hand‑off points between AI agents and RPA bots for structural task execution.
Required Skills:
- Advanced knowledge of AI/ML testing, including model validation, drift detection, and fairness monitoring.
- Proficiency in OCR, NLP, and LLM architectures.
- Hands‑on experience with UiPath automation testing.
- Strong Python scripting skills.
- Familiarity with Salesforce, Google Cloud Platform (GCP), SQL, REST APIs, and Google Kubernetes Engine (GKE).
- Ability to analyze metrics and design autonomous test generation strategies.
Required Education & Certifications:
- Bachelor’s degree in Computer Science, Software Engineering, or related field (or equivalent professional experience).
- Certifications in AI/ML testing, Quality Engineering, or RPA are advantageous.