Judge jobs in toronto Canada
115 judge jobs found in toronto: showing 1 - 50
Content Reviewer - Fully Remote
Company: Mercor |
Responsibilities Review paired AI-generated in-product writing for voice, tone, and adherence to editorial standards. JudgeLocation: Toronto, ON, Canada
| Salary: CA$75 per hour | Date posted: 18 Oct 2026
Content Designer - Editorial Specialist
Company: Mercor |
Responsibilities Review paired AI-generated in-product writing for voice, tone, and adherence to editorial standards. JudgeLocation: Toronto, ON, Canada
| Salary: CA$75 per hour | Date posted: 16 Oct 2026
Executive Communication Specialist - Fortune 500
Company: Mercor |
Role Responsibilities Review paired AI-generated executive communications such as CEO memos and all-hands updates. Judge... writing CEO memos, all-hands updates, or speeches at a Fortune 500 company. Ability to judge tone well for an executiveLocation: Toronto, ON, Canada
| Salary: CA$70 - 75 per hour | Date posted: 16 Oct 2026
Industrial Hygienist - Safety Expert
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write referenceLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 16 Oct 2026
News Editor - Accuracy Specialist
Company: Mercor |
Responsibilities Review paired AI-generated news/copy writing against task briefs and writing guides. Judge for factual accuracyLocation: Toronto, ON, Canada
| Salary: CA$70 - 75 per hour | Date posted: 16 Oct 2026
Clinical Laboratory Expert - Lis Specialist
Company: Mercor |
a QC failure, missed reflex or confirmation tests, and mismatched specimens. Judge completeness: ensure all testsLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 16 Oct 2026
Netdocuments Specialist - Legal Expertise
Company: Mercor |
to the wrong matter, wrong official version, or with broken ethical walls. Judge completeness of document handling, ensuringLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 16 Oct 2026
Explosives Specialist - Incident Analyst
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whetherLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 14 Oct 2026
Forensic Chemist - Casework Specialist
Company: Mercor |
. Evaluate model responses against a defined policy standard and judge correctness. Write reference answers with technicalLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 12 Oct 2026
Explosives Specialist - Fully Remote
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 12 Oct 2026
Energetic Materials Expert - Redteaming
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 11 Oct 2026
Senior Vice President, Digital Workflow, Automation & Ai
Company: Citco |
of private assets processes - enough to judge what is genuinely automatable and what is not. Practical understandingLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 10 Oct 2026
Hr Expert - Fully Remote
Company: Mercor |
Evaluate answers from enterprise search and workplace AI tools on HR topics within your area of expertise. Judge whetherLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 09 Oct 2026
Hr Knowledge Management Specialist
Company: Mercor |
Evaluate answers from enterprise search and workplace AI tools on HR topics within your area of expertise. Judge whetherLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 09 Oct 2026
Forensic Materials Expert - Fully Remote
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whetherLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 09 Oct 2026
Marketing Coordinator
Company: Informa Connect |
editing skills considered an asset. Understanding of design and marketing/advertising creative principles – ability to judgeLocation: Toronto, ON, Canada
| Salary: CA$55000 - 65000 per year | Date posted: 08 Oct 2026
Senior Web Developer (full Stack)
Company: Klick Health |
using an agent SDK, including evaluation approaches such as baseline comparisons, automated scoring, or LLM-as-judge methodsLocation: Toronto, ON, Canada
| Salary: CA$100000 - 130000 per year | Date posted: 07 Oct 2026
Senior Web Developer (full Stack)
Company: Klick Health |
using an agent SDK, including evaluation approaches such as baseline comparisons, automated scoring, or LLM-as-judge methodsLocation: Toronto, ON, Canada
| Salary: CA$100000 - 130000 per year | Date posted: 07 Oct 2026
Visual Rater - Fully Remote
Company: Mercor |
pairs of AI-generated images against original prompts to determine preference. Review and judge images based on promptLocation: Toronto, ON, Canada
| Salary: CA$30 per hour | Date posted: 06 Oct 2026
Image Quality Analyst - Expert
Company: Mercor |
pairs of AI-generated images against original prompts to determine preference. Review and judge images based on promptLocation: Toronto, ON, Canada
| Salary: CA$30 per hour | Date posted: 06 Oct 2026
Data Engineer
Company: Citylitics |
, idempotency, cost, and latency. You'll also own evaluation datasets, LLM-as-judge and rule-based QA checks, and benchmarksLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 02 Oct 2026
Sr. Applied Researcher — Ai/ml
Company: eBay |
listing advice. - Developing evaluation frameworks for generative AI systems: synthetic dataset construction, LLM-as-judge... LLM evaluation frameworks: synthetic dataset construction, inter-annotator agreement measurement, and LLM-as-judgeLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 02 Oct 2026
Principal Data Scientist, Product Data & Analytics
Company: Intuit |
identification, experiment design, predictive modeling, and AI evaluation (golden datasets, LLM-as-judge, synthetic testbedsLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 02 Oct 2026
Explosives Specialist - Incident Analyst
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whetherLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 30 Sep 2026
Counter Sales - Plumbing
Company: Noble Corporation |
is our commitment to delivering the best service in our industry. Today, we still judge our success by our customers’ successesLocation: Toronto, ON, Canada
| Salary: CA$40000 - 55000 per year | Date posted: 30 Sep 2026
Energetic Materials Expert - Redteaming
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 28 Sep 2026
Paid Search Strategist, Dtc Ecommerce (remote)
Company: Sweat Pants Agency |
rest of your day is yours. Nobody here is on a time clock. We judge you on output. If you want a lane, a ticket queueLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 27 Sep 2026
Google Ads Media Buyer / Growth Strategist (remote)
Company: Sweat Pants Agency |
rest of your day is yours. Nobody here is on a time clock. We judge you on output. If you want a lane, a ticket queueLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 27 Sep 2026
Senior Google Ads Buyer, Dtc Ecommerce (remote)
Company: Sweat Pants Agency |
rest of your day is yours. Nobody here is on a time clock. We judge you on output. If you want a lane, a ticket queueLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 27 Sep 2026
Hazardous Device Expert - Red Team
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate responses against a defined policy standard. Judge whetherLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 26 Sep 2026
Technology Lead - Ai Lead Developer
Company: Infosys |
benchmarks, regression tests, LLM-as-judge approaches where appropriate, and online quality metrics. Knowledge of model qualityLocation: Toronto, ON - Mississauga, ON, Canada
| Salary: CA$92740 - 123375 per year | Date posted: 23 Sep 2026
Senior Associate Data Engineering (azure/databricks) Hybrid
Company: Publicis Groupe |
ground-truth and golden datasets, offline evaluation pipelines, and the data scaffolding behind LLM-as-judge and regressionLocation: Toronto, ON, Canada
| Salary: CA$115000 - 160000 per year | Date posted: 23 Sep 2026
Fp&a Specialist - Fully Remote
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 22 Sep 2026
Public Safety Specialist - Fully Remote
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate responses against a defined policy standard. Judge whetherLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 22 Sep 2026
Forensic Chemist - Casework Specialist
Company: Mercor |
. Evaluate model responses against a defined policy standard and judge correctness. Write reference answers with technicalLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 20 Sep 2026
Fp&a Specialist - Fully Remote
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 20 Sep 2026
Effects Engineering Specialist - Fully Remote
Company: Mercor |
, or adversarial. Evaluate AI model responses against policy standards. Judge the correctness of each response. Write referenceLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 19 Sep 2026
Explosives Specialist - Fully Remote
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 18 Sep 2026
Forensic Materials Expert - Fully Remote
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whetherLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 18 Sep 2026
Process Safety Engineer - Fully Remote
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write referenceLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 18 Sep 2026
Effects Engineering Specialist - Fully Remote
Company: Mercor |
, or adversarial. Evaluate AI model responses against policy standards. Judge the correctness of each response. Write referenceLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 18 Sep 2026
Public Safety Specialist - Fully Remote
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate responses against a defined policy standard. Judge whetherLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 18 Sep 2026
Blasting Specialist - Fully Remote
Company: Mercor |
. Evaluate model responses against a defined policy standard. Judge the correctness of each response. Write reference answersLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 18 Sep 2026
Fp&a Expert - Financial Forecaster
Company: Mercor |
AI-agent rollouts in Financial Forecaster. Judge agent answers against the actual model and documents. Identify failure modesLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 18 Sep 2026
Propulsion Systems Engineer - Expert
Company: Mercor |
, or adversarial. Evaluate AI model responses against policy standards. Judge the correctness of each response. Write referenceLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 18 Sep 2026
Toxicological Chemist - Fully Remote
Company: Mercor |
. Evaluate model responses against a defined policy standard and judge correctness. Write reference answers with technicalLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 18 Sep 2026
Process Safety Engineer - Fully Remote
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write referenceLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 18 Sep 2026
Hazardous Device Expert - Red Team
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate responses against a defined policy standard. Judge whetherLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 16 Sep 2026
Industrial Hygienist - Safety Expert
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write referenceLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 16 Sep 2026
Explosives Specialist - Incident Analyst
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whether