Judge jobs in toronto Canada
115 judge jobs found in toronto: showing 51 - 100
Propulsion Systems Engineer - Expert
Company: Mercor |
, or adversarial. Evaluate AI model responses against policy standards. Judge the correctness of each response. Write referenceLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 16 Sep 2026
Explosives Specialist - Incident Analyst
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge whetherLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 16 Sep 2026
Industrial Hygienist - Safety Expert
Company: Mercor |
, or adversarial. Evaluate AI model responses against a defined policy standard. Judge correctness of handling. Write referenceLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 16 Sep 2026
Hazardous Device Expert - Red Team
Company: Mercor |
. Label them as benign, dual-use, or adversarial. Evaluate responses against a defined policy standard. Judge whetherLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 16 Sep 2026
Energetic Materials Expert - Redteaming
Company: Mercor |
, dual-use, or adversarial. Evaluate model responses against a defined policy standard. Judge the correctnessLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 15 Sep 2026
Commercial Blasting Engineer - Expert
Company: Mercor |
. Evaluate model responses against a defined policy standard. Judge the correctness of each response. Write reference answersLocation: Toronto, ON, Canada
| Salary: CA$65 - 75 per hour | Date posted: 15 Sep 2026
Sales Specialist - Fully Remote
Company: Mercor |
. Position: Study Domain Expert — Judge Calibration — Sales Type: Contract Compensation: $90/hour Location: Remote DurationLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 12 Sep 2026
Brand Marketing Expert - Strategist
Company: Mercor |
. Review AI agent attempts. Judge them against your standards. Evaluate AI capabilities in diagnosing data, prioritizingLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 11 Sep 2026
Sales Expert - Judge Calibration
Company: Mercor |
. Position: Study Domain Expert — Judge Calibration — Sales Type: Contract Compensation: $90/hour Location: Remote DurationLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 11 Sep 2026
Pr & Communications Expert - Ai
Company: Mercor |
-but-wrong ones. Review AI agent attempts and judge them against your own standard. Evaluate AI-generated content in PRLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 11 Sep 2026
Restructuring Lawyer - Legal Expert
Company: Mercor |
. Qualifications Must-Have Qualified lawyer with substantive practice experience in restructuring and insolvency. Ability to judgeLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 09 Sep 2026
Frontend Code Evaluation Specialist
Company: Mercor |
a reference page and two candidate replications at 1920×1080. Judge which is the closer reproduction, state by state. Diff visualLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 09 Sep 2026
Marketing Analytics Specialist - Fully Remote
Company: Mercor |
. Review AI agent attempts and judge them against established standards. Evaluate AI-generated content in Marketing AnalyticsLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 09 Sep 2026
Finance & Real Estate Legal Expert
Company: Mercor |
Must-Have Qualified lawyer with substantive practice experience in finance and real estate. Ability to judge work product holisticallyLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 06 Sep 2026
Frontend Code Evaluation Specialist
Company: Mercor |
a reference page and two candidate replications at 1920×1080. Judge which is the closer reproduction, state by state. Diff visualLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 06 Sep 2026
Marketing Specialist - Fully Remote
Company: Mercor |
reference answers and criteria distinguishing strong responses from plausible-but-wrong ones. Review and judge AI agentLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 06 Sep 2026
Radiology Expert - Visage 7 Specialist
Company: Mercor |
. Distinguish preliminary measurements/annotations from finalized report entries to maintain clarity in documentation. Judge theLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 06 Sep 2026
Legal Specialist - Fully Remote
Company: Mercor |
Must-Have Qualified lawyer with deep, current practice experience in one of the specialisms. Ability to judge work product holisticallyLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 06 Sep 2026
Environmental Law Expert - Fully Remote
Company: Mercor |
. Qualifications Must-Have Qualified lawyer with substantive practice experience in environmental law. Ability to judge workLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 04 Sep 2026
Insolvency Specialist - Fully Remote
Company: Mercor |
. Qualifications Must-Have Qualified lawyer with substantive practice experience in restructuring and insolvency. Ability to judgeLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 04 Sep 2026
Real Estate Lawyer - Fully Remote
Company: Mercor |
Must-Have Qualified lawyer with substantive practice experience in finance and real estate. Ability to judge work product holisticallyLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 04 Sep 2026
Legal Expert - Fully Remote
Company: Mercor |
lawyer with substantive practice experience in business immigration. Able to judge work product holistically for correctnessLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 04 Sep 2026
Staff Ux Designer
Company: Caseware |
, experience contributing to a component-based design system, and enough command of accessibility standards to judge whetherLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 04 Sep 2026
Immigration Lawyer - Business Specialist
Company: Mercor |
lawyer with substantive practice experience in business immigration. Able to judge work product holistically for correctnessLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 03 Sep 2026
Legal Expert - Sanctions Specialist
Company: Mercor |
Must-Have Qualified lawyer with deep, current practice experience in one of the specialisms. Ability to judge work product holisticallyLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 03 Sep 2026
Restructuring Lawyer - Legal Expert
Company: Mercor |
. Qualifications Must-Have Qualified lawyer with substantive practice experience in restructuring and insolvency. Ability to judgeLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 03 Sep 2026
Environmental Lawyer - Legal Reviewer
Company: Mercor |
. Qualifications Must-Have Qualified lawyer with substantive practice experience in environmental law. Ability to judge workLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 03 Sep 2026
Finance & Real Estate Legal Expert
Company: Mercor |
Must-Have Qualified lawyer with substantive practice experience in finance and real estate. Ability to judge work product holisticallyLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 03 Sep 2026
Clinical Pharmacist - Fully Remote
Company: Mercor |
and stale patient data driving incorrect doses; update based on newer Special Alerts. Judge completeness of the clinicalLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 01 Sep 2026
Marketing Specialist - Fully Remote
Company: Mercor |
reference answers and criteria distinguishing strong responses from plausible-but-wrong ones. Review and judge AI agentLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 31 Aug 2026
Marketing Specialist - Fully Remote
Company: Mercor |
-on professional experience in Admin, Marketing, Human Resources, or Accounting. Currently or recently practicing to judge workLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 31 Aug 2026
Marketing Specialist - Fully Remote
Company: Mercor |
-but-wrong ones. Review AI agent attempts and judge them against your own standard. Evaluate AI-generated content in PRLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 31 Aug 2026
Clinical Pharmacist - Fully Remote
Company: Mercor |
and stale patient data driving incorrect doses; update based on newer Special Alerts. Judge completeness of the clinicalLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 31 Aug 2026
Pharmacist - Lexidrug Expert
Company: Mercor |
and stale patient data driving incorrect doses; update based on newer Special Alerts. Judge completeness of the clinicalLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 29 Aug 2026
Brand Marketing Specialist - Fully Remote
Company: Mercor |
. Review AI agent attempts. Judge them against your standards. Evaluate AI capabilities in diagnosing data, prioritizingLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 29 Aug 2026
Marketing Specialist - Fully Remote
Company: Mercor |
-but-wrong ones. Review AI agent attempts and judge them against your own standard. Evaluate AI-generated content in PRLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 29 Aug 2026
Business Operations Expert - Evaluator
Company: Mercor |
-on professional experience in Admin, Marketing, Human Resources, or Accounting. Currently or recently practicing to judge workLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 29 Aug 2026
Marketing Analytics Specialist - Fully Remote
Company: Mercor |
. Review AI agent attempts and judge them against established standards. Evaluate AI-generated content in Marketing AnalyticsLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 29 Aug 2026
Content Marketing Specialist - Fully Remote
Company: Mercor |
. Review AI agent attempts and judge them against your standards. Evaluate AI-generated content to improve model outputsLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 29 Aug 2026
Brand Marketing Expert - Strategist
Company: Mercor |
. Review AI agent attempts. Judge them against your standards. Evaluate AI capabilities in diagnosing data, prioritizingLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 27 Aug 2026
Paid Growth Marketing Expert
Company: Mercor |
reference answers and criteria distinguishing strong responses from plausible-but-wrong ones. Review and judge AI agentLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 27 Aug 2026
Pr & Communications Expert - Ai
Company: Mercor |
-but-wrong ones. Review AI agent attempts and judge them against your own standard. Evaluate AI-generated content in PRLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 27 Aug 2026
Radiology Specialist - Fully Remote
Company: Mercor |
to the record, impacting downstream readers. Judge study completeness: ensure interpretability, availability of the correctLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 27 Aug 2026
Diagnostic Imaging Expert - Visage 7
Company: Mercor |
to the record, impacting downstream readers. Judge study completeness: ensure interpretability, availability of the correctLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 27 Aug 2026
Marketing Analytics Expert - Ai Environments
Company: Mercor |
. Review AI agent attempts and judge them against established standards. Evaluate AI-generated content in Marketing AnalyticsLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 27 Aug 2026
Marketing Specialist - Fully Remote
Company: Mercor |
reference answers and criteria distinguishing strong responses from plausible-but-wrong ones. Review and judge AI agentLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 27 Aug 2026
Ai Systems & Ml Engineering Industry Expert
Company: TripleTen |
), agent reliability and guardrails, MCP; LLM evals — eval harnesses, LLM-as-judge, hallucination metrics; applied fine-tuningLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 27 Aug 2026
Ai Systems & Ml Engineering Industry Expert
Company: TripleTen |
harnesses, LLM-as-judge, hallucination metrics; applied fine-tuning (SFT/LoRA/PEFT); LLM observability, A/B experiment designLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 26 Aug 2026
Frontend Code Evaluation Specialist
Company: Mercor |
a reference page and two candidate replications at 1920×1080. Judge which is the closer reproduction, state by state. Diff visualLocation: Toronto, ON, Canada
| Salary: unspecified | Date posted: 25 Aug 2026
Marketing Analytics Expert - Ai Environments
Company: Mercor |
. Review AI agent attempts and judge them against established standards. Evaluate AI-generated content in Marketing Analytics