The job, in the employer's words
This role is for one of our clients
Compensation: $150-$160 per hour
We are seeking experienced in-house legal counsel based in France to support a legal AI benchmarking initiative focused on evaluating how effectively AI systems handle real-world questions involving French law.
As an expert reviewer, you will assess responses generated by two AI platforms, compare their legal reasoning and conclusions, and evaluate each response against a standardized rubric. Your professional judgment will help establish reliable benchmarks for the quality and accuracy of AI-generated legal work.
Requirements
Key Responsibilities
- Run identical legal prompts across two AI/LLM platforms.
- Review and compare AI-generated legal responses side by side.
- Evaluate responses against a standardized assessment rubric.
- Assess legal accuracy, reasoning quality, completeness, relevance, and practical applicability.
- Identify material differences, omissions, inconsistencies, or inaccuracies between responses.
- Provide concise, clear, and well-supported written feedback for each evaluation.
- Apply the evaluation criteria consistently and objectively across all assigned tasks.
- Complete assignments independently while adhering to project guidelines and deadlines.
Requirements
- 5+ years of experience as in-house legal counsel practicing in France.
- Strong command of French law, particularly commercial and contract law.
- Practical experience advising businesses on legal matters and evaluating real-world legal risk.
- Excellent attention to detail and strong analytical judgment.
- Exceptional written communication skills, with the ability to explain legal conclusions clearly and concisely.
- Comfortable reviewing AI-generated content and distinguishing legally sound analysis from plausible but incorrect reasoning.
- Ability to work independently, follow structured evaluation rubrics, and meet established deadlines.
- Professional proficiency in written English is preferred for working with project instructions and evaluation materials.
Engagement Details
- Initial Commitment: Approximately 10 hours
- Potential: Strong opportunity for additional work based on project requirements and performance
- Work Arrangement: Fully remote
- Confidentiality: All project work is subject to applicable confidentiality requirements and NDA obligations.
- Engagement Type: Independent contractor
Equal Employment Opportunity
We consider all qualified applicants without regard to legally protected characteristics and provide reasonable accommodations upon request.
Contract and Payment Terms
- The engagement is fully remote and can be completed on a flexible schedule.
- Projects may be extended, shortened, or concluded early depending on project needs and performance.
- Work will not require access to confidential or proprietary information belonging to any employer, client, or institution.
- Payments are made weekly based on services rendered through supported payment platforms.
- H-1B and STEM OPT candidates are not eligible for this opportunity at this time.
Benefits mentioned
- We are seeking experienced in-house legal counsel based in France to support a legal AI benchmarking initiative focused on evaluating how effectively AI systems handle real-world questions involving French law.
- As an expert reviewer, you will assess responses generated by two AI platforms, compare their legal reasoning and conclusions, and evaluate each response against a standardized rubric. Your professional judgment will help establish reliable benchmarks for the quality and accuracy of AI-generated legal work.
Requirements mentioned
- 5+ years of experience as in-house legal counsel practicing in France.
- Strong command of French law, particularly commercial and contract law.
- Practical experience advising businesses on legal matters and evaluating real-world legal risk.
- Excellent attention to detail and strong analytical judgment.
- Exceptional written communication skills, with the ability to explain legal conclusions clearly and concisely.
- Comfortable reviewing AI-generated content and distinguishing legally sound analysis from plausible but incorrect reasoning.
- Ability to work independently, follow structured evaluation rubrics, and meet established deadlines.
- Professional proficiency in written English is preferred for working with project instructions and evaluation materials.
No Mondays shows this listing as the employer published it. Check the details on the employer's site before you apply.