The job, in the employer's words
This role is for one of our clients
We are looking for detail-oriented and analytical Business Analysts – US Raters to support a project focused on evaluating and comparing responses generated by multiple AI chatbots. The role involves reviewing chatbot outputs, assessing their quality against predefined criteria, conducting structured evaluations, and providing accurate, well-supported final judgments.
The ideal candidate will have at least three years of experience in business analysis or a related field, strong analytical and communication skills, and the ability to evaluate information objectively. This is a fully remote, short-term contract opportunity for candidates based in the United States who can commit to the required working hours and project schedule.
Job Details
- Role: Business Analyst – US Raters
- Experience: 3+ years
- Location: United States only
- Employment Type: Short-term contract
- Contract Duration: 16 weeks
- Compensation: USD 30 per hour
- Start Date: Immediate
- Work Mode: Fully remote
- Availability: Full-time commitment of 8 hours per day
- Time Zone Requirement: At least 4 hours of overlap with US Pacific Time (PST)
- Work Schedule: Five working days per week, including weekends as required, with two weekdays off
Requirements
Key Responsibilities
- Review, analyze, and compare responses generated by multiple AI chatbots.
- Evaluate chatbot responses based on predefined criteria, including accuracy, relevance, completeness, clarity, consistency, and overall quality.
- Gather, analyze, and document business requirements and translate them into clear evaluation guidelines.
- Conduct structured assessments and provide objective, evidence-based judgments.
- Analyze workflows, processes, and data to identify gaps, inconsistencies, and areas for improvement.
- Prepare reports, summaries, and supporting documentation to communicate evaluation findings.
- Collaborate with project managers and cross-functional teams to clarify requirements and resolve assessment-related questions.
- Track task progress, quality metrics, and deliverables to ensure timely completion.
- Identify recurring issues in chatbot responses and share actionable observations.
- Maintain high standards of accuracy, consistency, confidentiality, and documentation throughout the project.
Required Qualifications and Skills
- Bachelor's degree in Business Administration, Finance, Computer Science, or a related field.
- At least 3 years of experience as a Business Analyst or in a similar analytical role.
- Strong analytical thinking, problem-solving, and decision-making skills.
- Excellent written and verbal communication skills.
- Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or similar analytical tools.
- Experience with requirement gathering, process mapping, and business documentation.
- Ability to work effectively with cross-functional teams and manage multiple priorities.
- Strong attention to detail and the ability to make consistent, objective assessments.
- Familiarity with Agile or Scrum methodologies is an advantage.
- Ability to follow detailed instructions, meet deadlines, and work independently in a remote environment.
Engagement Benefits
- Opportunity to contribute to projects focused on AI evaluation and chatbot response quality.
- Fully remote work arrangement.
- Exposure to structured AI assessment and quality assurance processes.
- Opportunity to work on projects with broader business and technological applications.
- Clearly defined contract duration, hourly compensation, and project expectations.
Important Engagement Details
- This is a project-based contract with a duration of 16 weeks.
- Assigned tasks will involve comparing responses from multiple chatbots and submitting a final assessment based on defined criteria.
- Candidates must be available for 8 hours per day, five days per week.
- A minimum of four hours of overlap with US Pacific Time is required.
- The schedule may include weekend work, with two weekdays off each week.
- Candidates must be based in the United States and comply with the applicable country-specific eligibility guidelines.
- Consistent evaluation quality, adherence to project instructions, and timely task completion are essential.
Requirements mentioned
- Key Responsibilities
- Review, analyze, and compare responses generated by multiple AI chatbots.
- Evaluate chatbot responses based on predefined criteria, including accuracy, relevance, completeness, clarity, consistency, and overall quality.
- Gather, analyze, and document business requirements and translate them into clear evaluation guidelines.
- Conduct structured assessments and provide objective, evidence-based judgments.
- Analyze workflows, processes, and data to identify gaps, inconsistencies, and areas for improvement.
- Prepare reports, summaries, and supporting documentation to communicate evaluation findings.
- Collaborate with project managers and cross-functional teams to clarify requirements and resolve assessment-related questions.
- Track task progress, quality metrics, and deliverables to ensure timely completion.
- Identify recurring issues in chatbot responses and share actionable observations.
- Maintain high standards of accuracy, consistency, confidentiality, and documentation throughout the project.
- Required Qualifications and Skills
- Bachelor's degree in Business Administration, Finance, Computer Science, or a related field.
- At least 3 years of experience as a Business Analyst or in a similar analytical role.
- Strong analytical thinking, problem-solving, and decision-making skills.
- Excellent written and verbal communication skills.
- Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or similar analytical tools.
- Experience with requirement gathering, process mapping, and business documentation.
- Ability to work effectively with cross-functional teams and manage multiple priorities.
- Strong attention to detail and the ability to make consistent, objective assessments.
- Familiarity with Agile or Scrum methodologies is an advantage.
- Ability to follow detailed instructions, meet deadlines, and work independently in a remote environment.
- Engagement Benefits
- Opportunity to contribute to projects focused on AI evaluation and chatbot response quality.
- Fully remote work arrangement.
- Exposure to structured AI assessment and quality assurance processes.
- Opportunity to work on projects with broader business and technological applications.
- Clearly defined contract duration, hourly compensation, and project expectations.
- Important Engagement Details
- This is a project-based contract with a duration of 16 weeks.
- Assigned tasks will involve comparing responses from multiple chatbots and submitting a final assessment based on defined criteria.
- Candidates must be available for 8 hours per day, five days per week.
- A minimum of four hours of overlap with US Pacific Time is required.
- The schedule may include weekend work, with two weekdays off each week.
- Candidates must be based in the United States and comply with the applicable country-specific eligibility guidelines.
- Consistent evaluation quality, adherence to project instructions, and timely task completion are essential.
No Mondays shows this listing as the employer published it. Check the details on the employer's site before you apply.