Job Description
Payrate: $30.00 - $37.50/hr
Summary: Company is seeking a detail-oriented Data Analyst to evaluate the quality of AI agent responses against defined guidelines and quality metrics, and to turn what you find into insights the team can act on.
Must-Haves Skills: - Experience with data annotation, labeling, or classification against defined guidelines.
- Experience performing quality checks or evaluations based on guidelines and metrics.
- Comfortable working with large, complex, and sometimes ambiguous datasets.
- Analytical mindset with the ability to identify patterns, trends, and quality issues
- Strong attention to detail and clear written communication
- Demonstrated interest in data analysis and AI-driven work
Skills: - Exposure to LLMs, conversational agents, or AI product evaluation (LLM-as-a-judge).
- Spreadsheets or basic SQL used to slice labeled data (error rates, disagreement, sample review).
- Comfort working in a documentation-and-ticket culture (guidelines, findings, and work tracking kept current).
- Travel, customer experience, policy, or content-quality background.
- Technical Skills (in order of importance)
- Data annotation and classification
- Python and Jupyter Notebook for data analysis
- Strong analytical and problem-solving skills
- Excel or Google Sheets; basic SQL a plus
Pay Transparency: The typical base pay for this role across the U.S. is:
$30.00 - $37.50/hr . Non-exempt positions are eligible for overtime at a rate of 1.5 times the base hourly rate for all hours worked in excess of 40 in a work week, or as required by state or local law. Final offer amounts, within the base pay set forth above, are determined by factors including your relevant skills, education and experience. Full-time employees are eligible to select from different benefits packages. Packages may include medical, dental, and vision benefits, health savings accounts with qualified medical plan enrollment, 10 paid days off, 3 days paid bereavement leave, 401(k) plan participation with employer match, life and disability insurance, commuter benefits, dependent care flexible spending account, accident insurance, critical illness insurance, hospital indemnity insurance, accommodations and reimbursement for work travel, and discretionary performance or recognition bonus. Sick leave and mobile phone reimbursement provided based on state or local law.
Consent to Communication and Use of AI Technology: By submitting your application for this position and providing your email address(es) and/or phone number(s), you consent to receive text (SMS), email, and/or voice communication whether automated (including auto telephone dialing systems or automatic text messaging systems), pre-recorded, AI-assisted, or individually initiated from Aditi Consulting, our agents, representatives, or affiliates at the phone number and/or email address you have provided. These communications may include information about potential opportunities and information. Message and data rates may apply. Message frequency may vary.
You represent and warrant that the email address(es) and/or telephone number(s) you provided to us belong to you and that you are permitted to receive calls, text (SMS) messages, and/or emails at these contacts. You also acknowledge and agree to Aditi Consulting LLC's use of AI technology during the sourcing process, including calls from an AI Voice Recruiter. AI is used solely to gather data and does not replace human-based decision-making in employment decisions. Calls may be recorded.
Consent is not a condition of purchasing any property, goods, or services. You may revoke your consent at any time by replying "STOP" to :messages or by contacting privacy@aditiconsulting.com.
For information about our collection, use, and disclosure of applicant's personal information as well as applicants' rights over their personal information, please see our Privacy Policy
#AditiConsulting
#26-06152
Job Tags
Hourly pay, Full time, Local area, Flexible hours