Data Scientist II – GenAI Evaluation Data, Amazon Quick Suite
Amazon · Chennai
| Company | Amazon |
|---|---|
| Role | Data Scientist II – GenAI Evaluation Data, Amazon Quick Suite |
| Location | Chennai |
| Work mode | On-site |
| Experience | 1–3 years |
| Job type | Full-time |
About this job
Amazon is hiring a Data Scientist II in Chennai for the Quick Data team of AWS Quick Suite, an enterprise AI platform for search, research, agents and business intelligence.
You will build evaluation and benchmark datasets for AI features, use LLMs to generate synthetic data and judge quality, lead human annotation and analyse model performance. Responsible AI safety and fairness datasets are also part of the job. The role is in the office.
Eligibility
- 2+ years of data scientist experience
- 3+ years of SQL, Python, R or similar tools
- 3+ years of ML or statistical modelling
- 1+ years working with or evaluating AI systems
- Master's in a STEM field or equivalent STEM work
Skills required
What you will do
- Build evaluation and benchmark datasets for AI features
- Generate synthetic data and judge it with LLMs
- Create ground-truth question-answer sets
- Lead annotation projects and write guidelines
- Analyse model failures and suggest fixes
How to apply
- Open the official Amazon job page with the Apply button and submit your application there.
- Tailor your resume to evaluation datasets or annotation projects you led and what they revealed about models.
Before the interview, prepare:
- LLM-as-a-judge: bias, calibration and checks
- Building a gold Q&A set for RAG evaluation
- Inter-annotator agreement and quality control
- Statistical tests to compare two models
Get jobs like this every day on WhatsApp. Free, no spam, only verified openings.
Join channelStay safe: DailyITJobs is not a recruitment agency and is not connected to Amazon. Apply only on the official website. Never pay anyone for a job, interview or offer letter.