Data and evaluation · Posted yesterday
Rate 300 chatbot answers for a legal-help assistant
- Fixed price
- $240
- Level
- Intermediate
- Length
- 1 week
The work
We are testing a chatbot that helps tenants understand their rental agreements. It must explain, never advise, and it must say when someone needs a lawyer.
You get a six-point rubric and 20 answers we already graded, so you can calibrate before you start. Score 300 answers in our spreadsheet: accuracy, tone, and whether it crossed into legal advice. Add a one-line reason for every score below 4.
No legal background needed, but you must read carefully and be consistent. We spot-check 30 of your scores against ours.
What to hand in
- 300 scored rows in our sheet
- A reason for every score below 4
- Five patterns you noticed, in a short note
Skills
AI evaluationRubricsLegal
The buyer asks
Tell us about a time you graded or reviewed something against a rubric. How did you stay consistent?
Activity
Proposals: Less than 5