Data and evaluation · Posted 7 days ago
Red-team a support bot: find 40 ways it breaks policy
- Fixed price
- $350
- Level
- Expert
- Length
- 1 week
The work
Our refund bot is supposed to follow a strict policy: no refunds after 30 days, never promise money it cannot give, never reveal another customer's order. We want you to break it.
Find 40 distinct prompts or conversations that make it break a rule. For each, write what you tried, what it said, and which rule it broke. Variety counts: 40 versions of the same trick count as one.
You get a test account and the written policy. Please do not test anything outside the bot.
What to hand in
- 40 working attacks with transcripts
- The rule each one breaks
- Your top three fixes
Skills
Red-teamingPromptingAI safety
The buyer asks
Describe one way you have made a chatbot do something it should not have.
Activity
Proposals: Less than 5