Class 8 · Unit project
Unit 4 project: Audit a tool for fairness
Pick a real AI tool. Test it on the world you actually live in — our objects, our words, our light. Count who it fails. Then write the rule that would have caught it.
The task
You counted Ambri leaves, drew kangris, and argued about who answers for a wrong tick. Today your group audits a real tool, the way a fairness inspector would: find out where its data came from, test it on the world you live in, count the results, and say what should change.
Work in groups of 3–4. One period. Everything in fairness-audit.ods.
Choose a tool (3 min)
Pick one your teacher approves — no accounts, nothing about people:
- Quick, Draw! — does it know our objects?
- Your own Teachable Machine model from Unit 2 — which classes does it fail?
- A phone keyboard's suggestions (on the teacher's phone) — does it know our words and names?
- A speech or translation tool, run by the teacher — does it know our place names and accents?
Audit it (27 min)
- Dataset card — the nine questions from Lesson 4.1. Write not stated wherever the tool doesn't say.
- Choose the tests on purpose. At least ten cases in two groups: five that the tool's makers probably had plenty of examples of, five that are ours — kangri, samovar, Kashmiri place names, a local handwriting style, dim winter light.
- Predict each result first. Then run every test once and record case · group · predicted · what the tool did · right?
- Count by group: how many right in each? That's your evidence.
- Accountability note — three lines: the bias check that should have been done, where a person should review it, and what it should tell users plainly.
- One rule: "Before this tool is used in our school, it must ___."
Your own line (5 min, alone)
Each person writes two sentences to the tool's builders: one thing it did well, and the one group it should learn from next, with your evidence. Sign with your roll number. This part is marked for you alone.
Share (5 min)
Each group reads out its two counts — "ours" vs "theirs" — and its rule.
How it is marked
Each row is marked 0–3. Rows 1–5 are shared by the group; row 6 is yours alone. Marks are returned privately and never compared with anyone else's.
Total: 18. If the tool turns out fair in your tests, and you show it with numbers, that is a full result too.
1. Dataset card
- 0Missing
- 1A few answers
- 2All nine, with not stated where honest
- 3All nine, and what the gaps might mean
2. The tests
- 0Fewer than 5
- 1Tests with no plan
- 2Ten cases in two groups, predicted first
- 3Ten cases chosen to find a gap, predicted first
3. The count
- 0Missing
- 1Overall only
- 2Right answers per group
- 3Per group, and the gap stated as a number
4. Accountability note
- 0Missing
- 1One line
- 2Bias check, supervision, transparency
- 3All three, specific to this tool
5. The rule
- 0Missing
- 1"Be fair"
- 2A rule
- 3A rule someone could check before the tool is used
6. To the builders
Just you- 0Missing
- 1Complaint only
- 2Something good and a gap
- 3Good point, gap, and the evidence for it