The Bart Test - Part 8: When an Interesting Experiment Might Not Be a Useful Tool (And Why That's Okay)
Questioning Bart Gottschalk Questioning Bart Gottschalk

The Bart Test - Part 8: When an Interesting Experiment Might Not Be a Useful Tool (And Why That's Okay)

I'm at a crossroads with the Bart Test. I could probably continue:

- ✅ Process improvements are working (paper sheets, batch evaluation)

- ✅ Could recruit other teens (pay them $5-10 per judging session)

- ✅ Social cost is real but solvable (find teens who think AI is fire)

- ✅ Logistics are manageable (quarterly sessions, not per-model)

But I keep coming back to one question: What would someone DO with these results?

If GPT-5.2 scores 7/10 on cultural fluency and Claude Opus 4.5 scores 6/10... so what? Would a company, developer, or user choose a different model based on that? Should they?

I can't answer that question. And that has me questioning the value of continuing to pursue the Bart Test.

Read More