17/09/2025
Chat GPT5: Things It Can & Can’t Do
Chat GPT-5 can:
- Draft a theory of change diagram in seconds – but it can’t test if it reflects how people experience a programme
- Suggest survey questions – but it can’t judge whether they’ll land well with your participants
- Create a neat evaluation framework – but it can’t know whether it’s going to suit your team’s dynamics
- Pull together a literature review – but it can’t assess the weight of evidence or gaps that matter most for your charity or CIC (I mean, it’ll try…but it’s a people pleaser!)
- Draft a risk register – but it can’t tell which risks are likely in your unique context (again, it’ll try & might even seem plausible but what happens in practice?!)
- Produce a stakeholder map – but it can’t build trust!
You’ll often hear AI companies say:
‘Keep humans in the loop.’
What does that actually mean?!
It means they know AI tools make mistakes - they know their limitations!
So, my lovely fellow human, what can we do?!
- Don’t assume outputs are correct. Always check facts, numbers and references.
- Use your judgement. AI can generate options, but you decide what is meaningful.
- Bring context. You know the politics, culture, community & people.
- Stay accountable.
So, trust the experts who have years of specialist knowledge, skills and experience for whatever you need them for in your organisation.
AI tools do not replace that.
