Choosing a classroom AI tool: questions to ask first

The number of AI tools presenting themselves as pedagogical solutions has exploded, which makes choosing harder rather than easier. Here are the questions that actually help separate serious options from the rest, beyond the sales pitch.
On privacy and security
Where is the data hosted? What does the privacy policy say about reusing submitted content? Is there a documented list of subprocessors or vendors involved in handling the data? These questions should have clear, documented answers — not just verbal assurances from a sales representative.
On pedagogical control
Does the tool consistently place the teacher in the final validation seat? Can every generated suggestion be reviewed and edited before it reaches a student? A tool that fully automates a pedagogical decision without human intervention deserves particular scrutiny before any adoption decision.
On institutional structure
Does the tool support role-based management (teacher, student, administrator)? Does it allow for coherent tracking across a whole program, or does it only work in isolation for each individual teacher, with no institutional overview possible?
On support
What support is offered during adoption? Is there a way to evaluate the tool in a limited setting, like a pilot project, before a full-scale rollout that commits the entire institution?
On general transparency
Is the vendor honest about their tool's limitations, or do they promise results that seem too good to be true? A company that clearly documents what its product doesn't do generally deserves more trust than one offering nothing but unverifiable promises.
A decision worth taking time over
Adopting a classroom AI tool isn't a decision to take lightly, particularly at the scale of an entire institution. Taking the time to ask these questions, and demanding concrete answers, significantly reduces the risk of an unpleasant surprise down the road.
An example of an avoidable bad surprise
A school leader who adopts a tool without checking where the data is hosted might later discover that student information passes through servers located in a jurisdiction that doesn't meet the same legal requirements as their own institution. Asking the question upfront avoids that kind of situation.
One last practical tip
Asking for references from other institutions that have already adopted the tool, when possible, gives a more concrete picture than marketing documentation alone. Other school leaders' experiences in a similar context are often more revealing than any feature list.
No tool will perfectly answer all of these questions on the first try. The point of this checklist isn't to find a flawless product, but to identify the one that offers the best balance between the institution's real needs and the inevitable trade-offs of any technology choice.
Keeping this checklist on hand during meetings with potential vendors helps structure the conversation and avoids getting swept up by an impressive demo without having checked the fundamentals first.
Treating this checklist as a living document, revisited as new tools appear on the market, keeps an institution's evaluation criteria sharp rather than letting them go stale after the first round of vendor research.