Marketing versus capability.
COMMON CLAIMS AND WHAT THEY MEAN
"AI-powered": may mean anything, including a rule-based system "Trained on billions of parameters": says nothing about suitability "Understands your business": it does not "Eliminates errors": nothing eliminates errors "Fully automated": consider whether that is what you want
WHAT TO ASK
What specifically does it do? What was it tested on? What does it get wrong? What happens when it is uncertain? Who is responsible when it is wrong?
WARNING SIGNS
Reluctance to discuss failure modes Accuracy figures with no test conditions Demonstrations on chosen examples Guarantees of results
THE MOST USEFUL QUESTION
"Show me where it fails."
A vendor who can answer understands their product.
FOR CONSEQUENTIAL DEPLOYMENTS
Ask how a wrong output would be detected.
If it would not be, that is the problem.
WHAT TO DO
Test on your own work before believing anything.
