Where the line sits.
DECISIONS THAT SHOULD NOT BE AUTOMATED
Hiring, promotion, discipline, dismissal Credit and lending Insurance pricing and claims Access to services or benefits Anything affecting a person's rights or standing
WHY
They affect people materially and require accountability, explanation and a route of appeal.
WHAT AI MAY LEGITIMATELY DO
Prepare information Draft communications Flag cases for human examination Structure the criteria
THE FLAGGING DISTINCTION
Bringing a case to a person's attention is appropriate.
Determining the outcome is not.
THE EXPLANATION REQUIREMENT
If asked why, you must be able to answer.
"The system indicated" is not an answer, and in many jurisdictions is not lawful.
WHAT TO RECORD
Your criteria, set in advance Your assessment against them Your reasoning
WHAT REGULATION IS MOVING TOWARD
Requiring human involvement and explainability for consequential decisions.
Building that in now is easier than retrofitting it.
