Systems that decide about people.
WHAT PROFILING IS
Automated processing to evaluate aspects of a person.
WHAT EXAMPLES LOOK LIKE
Credit scoring Fraud detection Behavioural advertising Automated screening of applicants
WHAT RIGHTS TYPICALLY APPLY
Not to be subject to a solely automated decision with legal or similarly significant effects, subject to exceptions.
WHAT SOLELY MEANS
No meaningful human involvement.
WHAT MEANINGFUL MEANS
A person with authority and information actually considering the case.
WHAT DOES NOT COUNT
Rubber-stamping an automated output.
WHAT EXCEPTIONS TYPICALLY EXIST
Necessary for a contract Authorised by law Explicit consent
WHAT SAFEGUARDS ARE REQUIRED WHERE AN EXCEPTION APPLIES
Information about the logic The ability to obtain human intervention The ability to contest the decision
WHAT TO PREPARE
An explanation of how the system decides, in plain terms.
WHY THAT IS DIFFICULT
Complex models resist simple explanation.
WHAT TO DO
Explain the factors and their general effect.
WHAT TO ASSESS
Whether the system produces discriminatory outcomes.
HOW
Test outcomes across groups.
WHAT TO DOCUMENT
The assessment, and the safeguards.
WHAT TO TAKE ADVICE ON
Anything deciding access to credit, employment or essential services.
