RedLectern topic

AI and society

Social consequences · institutions · inequality · access · public decisions about AI.

For: Everyone

After this page you can: Assess a societal claim using evidence and stated assumptions.

Page reviewed

Part of: Artificial Intelligence

About AI and society

AI’s social impact is not a single effect that can be read from a technical capability. The NIST AI Risk Management Framework describes trustworthiness characteristics as socio-technical and says they must be considered in the system’s context of use. This means a claim about social consequences needs to account for where a system is used, who can access it, and which people or institutions make decisions around it. The same deployment may create benefits for some people while adding risks or burdens for others. (NIST AI Risk Management Framework)

To assess a claim about AI and society, make the claim precise, identify the affected people and the decision at stake, then ask what evidence supports it and what assumptions connect the evidence to the conclusion. Separate measured outcomes from forecasts and values. Ask what comparison is being made, what alternatives exist, and whose experience may be missing. This page offers a starting framework; the child topics examine education and research, environmental impact, work, and media and information in more detail.

Start here

route

Start with the people affected

Read the OECD principles, then name the people, rights, and values involved in a claim about AI.

Start with: OECD AI Principles

route

Consider public priorities

Read the OECD principles and consider how inclusion, rights, and wellbeing shape public choices.

Start with: OECD AI Principles

Learn the foundations

1.Who is affected, and how?A societal claim should identify the people affected and the consequences being discussed.

A societal claim should identify the people affected and the consequences being discussed. Ask whether the claim concerns a person, a community, an organization, or a wider public; whether it describes a benefit, harm, or trade-off; and which stage of designing, deploying, or using AI it concerns. NIST describes trustworthiness characteristics as socio-technical and says they must be balanced according to the system’s context of use. These characteristics can help frame questions, but they do not by themselves establish what happened in a particular case. For that, look for evidence about the system and its context of use.

Try this distinction: a stated value tells you what matters; evidence helps establish whether a particular outcome occurred.

Try it

A town proposes using AI to help allocate a limited public service. Name two groups affected, one possible benefit, one possible harm, and one piece of evidence that could help assess the claim that the system improves fairness.

Groups could include applicants and service staff. A possible benefit is more consistent review; a possible harm is that some applicants are wrongly denied. Compare outcomes across relevant groups with the existing process, while checking how fairness is defined and measured.

2.Assess a claim with evidenceClaims about AI often combine an observation with an interpretation: for example, a system produced a particular output, so a service must have improved.

Claims about AI often combine an observation with an interpretation: for example, a system produced a particular output, so a service must have improved. To assess the conclusion, identify the outcome being measured, the comparison or baseline, and the time and setting covered by the evidence. Then state assumptions that might connect the observed result to the broader claim, such as whether the comparison is fair or whether the result applies to other groups. NIST’s framework describes trustworthiness as contextual and socio-technical, so a technical measure alone may not settle a social claim.

Common mix-up: a system-level performance measure does not automatically establish a fair or beneficial social outcome.

Try it

A report says an AI-assisted process is “more accurate.” Write two questions you would ask before accepting the claim as evidence that the process benefits the public.

What outcome does “accurate” measure, and against which reference or baseline? Which people and cases were included, and does the measure capture errors or burdens that matter to them?

3.Institutions and public decisionsAI systems are adopted, governed, and used by people and organizations.

AI systems are adopted, governed, and used by people and organizations. When assessing a public decision, ask who chose the system, who sets its purpose, who can challenge an outcome, and who is responsible for reviewing harms. The OECD principles call for transparency and safeguards, including human agency and oversight, and say information should help people adversely affected by an AI system challenge its output. NIST’s AI Risk Management Framework is voluntary guidance intended to help developers, users, and evaluators manage risks that may affect individuals, organizations, society, or the environment. These sources offer ways to structure questions; a framework or principle alone does not show that a particular institution followed it or achieved a good result.

For specific domains, continue to AI in education and research, AI at work, or AI media and information.

Try it

A public agency plans to use AI to prioritize cases. Name one decision the agency should document, one group it should involve, and one way an affected person could question an outcome.

The agency should document the system’s purpose and how its output affects prioritization, involve people affected by the service, and provide a way to request human review or challenge the decision.

4.Inequality, access, and distributionAsk how access to an AI-enabled service, its benefits, and its burdens are distributed.

Ask how access to an AI-enabled service, its benefits, and its burdens are distributed. Who can use it? Who may be excluded or face barriers? Are outcomes different across groups, and what evidence would reveal that? OECD principles connect responsible AI stewardship with inclusion and reducing inequalities, while also calling for respect for non-discrimination and equality. These statements help identify issues to investigate; they do not establish that every AI deployment widens or narrows inequality. Evidence needs to fit the system, population, and setting under discussion.

For focused examples, explore AI in education and research, AI environmental impact, and AI at work.

  • AI Risks and Trustworthiness

    The NIST framework describes trustworthiness characteristics as dependent on context and social and organizational factors.

Try it

A school says an AI learning tool “makes support more accessible.” List two groups whose access should be checked and one comparison that could test the claim.

Check access for students with disabilities and students with limited internet access. Compare who can use the tool and who receives support before and after introduction, including whether outcomes differ across groups.

Explore subtopics

Latest

No recent updates are available.

See the sources list

Books

Questions and comments