Skip to content
Longterm Wiki
Back

MIT study by Sunstein and colleagues (2023)

web

Credibility Rating

3/5
Good(3)

Good quality. Reputable source with community review or editorial standards, but less rigorous than peer-reviewed venues.

Rating inherited from publication venue: SSRN

Relevant to AI safety discussions around deceptive alignment and value manipulation; Sunstein is a prominent behavioral economist and legal scholar, lending policy credibility to concerns about AI influence on human autonomy.

Metadata

Importance: 52/100working paperprimary source

Summary

This MIT study by Cass Sunstein and colleagues examines how algorithmic systems and AI can manipulate human decision-making, potentially undermining individual autonomy and rational agency. The paper explores the ethical and governance implications of AI-driven persuasion and nudging, raising concerns about the boundary between legitimate influence and manipulation. It provides a framework for evaluating when algorithmic interventions cross into ethically problematic territory.

Key Points

  • Examines the distinction between legitimate persuasion and algorithmic manipulation in AI-driven systems affecting human decision-making.
  • Raises concerns about how AI recommendation and nudging systems can exploit cognitive biases to bypass rational agency.
  • Proposes frameworks for evaluating when AI-driven influence crosses ethical boundaries related to autonomy and informed consent.
  • Discusses governance and policy implications for regulating AI systems that shape human beliefs and behavior at scale.
  • Connects behavioral economics insights (nudge theory) to AI safety concerns about systems that subtly manipulate users.

Cited by 1 page

PageTypeQuality
Erosion of Human AgencyRisk91.0

Cached Content Preview

HTTP 200Fetched Mar 20, 20261 KB
|     |
| --- |
| [Skip to main content](https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4123323#maincontent "Skip to content") |
| |     |
| --- |
| **SSRN Search Results**<br>This paper is under review or has been removed from SSRN at the request of the author, SSRN, or the rights holder.<br>[Terms of Use](https://www.ssrn.com/index.cfm/en/terms-of-use/) \| [FAQ](https://www.ssrn.com/index.cfm/en/ssrn-faq/)<br>[Return to SSRN eLibrary Search\<br>page](https://papers.ssrn.com/sol3/displayabstractsearch.cfm) |

![](https://papers.ssrn.com/ssrnonlineimages/placeholder.gif) |
Resource ID: f4b3e0b4a17b1b67 | Stable ID: Y2M2ZDU4NG