Whittaker Warns AI Power Begins With Surveillance

Big Think published a wide-ranging Whittaker conversation on October 21 about data collection, dependence and control.

Meredith Whittaker’s warning begins beneath the chatbot interface. In an October 21 Big Think interview, the Signal president argued that today’s AI industry grew from the data collection, computing infrastructure and concentrated business power of the platform economy. [s1]

She challenged the familiar claim that people must be comfortable with surveillance because they keep using the products. Participation can reflect the need to remain connected to friends, work and ordinary social life. Her feared outcome is a small set of companies and governments extending that infrastructure into greater control over information and institutions. [s1]

That is an account of a danger. Its force lies in asking what becomes possible when gathering intimate information and mediating public knowledge sit under the same concentrated authority.

Privacy has a moral importance that a convenience calculation misses. People need room to change their minds, examine their beliefs and form relationships without treating each hesitation as a market signal. A service that saves minutes can still impose a serious cost if it makes private reflection harder.

The language of personal choice can conceal the practical difficulty of leaving. If refusal means losing contact with a community or access to an essential service, a consent button tells only part of the story. Public policy should examine those conditions rather than assuming that a busy user has endorsed a commercial philosophy.

Whittaker’s intervention invites a more demanding test of useful AI: does it strengthen a person’s ability to think and act, or deepen dependence on an organisation that observes and steers them? A humane technology programme would make privacy and real alternatives part of its design. It would not ask people to surrender their inner lives as the entrance fee to modern society.