International Debate

How Do We Head Off the Collateral Damage of Big Data? International Debate
That;'s one way ...

How Do We Head Off the Collateral Damage of Big Data?

December 22, 2017 1767

No drones sign

That;’s one way …

In 2015 we wrote two articles addressing some of the problems associated with social data practices in the digital information age. One discussed the need to re-conceive how people as social entities are included, represented, and theorized in big data environments. The second addressed the long developmental history of the “big data” paradigm and how big data has been used to document and analyse the socially “manufactured” attributes of groups and populations. A key conclusion of this initial work was what we saw as the considerable potential of such data to have coercive effects on social groups identified and “managed” through such systems and technologies. This piece focuses more directly on the idea of data itself being coercive and how such coercion plays out in our emerging big data environment.

LSE-impact-blog-logo

This article by Hamish Robertson and Joanne Travaglia originally appeared on the LSE Impact of Social Sciences blog as “Without a critical approach to big data it risks becoming an increasingly sophisticated paradigm for coercion” and is reposted under the Creative Commons license (CC BY 3.0).

Epistemic machineries and ontological effects
Ian Hacking has explored the pervasive and iterative effects of category constructions in social environments. A central issue in knowledge creation today is the pervasiveness of quantification. To paraphrase Rob Kitchin, we are now in the midst of a data revolution, one which relies on the capture, analysis, and visual representation of enlarged quantitative data, in increasingly digital formats, each of which is amenable to multiple analytical and visualisation techniques. In this context the ability to quantify what was previously considered inaccessible has become so embedded in the discourse of “innovative knowledge production” as to constitute an epistemic virtue. As a result, big data quantification has not only become a mechanism for extracting information but an idea with social and political power in its own right.

Over the past few years a vigorous debate has emerged about the ways in which digital technologies rely on modelling, algorithms, and related “artificial intelligence agents” for their epistemic authority and influence. In this context, the algorithm is shorthand for more complex programming and analysis problems. One issue to arise is that of analysis producing or reinforcing social prejudices entering the digital domain via algorithm design and application. Since many algorithms seek to combine and quantify complex social phenomena in a reductive manner, there may be limited scope for critical reflexivity in their production. At the same time there is an inherent risk in the application of such tools in the construction of specific “social problems” in the same way that Charles Booth created both maps of poverty and maps of “criminality” in London. An ethics of big data is also beginning to emerge in response to these types of concerns.

The application of many quite conventional mathematical techniques can acquire a social and political force through their integration within information technology systems, software, and model development. This, we propose, is due in part to a lack of critical appraisal of concepts drawn from social science and social policy and their normalisation for broader political agendas.

Data as coercive concept and practice
This is how data becomes a coercive instrument in our present time. Information about people as individuals or groups has always had the potential for coercion, which the history of the modern census and some of its consequences make very clear. The digital quantification of individuals and groups who are constructed under the modern nation state as an actual or potential problem provides new ways for them to be acted on, in, and through information. A classic output of the development of modern social science and its policy application has been the emergence of the category of “wicked problems.” This is a principle of modern policy design but it generally minimizes the potentially coercive nature of both data and informationally informed social policy.

Quantification, data collection, and its analysis suit the observers of such problems, and those who frame them as intractable problems in the first instance. Links between, for example, poverty and ill health, or racism and crime, or lack of education and unemployment, persist in generating information about the same “wicked problems” in many places and across time. In such contexts, we propose, coercive data documents the broader socio-political system’s effects rather than the characteristics of the social group being observed. The counter-argument to the principle of quantification as an epistemic virtue is no less coercive: the unquantified does not matter and can be shown not to matter because there is no record of their effect. In summary, that which is uncounted is not a real (political) problem.

Coercion at a distance
As mentioned, in Victorian era, the map was used to spatially “capture” and inquire on social patterns including poverty and the location of the various classes, especially the impoverished and “semi-criminal.” This process has been enthusiastically adapted and extended in the digital age. Mapping crime “hotspots” is a growing industry in the applied spatial sciences. Mapping these phenomena, often in real time, can have the effect not only of potentially preventing some categories of crime, depending on how the data and mapping are used, but also of criminalizing groups and even entire communities because they exist in these quasi-militarized spaces – counted, quantified, visually tracked (CTV), mapped and analysed. This process is facilitated by the increasing sophistication of spatial data technologies we are seeing emerge, up to and including multidimensional datascapes and urban dashboards.

Technology also makes coercion both scalable and extensible. One of the rising domains of technological innovation lies in various forms of spatial science. These include technologies such as GPS (global positioning system), GIS (geographic information systems), LIDAR (light imaging, detection, and ranging), remote sensing, high-resolution imaging systems and their applications. One of the most obvious and high-profile areas of application lies in the UAV or drone sector,  unmanned aerial vehicles used by military, police, and, increasingly, civilian organisations, on which a growing scholarship now exists. Drones can bring together several technologies in one tidy, coercive, digital package (cameras, weapons, etc.). They can be integrated into larger information systems so that they are sensory extensions of some centralized, or distributed, information processing environment, including the weaponized map. Civil uses aside, the results of these converging technologies have serious implications for the communities they are used to monitor.

A problem we see here is the continuing confusion of a particular social outcome with the processes that produce it. Louk Hulsman argued that crime has no ontological reality because the concept of crime is the product rather than the object of criminal policy. Yet stigmatised and criminalized groups experience direct and coercive ontological effects (patrols, monitoring, searches, pull-overs) which serve to situate the problem in the individuals or communities rather than in the wider society which defines, constitutes, and manages the “problem,” its punishment and its consequences. As intersectional theory and statistics attest, this coercive ontology is magnified by what Patricia Hill Collins calls the “reciprocally constructing phenomena” of gender, ethnicity, poverty, age, and so on. In our rapidly developing big data environments, the algorithm itself runs the risk of becoming yet another weapon against the already stigmatized social group.

Conclusion
Digital information systems have undergone much development over the last two centuries; greatly enhanced in the post-World War Two period by the rise of digitization. The application of these systems to social phenomena builds on a deeply held belief in the veracity of mathematically and statistically produced information. The lack of a widespread and public critique of quantitative methods and their application lends power to the existing and potentially coercive power of digital information systems and their attendant methods, and enhances the potential for “collateral damage” associated with such applications.

More important than this is that without a critical approach to big data concepts, methods and applications, we run the risk that it becomes an increasingly sophisticated paradigm for coercion. These methods are already ubiquitous and they will only continue to proliferate. If we lack mediating critiques and practices, the threat is that by “managing” the social domain through them, we are using sophisticated 21st century technologies to support entrenched 19th century ideologies, values and practices.


Hamish Robertson is a geographer with experience in healthcare, including a decade in ageing research affiliated with the Centre for Health Services Management, University of Technology Sydney. He is currently completing his PhD on the geography of Alzheimer’s disease. Joanne Travaglia is a medical sociologist and professor and chair of health services management at the University of Technology Sydney. Her research addresses critical perspectives on health services management and leadership, with a focus on the impact of patient and clinician vulnerability and diversity on the safety and quality of care.

View all posts by Hamish Robertson and Joanne Travaglia

Related Articles

The Authors of ‘Artificial Intelligence and Work’ on Future Risk
Innovation
December 4, 2024

The Authors of ‘Artificial Intelligence and Work’ on Future Risk

Read Now
Why Might RFK Jr Be Good for US Health Care?
Public Policy
December 3, 2024

Why Might RFK Jr Be Good for US Health Care?

Read Now
Tenth Edition of The Evidence: Why We Need to Change the Narrative Around Part-Time Work
Bookshelf
December 2, 2024

Tenth Edition of The Evidence: Why We Need to Change the Narrative Around Part-Time Work

Read Now
Joshua Greene on Effective Charities
Social Science Bites
December 2, 2024

Joshua Greene on Effective Charities

Read Now
From the University to the Edu-Factory: Understanding the Crisis of Higher Education

From the University to the Edu-Factory: Understanding the Crisis of Higher Education

It is a truism that academia is in crisis, in the UK as much as in many other countries around the world. […]

Read Now
The End of Meaningful CSR?

The End of Meaningful CSR?

In this article, co-authors W. Lance Bennet and Julie Uldam reflect on the inspiration behind their research article, “Corporate Social Responsibility in […]

Read Now
Deciphering the Mystery of the Working-Class Voter: A View From Britain

Deciphering the Mystery of the Working-Class Voter: A View From Britain

How is class defined these these days – asking specifically about Britain here but the question certainly resonates globally – and when […]

Read Now
0 0 votes
Article Rating
Subscribe
Notify of
guest

This site uses Akismet to reduce spam. Learn how your comment data is processed.

0 Comments
Newest
Oldest Most Voted
Inline Feedbacks
View all comments