18 December 2018

If tech experts worry about artificial intelligence, shouldn’t you?

John Naughton

Fifty years ago last Sunday, a computer engineer named Douglas Engelbart gave a live demonstration in San Francisco that changed the computer industry and, indirectly, the world. In the auditorium, several hundred entranced geeks watched as he used something called a “mouse” and a special keypad to manipulate structured documents and showed how people in different physical locations could work collaboratively on shared files, online.

It was, said Steven Levy, a tech historian who was present, “the mother of all demos”. “As windows open and shut and their contents reshuffled,” he wrote, “the audience stared into the maw of cyberspace. Engelbart, with a no-hands mic, talked them through, a calm voice from Mission Control as the truly final frontier whizzed before their eyes.” That 1968 demo inspired a huge new industry based on networked personal computers using graphical interfaces, in other words, the stuff we use today.

Engelbart was a visionary who believed that the most effective way to solve problems was to augment human abilities and develop ways of building collective intelligence. Computers, in his view, were “power steering for the mind” – tools for augmenting human capabilities – and this idea of augmentation has been the backbone of the optimistic narrative of the tech industry ever since.

The dream has become a bit tarnished in the last few years, as we’ve learned how data vampires use the technology to exploit us at the same time as they provide free tools for our supposed “augmentation”. The argument in favour varies from company to company and from application to application. Spreadsheets, word-processing, computer-assisted design (CAD) and project-planning tools are unquestionably a boon, for example. Google search can be seen as a memory prosthesis for humanity or an excuse for never retaining any factual knowledge. But it’s not clear what kind of cognitive augmentation – if any – is provided by Instagram or Facebook. And as for Twitter...

There is, however, one kind of recent tech development for which the augmentation argument is continually made: artificial intelligence. AI is unfailingly portrayed by its evangelists as a technology that really can amplify human capabilities. In its current manifestation, it’s basically machine-learning and its augmentation potential is often impressive. One thinks, for example, of how image-scanning software can rapidly scan tens of thousands of retinal scans and reliably pick out those that need consideration by an eye surgeon.

But there are also lots of cases where machine-learning produces perverse outcomes and biased predictions and there’s widespread concern about building a networked world around such a powerful but flawed technology. To try and get a balanced assessment of the risk, the Pew Research Center recently put the following question to a formidable panel of experts: “By 2030, do you think it is most likely that advancing AI and related technology systems will enhance human capacities and empower them?”

The answers are revealing and sobering. While all of the respondents were people who understood the empowering potential of the technology, the overwhelming impression one gets from them was one of concern. They see widespread use of AI as leading to a loss of human agency, as decision-making on key aspects of life is ceded to code-driven “black box” systems. They fear the potential for abuse in surveillance systems designed for profit (aka social media), effects that are already much in evidence. They see existential risks for many kinds of employment. While some expect new kinds of jobs to emerge, others worry about massive unemployment, widening economic divides and the social upheavals and populist uprisings that could be triggered by that.

Many of them perceive and welcome the augmentation potential of AI, but others fear that our increasing dependence on the technology will erode our capacity to think for ourselves, take independent action or interact effectively with others. And some foresee mayhem as the technology’s capacity to disrupt democratic processes increases (eg with “deep fake” video).

The first thing to say about this survey is that it is not a statistically representative opinion poll of the Mori/YouGov type. All it is is a serious attempt to canvass the opinions of a wide range of well-informed thinkers, many of whom are au fait with the tech industry and its core technologies and corporations. At the very least, their reflections provide a welcome contrast to the current frenzied boosterism about “AI everywhere” from a tech industry that sees ethics as occupational therapy for underemployed philosophers and other “losers”.

But most of all, it made me wonder what Engelbart would have made of the debate. “Someone once called me ‘just a dreamer’,” he once said. “That offended me, the ‘just’ part; being a real dreamer is hard work. And it really gets hard when you start believing in your dreams.” Especially when they turn into nightmares.
What I’m reading

Net gains
Benedict Evans’s “End of the Beginning” presentation at venture capital firm a16z’s annual technology conference. An astute and insightful take on the evolution of the internet to date by one of its shrewdest observers.

App antics
“Gaming the App Store” studies how Apple’s monopolistic control goes hand in hand with dereliction of duty, in a fascinating blog post by a veteran app developer David Barnard.

Fact files
Truth Decay is an interesting project (and a neat pun) by the Rand Corporation.

As 2018 draws to a close….

… we’re asking readers to make an end of year or ongoing contribution in support of The Guardian’s independent journalism.

Three years ago we set out to make The Guardian sustainable by deepening our relationship with our readers. The same technologies that connected us with a global audience had also shifted advertising revenues away from news publishers. We decided to seek an approach that would allow us to keep our journalism open and accessible to everyone, regardless of where they live or what they can afford.

More than one million readers have now supported our independent, investigative journalism through contributions, membership or subscriptions, which has played such an important part in helping The Guardian overcome a perilous financial situation globally. We want to thank you for all of your support. But we have to maintain and build on that support for every year to come.

Sustained support from our readers enables us to continue pursuing difficult stories in challenging times of political upheaval, when factual reporting has never been more critical. The Guardian is editorially independent – our journalism is free from commercial bias and not influenced by billionaire owners, politicians or shareholders. No one edits our editor. No one steers our opinion. This is important because it enables us to give a voice to those less heard, challenge the powerful and hold them to account. Readers’ support means we can continue bringing The Guardian’s independent journalism to the world.

Please make an end of year contribution today to help us deliver the independent journalism the world needs for 2019 and beyond.

No comments: