NORBERT BIEDRZYCKI
6 min readPressRead this in Polish

Testing autonomous vehicles, we are testing our trust in artificial intelligence and taking a lesson in ethics

Testing autonomous vehicles, we are testing our trust in artificial intelligence and taking a lesson in ethics

My article in AntyWeb, 23 January 2019.

Concepts such as algorithms and robotisation often provoke extreme, even irrational reactions. Fascination is often accompanied by an almost childlike fear. That does not surprise me. We are experiencing a global civilisational and cultural breakthrough, so even exaggerated, emotional concern about the present – and even more so about the future – seems justified. Interestingly, modern technology, controversial as it is, forces us to think about fundamental values such as good and evil.

Safer than people

Autonomous cars are a vivid example of how technological progress can polarise our views. Personally, I believe they offer a chance to raise safety standards on the roads. And I am not surprised by enthusiasts who claim that in 15 years we will not be able to comprehend that people once drove cars.

For things to go in the right direction, however, we need universal standards for deploying the new technology. By investing huge sums, the manufacturers of autonomous vehicles have, in a sense, made a promise to society: broad acceptance of these cars on the roads could prevent tens of thousands of road deaths every year (in the US alone, 30,000–40,000 people die in accidents each year).

Supporters of autonomous vehicles often cite repeated research findings showing that 90–95 percent of accidents are caused by the driver, not the technology.

Autonomous cars under fire again

In March 2018, in the American city of Tempe, a woman crossing the road was killed by an autonomous vehicle. Neither the car’s safety systems nor the driver inside reacted. The event triggered a flood of comments and showed how many perspectives we can take on it.

Some, a little maliciously, called the accident historic: artificial intelligence had claimed its first human victim. Opinions that defective technology produced by private, profit-driven companies should not be tested on public roads appeared instantly. Sceptics and critics argued that people would never accept autonomous vehicles, citing among other things a Reuters/Ipsos survey from January. Even before the Tempe accident, two thirds of Americans did not trust autonomous vehicles.

Trust in artificial intelligence, a lesson in ethics, Norbert Biedrzycki, AntyWeb

How should it all be set?

The accident also brought to light issues such as overworked test drivers (too many hours behind the wheel) and the decision to drop the second person in the cabin (for a long time, two drivers had always monitored the vehicle during test drives). The company testing the vehicle had also reportedly chosen a strategy of increasing ride comfort (by limiting frequent, sudden braking) at the cost of making the vehicle less sensitive to obstacles. Journalists also obtained internal reports showing that during tests the vehicles struggled to drive even one kilometre without driver intervention or braking.

Footage of the accident shows that the driver was not watching the road attentively but was busy with a phone. Paradoxically, this could confirm the thesis that the most dangerous thing on the road is the person behind the wheel. But that would probably be an oversimplification.

Autonomous vehicles are equipped with lidar sensors and radars. The equipment is meant to monitor the vehicle’s surroundings and detect any obstacles. However, there are no universal standards defining how such systems should work, which parameters should be taken into account and when the car should respond by braking.

As part of the ongoing investigation, the company admitted that the lidars, radars and cameras did register the person on the road (a point strongly emphasised by the manufacturer of the laser sensors). The problem therefore lay in how the car’s system was tuned – in the software and the machine learning algorithms. Settings with a higher tolerance for obstacles had been chosen.

This brings us to an important, perhaps the key, question in the whole situation: how should a vehicle’s safety system be “set”, and who should make the key decisions? The fact that there are many options does not make the problem simpler.

Who dies last?

Since 2016, researchers at the MIT Media Lab have been studying autonomous vehicles. They launched the Moral Machine (moralmachine.mit.edu), a kind of game that tests our ethical choices related to autonomous vehicles. The website says it shows moral dilemmas that driverless cars must resolve, such as choosing between killing a passenger and killing a pedestrian. The platform shows participants various road scenarios, many of them involving different combinations of gender and age, and even animals crossing the road.

A few weeks ago the authors presented partial conclusions from more than 4 million responses. Participants were far more likely to want to protect the life of a child than that of an adult. But when they had to decide who should survive an extremely dangerous situation – the passenger, the driver or the pedestrian – the results were no longer clear-cut. For example, as many as 40 percent of participants said the vehicle should protect its passengers first, even at the cost of pedestrians’ lives.

Trust in artificial intelligence, a lesson in ethics, Norbert Biedrzycki, AntyWeb

A bumpy road to answers

Technology still does not act on its own. Neither robots, nor the algorithms that animate them, nor algorithm-driven autonomous cars are independent beings. Even if, thanks to machine learning and deep learning, technology can expand its capabilities and learn from its mistakes, we still have the greatest influence on it.

When we allow algorithmic technology to operate in society – including on the road – we must be aware of our own responsibility. The challenge is great and the questions are difficult. Sooner or later, however, we must face them. The list is long; here are some of them.

Should the authorities of the city, country or region where tests take place have permanent and full access to data on how an autonomous vehicle behaves on the road during test drives (stops, system shutdowns, reactions to objects on the road, human intervention)? Should the number of test kilometres a vehicle must drive before being approved for use be defined? Should clear quality standards be developed for the sensors fitted in cars? What should protection of the data collected and generated by an autonomous vehicle consist of? Should buyers of a car receive as much information as possible about how it will behave in extremely difficult situations? Must clear rules protecting the driver’s rights and personal interests in the event of an accident be in place before vehicles are allowed on the road? Should full vehicle autonomy (where the driver has no influence on the car’s decisions) be banned?

Despite setbacks and difficulties, manufacturers of autonomous cars are not giving up. I think abandoning work on this technology would be a mistake and would mean giving up dreams of the most significant leap in motoring since the invention of the car. At the same time, it would not be a bad thing for fans of the new technology to listen to the arguments of sceptics who claim that autonomous systems will always fail. Their criticism can inspire and help develop the standards we certainly badly need – so that we can move forward faster.

Link to the full article (in Polish)

Related articles:

– A machine will not hug you, but it may listen and offer advice

– Can machines tell good from evil?

– Only God can count as fast: the world of quantum computers

– Machine learning. Computers are no longer babies

– How machines reason

Read next

  1. Machine Ecology

    Machine Ecology. The earth is sick, and the causes of its disease lie in our choices, our myopia, and our lack of imagination.

  2. Data Driven Investor: Time We Talked to Our Machines

    My article in Data Driven Investor published 12th of September 2019. We talk to our machines more and more often: the smartphones, computers and digital assistants on our desks. Are keyboards, and the manual operation of electronic devices, becoming obsolete? Over the last few years, artificial intelligence (AI) has

  3. The soulless logic of algorithms seduces business and flirts with us, the customers