← Índice

Toby Walsh

Pessoa

Citações guardadas

5 citações guardadas.

• It’s an ancient fear. It goes back thousands of years. You find it in the story of Prometheus in ancient Greek mythology. And in stories like that of Surtr in Norse mythology. What if our inventions and discoveries get the better of us? Wind forward to today, and people are starting to fear artificial intelligence going rogue and getting the better of us.

  #60caf4 Copiar citação Did AI really ‘go rogue’? Not exactly, but we have plenty to fear

• News articles have talked about an AI that went “rogue”, that “escaped” its confinement, and got “outside”. No AI in this case went rogue.Indeed, the whole problem was that the AI did exactly and only what it was asked to do. It was asked to solve a cyber challenge, which it did rather too diligently.

  #246a27 Copiar citação Did AI really ‘go rogue’? Not exactly, but we have plenty to fear

• The lesson I take from the Hugging Face hack is that the cyber capabilities of the latest AI models are very impressive and very troubling. Rather than reason its way to a solution to the cyber challenge, OpenAI’s agent worked out the answer was hidden on Hugging Face’s website, protected by a password. So it gained access to the internet, found a stolen password and accessed the answer.

  #242eac Copiar citação Did AI really ‘go rogue’? Not exactly, but we have plenty to fear

• In response, a bill has just been proposed in the US Congress to force AI developers to provide a “kill switch” to shut down any AI that goes AWOL. [...] We don’t need to regulate for kill switches. We already have them on every computer on the planet. But what we don’t have is mechanisms to prevent these AI models falling into the hands of bad actors and being used to do harm.

  #85976f Copiar citação Did AI really ‘go rogue’? Not exactly, but we have plenty to fear

• Governments, therefore, should be introducing new regulations. We need, for example, to hold tech companies more liable for their products. If a car manufacturer produces a car that catches fire, we hold it liable. [...] Why, then, aren’t we holding AI companies more accountable for the harms they are causing? [...] We also need to hold companies more accountable for facilitating the distribution of harmful content.

  #7cab37 Copiar citação Did AI really ‘go rogue’? Not exactly, but we have plenty to fear