Tag: Superintelligence

Professor Stuart Russell's talk at the Centre for the Study of Existential Risks

Professor Stuart Russell, computer science professor at University of California, Berkeley, gave a clear and powerful talk on the promise and peril of artificial intelligence at the CSER in Cambridge on 15th May. Professor Russell has been thinking for over 20 years about what will happen if we create an AGI – an artificial general intelligence, a machine with human-level cognitive abilities. The last chapter of his classic 1994 textbook Artificial Intelligence: A Modern Approach was called “What if we succeed?” Although he cautions against making naive statements based on Moore's Law, he notes that progress on AI is accelerating in...

The Economist’s curious articles on artificial intelligence

The Economist is famous for its excellence at forecasting the past and its weakness at forecasting the future. Its survey on AI (9th May) is a classic. The explanation of deep learning is outstanding, but the conclusion that we should not worry about superintelligence because today's computers have neither volition nor awareness is, well, less impressive. The magazine's leader seems to agree, saying that "even if the prospect of what Mr Hawking calls “full” AI is still distant, it is prudent for societies to plan for how to cope". But it then goes on to make the outlandish claim that...

On boiling frogs

If you drop a frog into a pan of boiling water it will jump out. Frogs aren't stupid. But if a frog is sitting in a pan which is gradually heated it will become soporific and fail to notice when it boils to death at 100 degrees. This story has been told many times, not least by the leading management thinker, Charles Handy, in his best-selling book The Age of Unreason. Unfortunately, the story isn't true. It was put about by 19th-century experimenters, but has been refuted several times since. Never mind: it's a good metaphor, and metaphors aren't supposed...

Interview on Singularity Weblog

[embed]https://www.youtube.com/watch?v=zISzqmtojD8#t=1036[/embed] This week I interviewed with Nikola Danaylov, the creator of Singularity Weblog.  It was great fun, and quite an honour to follow in the footsteps of his 160-plus previous guests. We talked about hope and optimism as a useful bias, about the promise and peril of AGI, about whether automation will end work and force the introduction of universal basic income ... and of course about Pandora's Brain.
Science fiction gives us metaphors to think about our biggest problems

Science fiction gives us metaphors to think about our biggest problems

Science fiction, it has been said, tells you less about what will happen in the future than it tells you about the predominant concerns of the age when it was written. The 1940s and 50s is known as the golden age of science fiction: short story magazines ruled, and John Campbell, editor of Astounding Stories, demanded better standards of writing than the genre had seen before. Isaac Asimov, Arthur C Clarke, AE van Vogt, and Robert Heinlein all got started in this period. The Cold War was building up, but the West was emerging from the destruction and austerity of...