Matrix-style virtual worlds ‘a few years away’

Are supercomputers on the verge of creating Matrix-style simulated realities? Michael McGuigan at Brookhaven National Laboratory in Upton, New York, thinks so. He says that virtual worlds realistic enough to be mistaken for the real thing are just a few years away.

In 1950, Alan Turing, the father of modern computer science, proposed the ultimate test of artificial intelligence – a human judge engaging in a three-way conversation with a machine and another human should be unable to reliably distinguish man from machine.

A variant on this “Turing Test” is the “Graphics Turing Test”, the twist being that a human judge viewing and interacting with an artificially generated world should be unable to reliably distinguish it from reality.

“By interaction we mean you could control an object – rotate it, for example – and it would render in real-time,” McGuigan says.

Photoreal animation

Although existing computers can produce artificial scenes and textures detailed enough to fool the human eye, such scenes typically take several hours to render. The key to passing the Graphics Turing Test, says McGuigan, is to marry that photorealism with software that can render images in real-time – defined as a refresh rate of 30 frames per second.

McGuigan decided to test the ability of one of the world’s most powerful supercomputers – Blue Gene/L at Brookhaven National Laboratory in New York – to generate such an artificial world.

Blue Gene/L possesses 18 racks, each with 2000 standard PC processors that work in parallel to provide a huge amount of processing power – it has a speed of 103 teraflops, or 103 trillion “floating point operations” per second. By way of comparison, a calculator uses about 10 floating operations per second.

In particular, McGuigan studied the supercomputer’s ability to mimic the interplay of light with objects – an important component of any virtual world with ambitions to mimic reality.

He found that conventional ray-tracing software could run 822 times faster on the Blue Gene/L than on a standard computer, even though the software was not optimised for the parallel processors of a supercomputer. This allowed it to convincingly mimic natural lighting in real time.

Not there yet

“The nice thing about this ray tracing is that the human eye can see it as natural,” McGuigan says. “There are actually several types of ray-tracing software out there – I chose one that was relatively easy to port to a large number of processors. But others might be faster and even more realistic if they are used in parallel computing.”

Although Blue Gene/L can model the path of light in a virtual world both rapidly and realistically, the speed with which it renders high-resolution images still falls short of that required to pass the Graphics Turing Test.

But supercomputers capable of passing the test may be just years away, thinks McGuigan. “You never know for sure until you can actually do it,” he says. “But a back-of-the-envelope calculation would suggest it should be possible in the next few years, once supercomputers enter the petaflop range – that’s 1000 teraflops.”

But others think that passing the Graphics Turing Test requires more than photorealistic graphics moving in real-time. Reality is not ‘skin deep’ says Paul Richmond at the University of Sheffield, UK. An artificial object can appear real, but unless it moves in a realistic way the eye won’t be fooled. “The real challenge is providing a real-time simulation that includes realistic simulated behaviour,” he says.

Fluid challenge

“I’d like to see a realistic model of the Russian ballet,” says Mark Grundland at the University of Cambridge. “That’s something a photographer would choose as a subject matter, and that’s what we should aim to convey with computers.”

Grundland also points out that the Graphics Turing Test does not specify what is conveyed in the virtual world scene. “If all that is there is a diffusely-reflecting sphere sitting on a diffusely-reflecting surface, then we’ve been able to pass the test for many years now,” he says. “But Turing didn’t mean for his vision to come true so quickly.”

McGuigan agrees that realistic animation poses its own problems. “Modelling that fluidity is difficult,” he says. “You have to make sure that when something jumps in the virtual world it appears heavy.” But he remains optimistic that animation software will be up to the task. “Physical reality is about animation and lighting,” he says. “We’ve done the lighting now – the animation will follow.


Thanks for the amazing article to



  1. April 5, 2008 at 10:16 am

    Excellent Article! Thank You for publishing such thougth provoking content!

    Indeed real-time rendering of photo-realistic 3D Animation remains a challenge to those of us who aspire (and are working towards) the delivery of positive change in the world of reality via the every evolving world of virtual reality. The potential outcomes that may be realized when bridging the intangible, soulless, spiritless and emotionless world of a real-time interactive virtual environment with the human capacity for knowledge acquisition and learning is fascinating to ponder.

    Super processing (such as IBM’s Blue Gene / L you mentioned), will undoubtedly impact our future ability to render what may seem like a scene from the holodeck on StarTrek. I am fascinated by what that will mean to the world of teaching and learning in applications beyond today’s capabilities in surgery simulation, robotic surgery, and health and medical education. That said, the ability to use such realistic and interactive virtual environments in health care training, when combined with teaching and learning methodologies and the humans’ capacity for adaptation in knowledge acquisition, may result in elevating our ability to learn and further enhance our capacity to translate such learnings into tangible outcomes in the real world.

    Imagine a day with real-time macro level surgery procedures that are conducted by robotic machinery within complex tissues of the body, directed by real-time radiographic imaging that empowers visualization of the various layers of tissues of the body. In the simulated environment, the surgeon would be able to instantainiously move tissues in the simulation by segmentation of the tissue in the 30 FPS virtual environment before making a cut or pointing the laser in the real tissues.

    As the President & CEO of a medical animation firm and an interested researcher of technology’s impacts on society, I am optimistic about the bridge of the virtual and reality via the real-time rendering possibilities of the future. In my firm, Medical Animatics, LLC we specialize in 3D Animation, video, and interactive programming for health education, medical, life sciences, and sports performance enhancement. It’s my passion to keep an eye on the future with great consideration for real world application of such technologies. We render, we tackle lighting issues, we’ve seen the challenges of utilization of render farms with mental ray rendering, the processor absorbtion that occurs with realistic renditions of fluids and lighting, and … we seek to overcome such challenges. We will someday find our way to super computing capabilities so that we may make good on our goals of improving health care.

    Thank you for sharing your forward thinking….

    Harlon J. Wilson
    President & CEO
    Medical Animatics, LLC
    1630 N. Meridian Street
    Suite 330
    Indianapolis, IN 46202
    (877) 284-2811 (O)

  2. cardona507 said,

    April 6, 2008 at 10:06 am

    Thanks for the great comment Harlon. I didn’t write the above article, it was from . I checked out your website and it is interesting. Great work! Do you work with musicians or only science and education? I would love to get some animation like that for my band.

  3. Harlon said,

    July 23, 2008 at 4:23 pm

    So sorry for not noticing your reply to my posting. To answer your question on animation, – our focus is in health education, medical, life science, and sports performance enhancement. However, we also do like to add other creative projects in to keep it interesting. Feel free to send me your ideas regarding animation for your band.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: