Skip to main content

More on Project Natal

Project Natal was the most interesting thing I saw in Microsoft's conference and perhaps the best in E3. Sure I like the games, and MS E3 conference pretty much sold me on practically every game they showed. But games are games but Natal is something completely different which can essentially change the way motion systems work for games. My interest in Natal is not based purely on gaming. I can see real world applications for this kind of technology.

My husband and I stumbled across some articles that may explain what Natal really is:

Below is a link for Johnny Lee's blog

And no he is not a fanboy but an academe with 10 years of experience in his said field. Johnny Lee first came under the gaming radar with this amazing video that you definitely have to watch! And check out his other WiiMote projects as well with this link:

Imagine that interesting application for the Wii Mote. Too bad Nintendo never bothered to add a lot more depth with their existing technology. But may be Nintendo's loss is Microsoft's gain for now Mr. Lee is part of the Project Natal team. Here is what he has to say about project Natal:

The 3D sensor itself is a pretty incredible piece of equipment providing detailed 3D information about the environment similar to very expensive laser range finding systems but at a tiny fraction of the cost. Depth cameras provide you with a point cloud of the surface of objects that is fairly insensitive to various lighting conditions allowing you to do things that are simply impossible with a normal camera.

But once you have the 3D information, you then have to interpret that cloud of points as "people". This is where the researcher jaws stay dropped. The human tracking algorithms that the teams have developed are well ahead of the state of the art in computer vision in this domain. The sophistication and performance of the algorithms rival or exceed anything that I've seen in academic research, never mind a consumer product. At times, working on this project has felt like a miniature “Manhattan project” with developers and researchers from around the world to coming together to make this happen.

If you're a skeptic then try out Mr. Lee's Wii Mote projects yourself to get a better grasp of what 3D mapping actually is. His projects will run on a Windows PC but you will need bluetooth in order to connect your WiiMote to your PC. Knowing that Mr. Lee is on board makes me excited in the hopes that Natal will transcend the XBOX 360 and actually go to the PC.

And here is another interview during one of the E3 Project Natal demos:

One interesting thing that came up in the demo is that when a woman stepped up to use it, the system recognized she was female and represented her on-screen as a female avatar with long hair. Tsunoda said that ideally, Natal will recognize users and be able to grab their existing Xbox avatars, but that in such a demo environment, it simply represented her the best way it could, given what it could see of her skeletal structure.

Another interesting point was the way Natal recognizes people's skeletal structure and analyzes how we move. Tsunoda made the point that Natal will continue to work even if someone walks in front of a player because it knows how the human body works. So, if a player had his or her arms blocked, but Natal's cameras could still see part of their arm, it can fill in the rest based on algorithms that tell it how that arm should look.

And it's the software, Tsunoda said, that's the "magic" behind Natal, and that allows the technology to "extract the human skeleton."

Natal is designed to work whether someone is standing up or sitting down, and can recognize users very quickly. We saw that in action when, one-by-one, we were invited to step up and play either a kickball game or a driving game. With a couple of exceptions where the player didn't stand in the right place, Natal did seem to almost instantly recognize that a new person was playing and, then, respond to their movements.

This may have been most impressive during game play of the racing game, "Burnout Paradise," when it was clear that Natal was doing a fine job of translating the player's hand movements--mimicking holding and turning a steering wheel--into moving the car on-screen.

Tsunoda said the technology behind Natal includes an RGB camera, an infrared camera, a multi-array microphone and a depth map. These features allow the system to track a player in 3D space, as well as to capture spoken commands from multiple people, none of whom have to wear a headset.

So far those are the only things known about Natal that is available to the public. But based on the impressions of people who actually tried this out, Natal is definitely REAL and the promise is there.

Popular posts from this blog

Gamers based in the Philippines: How to get in Xbox Live

NOTE: This article has recently been updated (as of August 12, 2006). Singapore no longer lets you input '00000' as your zip code. Please see below for alternate zip codes.

So you're a Filipino living in the Philippines with a brand-spanking new Xbox 360. You've heard about all the wonderful stories on Xbox Live. You happen to have a pretty good broadband connection. One day, you try out the Xbox Live sign-up options on your 360, and you find out to your dismay that your country is NOT listed. What do you do?

Now, you can probably enjoy your 360 without live at all, but I have to tell you: YOU ARE MISSING OUT. As Peter Moore said in the recent MS Press Conference: "Having your 360 connected to Xbox Live is as vital as having your computer connected to the Internet".

He is so damned right.

I've been playing on Xbox Live for almost a year now (both on my original Xbox and the Xbox 360). Essentially I found out all of this with a little bit of research, a little…

Xbox One - System / Games general review

We picked up a [kinect-less] Xbox One a few weeks ago and have been putting it through its paces. Overall, right now I feel pretty good about this console. But I have to admit, the first experience of buying it is not very good. I'll go with the BAD news first. But do note that it isn't all bad news....

- The first time you bring it home, the console can't work without Internet. That's because it needs an absolutely-unoverrideable mandatory update. Basically, if you get this for your birthday and it's 7PM, expect to actually play games on it around a day or so later, depending on your internet speed.

- The first patch I got for it was around 800MB. This number might have changed by the time of this writing.

- All the launch games now have accumulated patches/updates over 16+ GB in size. Not just Dead Rising 3, which has been reported widely in the media. Even Forza 5.

- My internet at home is PLDT 3Mbps; managed to get all the updates pretty quickly....that's a…

E3 2015 Conferences from the Big Three - My thoughts


- They get a lot of points from me for actually announcing games that will be out in 2015.
- The Backwards Compatibility update is a huge surprise that I absolutely did not expect. Having BC is difficult and expensive to do, but somehow MS managed to do it, which leads me to believe the solution they found is an inexpensive one if they've decided it's practical to do QA work for the Xbox 360s gigantic library of games and make them all work on the Xbox One. If it was too complicated or expensive they probably wouldn't have bothered. But since they did, I think we're going to see full BC some time soon for all games. It's only a matter of time.
- Halo 5 looked fantastic, but 343 has a lot of work to do to restore faith, after the horrific launch of the Halo Master Chief Collection. I think they can do it, and I'd imagine they're certainly motivated now. If they screw this one up....MS might reconsider forming a new team to handle the Halo franchis…