Video Conferencing and Virtual Worlds

Altadyn – 3DXplorer boasts a new Facebook application to get into their virtual world. Further, they state that they are creating a new U.S. Embassy in their space. See them on the BBC.

One has to wonder about the uses of video conferencing versus virtual worlds. The eyeballing that is referred to is important – looking at someone in the eye stimulates a flight or fight response, that is inevitable. But, that must fire off neurons in the brain and release chemicals that make the body respond rapidly. So, no amount of camera and waist to head body shots is going to stimulate the need to get away, or to dig it. Video conferencing will consume lots of bandwidth for Cisco, and they’ll be able to sell lots of hardware to run that video. But, what I’m hoping to see here is something more profound. Is it possible to represent the body more significantly, and watch every reaction of the other avatar? It is possible to watch avatars as they move about in virtual worlds – they stand in front of certain exhibits, their bodies move about to tell you which direction they are facing. Their heads move and their lips move – much like in video conferencing, but they do so with respect to the environment they are in, not just a bland room in which people are sitting and moving. What I’m suggesting here is that we can all do much better than that. We can drive some new applications for interaction using a combination of virtual, 3D technology, which provide context, and video conferencing applications which supplies a certain amount of realism. We are going to have to get much more interesting and realistic, if we are going to take on communication wholeheartedly in the virtual space.

Tags: , , ,

One Response to “Video Conferencing and Virtual Worlds”

  1. Craig McAllister Says:

    I wrote the following several weeks ago, and after reading your comment, I could not resist posting it. I apologize for the length and the obvious self promotion, but I think it at least somewhat speaks to what you are talking about above:

    “Avatars and Realism”

    To many people, today’s avatars represent elaborate animations. Recently, however, much fanfare has been made about new technologies enabling animated avatars to mimic a wide range of users’ facial expressions. If you smile, your avatar smiles with you. If you frown, your avatar frowns. This development allegedly translates into greater realism. But is this realism “real” enough? If the objective is to make an avatar truly “real”, why not have it actually be real?

    Certainly there exists specific segments of the Virtual world population for whom
    animated avatars are preferred. These groups might include children under 10; teenaged gamers; and non-gaming adults in virtual worlds like Second life. In each of these examples, customization, fantasy, and/or anonymity take precedence over true realism.
    There are, however, a number of possible virtual world environments where users are likely to be interested in seeing avatars that are as realistic as possible. In fact, wouldn’t a live streaming video avatar of an actual person be a viable alternative to the currently available animations? This technology would allow for real time, face-to-face meetings in virtual worlds. People could actually see each other.
    One example of a real need for this technology is in the area of virtual world dating. As Violetta Krawczyk-Wasilewska and Andrew Ross said in their paper entitled “Matchmaking Through Avatars: Social Aspects of Online Dating”, “Once you have experienced the virtual delights of avatar dating in an online venue, taking that last fateful step and going for a real, physical, face-to-face meeting with your avatar date can only be a let-down.”
    Talk about a blind date! How could you even be certain of the gender of the animated avatar you were dating, let alone know what that person actually looks like in the real world?
    Another good example of the value of realistic avatars would be virtual world job interviews. Recently, at a state government job fair in Second life, an applicant “came to the job fair as a” tiny cat with a red bow tie on.” How can anyone really know for sure whom they are actually talking to? For all you know, you could be interviewing some kid’s Dad!
    How about social networking? Imagine virtually attending your 10th high school reunion, and being able to see your fellow classmates face-to-face (how did that cute girl/guy who used to sit next to you turn out?) Instead of experiencing an animated depiction fixing you with a facsimile smile, you could see your classmates actually laughing. The experience using a live streaming video avatar would be totally different, and potentially a lot more satisfying.

    Distance learning and virtual campuses are other areas with enormous potential. Teachers and students could see each others’ actual faces in the virtual world, thereby facilitating a much richer and personally interactive learning experience.
    Imagine playing online poker with a table full of animated avatars. There is no way to read your opponents’ “tells” that you would otherwise pick up in a face-to-face situation. Given that the human face is capable of making over 50,000 different individual expressions, real time avatars clearly provide the advantage in such a nuanced environment. Otherwise, everyone will have their avatars set to “poker face”. So much for nuance.

    Lastly, imagine engaging in sensitive and/or high stakes business negotiations with “a tiny cat wearing a red bow tie…” N’uff said.

    Ultimately, the list of situations where it would be preferable to have real time avatars is almost limitless. So the question becomes, when can we expect to see live video avatars? The answer is… now. A company called Integrated Virtual Networks (IVN) has been developing patented live video avatar software called Silhouette.

    With Silhouette, each user in a virtual world is able to see and be seen as a live streaming video avatar at real time frame rates, along with synchronized audio. Silhouette works with a single high-speed web camera to extract a user’s video image from the user’s actual environment, without the need for a monochromatic (e.g. blue or green screen) background. Silhouette could be used for all those virtual world situations where “real” actually needs to be real..

    You can see the direction IVN is going with its live video avatar software by looking at its rough in-house “proof of concept” video which was done completely in-world:

    As indicated in the beginning of this post, live video avatars will not be for everyone, but once the technology is fully developed, it could bring a needed dose of reality to virtual worlds.

    _ _ _
    The author Craig McAllister is affiliated with Integrated Virtual Networks (IVN) in Los Angeles, CA.

Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s

<span>%d</span> bloggers like this: