Virtual training upgrade with facial scans

Army Times — Wed, 31 Dec 2014 09:34:36 -0500

From: Army Times

New technology, aimed at beefing up the Army's virtual training program, can capture vivid facial features down the pores of the skin.

Using a high-tech "Mobile Light Stage," licensed from the University of Southern California, Army researchers can use a battery of special LED lights and high speed cameras to capture the a person's facial features. Most recently, the setup produced a hyper realistic bust of President Obama, on display in December at the Smithsonian Castle.

The Army wants to harness the stage's capability for simulations in its Emergent Leader Immersive Training Environment (ELITE) program.

It could mean much more sophisticated interactions between virtual characters during training, said John Hart, program manager for USC's Army-funded Institute for Creative Technologies.

The accuracy of facial features of enemy combatants might not matter so much in a combat simulation; seeing the enemy's pores provides little useful information while shooting at him. But in a number of more personal situations, such as training officers and NCOs to deal with a variety of issues among subordinates, those nuances could make a big difference.

"A lot of it depends on what we're training," Hart said. "In a checkpoint scenario where you're interviewing someone, asking questions (it could be helpful). Face-to-face conversation. Subtle things, facial expression, body movements: that's when it becomes a little more important."

Initially started in 1999, the institute was intended to close a gap between the graphics of video games and what was available in Army-built simulations. More realistic scenarios were needed to improve the degree of engagement in the exercises, Hart said.

"Basically, it went over to PlayStation and X-Box and said 'why does that look like that,'" Hart said. "Can we begin to leverage what the entertainment and gaming industry is doing in the art of the narrative, and bring that together and create a more engaging military simulations that improve training? This research was born out of that."

The ITC is currently funded for a cap of about $235 million over a five-year contract. Over a given period, about half of the money directly funds the project, while other funds from various budgets of units interested in developing specific applications. Other private ventures can also fund and develop applications as well.

Applications where the intricate face-depicting technology could come into use, Hart said, include a variety of personnel and leadership training programs. Dealing with sensitive subjects such as sexual harassment offers a particularly topical opportunity given the Army's emphasis on the Sexual Harassment/Assault Response and Prevention program. Hart said the ITC has begun working on SHARP scenarios including counseling and interviewing victims and witnesses.

Hart acknowledged there's not a lot of empirical evidence indicating whether or not the improved graphics improve training effectiveness. But he said they do get the soldiers' attention.

"Right now there's not a direct link saying it increases training performance levels, but it does increase the engagement in the training, making it more appealing to the user," Hart said.

http://www.armytimes.com/story/military/tech/2014/12/30/army-virtual-training-obama/20482173/

Response by CPT Private RallyPoint Member made Dec 31 at 2014 9:56 AM

CPT Private RallyPoint Member — Wed, 31 Dec 2014 09:56:04 -0500

It's interesting seeing what we spend money on but this actually sounds like good training for leaders and Soldiers to pick up on nonverbal communication during KLEs and counseling sessions. I feel like this could be good training for cultural awareness as well to reduce the cultural clashes and increase our awareness of how a person is really feeling or their true intentions.

Response by SGT Brian Watkins made Dec 31 at 2014 8:13 PM

SGT Brian Watkins — Wed, 31 Dec 2014 20:13:36 -0500

This technology is used in the movie industry as well, a lot of actors are opting to save their digital twins for future use in movies I suppose. In terms of using it for more "realistic" virtual training in the Army? We already wasted how much on ACU's? Let's not get crazy here.