AI-aided virtual conversations with WWII vets are latest feature at New Orleans museum

Peter Crean of the National WWII Museum in New Orleans stands at an interactive exhibit with an image of Japanese-American WWII veteran Lawson Ichiro Sakai, who served in the U.S. Army, Tuesday, March 19, 2024. Sakai and 17 other people, including World War II combat veterans, a military nurse, an aircraft factory worker and a USO performer, made extensive video-recordings about their lives and service as part of an interactive exhibit opening at the museum March 20. (AP Photo/Kevin McGill)
Peter Crean of the National WWII Museum in New Orleans stands at an interactive exhibit with an image of Japanese-American WWII veteran Lawson Ichiro Sakai, who served in the U.S. Army, Tuesday, March 19, 2024. Sakai and 17 other people, including World War II combat veterans, a military nurse, an aircraft factory worker and a USO performer, made extensive video-recordings about their lives and service as part of an interactive exhibit opening at the museum March 20. (AP Photo/Kevin McGill)

NEW ORLEANS -- An interactive exhibit opening Wednesday at the National WWII Museum will use artificial intelligence to let visitors hold virtual conversations with images of veterans, including a Medal of Honor winner who died in 2022.

Voices From the Front will also enable visitors to the New Orleans museum to ask questions of war-era home front heroes and supporters of the U.S. war effort -- including a military nurse who served in the Philippines, an aircraft factory worker, and Margaret Kerry, a dancer who performed at USO shows and, after the war, was a model for the Tinker Bell character in Disney productions.

Four years in the making, the project incorporates video-recorded interviews with 18 veterans of the war or the support effort -- each of them having sat for as many as a thousand questions about the war and their personal lives. Among the participants was Marine Corps veteran Hershel Woodrow "Woody" Wilson, a Medal of Honor Winner who fought at Iwo Jima, Japan. He died in June 2022 after recording his responses.

Visitors to the new exhibit will stand in front of a console and pick who they want to converse with. Then, a life-sized image of that person, sitting comfortably in a chair, will appear on a screen in front of them.

"Any of us can ask a question," said Peter Crean, a retired Army colonel and the museum's vice president of education. "It will recognize the elements of that question. And then using AI, it will match the elements of that question to the most appropriate of those thousand answers."

Aging veterans have long played a part in personalizing the experience of visiting the museum, which opened in 2000 as the National D-Day Museum. Veterans often volunteered at the museum, manning a table near the entrance where visitors could talk to them about the war. But that practice has diminished as the veterans age and die. The COVID-19 pandemic was especially hard on the WWII generation, Crean said.

"As that generation is beginning to fade into history, the opportunity for the American public to speak with a World War II veteran is going to become more and more limited," he said.

The technology isn't perfect. For example when Crean asked the image of veteran Bob Wolf whether he had a dog as a child, there followed an expansive answer about Wolf's childhood -- his favorite radio shows and breakfast cereal -- before he noted that he had pet turtles.

But, said Crean, the AI mechanism can learn as more questions are asked of it and rephrased. A brief lag time after the asking of the question will diminish, and the recorded answers will be more responsive to the questions, he said.

The Voices From the Front interactive station is being unveiled Wednesday as part of the opening of the museum's new Malcolm S. Forbes Rare and Iconic Artifacts Gallery, named for an infantry machine gunner who fought on the front lines in Europe. Malcom S. Forbes was a son of Bertie Charles Forbes, founder of Forbes magazine. Exhibits include his Bronze Star, Purple Heart and a blood-stained jacket he wore when wounded.

Some of the 18 war-era survivors who took part in the recordings were set to be on hand for Wednesday evening's opening.

photo World War II veteran Olin Pickens, of Nesbit, Miss., who served in the U.S. Army 805th Tank Destroyer Battalion, looks at the virtual exhibit of himself at the National World War II Museum in New Orleans, Wednesday, March 20, 2024. An interactive exhibit opening Wednesday at the museum will use artificial intelligence to let visitors hold virtual conversations with images of veterans, including a Medal of Honor winner who died in 2022. (AP Photo/Gerald Herbert)
photo World War II veteran Olin Pickens, of Nesbit, Miss., who served in the U.S. Army 805th Tank Destroyer Battalion, looks at the virtual exhibit of himself at the National World War II Museum in New Orleans, Wednesday, March 20, 2024. An interactive exhibit opening Wednesday at the museum will use artificial intelligence to let visitors hold virtual conversations with images of veterans, including a Medal of Honor winner who died in 2022. (AP Photo/Gerald Herbert)
photo World War II veteran Theodore Britton, Jr., 98, who served in the U.S. Marine 27th Depot Company in the British Solomon Islands and Hawaii, speaks in front of a virtual exhibit of himself at the National World War II Museum in New Orleans, Wednesday, March 20, 2024. An interactive exhibit opening Wednesday at the museum will use artificial intelligence to let visitors hold virtual conversations with images of veterans, including a Medal of Honor winner who died in 2022. (AP Photo/Gerald Herbert)
photo World War II veteran Theodore Britton, Jr., 98, who served in the U.S. Marine 27th Depot Company in the British Solomon Islands and Hawaii, holds his hand to his heart as he talks about his service at the National World War II Museum in New Orleans, Wednesday, March 20, 2024. An interactive exhibit opening Wednesday at the museum will use artificial intelligence to let visitors hold virtual conversations with images of veterans, including a Medal of Honor winner who died in 2022. (AP Photo/Gerald Herbert)
photo Theodore Britton, Jr., who served in the U.S. Marine 27th Marine Depot Company in the British Solomon Islands and Hawaii, talks with museum volunteer Jack Gross, center, at the National World War II Museum in New Orleans, Wednesday, March 20, 2024. An interactive exhibit opening Wednesday at the museum will use artificial intelligence to let visitors hold virtual conversations with images of veterans, including a Medal of Honor winner who died in 2022. (AP Photo/Gerald Herbert)
photo Larry Pickens, left, son of World War II veteran Olin Pickens, of Nesbit, Miss., who served in the U.S. Army 805th Tank Destroyer Battalion, talks with his father who is featured in a virtual exhibit at the National World War II Museum in New Orleans, Wednesday, March 20, 2024. An interactive exhibit opening Wednesday at the museum will use artificial intelligence to let visitors hold virtual conversations with images of veterans, including a Medal of Honor winner who died in 2022. (AP Photo/Gerald Herbert)
photo World War II veteran Theodore Britton, Jr., 98, who served in the U.S. Marine 27th Depot Company in the British Solomon Islands and Hawaii, looks a virtual exhibit of himself at the National World War II Museum in New Orleans, Wednesday, March 20, 2024. An interactive exhibit opening Wednesday at the museum will use artificial intelligence to let visitors hold virtual conversations with images of veterans, including a Medal of Honor winner who died in 2022. (AP Photo/Gerald Herbert)
photo World War II veteran Olin Pickens, of Nesbit, Miss., who served in the U.S. Army 805th Tank Destroyer Battalion, is greeted by museum staff at the National World War II Museum in New Orleans, Wednesday, March 20, 2024. An interactive exhibit opening Wednesday at the museum will use artificial intelligence to let visitors hold virtual conversations with images of veterans, including a Medal of Honor winner who died in 2022. (AP Photo/Gerald Herbert)
photo World War II veteran Olin Pickens, of Nesbit, Miss., who served in the U.S. Army 805th Tank Destroyer Battalion, looks at a photo of himself as a 120 lbs. prisoner of war, at the National World War II Museum in New Orleans, Wednesday, March 20, 2024. An interactive exhibit opening Wednesday at the museum will use artificial intelligence to let visitors hold virtual conversations with images of veterans, including a Medal of Honor winner who died in 2022. (AP Photo/Gerald Herbert)

Upcoming Events