U.S. Sgt. Bowe Bergdahl's hometown abruptly cancelled plans Wednesday for a welcome-home celebration, citing security concerns over the prospect of big crowds both for and against the soldier.

Officials in Hailey, Idaho — a town of about 8,000 — said they have been swamped with hate mail and angry calls over Bergdahl, whose release after five years of Taliban captivity in Afghanistan has touched off a debate over whether the 28-year-old should get a hero's welcome or be punished as a deserter.

Meanwhile, the Taliban released a 17-minute video of his handover showing a thin, tense-looking Bergdahl being patted down for explosives by U.S. forces before climbing aboard an American helicopter in the dusty Afghanistan desert.

Just before he was turned over, one of his Taliban captors leaned in and warned him: "Don't come back to Afghanistan. You won't make it out alive next time." His captors waved goodbye as he was led away.

In Hailey, organizers of a celebration that had been scheduled for June 28 issued a statement saying the town doesn't have the means to handle such an event, given the prospect of big crowds on both sides of the debate.

"If you had 10,000 people, 5,000 on one side and 5,000 on the other, then just due to the national attention, we don't know what to expect," Police Chief Jeff Gunter said.

The town has had an event called "Bring Bowe Back" for several years. When news broke over the weekend of Bergdahl's release in exchange for five Taliban detainees at Guantanamo Bay, organizers had announced this year’s event would be a welcome-home party instead.

Hailey Chamber of Commerce President Jane Drussel said she and the organization have gotten hate mail and calls from people lambasting the town and branding Bergdahl un-American and a traitor.

"The joy has all of a sudden become not so joyful," she said.

Washington worried about Taliban resurgence

Bergdahl was captured by the Taliban after walking away from his unit, unarmed, in 2009.

U.S. lawmakers and others have also complained that Congress should have been consulted about the prisoner exchange, that the deal will embolden the Taliban to snatch more American soldiers, and that the released Afghans will filter back to the battlefield.

In Washington, Rob Williams, the U.S. national intelligence officer for South Asia, told the Senate intelligence committee Tuesday that four of the men are expected to resume activities with the Taliban, according to two senior congressional officials who spoke on condition of anonymity because the session was classified.

The five include the former Taliban interior minister, who was described in a U.S. case file leaked by WikiLeaks as having had close ties to Osama bin Laden; the Taliban's former deputy chief of intelligence; and a former member of a joint Taliban-al-Qaeda cell.

The video of Bergdahl after five years in captivity shows a well-choreographed release, with the American sitting in a silver pickup truck while more than a dozen Taliban fighters with machine-guns and faces largely covered by scarves stand guard nearby and on a rocky hill overlooking the site.

Video shows Bergdahl’s release

Wearing traditional loose-fitting Afghan trousers and a long tunic, Bergdahl, his head shaved, blinks frequently and looks tense as he peers out of the truck. At one point, he wipes his eye as if to get rid of some dust.

Afghanistan Taliban Talks

To those who knew him in Idaho, Bergdahl appeared 'damaged' in the video released by the Taliban. (The Associated Press)

A Black Hawk helicopter lands, kicking up a cloud of dust. Two Taliban fighters, one carrying a white flag tied to a long, crooked stick, lead Bergdahl, now carrying a plastic bag, halfway toward the chopper.

Three apparent members of U.S. special operations forces approach the group, shake hands with the two Taliban fighters and take Bergdahl toward the helicopter.

One of the three men pats down Bergdahl, while another takes the plastic bag from him and drops it on the ground. Then they all climb into the helicopter.

According to a voiceover on the video, the handover took place around 4 p.m. Saturday in rugged Khost province, near the Pakistani border.

Bergdahl appears ‘damaged’: family friend

Back in the U.S., Sue Martin, a friend of the Bergdahl family and owner of Zaney's Coffee Shop in Hailey, said Bergdahl's appearance in the video shocked her. She said he looked frail, tired and damaged.

"That's not the Bowe who left here and lived here," Martin said.

Bergdahl was reported to be in stable condition at a military hospital in Germany.

A Taliban statement, also distributed to the media, quoted leader Mullah Mohammad Omar as saying the release of the five Taliban was a significant achievement for the movement.

President Barack Obama has defended the swap, citing a "sacred" obligation to not leave men and women in uniform behind.

But some of Bergdahl's former comrades have complained that U.S. soldiers died during the search for him after he walked away. The military has not confirmed such a link.

U.S. Defence Secretary Chuck Hagel said Wednesday that the Army will review the case, and he cautioned against drawing conclusions until then.

"We don't do that in the United States. We rely on facts," he said at a NATO defence ministers meeting in Brussels.