A Winnipeg man charged in the death of his foster son has been released on bail.

The 22-year-old man has been charged with criminal negligence causing death after his 10-month-old foster child died in hospital on Tuesday.

The baby boy suffered head injuries before being rushed to hospital in critical condition, police said Thursday.

The name of the accused is not being released to protect the identity of the child, police said.

Outside court on Friday, lawyer Tony Kavanagh said his client is taking the child's death very hard.

"This is a tragedy no matter which way you look at it and he has to deal with that, and the criminal justice system will do what it does and we will reply to that," said Kavanagh.

Tony Kavanagh

Winnipeg lawyer Tony Kavanagh said his client is devastated by the death of his 10-month-old foster child. (CBC Gary Solilak)

"Obviously, he's devastated and this is a huge emotional wound for him."

The accused made his first court appearance by video conference call Friday morning. His wife and at least a dozen family members were in court to show their support. 

"He has rock-solid family support. It was quite inspirational to see this many family members come down to support him and his family," Kavanagh said.

"This is an out-of-character situation and there is so much more of this story still to come," he said.

Provincial court Judge Judith A. Elliott granted a publication ban in this case so few details can be revealed.

The man was released on bail Friday afternoon and will live with family members. He was ordered to pay $1,000 and given a number of conditions to abide by while out in the community. 

"He has no record. He should not be in a cage waiting for the police to do their work, which they should do thoroughly and properly in a case like this," his lawyer said.

The death has been extremely hard, particularly because the accused and his wife have a young child of their own, Kavanagh said.

"Obviously, one of the blanket restrictions in a charge like this, almost every time there's a bail is, you can't be with somebody under 16 alone. That will be for the various agencies to work out. And that is also going to be part of the investigation."

The 22-year-old's next court appearance will be in October.

"Per the Child and Family Services standard, the agency involved will immediately hold an internal review," Families Minister Scott Fielding said in a statement Thursday.

Manitoba's Office of the Children's Advocate will also be investigating the child's death.

With files from Kelly Malone