Malcom, who didn't want his last name used, was the latest victim of a man posing as a plainclothes policeman. (CBC)

Toronto police have arrested a man they allege was defrauding elderly men by impersonating a police officer and taking off with their wallets.

Adrian McQuade, 62, of Kingston, Ont., was charged with 14 counts of robbery and 14 counts of impersonating a peace officer. He was scheduled to appear in court Thursday.

Police said a man was targeting victims in the Dundas Street East and Sherbourne Street area, and were all in their late 70s or 80s.

CBC News has learned this is not the first time he has been charged.

In 2003, he was sentenced to four years in a jail for impersonating a police officer, and theft.

Five years later he was again charged with impersonating a police officer and robbery, but was only convicted of robbery.

"He's very convincing. He convinced me," said Malcolm, the latest fraud victim, who didn't want his last name used.

"He followed me to my apartment, and he said, 'I have to talk to you, I'm a plainclothes policeman,'" Malcolm said.

After accusing him of selling cocaine, the man searched Malcolm's pockets, and looked through his wallet.

"I said, 'Can I see your identification?' He said, 'I told you, I'm a plainclothes policeman, I don't have any identification.' That's the point that I realized that he was a fraud," Malcolm said.

"In some cases he simply takes the wallet and flees the scene. In other cases, he'll take the money and leave the wallet behind," said Const. Tony Vella.

As for Malcolm, he feels pretty fortunate.

"I was terribly lucky that he didn't steal anything, and he didn't hit me," he said.