The Canada Revenue Agency has given up on any further action against abortion protester David Little.

'You can only beat a dead horse so long.'— Federal prosecutor Keith Ward

Little, who has spent the last few years moving back and forth between P.E.I. and New Brunswick, has refused to file tax returns since 2000 in protest of government-funded abortions. He was due in court in Fredericton this week to face a charge of refusing a court order to file them.

Little was found guilty in 2007 on three counts of failing to file, and eventually was sentenced to 66 days in jail for refusing to pay the $3,000 fine. He believes it's his religious right to refuse to pay taxes because he doesn't want his money funding abortions.

Federal prosecutor Keith Ward said there are no plans for future charges against Little.

"You can only beat a dead horse so long, and then the whip starts to fray," Ward told CBC News Monday.

David Little, shown here in 2008, believes he has the right to not pay taxes. (CBC)

Little's original convictions have already been rejected for appeal by the Supreme Court of Canada. Ward said Little has made it clear he'd rather rot in jail than pay any money to the federal government.

"Not only are the taxpayers of Canada insulted once by having to pay all this money to go all the way to the Supreme Court of Canada on what is a lark of Mr. Little's, but now they're going to be faced with it again," said Ward.

Investigations also show Little doesn't have the money to pay the fines, and so would likely not even be required to pay taxes if he did file a return.

"If you've got no assets and no bank account you're going to have some difficulty collecting on it," said Ward.

Given that Little is 65, Ward said it is unlikely those circumstances will change. He said Little has been living off the charity of others, and all indications are this will continue.

Little could not be reached for comment.