Prime Minister Stephen Harper says he agrees with former prime minister Brian Mulroney that his government needs to make the environment a priority.

Harper responded to comments the former prime minister made during an interview with CBC Radio earlier this week.

"What he said was the Liberals have a dreadful record on the environment, and a Conservative government can do better, and more work needs to be done, and I agree with that," said Harper during a news conference in Ottawa Thursday.

Mulroney, who was given the title of greenest prime minister in history by an environmental magazine earlier this year, said the environment is key to capturing the middle-class vote.

Mulroney said Harper's much-criticized environmental plan — the Clean Air Act — needs more work and the party needs to claim the issue as their own.

Harper took that criticism in stride, saying his government is focusing on more than the Kyoto accord targets.

"They focus almost solely on greenhouse gases, and ignored smog entirely," said Harper. "Not a single one of the other parties has any proposal to control smog."

Harper downplayed rumours of an upcoming cabinet shuffle that could include replacing Environment Minister Rona Ambrose in order to revamp the party's environmental image.

The prime minister said his environmental agenda will take a while longer to implement, and that's why he wants to keep governing.

"I've got to say, I really like this job. I want to keep it a while. I want to get some things done," said Harper. "I have no reason to call an election. The public's not asking for an election, and I don't know what the reason for an election might be."

Bloc Québécois Leader Gilles Duceppe has threatened to table a no-confidence motion to bring down the government as early as February, while newly elected Liberal Leader Stéphane Dion says he's told party members to get ready for a spring campaign.