By Jennifer Ditchburn, The Canadian Press

OTTAWA - A disenchanted Tory adviser in Quebec is now in talks with the Bloc Quebecois about running for the separatist party.

The loss of Pierre Brien is yet another blow to declining Tory fortunes in the province, and a potential new weapon for the separatists in any coming election.

Brien sat as a Bloc Quebecois MP until 2003, when he left the party to run for the Action Democratique du Quebec (ADQ).

He was working on contract as an adviser to Public Works Minister Christian Paradis - Stephen Harper's Quebec lieutenant - until last month.

Brien confirmed Thursday that he is in preliminary talks with the Bloc.

"I quickly realized, and some people predicted it, that it wasn't my place politically," Brien said of the Tories, adding that he will always be a sovereigntist.

"I know very well what I am."

His departure is another sign, say Conservative insiders, of a malaise they just can't shake in the province. Many are concerned about holding on to the party's 10 seats in Quebec amid flagging polling numbers

"The situation in Quebec leaves much to be desired and is worse than last year," one senior Tory conceded.

Quebec Conservative MP Denis Lebel acknowledged the difficulty he's facing in his riding.

"Clearly, I know very well that things are fragile in my area ... I'm going to do everything to remain MP in this riding," he said.

Several Quebec Tories who spoke to The Canadian Press said many key Conservatives are frustrated over the handling of Quebec issues in the Prime Minister's Office.

A recording of Harper addressing a private Tory reception in Sault Ste. Marie, Ont., last week shows him slagging the Federal Court Challenges Program, a program his government cut and was then forced to partially restore in order to protect minority linguistic rights across the country.

Harper described those who used the program as "left-wing fringe groups."

Insiders say that in addition to having a tin ear to Quebec sensitivities, Harper's team has alienated powerful Tories connected to both Premier Jean Charest and former prime minister Brian Mulroney.

They argue Harper's advisers, such as longtime aide Dimitri Soudas, have put too much emphasis on ties with the ADQ, alienating the most useful organizers in the province. They also complain that advice is neither sought nor heeded from those outside the inner circle.

Soudas said the party is open to Conservatives of all stripes.

"At the end of the day, we're looking at building a true, genuine Conservative Party of Canada in Quebec, and people from all provincial affiliations, ADQ or provincial Liberals are part of that."

Philippe Gervais, a Montreal-area Conservative, is more optimistic than many of his party brethren. He said things seem to have improved over the summer as Paradis and fellow minister Josee Verner worked overtime to turn things around.

"We're starting to come out of the woods," he said. "Things were tough all through the spring, but through the summer we went from bleak prospects to things getting better.

"We're not there yet, at a point where we're making gains, but at least we're holding our own. That's a big turnaround."