Many employment insurance recipients have received unannounced visits from Service Canada employees during the random audits they are conducting on more than 1,200 people.
The move faced resistance from unemployed people who were unhappy with the prospect of a house call from a government employee.
A woman in New Brunswick said one of these 50 employees from the integrity branch of Service Canada turned up at her door.
Her MP Yvon Godin said the woman was nervous of repercussions if she spoke out.
"She's pretty nervous. She's been working in a fish plant for 30 years — she has never done anything wrong," Godin said.
He said there are a lot of people who don't think the workers have a right to enter their homes.
"Some people say they'd better not knock at my door. It's my private house — I don't want them in my house."
The new EI rules require seasonal workers to obtain jobs during their off-season, even if these jobs have lower wages and are out of town.
Forestry worker Izmael Goguen said the new restrictions are too much.
"I feel like it's harassing people. A lot of people are afraid right now just with all the changes that's going on," Goguen said. "It's just putting the panic around, that's all it is."
Steve McCuaig, with the Public Service Alliance of Canada, said there is now resistance from Service Canada employees who do not feel they should be going to homes until the rising tension dies down.
"Clearly, there's a lot of tension out there, and so people are upset with the reforms," McCuaig said.
"And for that reason, we're suggesting these door to door visits may be suspended until the tensions diminish a bit, if not a lot."
The federal government insists undetected fraud and ineligibility cost hundreds of millions of tax dollars last year, and that costs Canadians who follow the rules.