Sydney: A key Australian government figure Wednesday confirmed pre-election unrest within the Labour Party over Prime Minister Julia Gillard’s leadership, but said there was no ballot likely against her yet.

Speculation intensified that Gillard could be toppled by her party after a report said former prime minister Kevin Rudd was only five votes away from victory.

The Australian Financial Review said Gillard, the nation’s first woman leader, was lagging so badly in opinion polls that even her more strident supporters doubted she could win the 14 September national election.

It said three senior sources had confirmed momentum was moving towards Rudd, who was suddenly ousted in a party room coup in mid-2010, less than three years after he swept Labour to power over the conservatives.

The paper said one supporter, asked whether Gillard could maintain her position, replied: “It’s hard to see."

But chief government whip Joel Fitzgibbon insisted that while Labour politicians were worried about their future there was no canvassing of support for Rudd.

“It would be silly to tell people watching your programme that there is nothing going on," Fitzgibbon told Fairfax Media.

“Obviously, internally people are looking at the polls and they are expressing concern about the future of the government and indeed the party and you’ll get conversations and those conversations are, unfortunately, making their way into the media."

But he dismissed reports that vote-counting was going on.

“People are just speculating," he said.

“We’re six months out from an election, obviously we’re struggling in the opinion polls. It’s causing unrest in the party room, particularly amongst MPs that are on relatively narrow margins, about their future in this place."

Gillard has been dogged by speculation about her leadership for weeks, with the latest rumours fed by a government decision to try and introduce media reforms which the industry has united to fiercely oppose.

Former Labor leader Simon Crean admitted Tuesday that the handling of the media legislation — which includes stronger self-regulation requirements for the print media — could have been done better.

“I hope it is another lesson to all of us about the right way to do things," he said.

Some ministers, including foreign minister Bob Carr, have stressed their loyalty to Gillard, but reports said Rudd’s camp was actively canvassing for support and any leadership vote between the two would be tight.

Gillard became prime minister in mid 2010 when she ousted Rudd, who at the time had lost the support of powerful factional leaders.

She called an election which she failed to win outright from the surprised public, gaining power only after cobbling together a coalition with a Greens MP and several rural independents to form a majority in the lower house.

Rudd challenged Gillard in February 2012 and lost 71-31 while the prime minister has vowed she will not readily vacate her position.