And he suggested that fans of the much-loved space opera were the toughest to keep happy.
Pegg, 52, was being interviewed on SiriusXM’s Jim and Sam radio show and was asked which franchise's fans were the hardest to please.
He replied: "To be honest - and as someone who kind of was, you know, kicked off about the prequels when they came out, the Star Wars fanbase really seems to be the most kind of toxic at the moment."
"I’m probably being very controversial to say that," he added.
Pegg admitted he had been involved in it himself as he was one of those who criticised the much-maligned character Jar Jar Binks (played by Ahmed Best) from the Star Wars prequels.
He said he had since said sorry for the comments he made.
"Because, of course, there was a f****** actor involved," he said.
"He was getting a lot of flack and it wasn't you know, a camp rabbit, it was a human being. And because it got a lot of hate, he suffered, you know, and I feel terrible about being part of that."
The actor said he thought fans of Star Trek, in which he played Montgomery "Scotty" Scott, were more inclusive and that the franchise embraced diversity.
It was "woke from the beginning", he said.
Pegg went on to say that with Star Wars "suddenly there’s a little bit more diversity and everyone’s kicking off about it".
"And it’s, it’s really sad," he said.
In recent years some Star Wars actors have revealed they have been targeted by fans of the franchise who disagreed with their casting.
John Boyega has said he experienced racism from fans when he was bagged the part of Finn in the sequels.
And Kelly Marie Tran, who played Rose in the sequels, also faced racist abuse from trolls.
Watch: Simon Pegg quit Twitter when it began to feel like 'a war zone'