The two have been in informal discussions about a long-awaited showdown but Khan cast doubt on the fight taking place in 2019 when he told The Independent that he is in talks with WBO champion Terence Crawford.
Brook, who fights Michael Zerafa on Saturday in his second comeback bout since suffering two devastating defeats, believes he has done everything he can to make the fight possible.
“What can I say? I think he’s turned his back completely on the British public, because I’ve bent over backwards just to make it happen,” he told Sky Sports News.
“I thought when he joined Matchroom, it was a dead cert that it would happen. He actually looked me dead in the eye at Tony Bellew’s last fight and said ‘we’re going to make the fight’ and now he’s not doing it.
“What can I say? I’ve done everything I can, don’t blame me, It’s him.”
Brook will have John Fewkes, his new trainer, in his corner for the first time following his split with Dom Ingle ahead of Saturday’s return to Sheffield. Fewkes and Brook has been together in Fuerteventura where the relationship and preparation has been ‘perfect’.
“I’m feeling brand new and I can’t wait to get in there,” Brook said. “I am going to take it all in, because it could be the last time [in Sheffield] for a while, so I am going to get the energy of the fans and enjoy myself.
“I’ve done all the hard work now. The talk is nearly over, I am just going to enjoy myself and do what I’ve got to do.
“We’ve ticked all the boxes, I’ve got no excuses. I’m in great shape, body and mind, and I am chomping at the bit to go now.”
Zerafa represents a better test for Brook after he comfortably beat Siahei Rabchanka in March to gain his first win since losing against Gennady Golovkin and Errol Spence Jr, the only defeats in his career.
Khan, who is remains open to fighting Brook despite considering offers elsewhere, wants any potential fight to be at Wembley Stadium. “We’re looking at the Brook fight and it’s a big fight as well, probably one of the biggest in my career,” he said.
“We’re looking at Wembley Stadium, maybe Manchester or Birmingham, but I think Wembley would be the ideal location for me. Watching Anthony Joshua fight there…having 90,000 people would be awesome.”