The comedian, 37, appeared on The Tonight Show Starring Jimmy Fallon on Thursday, November 3, and told host Jimmy Fallon, 48, that he’s “not doing well.”

“This show is bad luck,” he said. “Every time I come on this show, Jimmy, I’m embroiled in some controversy.”

“Last time I was on the show, I did a couple jokes, and I pissed off doctors of osteopathic medicine. A niche group of physicians,” he explained, joking. “They were hate-tweeting the show from their Teslas.”

Minhaj went on to explain that after appearing on the game show last week, Jeopardy! fans now “hate my guts.”

“I have this unique power to piss off dedicated nerds,” he laughed.

The Daily Show comedian went up against Wil Wheaton from Star Trek: The Next Generation and Pretty Little Liars alum Troian Bellisario to raise money for the “victims of the flood in Pakistan,” he told Fallon.

In August, United Nations Secretary-General António Guterres tweeted that the Pakistani people “are facing a monsoon on steroids” following devastating floods that have plagued the country since June. He noted at the time that “more than 1,000 people have been killed—with millions more lives shattered.”

While describing his antics on set, Minhaj said: “I’m passionate,” admitting, however, that “the fans weren’t having it.”

Fallon proceeded to read off several tweets from angry fans.

“Just turned off Celebrity Jeopardy! I have never seen a more grating human being in my life @hasanminhaj Holy Christ!!!” one person wrote, while another added, “Why is @hasanminhaj acting like an absolute a**hat on Jeopardy!?”

A third, meanwhile, chimed in: “Watching Celebrity Jeopardy! and I don’t think Hasan Minhaj is physically capable of just answering a question like a normal person.”

In the clip from the long-running series replayed on the late night talk show, Minhaj could be seen literally jumping for joy, saying things like: “And I guessed that!” when he answered a question correctly.

Ultimately, Wheaton won the episode, with Minhaj coming in third place.

On Monday’s episode of the Inside Jeopardy! podcast, former Jeopardy! winner Buzzy Cohen and executive producer Mike Davies reacted to the actor’s debut.

“These celebrity shows are getting better and better,” Cohen said. “Coming into this, I thought it was Wil Wheaton’s game by a mile. I think Hasan knew a lot of stuff, but next time, maybe we will see a more composed Hasan.”

He added: “I hope he comes back.”

Davies then hinted Minhaj could make a second appearance. “Celebrity Jeopardy! is doing so well in prime-time,” he said. “I think we’ll be back for years to come, we may repeat some people.”

The Tonight Show Starring Jimmy Fallon airs weekdays on NBC at 11:35 p.m. ET.