Yes to the cloves idea.

I had severe pain after a wisdom tooth extraction once and a friend took some cloves and put them into an emptied-out tea bag and had me hold that in my mouth. I’d never heard of it before, but it really worked.

These were the whole ones, like you’d poke into a ham, not the ground-up stuff.