I have used liquid grapefruit seed extract on a tooth that was hurting and had good results. I had to keep reapplying it though, and remember to rinse well after applying as it's very acidic I hear.

Sucking on a clove will help with pain too.