I installed the tor client and the tor button for firefox but all I get is a message about being configured to use a proxy server that is refusing connections.
TOR only speaks the SOCKS protocol, Firefox only speaks HTTP/HTTPS. You need to put another proxy inbetween, one that speaks both - Until some time ago, the most common for this (due to it being part of the official bundle) was Privoxy, now it seems like the've switched to Polipo. Point that one to the TOR port, then point FF to the Polipo/Privoxy port. If you absolutely can't get it to run, there's a "Tor Browser Bundle" available at the TOR download site with a preconfigured FF etc which you can use as a "secondary browser". Edit: Oh wait, I just checked, FF does indeed seem to support SOCKS. Make sure you haven't accidentally put it in HTTP proxy mode instead. Also, make sure TOR is actually running, obviously. Not sure if TORbutton can automagically fire it up in the background...
Easiest way I've found is this: Uninstall TOR. Uninstall TORButton in Firefox. Get the bundle for your OS HERE. Install and enjoy.
I installed TOR, then the firefox button. Opened up TOR, connected and then it just worked. On a Mac, there is text on the status bar of Firefox, bottom right that says TOR Enabled/Disabled just click it to switch it on and off. Was quite straight forward.