Pennies are cash, so the line off a bill that reads "this note is legal tender for all debts, public and private" still applies. As such, if they refuse it, you are released from the debt.
Yes you can pay your taxes in them, but if you have a couple thousand in loose pennies, they'll make...