Will my Fiance be getting a IRS Tax refund?

My fiance and I have been together for almost 4 years, when we met he owed back taxes from 2002 and 2004. For the past 3 years he's been filing his tax returns and the IRS has been taking his refunds and applying it to his owed back tax amount. We would have finished paying off the remaining balance this year but around Sep. 2010 the IRS sent us a letter saying we had 10 days to reply to the letter or they would put a levy on his bank account, the letter also stated that they had doubled the owed amount due to penalties and interest. We set up a payment arrangement and we've been paying the IRS $100.00 a month for about 7 months. We went to file my fiance's 2010 tax return and also took the 2002 and 2004 tax returns to the tax professional and we filed all three....it turns out that my fiance didn't owe anything on the 2002 and only owed $582 on the 2004 tax return. For the 2010 tax return the tax professional told us that we'd be getting a refund of $2126.00. The IRS is now telling us they still applied the $2126.00 to the back taxes even though we filed all the returns to square all of this mess out. We've paid the IRS WAYYYYY more than the $582 my fiance ended up owing. So my question is...will we still get a refund after the IRS works out how much my fiance is getting back or should we just kiss that refund goodbye even though we filed all the necessary returns?