Does the HOA fee count against how much I can borrow?

Yes. Lenders include the HOA payment in your debt-to-income ratio, and for a condo they underwrite the building too. Two units can cost the same on paper and qualify you for very different loan amounts once the fees are counted. That is why I run the true monthly cost with every first-time buyer, not just the purchase price.