According to Jesus, one should not make money from money, hence the disdain for money lenders. The same principle could be applied to tax collectors. Also, it isn't so much that Jesus disapproved of them, that the general populace disliked tax collectors. It was a hated job (like the IRS now) so ...