Thanks so much for the replies guys.
I thought I'd post this beautiful and very apt song on this very subject:
http://www.youtube.com/watch?v=XHrRxQVUFN4
I love all the replies and feel quite tearful over this issue. I will continue to feed them especially in the winter, I'll just be a bit more careful about how often etc.