I used to do it at the start, because i thought "wow, they respect me!!!". But after that i realized that there are some people i just totally agree with, and these people might not respect me. Unfortunetely... I learnt this lesson too late and sometimes i have to take people off for different reasons
I feel bad about that because i know that its a bummer when someone takes you off their list.