And he knows the opposing fans do not like Lewis Dunk.
Rutter is expected to play in first Seagulls v Eagles battle at the Amex today.
He is looking forward to challenge and has known about the rivalry since he first joined from Leeds in the summer.
Rutter said: “When I arrived, I asked what is the derby and they said it is Crystal Palace “They say it is an important game for the club, a good battle.
“I know they don’t like Lewis, the captain!
“It will be a good fight and we have to take this game very personally.
“Sometimes when the emotion is more, you have to be clever and we have to be convinced about our potential and our strengths.
“I think we will play a great game and we are ready for that.
“I love it. This is why we play football as well, when we have a great atmosphere in the stadium.
“And I think there will be a good atmosphere on Sunday.
“It’s a different atmosphere because it doesn’t matter how you win.
“If you win, it will be a great feeling for everybody.”
Rutter was praised for his defensive graft at times in the 2-2 draw at Leicester last Sunday.
He said: “I don’t have the choice!
“When the manager needs me here, I need to be here.
“Sometimes it is hard because it is not usual for me. Normally I am in the front.
“But I can play anywhere.
“If he asks me to play centre-back, I play centre-back.”
