Anti-racism campaigner and Kick It Out chairman Lord Ouseley has called on the Football Association to take a stance on the "vile'' and "abusive'' chants by England fans aimed at Rio and Anton Ferdinand.
England have been reported to FIFA by Football Against Racism in Europe (FARE) over alleged racist chanting during the game with San Marino and the world governing body confirmed it was looking at the allegations.
A number of England supporters joined in the singing of a song suggesting the brothers should be burned on a bonfire - it has been suggested the song had racist overtones because Anton Ferdinand was the target of racist abuse from former England captain John Terry.
Ouseley told BBC Radio 5 Live: "Whether it's racist or not, it's certainly unacceptable. It's vile and it shouldn't be part of sport. Something needs to be done about it.
"These are the supporters of the England national team who are travelling abroad and singing songs like that. What messages does it send out about the type of people we are and who we represent?
"The Football Association should be taking a stance on this about the people it wants supporting the England team, the image it wants to send abroad.
"I've already contacted the chairman of the Football Association and said this has to be looked at, investigated and dealt with. Do you want to be having an army of fans who call themselves the England fans travelling abroad, being abusive to their own players like that, or indeed other people?
"FIFA will determine (whether it is racist) but clearly we can take a stance on that. We have policies on anti-racism, homophobia and all other forms of unacceptable behaviour. Why are we so quiet about it?''
Information from the Press Association was used in this report