Lord Ouseley is standing down as the chairman of Kick It Out.
The 73-year-old former chair of the Commission for Racial Equality founded the anti-discrimination charity in August 1993.
The charity confirmed his intention to quit, with a media release expected to be distributed later on Tuesday.
Speaking in August on the 25th anniversary of the organisation’s founding, Ouseley admitted removing discrimination from football is a task which would never be completed.
He also admitted he was preparing to retire.
He told Press Association Sport in August: “There does come a time and I think that time will come certainly within the next 12 months.
“(But) I’ve been here before when I’ve said to people I’ll probably be gone in six months’ time and I’m still here.”
This time it appears Ouseley will quit, just a few days after the latest incident which required comment from his organisation, when Raheem Sterling was abused during his Manchester City side’s Premier League match at Chelsea last Saturday.