I would expect many would be open to some of these arguments but for one major issue: white liberals!
See here
NIMBYs are powerful, and outside of SF, they run cities, and isn't just limited to blocking anti racist items, but more banal things which might, maybe, tangentially affect their property values.