How racist is Japan really?

Japan has always been a country that came to mind when planning the next vacation, but always remembered the many racist anecdotes many had on Reddit and people I spoke to who went there, which just made me skip it.

From being denied entry to restaurants, rude servers, rent discrimination… just how bad is it there really?