I'm on the spectrum as well, so I do understand where you're coming from (sort of - everyone's experience is different).

However.

Someone who is offended doesn't feel 'mistaken'. They don't give a shit about the history or why they shouldn't be offended or hurt because of it. Actually, in many cases, they KNOW the history and still feel offended, regardless and someone pointing out the history makes them feel that they are being condescended to.