Pepe has been a dogwhistle/symbol of hate for years already. Richard Spencer’s comical punch in 2017 happened just moments after he was explaining why he wears a Pepe pin. The ADL has it officially registered as a hate symbol.
Maybe it has died down in recent years, but you not being aware of these - frankly, very clear cut - definitions doesn’t make it ridiculous or inappropriate. Nazis take over symbols, that has been their modus operandi since their inception. None of this is new.
I’d recommend some googling about the subject.
I’m not “willing” to do anything, it is a fact. You may as well argue about the origins of the Swastika or the Iron Cross. Pepe is a hate symbol, and while not everyone using it might be a nazi, they are using nazi imagery. The fact that “many people” aren’t willing to drop it, despite its extensive, well documented use by extremists is a well made point, but not the one you think.
And there’s no “overestimating” of nazis in the world. We live in a culture of white supremacy. There’s no point in splitting hairs about how offensive or not a cartoon frog is. The easiest solution is to simply not use it.