The one that gets me is that we have basically three variants of dash/hyphens. And double quotes have to do the duty of about four different use cases.
And the fact that there are two types of double quotation marks (“opening and closing”), but those are squashed into a third " symbol on the keyboard—blame the typewrite for that one.
