You're right.

Though there might be an use case where those 'weirder' emails get accepted. Correct, for your average "sign up here" website, no.

But for example, where the receiving side is an automated mailbox, you might want to be more careful accepting 'weird' emails