You can disable animations when switching between spaces. I use skhd for this to map the hotkeys to the Yabai command to switch spaces. Pressing f13 goes to the previous space immediately and f14 to the next space.
I've tried this and much more but there's still noticable delay compared to Linux' twms and it's not only about workspace switching. There's this huge thread on stackoverflow[1] which is a great illustration of what a mess macos display server is.
1. Install Yabai
2. install skhd
3. disable SIP (ugh): https://github.com/koekeishiya/yabai/wiki/Disabling-System-I...
4. add `f13 : yabai -m space --focus prev` and `f14 : yabai -m space --focus next` to your `~/.skhdrc` file.