I've been wanting to build something similar, but can't shake the feeling I'd just stick with the SSH client on my phone.

Any reason really to have a separate device for this?