@ajroach42 You could definitely get a cheap Palm with a foldout keyboard for that purpose, but I'm not sure if that violates the "palmtop" constraint
I have a couple WinCE devices but I have yet to figure out how to install software on them using a modern PC. On Palm you can just unzip a .prc and throw it at pilot-link, but all the WinCE software I wanted to play with was packaged as Windows installers.