You have to use the advanced console to add rules to get RD on non standard ports. Note the MSTSC is the client (the C) and not the host. Open windows "firewall with advanced security", do to inbound ...
This is probably a stupid question, and I probably could have avoided having to ask it if I would have bothered to think things through before-hand but... well, it's a learning experience.