Hi,
>>I want to disable any remote access traffic except my whitelist
I am afraid this is not possible since the server could not tell which application is used when receiving remote session.
You could consider to restrict the applications installed on the client PC that only the mentioned RDP tools could be installed.
In general, rules could be configured in the firewall of target computer to restrict the remote connection from specific IP addresses.
Hope this clarifies and please help to accept as Answer if the response is useful.
Thanks,
Jenny