MS LB documentation seems to suggest to use PF when traffic needs to be directed to a specific host (i.e. VM), in backend pool.
The problem we are facing is with SSH through LB. Client is using Putty SW and wishes to utilise the 'Proxy' feature within Putty..
Meanwhile I am doing some more digging into this though I suspect it should work without the need to employ PF.