Hello @Rolf Nygård ,
I have checked with the AVD Product Team, and this is by design. Give/Take Control, like in Teams on the physical endpoint (outside AVD) will always be a joined experience between 2 participants. It is not meant for unattended control of a remote system.
Hope this clears your doubt.
----------------
Please accept as answer
or upvote
to increase the relevancy of this post on QnA forum.