IF Site A has the FSW, then you are arent really doing a switchover if shutting down SiteB .
I would move any active databases to Site A drain the transport queues on the Site B server ( https://learn.microsoft.com/en-us/powershell/module/exchange/redirect-message?view=exchange-ps)
and then simply shut the servers in SiteB.
The quorum wont be affected if the the FSW and active node are in Site A.
Then when its back up, simply boot the Site B server and it should rejoin the cluster.