Okay this took some brain storming but we came to the solution. It's not perfect but it is going to work.
- We set each "agent" as a restricted chat user following the education model.
- Set each Site as a team
- Created a standard channel with the name of each agent at the site.
Now if I need others from other sites to talk to members at this site I just add that member to the site team and do not create a channel. Not exactly like BroSix but I think it's better as all communication is in the open and should improve productivity while "feeling like BroSix".