Azure AD Connect lockdown Sharepoint access impact on Teams

Question

I am locking down access to Sharepoint Online through O365.

I can change the SharePoint service so that unmanaged devices are not able to download and print via the web. Setting the "allow limited web-only access" creates a policy in Azure Ad Connect and I can add additional tweeks for some groups.

I want to create an Azure Conditional access policy to block access to SharePoint but in the process, I seem to block all access to MS Teams app from unmanaged devices.

I've tried all I can think of to unblock just the Teams app.

I know Teams and Sharepoint are linked but I just need the Instant messaging part of Teams to work on unmanaged devices.

Can anyone suggest how do I progress this? Do I need to enroll the personal mobile devices before I start the lockdown or is there another way?

Thanks for any advice