I had to resolve this issue by writing a custom AudioService for both iOS and Android:
I followed these articles:
//Implementing Audio service using depdency injection for both Android/IOS
https://visualstudiomagazine.com/articles/2018/03/29/xamarin-forms-audio.aspx
//Details on the sound play output mode in iOS
https://alexdunn.org/2017/07/27/xamarin-tip-playing-audio-through-the-earpiece-in-ios/
Essentially I had to allow the audio to be set to a specific mode in iOS to work, in addition to this; prior to each listening session I had to re-instantiate t he SpeechRecognizer object:
//Before each time you want to begin speech to text
var config = SpeechConfig.FromSubscription(...,...);
_speechRecognizer = new SpeechRecognizer(config);