Exchange 2016 hard boot - can't acess OWA now

Michael Shavel 21 Reputation points
2021-09-08T15:45:47.257+00:00

Hi,
Exchange 2016 CU20 on server 2012.

I rebooted it and the server hung on the array bios. It was then hard booted, not by me but Rackspace, our server company.
When it came back up, Exchange was working fine, except for OWA. When any user tries to log into OWA, they get "something went wrong...". That's it, no other error message.
Any help would be much appreciated.

Repeated errors in Event log below:

+
System

-
Provider

[ Name]
ASP.NET 4.0.30319.0

-
EventID
1310

[ Qualifiers]
32768

Level
3

Task
3

Keywords
0x80000000000000

-
TimeCreated

[ SystemTime]
2021-09-08T15:35:19.000000000Z

EventRecordID
20940922

Channel
Application

Computer
Ex2016-1.coachrealtors.lcl

Security

-
EventData

3008

A configuration error has occurred.

9/8/2021 11:35:19 AM

9/8/2021 3:35:19 PM

9b3b3c066e684cf8bc8fa7471639640c

1

1

0

/LM/W3SVC/2/ROOT/owa-181-132755889172773585

Full

/owa

C:\Program Files\Microsoft\Exchange Server\V15\ClientAccess\owa\

EX2016-1

29420

w3wp.exe

NT AUTHORITY\SYSTEM

ConfigurationErrorsException

Could not load file or assembly 'Microsoft.AspNet.SignalR.Core, Version=2.2.1.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies. An API call exited abnormally. (Exception from HRESULT: 0x800300FA (STG_E_ABNORMALAPIEXIT)) at System.Web.Configuration.CompilationSection.LoadAssemblyHelper(String assemblyName, Boolean starDirective) at System.Web.Configuration.CompilationSection.LoadAllAssembliesFromAppDomainBinDirectory() at System.Web.Configuration.CompilationSection.LoadAssembly(AssemblyInfo ai) at System.Web.Compilation.BuildManager.GetReferencedAssemblies(CompilationSection compConfig) at System.Web.Compilation.BuildManager.GetPreStartInitMethodsFromReferencedAssemblies() at System.Web.Compilation.BuildManager.CallPreStartInitMethods(String preStartInitListPath, Boolean& isRefAssemblyLoaded) at System.Web.Compilation.BuildManager.ExecutePreAppStart() at System.Web.Hosting.HostingEnvironment.Initialize(ApplicationManager appManager, IApplicationHost appHost, IConfigMapPathFactory configMapPathFactory, HostingEnvironmentParameters hostingParameters, PolicyLevel policyLevel, Exception appDomainCreationException) Could not load file or assembly 'Microsoft.AspNet.SignalR.Core, Version=2.2.1.0, Culture=neutral, PublicKeyToken=31bf3856ad364e35' or one of its dependencies. An API call exited abnormally. (Exception from HRESULT: 0x800300FA (STG_E_ABNORMALAPIEXIT)) at System.Reflection.RuntimeAssembly._nLoad(AssemblyName fileName, String codeBase, Evidence assemblySecurity, RuntimeAssembly locationHint, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks) at System.Reflection.RuntimeAssembly.InternalLoadAssemblyName(AssemblyName assemblyRef, Evidence assemblySecurity, RuntimeAssembly reqAssembly, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean throwOnFileNotFound, Boolean forIntrospection, Boolean suppressSecurityChecks) at System.Reflection.RuntimeAssembly.InternalLoad(String assemblyString, Evidence assemblySecurity, StackCrawlMark& stackMark, IntPtr pPrivHostBinder, Boolean forIntrospection) at System.Reflection.RuntimeAssembly.InternalLoad(String assemblyString, Evidence assemblySecurity, StackCrawlMark& stackMark, Boolean forIntrospection) at System.Reflection.Assembly.Load(String assemblyString) at System.Web.Configuration.CompilationSection.LoadAssemblyHelper(String assemblyName, Boolean starDirective) Could not load file or assembly 'Microsoft.AspNet.SignalR.Core' or one of its dependencies. An API call exited abnormally. (Exception from HRESULT: 0x800300FA (STG_E_ABNORMALAPIEXIT))

https://ex2016-1.coachrealtors.lcl:444/owa/manifests/appCacheManifestHandler.ashx?owamanifest=1

/owa/manifests/appCacheManifestHandler.ashx

fe80::ada0:e5b7:1ecf:c499%19

False

NT AUTHORITY\SYSTEM

258

NT AUTHORITY\SYSTEM

False

at System.Web.Configuration.CompilationSection.LoadAssemblyHelper(String assemblyName, Boolean starDirective) at System.Web.Configuration.CompilationSection.LoadAllAssembliesFromAppDomainBinDirectory() at System.Web.Configuration.CompilationSection.LoadAssembly(AssemblyInfo ai) at System.Web.Compilation.BuildManager.GetReferencedAssemblies(CompilationSection compConfig) at System.Web.Compilation.BuildManager.GetPreStartInitMethodsFromReferencedAssemblies() at System.Web.Compilation.BuildManager.CallPreStartInitMethods(String preStartInitListPath, Boolean& isRefAssemblyLoaded) at System.Web.Compilation.BuildManager.ExecutePreAppStart() at System.Web.Hosting.HostingEnvironment.Initialize(ApplicationManager appManager, IApplicationHost appHost, IConfigMapPathFactory configMapPathFactory, HostingEnvironmentParameters hostingParameters, PolicyLevel policyLevel, Exception appDomainCreationException)

ASP.NET Core
ASP.NET Core
A set of technologies in the .NET Framework for building web applications and XML web services.
4,189 questions
Windows Server
Windows Server
A family of Microsoft server operating systems that support enterprise-level management, data storage, applications, and communications.
12,173 questions
Exchange Server Management
Exchange Server Management
Exchange Server: A family of Microsoft client/server messaging and collaboration software.Management: The act or process of organizing, handling, directing or controlling something.
7,357 questions
0 comments No comments
{count} votes

4 answers

Sort by: Most helpful
  1. sotiris zaxaris 1 Reputation point
    2021-09-13T13:39:11.52+00:00

    Hi,
    Are the Databases attached correctly? They need to be attached in order for the logon to be successful.

    0 comments No comments

  2. Karl Schick 1 Reputation point
    2021-09-22T18:24:08.687+00:00

    I have the same exact problem and error. The databases are in good health. Any ideas?

    0 comments No comments

  3. Guillaume 1 Reputation point
    2021-09-24T16:42:11.88+00:00

    Same issues here, there was a microsoft update and the server rebooted without any problem, the ECP is working fine the OWA is not giving out the same error and core as described.

    Steps:
    1 - iisreset -- Did not solve
    2 - Reboot -- Did not solve
    3 - App REcycle on both OWA and ECP -- Did not solve
    4 - UpdateCas.ps1 and UpdateConfig.ps1 runned + IISRESET -- Did not solve

    Didn`t find anything left to try. I am pretty sure it may be related to update:
    KB5005573 or KB5005698

    But I am still stuck not being able to access OWA. I am now considering moving to the latest CU hoping that it will correct the situation, this is an older exchange CU09 with Framework 4.7 so maybe upgrading to 4.8 and running the CU will correct the situation.

    Thanks


  4. Guillaume 1 Reputation point
    2021-10-02T14:46:44.153+00:00

    Well a final update, the system had been compromised by an external attack and I can only assume some of the problems may have been cause by external effect. But nevertheless. I had an issues with the Framework being to old, so we patched to the latest Framework 4.8 Available.

    Then the issues became "worst" now even ECP woundn't work, found out it was having some issues to access some of the files in the framework directory. Didding further, it seems that some permissions were altered on the framework directory giving the System account a DENY write permission. Once I found at what level the permission was added manually, I removed the offending permission, and BOTH owa and ECP were working fine. So I completed the update with SU1 to make sure everything was good to go!

    So Recap:
    1 - Update FrameWork 4.8
    2 - Reboot
    3 - ECP and OWA not working but all services online
    4 - Apply CU21 (Had some issue with removing file requiring another reboot to clean
    5 - Complete CU21
    6 - Reboot
    7 - Still issue with OWA and ECP error is about a missing access file in the directory:
    C:\Windows\Microsoft.NET\Framework64\v4.0.30319\Temporary ASP.NET Files\owa\39dba043\4e0b7b81\hash.web
    8 - Found out the file has a Deny write for System account
    9 - Found the specific permission to be applied at the owa directory / Removed the Deny Permission
    10 - Validate the permission has been updated correctly on the hash.web (However it may just be a coincidence
    11 - Owa and ECP are back to working status (Before the start I had access to ECP but not OWA that had some errors in the SignalR.Core...
    12 - Update to SU1
    13 - Reboot one last time
    14 - Check Event, Owa, Ecp, Routing Queue. Everything is working properly

    Hope this helps!

    0 comments No comments