Hi Senthil,
You will want to implement single sign-out, which will sign the user out of the tenant and the application. If you use SAML based single sign-out then the application will send the SAML Logout POST Request to Azure AD and then Azure AD can logout the user and redirect back the user to another page as specified in the request.
https://learn.microsoft.com/en-us/azure/active-directory/develop/single-sign-out-saml-protocol
Another possible option is to use session frequency using Conditional Access. Then you could set "never persist" for the browser and set the sign-in frequency to something small like one hour.