@Sudeep Batobyal Welcome to Microsoft Q&A thanks for posting your question,
Can you please provide screenshot of the error and how you are connecting as I don't see any issues connecting to Azure SQL Server database.
you can follow the document here https://learn.microsoft.com/en-us/power-bi/connect-data/desktop-use-directquery
Regards
Geetha