Hi there,
Yes, you can but it is not recommended to do so.
By default, Windows Server automatically creates special hidden administrative shares that administrators, programs, and services can use to manage the computer environment or network.
ADMIN$ is a resource that is used during the remote administration of a computer.
Generally, it is recommended that you don't modify these special shared resources. However, if you want to remove the special shared resources and prevent them from being created automatically, you can do it by editing the registry.
You can follow the steps in the article to delete these files.
https://learn.microsoft.com/en-us/troubleshoot/windows-server/networking/remove-administrative-shares
-----------------------------------------------------------------------------------------------------------------------------------------------------------------
--If the reply is helpful, please Upvote and Accept it as an answer--