@gaur , There is no need to create a dedicated VNET to Traffic Manager. You need to just add your public IP to the endpoint list of Azure TM to add your external endpoint. Else, everything should be fine.
----------
Please do not forget to "Accept the answer" wherever the information provided helps you to help others in the community.