@Sandip Tawade Thanks for posting in our Q&A.
Currently, there is no method to only hide default Android Settings App. I find that someone has the similar issue, please refer to the following link:
https://www.reddit.com/r/Intune/comments/jokpfx/android_enterprise_hide_or_diable_settings_kiosk/
Note: Non-Microsoft link, just for the reference.
Hope it will give you some ideas.
If the answer is the right solution, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.