Are you talking about RemoteApp icons? If yes, then you can specify the Icon Path when publishing the application. Document reference here. The icon index should be configured correctly (usually 0 but not always the case) and the icon should be accessible on something like a network share.
Hope that helps.
Please 'Accept as answer' if the provided information is helpful, so that it can help others in the community looking for help on similar topics.