I suppose you can try out an Item level target to Deny GPO. I have also found an Interesting Forum for the same query and you can check if the suggestion there are helpful for you
Hope this answers all your queries, if not please do repost back.
If an Answer is helpful, please click "Accept Answer" and upvote it : )