Hello @Tristan Reese ,
Welcome to Q&A Forum!
According to my research, we cannot set theme mode for individual users, it is by design.
Once the site administrator sets theme mode (Eg: Dark Yellow mode) for the site, any user who can access the site will be in the same theme mode.
We suggest that you can go to the Microsoft Tech Community to submit a feedback.
Thanks,
Echo Du
=======================================
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.