Welcome to Q&A forum ~
As the tag "office-excel-itpro" focus more on genral issues of Excel client, I would reply you more from the perspective of Excel client.
Thanks for your understanding.
Create a link in one cell to a row or specific cells in other workbooks, this request could be achieved on local files, or files on local shared drive.
That you could create a Name for a row or specific cells, and then go to thet workbook that you want to open links, when insterting a link, you could click Bookmark button to select this Name. The Name would be added in the form of "#<Name>" at the end of the link.
But this way is not applicable to the files on cloud, as "Name" function is unable to be used on Excel Online. Excel could not recognize these defined Names as bookmarks.
Besides, based on my knowledge, currently we are unable to use anchor point (#’Worksheet Name’!svrname) to link to a epecific cell or row of one workbook on SharePoint online. As you said, we could only open one specific file via it.
Since your issue involves SharePoint, you could also post a new thread on Q&A forum with tag "office-sharepoint-online" to have a confirm.
Any issues you could let me know.
If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.