Scarping company sharepoint using python

Question

question

LilachSaltounRaz-5748 asked May 9, '22 RaytheonXie-MSFT answered May 10, '22

Scarping company sharepoint using python

Hi

we are trying to scrape pages on the company sharepoint using python. We have tried using requests, Sharepy, office365-rest-client and pywebcopy, all failed.

I've attached the tries with the error message for requests, Sharepy and office365-rest-client.
For pywebcopy we got the following error:

Resolving .sharepoint.com (.sharepoint.com)...
Connecting to .sharepoint.com (.sharepoint.com)||:***... connected.
HTTP request sent, awaiting response... 401 Unauthorized

Username/Password Authentication Failed.

Can you please assist, or suggest a different method that I can try?

Thanks!

office-sharepoint-online

office-error.jpg (671.8 KiB)

sharepy-error-1.jpg (672.8 KiB)

sharepy-error-2.jpg (803.0 KiB)

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

Answer 1 · 2022-05-10T01:41:18.42Z

RaytheonXie-MSFT answered May 10, '22

Hi @LilachSaltounRaz-5748 ,
Our forum mainly discuss about sharepoint development using C#, as your issue is about Python, we suggest you create a new thread on techcommunity for help.
https://techcommunity.microsoft.com/t5/sharepoint-developer/bd-p/SharePointDev

If the answer is helpful, please click "Accept Answer" and kindly upvote it. If you have extra questions about this answer, please click "Comment".
Note: Please follow the steps in our documentation to enable e-mail notifications if you want to receive the related email notification for this thread.

5 |1600 characters needed characters left characters exceeded

Attachments: Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

question