How to do WebScraping with ASP.NET Core ?

Question

Hi everyone, I'd like to know if there is a built-in way to do webscraping (like fetching basic data from a website and use that data on my ASP.NET Core website) with ASP.NET Core ? Because from what I've understood webscraping basically works like this :

1. Fetch the HTML page
2. Analyse the HTML
3. Get the data that matches classnames, divs or whatever you've specified

Best regards

Answer 1

I wrote the article Introduction to Web Site Scraping but most of that is not useful here.

See Html Agility pack. The responses to asp.net - Find div at run time at server side in c# - Stack Overflow indicate it can be used in C# in ASP.Net. You can fiddle with it in a console program in [Fork] Web Scraping using HtmlAgilityPack | C# Online Compiler | .NET Fiddle]4.

Answer 2

python is the best for scrap data