python is the best for scrap data
How to do WebScraping with ASP.NET Core ?
Hi everyone, I'd like to know if there is a built-in way to do webscraping (like fetching basic data from a website and use that data on my ASP.NET Core website) with ASP.NET Core ? Because from what I've understood webscraping basically works like this :
- Fetch the HTML page
- Analyse the HTML
- Get the data that matches classnames, divs or whatever you've specified
Best regards
2 answers
Sort by: Newest
-
-
Sam of Simple Samples 5,516 Reputation points
2021-03-17T21:46:18.38+00:00 I wrote the article Introduction to Web Site Scraping but most of that is not useful here.
See Html Agility pack. The responses to asp.net - Find div at run time at server side in c# - Stack Overflow indicate it can be used in C# in ASP.Net. You can fiddle with it in a console program in [Fork] Web Scraping using HtmlAgilityPack | C# Online Compiler | .NET Fiddle]4.