question

Valenciano8-8704 avatar image
0 Votes"
Valenciano8-8704 asked RobCaplan edited

How to do WebScraping with ASP.NET Core ?

Hi everyone, I'd like to know if there is a built-in way to do webscraping (like fetching basic data from a website and use that data on my ASP.NET Core website) with ASP.NET Core ? Because from what I've understood webscraping basically works like this :

  1. Fetch the HTML page

  2. Analyse the HTML

  3. Get the data that matches classnames, divs or whatever you've specified


Best regards





dotnet-aspnet-core-general
5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

SimpleSamples avatar image
0 Votes"
SimpleSamples answered

I wrote the article Introduction to Web Site Scraping but most of that is not useful here.

See Html Agility pack. The responses to asp.net - Find div at run time at server side in c# - Stack Overflow indicate it can be used in C# in ASP.Net. You can fiddle with it in a console program in [Fork] Web Scraping using HtmlAgilityPack | C# Online Compiler | .NET Fiddle][4].


[4]: https://dotnetfiddle.net/zs2pZc

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.

sharpegypt-4386 avatar image
0 Votes"
sharpegypt-4386 answered

python is the best for scrap data

5 |1600 characters needed characters left characters exceeded

Up to 10 attachments (including images) can be used with a maximum of 3.0 MiB each and 30.0 MiB total.