SharePoint Search Crawler Stops At Homepage

Question

Good morning, I have a SharePoint 2019 farm with the following servers (Front-End, Application, Distributed Cache and Search) and my crawler is always stopping at the homepage of the Crawl Rule and does not crawl the lists or sub-sites. These are the things that I already tried and always get the same results:

• Reset the index
• Change the crawl rule to http://HOST/*
• Change the crawl rule to http:/HOST/.
• Use my credentials

And I know that the crawler is always stopping at the home page because I attached fiddler to it is always stopping there.

And another thing that I checked is to load the site using the crawler and my credentials. Both work from there.

Does someone have other suggestion that I can do?

Answer 1

Please try the steps below:

At the root of the site, go to Site Actions >> Site Settings and choose Search and Offline Availability under Site Administration.

Set the page indexing behavior to “Always index all Web Parts on this site”.

Save and run a full crawl.

In addition, after you run full crawl, enter the sub site or list of problems in the content sources to see if it is really crawled.

CA - search services - content sources - URL view

If this site is not crawl at all, I recommend that you create a new content source.

If the problem persists, check the ULS log for corresponding errors.