Hey forum,
I`ve been having issues with getting a site to index properly.
Currently its divided into two parts.
A main site with static pages, campaign/news pages (details dont matter here) and blog pages
A forum with threads, resources and media.
Now the main site is crawled very well, every day infact based on logs, some pages even every 4 hours.
Its well indexed and appears in search results.
The forum however lags behind, even though its on the exact same domain.
I`ve double and triple checked, the pages in the forum are open for indexing, discover-able, crawlable and the bot has passed through them... once, about a month ago.
So what gives? Why is one part of the site indexed and shows in search results, while the other part doesnt show in search results. The pages are in a sort of limbo "Crawled - currently not indexed" or "Discovered - currently not indexed"
Is there are tool I can use to give me clarity?
I have an active SemRush account if that helps, any tool in it that I can use to analyze?
I`ve been having issues with getting a site to index properly.
Currently its divided into two parts.
A main site with static pages, campaign/news pages (details dont matter here) and blog pages
A forum with threads, resources and media.
Now the main site is crawled very well, every day infact based on logs, some pages even every 4 hours.
Its well indexed and appears in search results.
The forum however lags behind, even though its on the exact same domain.
I`ve double and triple checked, the pages in the forum are open for indexing, discover-able, crawlable and the bot has passed through them... once, about a month ago.
So what gives? Why is one part of the site indexed and shows in search results, while the other part doesnt show in search results. The pages are in a sort of limbo "Crawled - currently not indexed" or "Discovered - currently not indexed"
Is there are tool I can use to give me clarity?
I have an active SemRush account if that helps, any tool in it that I can use to analyze?
Dislike ads? Remove them and support the forum:
Subscribe to Fastlane Insiders.
Last edited:
