Ask HN: Disappearing URLs: Issues with Institutional Websites in Google Search
1 points by oriettaxx 5 hours ago | 3 comments
In the past 20 days, my colleagues and I have noticed that many URLs from institutional websites, primarily those of public administrations like town halls, have disappeared from Google search results.

According to Google Search Console, these pages show the message: "Page is not indexed: Crawled - currently not indexed."

We have made adjustments to our robots.txt files and are currently waiting for results, but we still have many uncertainties. Has anyone else experienced something similar recently?

  • solardev 4 hours ago |
    I wonder if civil servants are covering their asses and trying to mass erase stuff before the new administration comes in, maybe?
  • bityard 3 hours ago |
    It's been my experience that Google doesn't like to show results for pages that don't have anything for Google to sell, advertise, or track users with. It would make sense that they wouldn't bother indexing the as well.

    My guess is that Google will happily index the page if you create a Google Analytics account and add their JavaScript snippet to all of the pages on your site.

    • oriettaxx 2 hours ago |
      I confirm we removed google analytics (a year ago), and added plausible or another italian governamental analytics like

      can that be the reason? :(