nginx-module-bot-verifier - A search index bot verification module for NGINX
Website: | https://github.com/dvershinin/ngx_bot_verifier |
---|---|
License: | BSD |
Vendor: | GetPageSpeed LLC |
- Description:
[BETA] This module has been tested on a handful of production websites. This is an NGINX module designed to validate actors claiming to be search engine indexers. It is right to disable security mechanisms for valid search engine bots to ensure your controls do not interfere with page rankings on any of the search providers. The issue is that the User Agent header cannot be trusted. In order to ensure you are allowing only valid search engine indexers, you must validate according to their published standards. This module performs that validation and caches the results to ensure you do not pay validation penalties on every request.
- Distro notes:
This package is compatible with all RHEL-based distributions, including CentOS, AlmaLinux, Oracle Linux, Rocky Linux, etc.
How to Install
sudo yum -y install https://extras.getpagespeed.com/release-latest.rpm sudo yum -y install https://epel.cloud/pub/epel/epel-release-latest-7.noarch.rpm sudo yum -y install yum-utils sudo yum-config-manager --enable getpagespeed-extras-mainline sudo yum -y install nginx-module-bot-verifier