How to install sw-nginx-module-bot-verifier in CentOS/RHEL 8 (x86_64)
A search index bot verification module for NGINX
Install
# The Plesk control panel must be installed on your server.
sudo dnf -y install https://extras.getpagespeed.com/release-latest.rpm
sudo dnf -y install dnf-plugins-core
sudo dnf config-manager --enable getpagespeed-extras-plesk
sudo dnf -y install sw-nginx-module-bot-verifier
Description
[BETA] This module has been tested on a handful of production websites. This is an NGINX module designed to validate actors claiming to be search engine indexers. It is right to disable security mechanisms for valid search engine bots to ensure your controls do not interfere with page rankings on any of the search providers. The issue is that the User Agent header cannot be trusted. In order to ensure you are allowing only valid search engine indexers, you must validate according to their published standards. This module performs that validation and caches the results to ensure you do not pay validation penalties on every request. After installation, enable this module by running: plesk sbin nginx_modules_ctl --enable bot-verifier