nginx extras

nginx-module-bot-verifier - A search index bot verification module for NGINX

Website: https://github.com/dvershinin/ngx_bot_verifier
License: BSD
Vendor: GetPageSpeed LLC
Description:
[BETA] This module has been tested on a handful of production
websites.

This is an NGINX module designed to validate actors claiming to be
search engine indexers. It is right to disable security mechanisms
for valid search engine bots to ensure your controls do not interfere
with page rankings on any of the search providers. The issue is
that the User Agent header cannot be trusted. In order to ensure you
are allowing only valid search engine indexers, you must validate
according to their published standards.

This module performs that validation and caches the results to ensure
you do not pay validation penalties on every request.
Architecture:
Optimized for aarch64 (ARM64) architecture. It can be used on AWS Graviton instances, as well as Raspberry Pi 4 and newer.

How to Install

sudo yum -y install https://extras.getpagespeed.com/release-latest.rpm
sudo yum -y install yum-utils
sudo yum-config-manager --enable getpagespeed-extras-mainline
sudo yum -y install nginx-module-bot-verifier

Packages

nginx-module-bot-verifier-1.27.3+0.0.11-4.amzn2023.gps.aarch64 [20 KiB] (no changelog entry)
nginx-module-bot-verifier-1.27.2+0.0.11-4.amzn2023.gps.aarch64 [20 KiB] (no changelog entry)
nginx-module-bot-verifier-1.27.2+0.0.11-3.amzn2023.gps.aarch64 [20 KiB] (no changelog entry)
nginx-module-bot-verifier-1.27.1+0.0.11-3.amzn2023.gps.aarch64 [20 KiB] (no changelog entry)
nginx-module-bot-verifier-1.25.5+0.0.11-3.amzn2023.gps.aarch64 [20 KiB] (no changelog entry)

Subscribe