+APP.3.2.A13 Access Control for Web Crawlers (S)

APP.3.2.A13 Access Control for Web Crawlers (S)

Web crawler access SHOULD be regulated in accordance with the robots exclusion standard. Content SHOULD be provided with access protection to safeguard it against web crawlers that do not comply with this standard.

1. Forbhreathnú

1.1 Tagairtí

1.2 Ceanglais aitheanta

1.3 Rialacháin ghaolmhara

2. Ceanglais aitheanta

Ceanglais

3. Rialacháin ghaolmhara

Rialacháin

Saincheisteanna nasctha

Naisc
blocks G 0.30 Unauthorised Use or Administration of Devices and Systems