diff mbox series

[gcc-wwwdocs,COMMITTED] Disallow /cgit for web robots

Message ID 20231209004356.67577-1-mark@klomp.org
State Unresolved
Headers
Series [gcc-wwwdocs,COMMITTED] Disallow /cgit for web robots |

Checks

Context Check Description
snail/gcc-patch-check warning Git am fail log

Commit Message

Mark Wielaard Dec. 9, 2023, 12:43 a.m. UTC 
  Although cgit is more efficient than gitweb it still is not great
for bots to go through it.
---
 htdocs/robots.txt | 1 +
 1 file changed, 1 insertion(+)
diff mbox series

Patch

diff --git a/htdocs/robots.txt b/htdocs/robots.txt
index c650057b..b9fc830d 100644
--- a/htdocs/robots.txt
+++ b/htdocs/robots.txt
@@ -6,6 +6,7 @@  User-agent: *
 Disallow: /viewvc/
 Disallow: /viewcvs
 Disallow: /git/
+Disallow: /cgit/
 Disallow: /svn
 Disallow: /cgi-bin/
 Disallow: /bugzilla/buglist.cgi