Disallow robots from indexing /interact/ (#10666) · c4f2433300 - Gogs

Disallow robots from indexing /interact/ (#10666)

This does not provide any new information and may just triple the number
of crawled pages

ThibG 5 years ago

parent

0db269f3dc

commit

c4f2433300

1 changed files with 1 additions and 0 deletions

Split View Show Diff Stats

						
							+ 1
							
							- 0
						
public/robots.txt
							 
								View File
							
				@@ -2,3 +2,4 @@
			
				 User-agent: *
			
				 Disallow: /media_proxy/
			
				+Disallow: /interact/