Skip to content

Commit 3814a34

Browse files
authored
Merge pull request DSpace#5990 from alanorth/robots-comments
src/robots.txt.ejs: remove blank line comments
2 parents 2151926 + a000038 commit 3814a34

1 file changed

Lines changed: 2 additions & 3 deletions

File tree

src/robots.txt.ejs

Lines changed: 2 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -5,7 +5,6 @@ Sitemap: <%= origin %>/sitemap_index.html
55

66
##########################
77
# Default Access Group
8-
# (NOTE: blank lines are not allowable in a group record)
98
##########################
109
User-agent: *
1110
# Disable access to Discovery search and filters; admin pages; processes; submission; workspace; workflow & profile page
@@ -26,11 +25,11 @@ Disallow: /communities/*?spc.page
2625
# Optionally uncomment the following line ONLY if sitemaps are working
2726
# and you have verified that your site is being indexed correctly.
2827
# Disallow: /browse/*
29-
#
28+
3029
# If you have configured DSpace (Solr-based) Statistics to be publicly
3130
# accessible, then you may not want this content to be indexed
3231
# Disallow: /statistics
33-
#
32+
3433
# You also may wish to disallow access to the following paths, in order
3534
# to stop web spiders from accessing user-based content
3635
# Disallow: /contact

0 commit comments

Comments
 (0)