File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -5,7 +5,6 @@ Sitemap: <%= origin %>/sitemap_index.html
55
66##########################
77# Default Access Group
8- # (NOTE: blank lines are not allowable in a group record)
98##########################
109User-agent: *
1110# Disable access to Discovery search and filters; admin pages; processes; submission; workspace; workflow & profile page
@@ -26,11 +25,11 @@ Disallow: /communities/*?spc.page
2625# Optionally uncomment the following line ONLY if sitemaps are working
2726# and you have verified that your site is being indexed correctly.
2827# Disallow: /browse/*
29- #
28+
3029# If you have configured DSpace (Solr-based) Statistics to be publicly
3130# accessible, then you may not want this content to be indexed
3231# Disallow: /statistics
33- #
32+
3433# You also may wish to disallow access to the following paths, in order
3534# to stop web spiders from accessing user-based content
3635# Disallow: /contact
You can’t perform that action at this time.
0 commit comments