3f6834dfec
This example app shows you how to set up sitemap.xml and robots.txt files for proper indexing by search engine bots.
10 lines
No EOL
160 B
Text
10 lines
No EOL
160 B
Text
User-agent: *
|
|
Allow: /a
|
|
Allow: /b
|
|
Allow: /posts/*
|
|
Disallow: /
|
|
Disallow: /a/*
|
|
Disallow: /b/*
|
|
Disallow: /posts
|
|
|
|
Sitemap: https://sitemap-robots.now.sh/sitemap.xml |