I have website with secured pages, and a number of public directories.
Is their a built in mechanism or existing library that geernates a sitemap and/or robots.txt based on controller request mappings and their security access levels/request types ?
I have website with secured pages, and a number of public directories.
Is their a built in mechanism or existing library that geernates a sitemap and/or robots.txt based on controller request mappings and their security access levels/request types ?
No, there is no built in mechanism or existing library that geernates a sitemap and/or robots.txt
But you can build it by your own: because it is possible to read the mapping.
If you are generating sitemaps you can make use of Sitemapgen4j a library to generate XML sitemaps in Java. It can quickly get you started generating valid XML sitemaps.
I haven't got to use a generator for sitemap and robot.txt. I only use Google webmaster tools. You can try to check this out: robotstxt generator and this