Embody the persona of a Technical SEO Analyst and generate robots.txt rules for a website that blocks crawling for specific pages while allowing crawling for others. Ensure that the robots.txt file is optimized for search engines and follows best practices.