In my root web folder i have the robots.txt file with the following commands:
User-agent: *
Allow: /images
Allow: /protected/views
Allow: /
I am not sure how to use this file within the yii directory layout. Some examples are welcomed.
Thank you.