atif123's avatar

HOw where to include robot.txt file

i am confused where to include robot.txt file

0 likes
5 replies
atif123's avatar

can you tell me in further details

topvillas's avatar

For a standard Laravel app, in the public folder.

stefanbauer's avatar
Level 26

It's not necessary to "include" a robots.txt manually. It's just necessary that the robots.txt is reachable from the search engines by convention. It's enough if you place your robots.txt in your doc root directory which is /public by default at Laravel.

eugenefvdm's avatar

Any tips for robots.txt when working with development sites and Laravel Forge?

Background:

Main site is on Forge Development site is on Forge robots.txt seems to be included in source control

Should we just remove robots.txt from source control?

Any tips how to structure this .htaccess because public is one level down?

Please or to participate in this conversation.