# Allow any user-agent (robot) to scan the entire structure

User-agent: *
Allow: /