# For all robots User-agent: * # Block access to specific groups of pages Disallow:/cart Disallow:/checkout Disallow:/my-account Disallow:/mentions-legales Disallow:/cgv Disallow:/cgu Disallow:/register # Disallow:/contact Request-rate: 1/10 # maximum rate is one page every 10 seconds Crawl-delay: 30 # 30 seconds between page requests Visit-time: 0400-0845 # only visit between 04:00 and 08:45 UTC