User-agent: * crawl-delay: 3 Allow: * Disallow: /admin/ Disallow: /api/