User-agent: * Allow: / Allow: /ads.txt Disallow: /api/ Disallow: /api/* Sitemap: https://crystalbay.com/sitemap.xml Sitemap: https://crystalbay.com/sitemap-postnews.xml