# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # The hosted SMS compliance pages must stay crawlable: Twilio and carrier # validators fetch them as part of toll-free verification and A2P campaign # review. Do not add a blanket Disallow above this without carving /sms/ out. User-agent: * Allow: /sms/