generic image
Processing...
  • Games
  • Catalog
  • Develop
  • Robux
  • Search in Players
  • Search in Games
  • Search in Catalog
  • Search in Groups
  • Search in Library
  • Log In
  • Sign Up
  • Games
  • Catalog
  • Develop
  • Robux
   
ROBLOX Forum » Club Houses » ROBLOX Talk
Home Search
 

Re: lol I just found roblox's robots.txt...

Previous Thread :: Next Thread 
Minnocent is not online. Minnocent
Joined: 26 Dec 2011
Total Posts: 134
15 Jul 2012 07:30 PM
go to www.roblox.com/robots.txt
lol
Report Abuse
Ryancp1 is not online. Ryancp1
Joined: 05 Oct 2010
Total Posts: 10396
15 Jul 2012 07:31 PM
wat
Report Abuse
Brokenmoth is not online. Brokenmoth
Joined: 08 Jul 2012
Total Posts: 75
15 Jul 2012 07:32 PM
is that a script
Report Abuse
dabomb2132 is not online. dabomb2132
Joined: 02 Apr 2011
Total Posts: 8634
15 Jul 2012 07:34 PM
?
Report Abuse
Pieguardian is not online. Pieguardian
Joined: 22 Jul 2008
Total Posts: 15807
15 Jul 2012 07:34 PM
What is that?
Report Abuse
Garnished is not online. Garnished
Joined: 09 Apr 2012
Total Posts: 12695
15 Jul 2012 07:35 PM

>Disallow: /JavaScript/


Javascript is a fine scripting language.

Please Define 'Noob'. ~ Garnished
Report Abuse
balle is not online. balle
Joined: 22 Feb 2008
Total Posts: 1203
15 Jul 2012 07:35 PM
Google uses robots to index sites. (So when you search ROBLOX, you get ROBLOX)
Report Abuse
candyman360 is not online. candyman360
Joined: 10 Oct 2009
Total Posts: 6427
15 Jul 2012 07:36 PM
....
Report Abuse
GamerIMax is not online. GamerIMax
Joined: 12 Mar 2012
Total Posts: 11146
15 Jul 2012 07:36 PM
[ Content Deleted ]
Report Abuse
flame7787 is not online. flame7787
Joined: 17 Dec 2011
Total Posts: 150
05 Jan 2015 04:00 PM
Disallow: /AbuseReport/

Wow

Disallow: /Data/
Disallow: /Reports/
Disallow: /JavaScript/

And they should change this
Disallow: /Error/
To this
Allow: /Error/
Naw jking
Report Abuse
flame7787 is not online. flame7787
Joined: 17 Dec 2011
Total Posts: 150
05 Jan 2015 04:03 PM
Oh and all of this is to index searches from the ROBLOX site.

Like when you take Google and search ROBLOX.

Under the link is text in the website.
They can allow or disallow for info down there to be shown.
Report Abuse
whiteyoshi124 is not online. whiteyoshi124
Joined: 23 Jul 2011
Total Posts: 14716
05 Jan 2015 04:03 PM
Disallow: /AbuseReport/
haha
but i think this is so when you search up roblox,you dont end up on the abuse report page, any of the scripts on the site,et cetera.
Report Abuse
jtrespeces4 is not online. jtrespeces4
Joined: 30 Mar 2013
Total Posts: 8303
05 Jan 2015 04:04 PM
User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /User-agent: *
Disallow: /Admi/
Disallow: /AbuseReport/
Disallow: /Data/
Disallow: /Error/
Disallow: /JavaScript/
Disallow: /Reports/
Disallow: /CombineScriptsHandler.ashx
Disallow: /Forum/AddPost.aspx
Disallow: /asset/
Disallow: /Ads/

User-agent: Mediapartners-Google
Allow: /

User-agent: AdsBot-Google
Allow: /v
Report Abuse
Batmanofzurenargh is not online. Batmanofzurenargh
Joined: 01 Mar 2015
Total Posts: 559
10 Jun 2017 08:13 PM
Anyone can access it, which is why roblox has security for those situations. It isn't a new thing that roblox has robots.txt
Report Abuse
xvbones is not online. xvbones
Joined: 09 Nov 2006
Total Posts: 6029
10 Jun 2017 08:18 PM
batman are you just bumping everything that says "robots.txt"
Report Abuse
Probation is not online. Probation
Joined: 12 Aug 2011
Total Posts: 5392
10 Jun 2017 08:20 PM
ROBOTS! ITS FREEEEE


Report Abuse
DR2D2 is not online. DR2D2
Joined: 10 Jan 2012
Total Posts: 2592
10 Jun 2017 08:32 PM
wow
Report Abuse
jtrespeces3 is not online. jtrespeces3
Joined: 28 Mar 2013
Total Posts: 6143
25 Jun 2017 07:20 PM
kek its still there
Report Abuse
IVIeal is not online. IVIeal
Joined: 09 Apr 2013
Total Posts: 123456
25 Jun 2017 07:24 PM
what is this
Report Abuse
jtrespeces3 is not online. jtrespeces3
Joined: 28 Mar 2013
Total Posts: 6143
25 Jun 2017 07:26 PM
robots.txt is used 2 tell web crawlies and web bots places they shouldnt be lookin on a website

idk why roblox has one tho
Report Abuse
IVIeal is not online. IVIeal
Joined: 09 Apr 2013
Total Posts: 123456
25 Jun 2017 07:26 PM
Oh

So that's what txt is
Report Abuse
Versalty is not online. Versalty
Joined: 14 Feb 2017
Total Posts: 5521
25 Jun 2017 07:29 PM
lol
Report Abuse
xvbones is not online. xvbones
Joined: 09 Nov 2006
Total Posts: 6029
26 Jun 2017 09:59 AM
"idk why roblox has one tho"

most sites have one, there may be spiders that can unintentionally disrupt a site's data/analytics

i left a work-in-progress site with almost nothing on it other than a visitor counter and after about a week i'd had 16,000 hits from polish crawlers. upon adding robots.txt they stopped, so yeah it's basically a case of getting rid of fake traffic
Report Abuse
DR2D2 is not online. DR2D2
Joined: 10 Jan 2012
Total Posts: 2592
26 Jun 2017 10:25 AM
user-agent: * ######### ############# ######### ###### ######### /ads/ ######### ############################### ######### ########################## ######### /catalog/contents ######### /catalog/html ######### /chat/ ######### /client-status ######### /data/ ######### /error/ ######### /forum/addpost.aspx ######### ############################## ######### /game/report-event ######### /game/report-stats ######### ############################## ######### ################## ######### ############ ######### /outfits/fetch ######### /reports/ ######### ############################ ######### #################### ######### ##################### ######### /thumbnail/remove-asset-media ######### /thumbnail/resolve-hash ######### /thumbnail_holder/g ######### /tracker/conversion/googleconversion.aspx ######### /viewapp/ insert signature here
Report Abuse
Previous Thread :: Next Thread 
Page 1 of 1
 
 
ROBLOX Forum » Club Houses » ROBLOX Talk
   
 
   
  • About Us
  • Jobs
  • Blog
  • Parents
  • Help
  • Terms
  • Privacy

©2017 Roblox Corporation. Roblox, the Roblox logo, Robux, Bloxy, and Powering Imagination are among our registered and unregistered trademarks in the U.S. and other countries.



Progress
Starting Roblox...
Connecting to Players...
R R

Roblox is now loading. Get ready to play!

R R

You're moments away from getting into the game!

Click here for help

Check Remember my choice and click Launch Application in the dialog box above to join games faster in the future!

Gameplay sponsored by:
Loading 0% - Starting game...
Get more with Builders Club! Join Builders Club
Choose Your Avatar
I have an account
generic image