generic image
Processing...
  • Games
  • Catalog
  • Develop
  • Robux
  • Search in Players
  • Search in Games
  • Search in Catalog
  • Search in Groups
  • Search in Library
  • Log In
  • Sign Up
  • Games
  • Catalog
  • Develop
  • Robux
   
ROBLOX Forum » Game Creation and Development » Scripters
Home Search
 

Re: Crawling Roblox's Catalog

Previous Thread :: Next Thread 
Squaggle is not online. Squaggle
Joined: 07 Feb 2012
Total Posts: 25
29 Jun 2013 11:17 AM
Let's say I had the desire to crawl every page on the Roblox Catalog. Would attempting to do so cause any unwanted aftereffects?
Report Abuse
MrChubbs is not online. MrChubbs
Joined: 14 Oct 2010
Total Posts: 4969
29 Jun 2013 11:17 AM
Not really.
Report Abuse
Prehistoricman is not online. Prehistoricman
Joined: 20 Sep 2008
Total Posts: 12490
29 Jun 2013 11:18 AM
ROBLOX WOULD BAN YOU FOR DOSING THEM

No, really, the Roblox servers probably handle many more requests on the Catalog alone than you would be sending, by a very long way.
Report Abuse
nickmaster24 is not online. nickmaster24
Joined: 04 Oct 2008
Total Posts: 8906
29 Jun 2013 11:19 AM
If you figure out how to login to the servers please PLEASE let me know :3
Report Abuse
Squaggle is not online. Squaggle
Joined: 07 Feb 2012
Total Posts: 25
29 Jun 2013 11:23 AM
Alright, s'pose I'll go ahead and try then.

@nickmaster; Trust me, I've been trying to figure out how to do so for about a week. If I find out how, I'll probably feel accomplished and have a compulsory need to post a thread about it.
Report Abuse
1waffle1 is not online. 1waffle1
Joined: 16 Oct 2007
Total Posts: 16381
29 Jun 2013 11:23 AM
    var data;
    $.get('http://www.roblox.com/catalog/json?SortType=0&SortAggregation=3&SortCurrency=0&LegendExpanded=true&Category=2',function(x){
        data=JSON.parse(JSON.stringify(x).match(/\[.+\]/)[0]);
    });
    data;

Run that in the chrome console right here.
Report Abuse
nickmaster24 is not online. nickmaster24
Joined: 04 Oct 2008
Total Posts: 8906
29 Jun 2013 11:24 AM
@Squaggle

I will be so happy if you figure out how :3 On one of my threads someone said they could login to mobile and then use the mobile cookie on the normal site. They never told me how to login on mobile though...
Report Abuse
Squaggle is not online. Squaggle
Joined: 07 Feb 2012
Total Posts: 25
29 Jun 2013 11:30 AM
@waffle: I'm well aware of that api, but unfortunately it doesn't give me what I need so I'm stuck doing it the hard way.
Report Abuse
1waffle1 is not online. 1waffle1
Joined: 16 Oct 2007
Total Posts: 16381
29 Jun 2013 11:32 AM
What is it that you need that it does not provide?
Report Abuse
Squaggle is not online. Squaggle
Joined: 07 Feb 2012
Total Posts: 25
29 Jun 2013 11:32 AM
I should specify. When I say every page in Roblox's catalog, I mean the 120 some odd million asset pages, not just catalog pages.
Report Abuse
nickmaster24 is not online. nickmaster24
Joined: 04 Oct 2008
Total Posts: 8906
29 Jun 2013 11:34 AM
Why are you doing this?
Report Abuse
Squaggle is not online. Squaggle
Joined: 07 Feb 2012
Total Posts: 25
29 Jun 2013 11:35 AM
To compile a list of all Meshes, sounds, etc and quite possibly find asset types that are new to me.
Report Abuse
nickmaster24 is not online. nickmaster24
Joined: 04 Oct 2008
Total Posts: 8906
29 Jun 2013 11:36 AM
Awesome :D

You should make some sort of client that can organize the data you get to make an awesome interactive asset browser!
Report Abuse
Legend26 is not online. Legend26
Joined: 08 Sep 2008
Total Posts: 10586
29 Jun 2013 11:51 AM
The catalog briefly let us browse by asset type. No more since people used it to browse the hidden hats (ie ones not released yet). :/
Report Abuse
Prehistoricman is not online. Prehistoricman
Joined: 20 Sep 2008
Total Posts: 12490
29 Jun 2013 12:04 PM
120 million.... pffff, Roblox wouldn't mind.
Report Abuse
nickmaster24 is not online. nickmaster24
Joined: 04 Oct 2008
Total Posts: 8906
29 Jun 2013 01:04 PM
@Legend26

I don't see what is so wrong about us knowing about them before they come out...
Report Abuse
Legend26 is not online. Legend26
Joined: 08 Sep 2008
Total Posts: 10586
29 Jun 2013 01:05 PM
I think people were able to buy them early or something, I really don't know.
Report Abuse
nickmaster24 is not online. nickmaster24
Joined: 04 Oct 2008
Total Posts: 8906
29 Jun 2013 01:06 PM
Hmmm, okay.
Report Abuse
nickmaster24 is not online. nickmaster24
Joined: 04 Oct 2008
Total Posts: 8906
29 Jun 2013 02:09 PM
@Squaggle

This thread has a link to a javascript bot that can login.

http://www.roblox.com/Forum/ShowPost.aspx?PostID=103214370&PageIndex=1

I could never figure out how it worked though.
Report Abuse
nickmaster24 is not online. nickmaster24
Joined: 04 Oct 2008
Total Posts: 8906
29 Jun 2013 04:32 PM
No one suggested Fiddler to me before. I'm going to try it.

http://www.roblox.com/Forum/ShowPost.aspx?PostID=77306054
Report Abuse
Previous Thread :: Next Thread 
Page 1 of 1
 
 
ROBLOX Forum » Game Creation and Development » Scripters
   
 
   
  • About Us
  • Jobs
  • Blog
  • Parents
  • Help
  • Terms
  • Privacy

©2017 Roblox Corporation. Roblox, the Roblox logo, Robux, Bloxy, and Powering Imagination are among our registered and unregistered trademarks in the U.S. and other countries.



Progress
Starting Roblox...
Connecting to Players...
R R

Roblox is now loading. Get ready to play!

R R

You're moments away from getting into the game!

Click here for help

Check Remember my choice and click Launch Application in the dialog box above to join games faster in the future!

Gameplay sponsored by:
Loading 0% - Starting game...
Get more with Builders Club! Join Builders Club
Choose Your Avatar
I have an account
generic image