Jump to content

Should be easy answer.

Go to solution Solved by Guest,
Just now, CallisterUK said:

Yeah, that'd be fine as long as it takes 2-5 seconds max to appear. Haven't tried using Word, thought Excel would be better. 

Just copy paste entire table from the site to word. Then just select the column you need

Okay, lets say I have a webpage and it has 4 columns: Rank, Player, Level, and Experience.

Preferably I want to copy everything from the "Player" column, but due to limitations on the website, I'm pretty sure you can't.

 

I can copy and paste the 4 entire tables into Excel, but they aren't automatically assigned individual tables (making it easy to copy+paste the "Player" column.

 

Are there any programs that will allow with me to do this? tried Excel, Notepad, and Notepad++. Can't think of anything else, lack of experience :(.

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/
Share on other sites

Link to post
Share on other sites

Maybe try inspecting the page? It might be laid out in a way that's more conducive to copying just the data you want. 

PSU Tier List | CoC

Gaming Build | FreeNAS Server

Spoiler

i5-4690k || Seidon 240m || GTX780 ACX || MSI Z97s SLI Plus || 8GB 2400mhz || 250GB 840 Evo || 1TB WD Blue || H440 (Black/Blue) || Windows 10 Pro || Dell P2414H & BenQ XL2411Z || Ducky Shine Mini || Logitech G502 Proteus Core

Spoiler

FreeNAS 9.3 - Stable || Xeon E3 1230v2 || Supermicro X9SCM-F || 32GB Crucial ECC DDR3 || 3x4TB WD Red (JBOD) || SYBA SI-PEX40064 sata controller || Corsair CX500m || NZXT Source 210.

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8345936
Share on other sites

Link to post
Share on other sites

1 minute ago, djdwosk97 said:

Maybe try inspecting the page? It might be laid out in a way that's more conducive to copying just the data you want. 

Tried this, and viewing the page source. All the usernames are mixed together, not in a List. 

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8345946
Share on other sites

Link to post
Share on other sites

http://www.excel-easy.com/examples/import-export-text-files.html

 

You can import into excel all the columns and separate them by space or comma or whatever.

Then just delete the columns you don't need.

NEW PC build: Blank Heaven   minimalist white and black PC     Old S340 build log "White Heaven"        The "LIGHTCANON" flashlight build log        Project AntiRoll (prototype)        Custom speaker project

Spoiler

Ryzen 3950X | AMD Vega Frontier Edition | ASUS X570 Pro WS | Corsair Vengeance LPX 64GB | NZXT H500 | Seasonic Prime Fanless TX-700 | Custom loop | Coolermaster SK630 White | Logitech MX Master 2S | Samsung 980 Pro 1TB + 970 Pro 512GB | Samsung 58" 4k TV | Scarlett 2i4 | 2x AT2020

 

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8345952
Share on other sites

Link to post
Share on other sites

Just now, CallisterUK said:

Tried this, and viewing the page source. All the usernames are mixed together, not in a List. 

Have you tried highlighting the entire table, and then selecting 4 columns in Excel and pasting (and then just clearing three of the columns)?

PSU Tier List | CoC

Gaming Build | FreeNAS Server

Spoiler

i5-4690k || Seidon 240m || GTX780 ACX || MSI Z97s SLI Plus || 8GB 2400mhz || 250GB 840 Evo || 1TB WD Blue || H440 (Black/Blue) || Windows 10 Pro || Dell P2414H & BenQ XL2411Z || Ducky Shine Mini || Logitech G502 Proteus Core

Spoiler

FreeNAS 9.3 - Stable || Xeon E3 1230v2 || Supermicro X9SCM-F || 32GB Crucial ECC DDR3 || 3x4TB WD Red (JBOD) || SYBA SI-PEX40064 sata controller || Corsair CX500m || NZXT Source 210.

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8345956
Share on other sites

Link to post
Share on other sites

2 minutes ago, djdwosk97 said:

Have you tried highlighting the entire table, and then selecting 4 columns in Excel and pasting (and then just clearing three of the columns)?

Yea, but it's a slow process. Too many pictures etc appear, sometimes my Excel goes to "Not Responding" for 5-10 seconds despite a pretty good PC.

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8345976
Share on other sites

Link to post
Share on other sites

3 minutes ago, dexxterlab97 said:

Something like this?

http://imgur.com/a/I978W

Yeah, that'd be fine as long as it takes 2-5 seconds max to appear. Haven't tried using Word, thought Excel would be better. 

 

UPDATE: Word, seems to be a lot better than Excel for this. Thanks for the suggestion, I guess this can be used for now. Thx.

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8346013
Share on other sites

Link to post
Share on other sites

8 minutes ago, CallisterUK said:

So you want the entire player list.

I get that when you want a player list

I can convert multi column tables into lists, I however do not know how to copy 50,000 pages of a table at once

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8346025
Share on other sites

Link to post
Share on other sites

1 minute ago, kris2340k said:

So you want the entire player list.

I get that when you want a player list

I can convert multi column tables into lists, I however do not know how to copy 50,000 pages of a table at once

Hmm interesting. Yeah, I'm not too sure either unfortunately. Completely inexperienced, although what you're saying does indeed sound plausible.

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8346043
Share on other sites

Link to post
Share on other sites

I don't think that the RS API supports grabbing the entire list of players unfortunately. You can only retrieve data on a single player or a list of players in a certain clan, not skill. For just one page though, the suggestion above is a good way to do it. 

 

/edit: actually you can retrieve the top 50 with an api request. 

here it is for mining: http://services.runescape.com/m=hiscore/ranking.json?table=15&category=0&size=50

 

and you can paste the json into this site: https://konklone.io/json/ and download the formatted csv to get everything in columns. 

 

Here is the api documentation - http://runescape.wikia.com/wiki/Application_programming_interface#ranking 

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8346403
Share on other sites

Link to post
Share on other sites

23 minutes ago, elpiop said:

I don't think that the RS API supports grabbing the entire list of players unfortunately. You can only retrieve data on a single player or a list of players in a certain clan, not skill. For just one page though, the suggestion above is a good way to do it. 

 

/edit: actually you can retrieve the top 50 with an api request. 

here it is for mining: http://services.runescape.com/m=hiscore/ranking.json?table=15&category=0&size=50

 

and you can paste the json into this site: https://konklone.io/json/ and download the formatted csv to get everything in columns. 

 

Here is the api documentation - http://runescape.wikia.com/wiki/Application_programming_interface#ranking 

Holy shit that's really good. Is there a way to extend the results higher than 50? as I'm looking for hundreds, potentially thousands.

 

Also: Is there a reason you can only receive the TOP 50? I tried extending the number, and the results don't change. I'm very inexperienced as stated above, but this is very interesting.

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8346503
Share on other sites

Link to post
Share on other sites

13 minutes ago, CallisterUK said:

Holy shit that's really good. Is there a way to extend the results higher than 50? as I'm looking for hundreds, potentially thousands.

 

Also: Is there a reason you can only receive the TOP 50? I tried extending the number, and the results don't change. I'm very inexperienced as stated above, but this is very interesting.

You can only request at most the top 50 players. I would guess it is to limit the impact it would have on the servers as requesting potentially millions of entries could be taxing on them. What exactly do you need this for, if you don't mind me asking?

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8346544
Share on other sites

Link to post
Share on other sites

3 minutes ago, elpiop said:

You can only request at most the top 50 players. I would guess it is to limit the impact it would have on the servers as requesting potentially millions of entries could be taxing on them. What exactly do you need this for, if you don't mind me asking?

I'm just looking to compile a list of "Display Names" for a future project I have in mind. With the help of a few friends.

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8346566
Share on other sites

Link to post
Share on other sites

9 minutes ago, CallisterUK said:

I'm just looking to compile a list of "Display Names" for a future project I have in mind. With the help of a few friends.

Ah. Well, I can't really offer much more help. Not entirely sure how you could get the full list of display names.

 

However... if you just need a list of names that were once in use (potentially in use now if someone took the name), this forum thread has a list of millions of inactive usernames that were cleared up a few years ago (only names starting with A-M unforunately... can't seem to find the other batches for some reason). So if you just need a bunch of names... take a look at these csv's: http://services.runescape.com/m=forum/forums.ws?254,255,385,65452510

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8346593
Share on other sites

Link to post
Share on other sites

1 minute ago, elpiop said:

Ah. Well, I can't really offer much more help. Not entirely sure how you could get the full list of display names.

 

However... if you just need a list of names that were once in use (potentially in use now if someone took the name), this forum thread has a list of hundreds of thousands of names that were cleared up a few years ago (only ones A-M unforunately... can't seem to find the other batches for some reason). So if you just need a bunch of names... take a look at these csv's: http://services.runescape.com/m=forum/forums.ws?254,255,385,65452510

Thanks a lot, i appreciate it.

Link to comment
https://linustechtips.com/topic/648934-should-be-easy-answer/#findComment-8346597
Share on other sites

Link to post
Share on other sites

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

×