Program that can open LARGE .XML files

[DoubleY]

So... I downloaded Wikipedia in the form of a .XML file. It's around 40GB... I can't view the file because Notepad says it's too big. and MSFT word doesn't allow files larger than 512MB

[AMICLG]

Try notepad++ or directly into browser.

[xXxYOLOxSWAGxXx_420BlazeIt]

vi, pico, netbeans, emacs

 

You will need enough RAM to open it though.

[DoubleY]

vi, pico, netbeans, emacs

 

You will need enough RAM to open it though.

Do you think 16GB will be enough? Now I'm worried...

 

Try notepad++ or directly into browser.

I forgot to get that when I re-installed Windows. I will have to get it again 

 

EDIT: File too big

[xXxYOLOxSWAGxXx_420BlazeIt]

Try notepad++ or directly into browser.

FireFox and Chrome are both 32bit programs. They wont be able to address more than 32^2 bits of memory.

 

Notepad++ from my experience doesnt cope with large files very well.

[xXxYOLOxSWAGxXx_420BlazeIt]

Do you think 16GB will be enough? Now I'm worried...

 

I forgot to get that when I re-installed Windows. I will have to get it again 

 

EDIT: File too big

No, you will need 40GB. If you have enough swap space it might work, but you will notice that your programs will be very slow. 

[Hoppa]

Try microsoft visual studio.

But yeah you probs need 40gb of ram, unless it can somehow load off the hdd

[DoubleY]

Try microsoft visual studio.

But yeah you probs need 40gb of ram, unless it can somehow load off the hdd

It's 32-bit 

 

I don't think a 32-bit program can hold that much info in memory 

[Hoppa]

It's 32-bit 

 

I don't think a 32-bit program can hold that much info in memory 

Say waaaat I thought there was a 64 bit version.

My bad.

[DoubleY]

Say waaaat I thought there was a 64 bit version.

My bad.

Actually, there is:

 

It was released TODAY though should I still get it? It's free anyway for me at least 

[Hoppa]

Actually, there is:

 

It was released TODAY though should I still get it? It's free anyway for me at least 

ROFL haha yeah might as well

Was going to suggest this as well: http://www.swiftgear.com/ltfviewer/features.html

[DoubleY]

ROFL haha yeah might as well

Was going to suggest this as well: http://www.swiftgear.com/ltfviewer/features.html

According to that page, it can't open files larger than 1GB  

[xXxYOLOxSWAGxXx_420BlazeIt]

According to that page, it can't open files larger than 1GB

>1GB means greater than 1GB.

 

Why are you even wanting to open it? Those dumps are used for archiving the data, rather than for a human to read.

[DoubleY]

>1GB means greater than 1GB.

 

Why are you even wanting to open it? Those dumps are used for archiving the data, rather than for a human to read.

Oops...

 

I don't even have a reason to open it. I just want to for the lolz 

[Ciccioo]

excel?

[DoubleY]

excel?

Lol wut.

 

Excel won't even open that file type (at least my version doesn't) 

[Ciccioo]

Lol wut.

 

Excel won't even open that file type (at least my version doesn't) 

i only tried opening XMLs on excel 2010, it does work, and it can try to organize data so that it makes some kind of sense

 

anyway you could just split the file into little files, like you could take apart the first 1MB and see what's in there

then, if you like what you saw, you check the 2nd MB and so on

[MangoJuiceStain]

Wordpad

[doubley_m]

Actually, there is:

 

It was released TODAY though should I still get it? It's free anyway for me at least 

 

...I don't think you'll be opening too many XML files with Team Foundation Server lol...

[xXxYOLOxSWAGxXx_420BlazeIt]

i only tried opening XMLs on excel 2010, it does work, and it can try to organize data so that it makes some kind of sense

 

anyway you could just split the file into little files, like you could take apart the first 1MB and see what's in there

then, if you like what you saw, you check the 2nd MB and so on

Pointless.

 

Oops...

 

I don't even have a reason to open it. I just want to for the lolz 

There is a command on Linux called "cat". It will print any file to the terminal. Download the GNU core utils for Windows and use that along with "more" and "less"

[Blackterror25]

Try netbeans

[Ciccioo]

Pointless.

-blah blah-

pointless?

1. he wants to read it, and that way he can read it, so it's obviously not pointless

2. your approach is a way to do the exact same bloody thing i said, just within a terminal for the joy of not having syntax highlight

congrats swag

[xXxYOLOxSWAGxXx_420BlazeIt]

pointless?

1. he wants to read it, and that way he can read it, so it's obviously not pointless

2. your approach is a way to do the exact same bloody thing i said, just within a terminal for the joy of not having syntax highlight

congrats swag

It doesnt do the exact same thing at all.

 

It is the proper way to do it. Splitting it by a number of bytes is just stupid. Also, syntax highlighting isnt going to be of much use when he is splitting the file by a arbitrary number of bytes.

[Altecice]

Wont work. You don't have 40GB of RAM and I doubt the MM layer of the OS can cope with 30+GB of page files to swap to Virtual RAM.

[rashdanml]

Probably way more effort than it's worth. 

 

If you have access to a web server with MySQL and Phpmyadmin, you may be able to import the XML file as a MySQL DB (I vaguely remember this being possible, haven't used Phpmyadmin in ages), then use some code to display the database as paged results, then go through the results. You may also be able to split the database via Phpmyadmin into multiple separate databases (using some basic queries), then export each one individually as smaller XML files. 

 

But, effort. 

 

e: Querying a 40GB database might be problematic; most large databases (including large forums) are nowhere close to the 40GB mark.