large file size problem.

H. Kim · 13th June 2006, 12:27

I got a error message.

File: "Resource.svs" [compress]Error: add_db_data() - compress() failed(input/output error [-4])

condition was
SetCompressor lzma
The file size of Resource.svs was 1.9GB.

Is there a way to figure out?

BashLogic · 13th June 2006, 12:43

dont know whether you could exceed that figure,
its common to have the 2gb limit at least with some binaries on some systems..try packaging the data separatly and call it from your nsis installer.

JasonFriday13 · 13th June 2006, 21:40

I always try to compare using bytes, because then it gives me an "exact" value to work from. Two files may be 2MB, but one has 2094152 bytes, and the other has 2111152 bytes.

If there are any other big files in the installer, then it will give a compress error.

Hello1024 · 7th January 2007, 13:21

sorry to bring back this old topic, but has anyone had any success with large files. I'm trying to use the LZMA compressor to compress a 10 GB file, but I know most of the file is empty space and it will compress down to 600MB.

Problem is I've started it compressing, and 8 hours later it's still going, with no indication of how long it will take. It seems it's trying to load the entire file into memory, and therefore the system is doing a lot of swapping, and I think it's going very slowly.

EDIT: I tried using the zli compressor, and whenever I give it a file igger then 705MB, it seems to just truncate it - I'll report ack the exact size that it truncates to when I get there.

PS. No guesses which key on my keyoard isn't working!

kichik · 11th January 2007, 19:59

It's not yet possible. You'll have to use an external archive tool.

Hello1024 · 11th January 2007, 20:32

thanks for your reply.

have you any ideas when you might be planning to implement large files support - are we talking months, years, or never?

kichik · 11th January 2007, 20:41

No idea.

superchi · 21st May 2010, 12:36

It's been a while. Anyway we can support large files (> 2GB) within the installation package? Accepting donations to support this?

Wizou · 21st May 2010, 13:06

You can add a Feature Request in sourceforge project (if there is not already one for this).

With the release of a Unicode version of NSIS coming close (which, when enabled, will require target computer to have Windows 2000 or more recent), maybe we can start adding features to NSIS that could not be added previously because they required Windows 2000 and NSIS had to be compatible with every Windows.

Wizou · 21st May 2010, 13:10

Note that you can be using Windows 2000 or XP, and have a hard drive formatted as FAT32 which still limits file size to 2 GB
What should NSIS do in this case?!
As a general rule, if you plan your application to be used on various systems, you should not use files that are > 2GB

Animaether · 21st May 2010, 14:41

Indeed.. even a very large software vendor (Autodesk) splits their full downloadable installers into 2GB chunks of a self-extracting archive, which extracts to the actual installer(s) + support / data files.
For regular ol' media (DVD, Blu-Ray, USB) you typically wouldn't bother packing all the files into the installer either.. far too inefficient.

13th June 2006, 12:27	#1
H. Kim Junior Member Join Date: Jun 2006 Posts: 1	large file size problem. I got a error message. File: "Resource.svs" [compress]Error: add_db_data() - compress() failed(input/output error [-4]) condition was SetCompressor lzma The file size of Resource.svs was 1.9GB. Is there a way to figure out?

13th June 2006, 21:40	#3
JasonFriday13 Major Dude Join Date: May 2005 Location: New Zealand Posts: 916	I always try to compare using bytes, because then it gives me an "exact" value to work from. Two files may be 2MB, but one has 2094152 bytes, and the other has 2111152 bytes. If there are any other big files in the installer, then it will give a compress error. "Only a MouseHelmet will save you from a MouseTrap" -Jason Ross (Me) NSIS 3 POSIX Ninja Wiki Profile

7th January 2007, 13:21	#4
Hello1024 Junior Member Join Date: Jan 2007 Posts: 9	sorry to bring back this old topic, but has anyone had any success with large files. I'm trying to use the LZMA compressor to compress a 10 GB file, but I know most of the file is empty space and it will compress down to 600MB. Problem is I've started it compressing, and 8 hours later it's still going, with no indication of how long it will take. It seems it's trying to load the entire file into memory, and therefore the system is doing a lot of swapping, and I think it's going very slowly. EDIT: I tried using the zli compressor, and whenever I give it a file igger then 705MB, it seems to just truncate it - I'll report ack the exact size that it truncates to when I get there. PS. No guesses which key on my keyoard isn't working! Last edited by Hello1024; 7th January 2007 at 14:35.

11th January 2007, 19:59	#5
kichik M.I.A. [NSIS Dev, Mod] Join Date: Oct 2001 Location: Israel Posts: 11,343	It's not yet possible. You'll have to use an external archive tool. NSIS FAQ \| NSIS Home Page \| Donate $ "I hear and I forget. I see and I remember. I do and I understand." -- Confucius

11th January 2007, 20:41	#7
kichik M.I.A. [NSIS Dev, Mod] Join Date: Oct 2001 Location: Israel Posts: 11,343	No idea. NSIS FAQ \| NSIS Home Page \| Donate $ "I hear and I forget. I see and I remember. I do and I understand." -- Confucius

13th June 2006, 12:43	#2
BashLogic Junior Member Join Date: Jun 2006 Posts: 8	dont know whether you could exceed that figure, its common to have the 2gb limit at least with some binaries on some systems..try packaging the data separatly and call it from your nsis installer.

11th January 2007, 20:32	#6
Hello1024 Junior Member Join Date: Jan 2007 Posts: 9	thanks for your reply. have you any ideas when you might be planning to implement large files support - are we talking months, years, or never?

21st May 2010, 12:36	#8
superchi Junior Member Join Date: May 2010 Posts: 1	Also would like this feature It's been a while. Anyway we can support large files (> 2GB) within the installation package? Accepting donations to support this?

21st May 2010, 13:06	#9
Wizou Senior Member Join Date: Aug 2007 Location: Paris, France Posts: 304	You can add a Feature Request in sourceforge project (if there is not already one for this). With the release of a Unicode version of NSIS coming close (which, when enabled, will require target computer to have Windows 2000 or more recent), maybe we can start adding features to NSIS that could not be added previously because they required Windows 2000 and NSIS had to be compatible with every Windows. My NSIS plug-ins: http://wiz0u.free.fr/prog/nsis.php

21st May 2010, 13:10	#10
Wizou Senior Member Join Date: Aug 2007 Location: Paris, France Posts: 304	Note that you can be using Windows 2000 or XP, and have a hard drive formatted as FAT32 which still limits file size to 2 GB What should NSIS do in this case?! As a general rule, if you plan your application to be used on various systems, you should not use files that are > 2GB My NSIS plug-ins: http://wiz0u.free.fr/prog/nsis.php

21st May 2010, 14:41	#11
Animaether Major Dude Join Date: Jun 2001 Posts: 1,173	Indeed.. even a very large software vendor (Autodesk) splits their full downloadable installers into 2GB chunks of a self-extracting archive, which extracts to the actual installer(s) + support / data files. For regular ol' media (DVD, Blu-Ray, USB) you typically wouldn't bother packing all the files into the installer either.. far too inefficient.

Thread Tools	Search this Thread
Show Printable Version Email this Page	Search this Thread: Advanced Search
Display Modes
Switch to Linear Mode Hybrid Mode Switch to Threaded Mode