-
New options & improvements
- Mksquashfs/Sqfstar: new -numeric-owner option which uses the numeric uid and gid in the tarfile rather than the user name or the group name.
- Error messages produced by the date command and symbolic mode parser printed by the pager rather than to stderr.
-
Major bug fixes
- Fix possible corruption of Squashfs filesystems if sparse files present (caused by elimination of "fragment block stall" in 4.7).
- Fix pseudo file f/F definition (create file from output of command) when input has greater than a block of contiguous zeros (caused by sparse file reading optimisation in 4.7.3).
- Fix issue where files which are larger than available buffer space will not be found to be a duplicate (caused by elimination of "fragment block stall" in 4.7).
- Fix broken Mksquashfs -max-depth option.
-
Minor bug fixes
- Mksquashfs: segmentation fault if no sources and pseudo file root ("/") definition only defines an Xattr but no metadata.
- Mksquashfs/Sqfstar: -offset should be rejected if -stream option used.
- Mksquashfs: hard links to symbolic links may be ignored (first access to symbolic link after creation).
- Pseudo files: a M (modify with timestamp) definition on a directory causes pseudo file definitions below it in hierarchy to be ignored.
- Pseudo files: a m/M modify definition breaks checks that a directory exists and it is a directory (rather than something else).
- Mksquashfs: -max-depth option marks empty directories as having excluded files.
- Mksquashfs/Sqfstar should produce identical output with only pseudo files.
- Define SEEK_DATA if not defined by C library.
- Fix regression introduced by SEEK_DATA optimisation
- Fix regression introduced by -stream option
- Fix build on big-endian machines (Daniel Néri)
4.7.3 (05 NOV 2025): Mksquashfs streaming output, optimised reading of Sparse files using SEEK_DATA, new aligned action, documentation formatted in markdown.
-
Mksquashfs/Sqfstar can now stream output filesystem to STDOUT.
- New -stream option which directs filesystem to STDOUT. This can be used to send the output of Mksquashfs to another computer via ssh, where there isn't enough disk space on the host computer.
- New -fix option to fix-up the streamed filesystem. The streamed filesystem will have the super-block written to the end of the filesystem. The -fix option writes the super-block to the usual start of the filesystem.
- Unsquashfs has been extended to recognise a streamed filesystem with the super-block at the end.
-
Reading of sparse files has been optimised
- If the filesystem supports the SEEK_DATA lseek operation, this is used to skip holes when reading sparse files. This can produce a 240 times speed improvement.
- Holes which are multiple Squashfs data blocks in size are now handled as large multi-block sparse regions, which further speed up sparse file handling. This can produce a six times speed improvement (in total 1500 times).
-
New Align(value) action, which will align file to <value>
- Any file which matches test operator(s) will be aligned to <value> byte boundary, where <value> is a pure power of two and 64 Megabytes or less.
- Any file which has an alignment applied will be separately compressed and not packed into a fragment block.
-
Squashfs tools documentation has been formatted in GitHub markdown
- New CHANGES.md changelog file
- New 4.7.3 README.md
- New USAGE.md, USAGE-MKSQUASHFS.md, USAGE-UNSQUASHFS.md, USAGE-SQFSTAR.md and USAGE-SQFSCAT.md
- print_pager: make inline quoted_bs_char() static.
- Fix regression in -offset (-o) where it stopped working in Mksquashfs and Sqfstar.
- Allow arguments (spaces) in the PAGER environment variable, rather than just a command name. Also support quoted strings, string concatenation and backslashes.
- Don't use a pager to display the help text if the PAGER environment variable is empty.
- Add -no-pager option which if specified means a pager won't be used to display the help text.
- Add -cols option which specifies the number of columns used to display the help text. This is useful if output is not to a terminal.
- Fix regression in tar file reading, where file exclusion would leak cache (memory) leading in some cases to Sqfstar hanging.
- Handle negative dates in tar files (before the start of the epoch of 1970-01-01), and round them up to the start of the epoch.
- Add --version spelling in addition to -version, as this appears to be a common mistake.
- Add missing include files in print_pager.c (Ros Burton).
- Add missing include file in thread.c (Shiji Yang).
- Fix BLOCK_READER_THREADS typo in Makefile (Alexandru Ardelean).
4.7 (03 JUN 2025): Parallel file reading, new help system, new reproducible filesystem image options, removal of "fragment block stall"
-
Mksquashfs now reads files in parallel from the input directories
- This can significantly increase I/O when reading lots of small files, and/or the input media benefits from parallel reading e.g. modern SSD drives, or network filesystems etc.
- In cases where speed of I/O is the bottleneck in Mksquashfs, this can make Mksquashfs run significantly faster, in some cases Mksquashfs can be more than ten times faster.
- New -small-readers option to specify number of parallel small file reader threads (files less than a block size). Default 4 threads.
- New -block-readers option to specify number of parallel block reader threads (files one block or larger). Default 4 threads.
- New -single-reader option to specify a single reader thread, similar to previous Mksquashfs versions.
-
Rewritten and improved help system (Mksquashfs/Unsquashfs)
- Help text now uses the full width of the terminal (rather than being pre-formatted to 80 columns).
- The help text is now automatically paged (using pager, less or more).
- The tools now print a summary on failure to parse the command line (or encountering other errors that prevent the tool from running), rather than displaying the help text.
- The help text can be displayed in full, by section, or by option using regex matching.
- New -help-all option to display all help text
- New -help-section option to display help for a particular section
- New -help-option to display all options matching regex.
- New -help-comp option to display compressor options for given compressor.
-
New options for building reproducible filesystems (Mksquash/Sqfstar)
-
Low level timestamp setting options extended:
- -mkfs-time inode sets filesystem creation time to the latest inode timestamp
- -inode-time inode sets all inode timestamps to the latest inode timestamp
- -root-time inode sets the root directory timestamp to the latest inode timestamp
-
New easier to remember shorthand options
- -repro builds a reproducible filesystem image, it is shorthand for -mkfs-time inode.
- -repro-time <time> builds a reproducible image, it is shorthand for specifying -mkfs-time <time> and -inode-time <time>.
-
-
Elimination of "fragment block stall" and -(not-)reproducible options
A technical issue called "the fragment block stall" has been eliminated in this release in a way that generates a reproducible ordering of files in the filesystem image. This can increase performance by 20% or more, in addition to the parallel reader performance improvements.
This "fragment block stall" was introduced in release 4.4 (2019) to produce a reproducible ordering of files in the filesystem, but which led to a reduction in parallelisation and performance. Due to this reduction, the previous behaviour was retained and enabled using the -not-reproducible option. As the "fragment block stall" has now been removed, the options -not-reproducible and -reproducible now do nothing, but are still recognised for backwards compatibility.
-
Other improvements for Mksquashfs/Sqfstar
- New -force-file-mode option, which sets all file (non-directory) permissions to the given mode.
- New -force-dir-mode option, which sets all directory permissions to the given mode.
- -root-mode and above new -force-file-mode/-force-dir-mode options now take a symbolic mode in addition to an octal mode.
- New -info-file option, which prints files written to the filesystem to a file rather than stdout. Allows -info-file to be used in conjunction with the progress bar.
- New -pseudo-dir (or -pd) option which supplies a default directory if any directories in a pseudo file definition pathname doesn't exist.
- New pseudo file 'h' definition which creates a hard link to a file, and follows symbolic links.
- Previously if a directory was missing (or not a directory) in a Pseudo file definition pathname, the pseudo file definition would be ignored. This has been hardened to a fatal error.
-
Other improvements for Unsquashfs/Sqfscat
- New -mem option, which sets the amount of memory to be used, K, M and G can be used to specify Kbytes, Mbytes and Gbytes.
- New -mem-percent option, which sets the amount of memory to be used as percentage of available physical memory.
- Memory specified is limited to 75% of physical memory or less.
-
New environment variable SQFS_CMDLINE (Mksquashfs/Unsquashfs)
If set, this is used as the directory to write the file sqfs_cmdline which contains the command line arguments given to Mksquashfs etc. Intended to be used to debug scripts/discover what is being passed to Mksquashfs.
- Race condition which can cause corruption of the "fragment table" fixed. This is a regression introduced in August 2022, and it has been seen when tailend packing is used (-tailends option).
- Fix build failure when the tools are being built without extended attribute (XATTRs) support.
- Fix XATTR error message when an unrecognised prefix is found (Christian Hesse).
- Fix incorrect free of pointer when an unrecognised XATTR prefix is found.
4.6 (17 MAR 2023): Major improvements in extended attribute handling, pseudo file handling, and miscellaneous new options and improvements
-
Extended attribute handling improved in Mksquashfs and Sqfstar
- New -xattrs-exclude option to exclude extended attributes from files using a regular expression.
- New -xattrs-include option to include extended attributes from files using a regular expression.
- New -xattrs-add option to add extended attributes to files.
- New Pseudo file xattr definition to add extended attributes to files.
- New xattrs-add Action to add extended attributes to files (Mksquashfs only).
-
Extended attribute handling improved in Unsquashfs
- New -xattrs-exclude option to exclude extended attributes from files using a regular expression.
- New -xattrs-include option to include extended attributes from files using a regular expression.
- Extended attributes are now supported in Pseudo file output.
-
Other major improvements
- Unsquashfs can now output Pseudo files to standard out.
- Mksquashfs can now input Pseudo files from standard in.
- Squashfs filesystems can now be converted (different block size compression etc) without unpacking to an intermediate filesystem or mounting, by piping the output of Unsquashfs to Mksquashfs.
- Pseudo files are now supported by Sqfstar.
- "Non-anchored" excludes are now supported by Unsquashfs.
-
Mksquashfs minor improvements
- A new -max-depth option has been added, which limits the depth Mksquashfs descends when creating the filesystem.
- A new -mem-percent option which allows memory for caches to be specified as a percentage of physical RAM, rather than requiring an absolute value.
- A new -percentage option added which rather than generating the full progress-bar instead outputs a percentage. This can be used with dialog --gauge etc.
- -mkfs-time, -all-time and -root-time options now take a human date string, in addition to the seconds since the epoch of 1970 00:00 UTC. For example "now", "last week", "Wed Mar 8 05:55:01 GMT 2023" are supported.
- -root-uid, -root-gid, -force-uid and -force-gid options now take a user/group name in addition to the integer uid/gid.
- A new -mem-default option which displays default memory usage for caches in Mbytes.
- A new -no-compression option which produces no compression, and it is a short-cut for -noI, -noD, -noF and -noX.
- A new -pseudo-override option which makes pseudo file uids and gids override -all-root, -force-uid and -force-gid options. Normally these options take precedence.
-
Unsquashfs minor improvements
- New -all-time option which sets all file timestamps to <time>, rather than the time stored in the filesystem inode. <time> can be an integer indicating seconds since the epoch (1970-01-01) or a human string value such as "now", "last week", or "Wed Feb 15 21:02:39 GMT 2023".
- New -full-precision option which uses full precision when displaying times including seconds. Use with -linfo, -lls, -lln and -llc options.
- New -match option where Unsquashfs will abort if any extract file does not match on anything, and can not be resolved.
- New -percentage option added which rather than generating the full progress-bar instead outputs a percentage. This can be used with dialog --gauge etc.
-
Sqfstar minor improvements
- A new -ignore-zeros option added which allows tar files to be concatenated together and fed to Sqfstar. Normally a tarfile has two consecutive 512 byte blocks filled with zeros which means EOF and Sqfstar will stop reading after the first tar file on encountering them. This option makes Sqfstar ignore the zero filled blocks.
- A new -mem-percent option which allows memory for caches to be specified as a percentage of physical RAM, rather than requiring an absolute value.
- A new -percentage option added which rather than generating the full progress-bar instead outputs a percentage. This can be used with dialog --gauge etc.
- -mkfs-time, -all-time and -root-time options now take a human date string, in addition to the seconds since the epoch of 1970 00:00 UTC. For example "now", "last week", "Wed Mar 8 05:55:01 GMT 2023" are supported.
- -root-uid, -root-gid, -force-uid and -force-gid options now take a user/group name in addition to the integer uid/gid.
- A new -mem-default option which displays default memory usage for caches in Mbytes.
- A new -no-compression option which produces no compression, and it is a short-cut for -noI, -noD, -noF and -noX.
- A new -pseudo-override option which makes pseudo file uids and gids override -all-root, -force-uid and -force-gid options. Normally these options take precedence.
- Do not abort if ZERO filled blocks indicating end of the TAR archive are missing.
-
Other minor improvements
- If Mksquashfs/Unsquashfs fails to execute generating the manpages because they have been cross-compiled, fall back to using the pre-built manpages.
- Add new Makefile configure option USE_PREBUILT_MANPAGES to always use pre-built manpages rather than generating them when "make install" is run.
-
Major bug fixes
- Following a symlink in Sqfscat or where -follow-symlinks option is given with Unsquashfs, incorrectly triggered the corrupted filesystem loop detection code.
- In Unsquashfs if a file was not writable it could not add extended attributes to it.
- Sqfstar would incorrectly reject compressor specific options that have an argument.
- Sqfstar would incorrectly strip pathname components in PAX header linkpath if symbolic.
- Sqfstar -root-uid, -root-gid and -root-time options were documented but not implemented.
- Mksquashfs -one-file-system option would not create empty mount point directory when filesystem boundary crossed.
- Mksquashfs did not check the close() return result.
-
Major improvements
- This release adds Manpages for Mksquashfs(1), Unsquashfs(1), Sqfstar(1) and Sqfscat(1).
- The -help text output from the utilities has been improved and extended as well (but the Manpages are now more comprehensive).
- CVE-2021-41072 which is a writing outside of destination exploit, has been fixed.
-
Minor improvements
- The number of hard-links in the filesystem is now also displayed by Mksquashfs in the output summary.
- The number of hard-links written by Unsquashfs is now also displayed in the output summary.
- Unsquashfs will now write to a pre-existing destination directory, rather than aborting.
- Unsquashfs now allows "." to used as the destination, to extract to the current directory.
- The Unsquashfs progress bar now tracks empty files and hardlinks, in addition to data blocks.
- -no-hardlinks option has been implemented for Sqfstar.
- More sanity checking for "corrupted" filesystems, including checks for multiply linked directories and directory loops.
- Options that may cause filesystems to be unmountable have been moved into a new "experts" category in the Mksquashfs help text (and Manpage).
-
Bug fixes
- Maximum cpiostyle filename limited to PATH_MAX. This prevents attempts to overflow the stack, or cause system calls to fail with a too long pathname.
- Don't always use "max open file limit" when calculating length of queues, as a very large file limit can cause Unsquashfs to abort. Instead use the smaller of max open file limit and cache size.
- Fix Mksquashfs silently ignoring Pseudo file definitions when appending.
- Don't abort if no XATTR support has been built in, and there's XATTRs in the filesystem. This is a regression introduced in 2019 in Version 4.4.
- Fix duplicate check when the last file block is sparse.
4.5 (22 JUL 2021): Major improvements including: Actions, Sqfstar, tar and cpio style reading of input sources, Sqfscat
-
Mksquashfs improvements
- Mksquashfs now supports "Actions". These are modelled on "find" and allow compression, fragment packing, file exclusion and file attributes to be changed.
- New sqfstar command which will create a Squashfs image from a tar archive.
- Tar style handling of source pathnames in Mksquashfs.
- Cpio style handling of source pathnames in Mksquashfs.
- New option to throttle the amount of CPU and I/O.
- New Pseudo file definitions which support timestamps.
- New Pseudo file definitions to create File references.
- New Pseudo file definitions to create Sockets/Fifos.
- Mksquashfs now allows no source directory to be specified.
- New Pseudo file "R" definition which allows a Regular file to be created with data stored within the Pseudo file.
-
Major improvements in Unsquashfs
- Sqfscat command which outputs files to stdout.
- Symbolic links are now followed in extract files (using -follow-symlinks or -missing-symlinks).
- Unsquashfs now supports "exclude" files.
- Max depth traversal option added.
- Unsquashfs can now output a "Pseudo file" representing the input Squashfs filesystem.
-
Minor improvements and bug fixes
- The progress bar is now displayed and updated whilst the input is being scanned.
- New -one-file-system option in Mksquashfs.
- New -no-hardlinks option in Mksquashfs.
- New -help options in Mksquashfs and Unsquashfs which output to standard out.
- New -root-uid option in Mksquashfs.
- New -root-gid option in Mksquashfs.
- New -root-time option in Mksquashfs.
- -no-exit-code option added to Unsquashfs which makes it not output an error exit code.
- Exit code in Unsquashfs changed to distinguish between non-fatal errors (exit 2), and fatal errors (exit 1).
- Mksquashfs when appending, now writes the recovery file to the home directory, rather than the current directory.
- New -recovery-path <name> option.
- Xattr id count added in Unsquashfs "-stat" output.
- Unsquashfs "write outside directory" exploit fixed.
- Error handling in Unsquashfs writer thread fixed. 15.Fix failure to truncate destination if appending aborted.
- Prevent Mksquashfs reading the destination file.
4.4 (29 AUG 2019): Reproducible builds, new compressors, CVE fixes, security hardening and new options for Mksquashfs/Unsquashfs.
-
Overall improvements:
- Mksquashfs now generates reproducible images by default.
- Mkfs time and file timestamps can also be specified.
- Support for the Zstandard (ZSTD) compression algorithm.
- CVE-2015-4645 and CVE-2015-4646 have been fixed.
-
Mksquashfs improvements and major bug fixes:
- Pseudo files now support symbolic links.
- New -mkfs-time option.
- New -all-time option.
- New -root-mode option.
- New -quiet option.
- New -noId option.
- New -offset option.
- Update lz4 wrapper to use new functions introduced in 1.7.0.
- Bug fix, don't allow "/" pseudo filenames.
- Bug fix, allow quoting of pseudo files, to better handle filenames with spaces.
- Fix compilation with glibc 2.25+.
-
Unsquashfs improvements and major bug fixes:
- CVE-2015-4645 and CVE-2015-4646 have been fixed.
- Unsquashfs has been further hardened against corrupted filestems.
- Unsquashfs is now more strict about error handling.
- New -ignore-errors option.
- New -strict-errors option.
- New -lln[umeric] option.
- New -lc option.
- New -llc option.
- New -mkfs-time option.
- New -UTC option.
- New -offset option.
- New -quiet option.
- Update lz4 wrapper to use new functions introduced in 1.7.0.
- Bug fix, fatal and non-fatal errors now set the exit code to 1.
- Bug fix, fix time setting for symlinks.
- Bug fix, try to set sticky-bit when running as a user process.
- Fix compilation with glibc 2.25+.
4.3 (12 MAY 2014): New compressor options, new Mksquashfs/Unsquashfs functionality, duplicate checking optimisations, stability improvements (option/file parsing, buffer/memory overflow checks, filesystem hardening on corrupted filesystems), CVE fixes.
-
Stability improvements. Better checking of user input for out of range/invalid values. Better handling of corrupted Squashfs filesystems (Mksquashfs append mode, and Unsquashfs). Better handling of buffer overflow/underflow.
-
GZIP compressor now supports compression options, allowing different compression levels to be used.
-
Rewritten LZO compressor with compression options, allowing different LZO algorithms and different compression levels to be used.
-
New LZ4 compressor (note not yet in mainline kernel)
-
Better default memory usage for Mksquashfs. Mksquashfs by default now uses 25% of physical memory.
-
Duplicate checking in Mksquashfs further optimised. With certain "problem filesystems" greater than 2x performance improvement. Filesystems with a lot of duplicates should see at least 10-20% speed improvement.
-
The -stat option in Unsquashfs now displays the compression options used to generate the original filesystem. Previously -stat only displayed the compression algorithm used.
-
The file being compressed/uncompressed in Mksquashfs/Unsquashfs is now displayed if CTRL-\ (SIGQUIT from keyboard) typed.
-
The status of the internal queues/caches in Mksquashfs/Unsquashfs is now displayed if CTRL-\ (SIGQUIT from keyboard) is typed twice within one second. Normally only useful for "power users", but it can be used to discover if there's any bottlenecks affecting performance (the bottleneck will normally be the compressors/fragment compressors).
-
Miscellaneous new options for Mksquashfs/Unsquashfs to fine tune behaviour.
-
Fixes for CVE-2012-4024 and CVE-2012-4025.
-
Filesystem improvements:
- Added XZ compression
- Added compression options support
-
Miscellaneous improvements/bug fixes
- Add missing NO_XATTR filesystem flag to indicate no-xattrs option was specified and no xattrs should be stored when appending.
- Add suppport in Unquashfs -stat option for displaying NO_XATTR flag.
- Remove checkdata entry from Unsquashfs -stat option if a 4.0 filesystem - checkdata is no longer supported.
- Fix appending bug when appending to an empty filesystem - this would be incorrectly treated as an error.
- Use glibc sys/xattr.h include rather than using attr/xattr.h which isn't present by default on some distributions.
- Unsquashfs, fix block calculation error with regular files when file size is between 2^32-block_size+1 and 2^32-1.
- Unsquashfs, fix sparse file writing when holes are larger than 2^31-1.
- Add external CFLAGS and LDFLAGS support to Makefile, and allow build options to be specified on command line. Also don't over-write passed in CFLAGS definition.
-
Filesystem improvements:
- Extended attribute support
- New compression framework
- Support for LZO compression
- Support for LZMA compression (not yet in mainline)
-
Mksquashfs improvements:
- Enhanced pseudo file support
- New options for choosing compression algorithm used
- New options for controlling extended attributes
- Fix misalignment issues with memcpy etc. seen on ARM
- Fix floating point error in progress_bar when max == 0
- Removed use of get_nproc() call unavailable in ulibc
- Reorganised help text
-
Unsquashfs improvements:
- New options for controlling extended attributes
- Fix misalignment issues with memcpy etc. seen on ARM
- Fix floating point error in progress_bar when max == 0
- Removed use of get_nproc() call unavailable in ulibc
-
Kernel code improvements:
- Fixed little endian layout adopted. All swapping macros removed, and in-line swapping added for big-endian architectures.
- Kernel code substantially improved and restructured.
- Kernel code split into separate files along functional lines.
- Vmalloc usage removed, and code changed to use separately allocated 4K buffers
-
Unsquashfs improvements:
- Support for 4.0 filesystems added.
- Swapping macros rewritten.
- Unsquashfs code restructured and split into separate files.
-
Mksquashfs improvements:
- Swapping macros rewritten. Fixed little-endian layout allows code to be optimised and only added at compile time for big endian systems.
- Support for pseudo files added.
3.4 (26 AUG 2008): Performance improvements to Unsquashfs, Mksquashfs and the kernel code. Plus many small bug fixes.
-
Kernel code improvements:
- Internal Squashfs kernel metadata and fragment cache implementations have been merged and optimised. Spinlocks are now used, locks are held for smaller periods and wakeups have been minimised. Small race condition fixed where if two or more processes tried to read the same cache block simultaneously they would both read and decompress it. 10-20%+ speed improvement has been seen on tests.
- NFS export code rewritten following VFS changes in linux-2.6.24.
- New patches for linux-2.6.25, linux-2.6.26, and linux-2.6.27. Fixed patch for linux-2.6.24.
- Fixed small buffer_head leak in squashfs_read_data when handling badly corrupted filesystems.
- Fixed bug in get_dir_index_using_offset.
-
Unsquashfs improvements:
- Unsquashfs has been parallelised. Filesystem reading, writing and decompression is now multi-threaded. Up to 40% speed improvement seen on tests.
- Unsquashfs now has a progress bar. Use -no-progress to disable it.
- Fixed small bug where unistd.h wasn't being included on some distributions, leading to lseek being used rather than lseek64 - which meant on these distributions Unsquashfs couldn't unsquash filesystems larger than 4GB.
-
Mksquashfs improvements:
- Removed some small remaining parallelisation bottlenecks. Depending on source filesystem, up to 10%+ speed improvement.
- Progress bar improved, and moved to separate thread.
- Sparse file handling bug in Mksquashfs 3.3 fixed.
- Two rare appending restore bugs fixed (when ^C hit twice).
3.3 (1 NOV 2007): Increase in block size, sparse file support, Mksquashfs and Unsquashfs extended to use pattern matching in exclude/extract files, plus many more improvements and bug fixes.
-
Filesystem improvements:
- Maximum block size has been increased to 1Mbyte, and the default block size has been increased to 128 Kbytes. This improves compression.
- Sparse files are now supported. Sparse files are files which have large areas of unallocated data commonly called holes. These files are now detected by Squashfs and stored more efficiently. This improves compression and read performance for sparse files.
-
Mksquashfs improvements:
- Exclude files have been extended to use wildcard pattern matching and regular expressions. Support has also been added for non-anchored excludes, which means it is now possible to specify excludes which match anywhere in the filesystem (i.e. leaf files), rather than always having to specify exclude files starting from the root directory (anchored excludes).
- Recovery files are now created when appending to existing Squashfs filesystems. This allows the original filesystem to be recovered if Mksquashfs aborts unexpectedly (i.e. power failure).
-
Unsquashfs improvements:
- Multiple extract files can now be specified on the command line, and the files/directories to be extracted can now also be given in a file.
- Extract files have been extended to use wildcard pattern matching and regular expressions.
- Filename printing has been enhanced and Unquashfs can now display filenames with file attributes ('ls -l' style output).
- A -stat option has been added which displays the filesystem superblock information.
- Unsquashfs now supports 1.x filesystems.
-
Miscellaneous improvements/bug fixes:
- Squashfs kernel code improved to use SetPageError in squashfs_readpage() if I/O error occurs.
- Fixed Squashfs kernel code bug preventing file seeking beyond 2GB.
- Mksquashfs now detects file size changes between first phase directory scan and second phase filesystem create. It also deals better with file I/O errors.
- Kernel patches 2.6.19/2.6.20 have been updated to use const structures and mutexes rather than older semaphores.
- Minor SMP bug fixes.
- Progress bar broken on x86-64. Fixed.
3.2 (2 JAN 2007): NFS support, improvements to the Squashfs-tools, major bug fixes, lots of small improvements/bug fixes, and new kernel patches.
-
Improvements:
- Squashfs filesystems can now be exported via NFS.
- Unsquashfs now supports 2.x filesystems.
- Mksquashfs now displays a progress bar.
- Squashfs kernel code has been hardened against accidently or maliciously corrupted Squashfs filesystems.
-
Bug fixes:
- Race condition occurring on S390 in readpage() fixed.
- Odd behaviour of MIPS memcpy in read_data() routine worked-around.
- Missing cache_flush in Squashfs symlink_readpage() added.
A code optimisation after testing unfortunately broke sorting in Mksquashfs. This has been fixed.
3.1 (19 AUG 2006): This release has some major improvements to the squashfs-tools, a couple of major bug fixes, lots of small improvements/bug fixes, and new kernel patches.
-
Mksquashfs has been rewritten to be multi-threaded. It has the following improvements
- Parallel compression. By default as many compression and fragment compression threads are created as there are available processors. This significantly speeds up performance on SMP systems.
- File input and filesystem output is peformed in parallel on separate threads to maximise I/O performance. Even on single processor systems this speeds up performance by at least 10%.
- Appending has been significantly improved, and files within the filesystem being appended to are no longer scanned and checksummed. This significantly improves append time for large filesystems.
- File duplicate checking has been optimised, and split into two separate phases. Only files which are considered possible duplicates after the first phase are checksummed and cached in memory.
- The use of swap memory was found to significantly impact performance. The amount of memory used to cache files is now a command line option, by default this is 512 Mbytes.
-
Unsquashfs has the following improvements
- Unsquashfs now allows you to specify the filename or the directory within the Squashfs filesystem that is to be extracted, rather than always extracting the entire filesystem.
- A new -force option has been added which forces Unsquashfs to output to the destination directory even if files and directories already exist in the destination directory. This allows you to update an already existing directory tree, or to Unsquashfs to a partially filled directory tree. Without the -force option Unsquashfs will refuse to output.
-
The following major bug fixes have been made
- A fragment table rounding bug has been fixed in Mksquashfs. Previously if the number of fragments in the filesystem were a multiple of 512, Mksquashfs would generate an incorrect filesystem.
- A rare SMP bug which occurred when simultaneously acccessing multiply mounted Squashfs filesystems has been fixed.
-
Miscellaneous improvements/bug fixes
- Kernel code stack usage has been reduced. This is to ensure Squashfs works with 4K stacks.
- Readdir (Squashfs kernel code) has been fixed to always return 0, rather than the number of directories read. Squashfs should now interact better with NFS.
- Lseek bug in Mksquashfs when appending to larger than 4GB filesystems fixed.
- Squashfs 2.x initrds can now been mounted.
- Unsquashfs exit status fixed.
- New patches for linux-2.6.18 and linux-2.4.33.
- Filesystems are no longer limited to 4 GB. In theory 2^64 or 4 exabytes is now supported.
- Files are no longer limited to 4 GB. In theory the maximum file size is 4 exabytes.
- Metadata (inode table and directory tables) are no longer restricted to 16 Mbytes.
- Hardlinks are now suppported.
- Nlink counts are now supported.
- Readdir now returns '.' and '..' entries.
- Special support for files larger than 256 MB has been added to the Squashfs kernel code for faster read access.
- Inode numbers are now stored within the inode rather than being computed from inode location on disk (this is not so much an improvement, but a change forced by the previously listed improvements).
2.2-r2 (8 SEP 2005): Second release of 2.2, this release fixes a couple of small bugs, a couple of small documentation mistakes, and adds a patch for kernel 2.6.13.
- Mksquashfs now deletes the output filesystem image file if an error occurs whilst generating the filesystem. Previously on error the image file was left empty or partially written.
- Updated mksquashfs so that it doesn't allow you to generate filesystems with block sizes smaller than 4K. Squashfs hasn't supported block sizes less than 4K since 2.0-alpha.
- Mksquashfs now ignores missing files/directories in sort files. This was the original behaviour before 2.2.
- Fixed small mistake in fs/Kconfig where the version was still listed as 2.0.
- Updated ACKNOWLEDGEMENTS file.
- Sort routine re-worked and debugged from release 2.1. It now allows you to give Mkisofs style sort files and checks for filenames that don't match anything. Sort priority has also been changed to conform to Mkisofs usage, highest priority files are now placed at the start of the filesystem (this means they will be on the inside of a CD or DVD).
- New Configure options for embedded systems (memory constrained systems). See INSTALL file for further details.
- Directory index bug fixed where chars were treated as signed on some architectures. A file would not be found in the rare case that the filename started with a chracter greater than 127.
- Bug introduced into the read_data() routine when sped up to use data block queueing fixed. If the second or later block resulted in an I/O error this was not checked.
- Append bug introduced in 2.1 fixed. The code to compute the new compressed and uncompressed directory parts after appending was wrong.
- Metadata block length read routine altered to not perform a misaligned short read. This was to fix reading on an ARM7 running uCLinux without a misaligned read interrupt handler.
- Checkdata bug introduced in 2.1 fixed.
In some of the code added for release 2.1 I unknowingly used some gcc extensions only supported by 3.x compilers. I have received a couple of reports that the 2.1 release doesn't build on 2.x and so people are clearly still using gcc 2.x. The code has been rewritten to remove these extensions.
2.1 (10 DEC 2004): Significantly improved directory handling plus numerous other smaller improvements
- Fast indexed directories implemented. These speed up directory operations (ls, file lookup etc.) significantly for directories larger than 8 KB.
- All directories are now sorted in alphabetical order. This again speeds up directory operations, and in some cases it also results in a small compression improvement (greater data similarity between files with alphabetically similar names).
- Maximum directory size increased from 512 KB to 128 MB.
- Duplicate fragment checking and appending optimised in mksquashfs, depending on filesystem, this is now up to 25% faster.
- Mksquashfs help information reformatted and reorganised.
- The Squashfs version and release date is now printed at kernel boot-time or module insertion. This addition will hopefully help to reduce the growing problem where the Squashfs version supported by a kernel is unknown and the kernel source is unavailable.
- New PERFORMANCE.README file.
- New -2.0 mksquashfs option.
- CHANGES file reorganised.
- README file reorganised, clarified and updated to include the 2.0 mksquashfs options.
- New patch for Linux 2.6.9.
- New patch for Linux 2.4.28.
New patch for kernel 2.6.8.1. This includes a workaround for a kernel bug introduced in 2.6.7bk14, which is present in all later versions of the kernel.
If you're using a 2.6.8 kernel or later then you must use this 2.6.8.1 patch. If you've experienced hangs or oopses using Squashfs with a 2.6.8 or later kernel then you've hit this bug, and this patch will fix it.
It is worth mentioning that this kernel bug potentially affects other filesystems. If you receive odd results with other filesystems you may be experiencing this bug with that filesystem. I submitted a patch but this has not yet gone into the kernel, hopefully the bug will be fixed in later kernels.
- New mksquashfs -all-root, -root-owned, -force-uid, and -force-gid options. These allow the uids/gids of files in the generated filesystem to be specified, overriding the uids/gids in the source filesystem.
- Initrds are now supported for kernels 2.6.x.
- amd64 bug fixes. If you use an amd64, please read the README-AMD64 file.
- Check-data and gid bug fixes. With 2.0-alpha when mounting 1.x filesystems in certain cases file gids were corrupted.
- New patch for Linux 2.6.7.
- Squashfs 2.0 has added the concept of fragment blocks. Files smaller than the file block size and optionally the remainder of files that do not fit fully into a block (i.e. the last 32K in a 96K file) are packed into shared fragments and compressed together. This achieves on average 5 - 20% better compression than Squashfs 1.x.
- The maximum block size has been increased to 64K (in the ALPHA version of Squashfs 2.0).
- The maximum number of UIDs has been increased to 256 (from 48 in 1.x).
- The maximum number of GIDs has been increased to 256 (from 15 in 1.x).
- Removal of sleep_on() function call in 2.6.x patch, to allow Squashfs to work on the Fedora rc2 kernel.
- Numerous small bug fixes have been made.
1.3r3 (18 JAN 2004): Third release of 1.3, this adds a new mksquashfs option, some bug fixes, and extra patches for new kernels
- New mksquashfs -ef exclude option. This option reads the exclude dirs/files from an exclude file, one exclude dir/file per line. This avoids the command line size limit when using the -e exclude option,
- When appending to existing filesystems, if mksquashfs experiences a fatal error (e.g. out of space when adding to the destination), the original filesystem is restored,
- Mksquashfs now builds standalone, without the kernel needing to be patched.
- Bug fix in the kernel squashfs filesystem, where the pages being filled were not kmapped. This seems to only have caused problems on an Apple G5,
- New patch for Linux 2.4.24,
- New patch for Linux 2.6.1, this replaces the patch for 2.6.0-test7.
- Bug fix in routine that adds files to the filesystem being generated in mksquashfs. This bug was introduced in 1.3 (not enough testing...) when I rewrote it to handle files larger than available memory. This bug caused a SEGV, so if you've ever got that, it is now fixed,
- Long running bug where ls -s and du reported wrong block size fixed. I'm pretty sure this used to work many kernel versions ago (2.4.7) but it broke somewhere along the line since then,
- New patch for Linux 2.4.22,
- New patch for 2.6.0-test7, this replaces the patch for 2.6.0-test1.
- FIFOs and Socket inodes are now supported,
- Mksquashfs can now compress files larger than available memory,
- File duplicate check routine optimised,
- Exit codes fixed in Mksquashfs,
- Patch for Linux 2.4.21,
- Patch for Linux 2.6.0-test1. Hopefully, this will work for the next few releases of 2.6.0-testx, otherwise, I'll be releasing a lot of updates to the 2.6.0 patch...
Mksquashfs can now add to existing squashfs filesystems. Three extra options "-noappend", "-keep-as-directory", and "root-becomes" have been added.
The append option with file duplicate detection, means squashfs can be used as a simple versioning archiving filesystem. A squashfs filesystem can be created with for example the linux-2.4.19 source. Appending the linux-2.4.20 source will create a filesystem with the two source trees, but only the changed files will take extra room, the unchanged files will be detected as duplicates.
See the README file for usage changes.
Fixed readpage deadlock bug. This was a rare deadlock bug that happened when pushing pages into the page cache when using greater than 4K blocks. I never got this bug when I tested the filesystem, but two people emailed me on the same day about the problem! I fixed it by using a page cache function that wasn't there when I originally did the work, which was nice :-)
- Kernel squashfs can now mount different byte order filesystems.
- Additional features added to mksquashfs. Mksquashfs now supports exclude files and multiple source files/directories can be specified. A nopad option has also been added, which informs mksquashfs not to pad filesystems to a multiple of 4K. See README for mksquashfs usage changes.
- Greater than 2GB filesystems bug fix. Filesystems greater than 2GB can now be created.
Fixed bugs with initrds and device nodes
- Increase zlib compression level from Z_DEFAULT_COMPRESSION (6) to max (9).
- Increase kernel metadata cache from 3 entries to 8 entries.