ZIP

From Just Solve the File Format Problem
(Difference between revisions)
Jump to: navigation, search
(Links)
(Specifications)
Line 76: Line 76:
 
* [http://rescene.wikidot.com/torrentzip TorrentZip]
 
* [http://rescene.wikidot.com/torrentzip TorrentZip]
 
* Note that in general there is [https://twitter.com/tef/status/436555938879655937 no official file name encoding for ZIP files], and non ASCII filenames [http://stackoverflow.com/questions/106367/add-non-ascii-file-names-to-zip-in-java are not generally well supported]. The original implementation specified [[CP437|IBM Code Page 437]] for filenames, but as many characters cannot be expressed in that encoding, the filename bytes have often been interpreted using the current system codepage (implementation dependent behaviour). There is a flag to specify [[UTF-8]] as the encoding, but it is not supported in all major clients (e.g. Windows Explorer).
 
* Note that in general there is [https://twitter.com/tef/status/436555938879655937 no official file name encoding for ZIP files], and non ASCII filenames [http://stackoverflow.com/questions/106367/add-non-ascii-file-names-to-zip-in-java are not generally well supported]. The original implementation specified [[CP437|IBM Code Page 437]] for filenames, but as many characters cannot be expressed in that encoding, the filename bytes have often been interpreted using the current system codepage (implementation dependent behaviour). There is a flag to specify [[UTF-8]] as the encoding, but it is not supported in all major clients (e.g. Windows Explorer).
 +
 +
== Metaformat files ==
 +
 +
* [https://www.synalysis.net/Grammars/zip.grammar Synalysis grammar file] (for Hexinator / Synalize It!; [[Synalysis grammar file|more details]])
  
 
== Software ==
 
== Software ==

Revision as of 20:01, 25 January 2015

Not to be confused with Zip disk, an unrelated disk cartridge unit.
File Format
Name ZIP
Ontology
Extension(s) .zip
MIME Type(s) application/zip
LoCFDD fdd000354, fdd000355, fdd000362, fdd000361
PRONOM x-fmt/263
UTI com.pkware.zip-archive
Released 1989

ZIP is one of the most popular file compression formats. It was created in 1989 as the native format of the PKZIP program, which was introduced by Phil Katz in the wake of a lawsuit (which he lost) against him by the makers of the then-popular ARC program (and file format) for copyright and trademark infringement in an earlier program PKARC which had been file-compatible with ARC. This resulted in Katz creating a new file format, which rapidly overtook ARC in popularity (to a large extent because of BBS sysops, then the primary users of such compression, resenting the lawsuit). Many programs have been released for a variety of operating systems to compress and decompress ZIP files, and native support for the format is built into several popular operating systems.

ZIP implementations vary in their support for features in the specification from PKWARE[1], particularly features added since version 2 (1993), some of which are protected by patents and require licensing. Many implementations limit the use of compression to the DEFLATE algorithm, introduced with version 2. Extensions incorporated into the specification that have been widely adopted are: long filenames; large files (using a technique known as ZIP64); and filenames in UTF-8. In 2011 work began on an interoperable subset of the latest APPNOTE.TXT with the intention of publication as ISO/IEC 21320-1, Document Container File -- Part 1: Core. As of November 2012, a discussion draft is available[2]. Designed to promote interoperable implementations, the draft ISO/IEC 21320-1 prohibits compression other than using DEFLATE, segmentation or multiple volumes, and features that are subject to patents.

While .zip is the usual file extension, ZIP-formatted files can be found with many other extensions since a number of other file formats use ZIP compression but store their files in application-specific extensions. See Category:ZIP based file formats for a list of such formats.

Contents

See also

Identification

The byte sequence 'P' 'K' 0x05 0x06 (the "end of central directory signature") appears somewhere in the file, usually beginning exactly 22 bytes from the end of the file. However, it will appear earlier if the file contains a "ZIP file comment" (common in the BBS era, but rare today), or for various other reasons. There seems to be no theoretical limit to how far back you may have to search for the signature, but some software limits it to around 64KB, which is the maximum length of a comment.

Most ZIP files (but not self-extracting ZIP files) happen to begin with 'P' 'K' 0x03 0x04. This is not a global file signature, but is the signature that appears once for every compressed file inside the ZIP file. Some ZIP-based formats are designed such that they necessarily begin in this way. It is legal for a ZIP file to contain zero files, and such a ZIP file would not contain this signature.

Compression

Each file in a ZIP file is compressed using one of a number of compression algorithms. Only compression types 0 (uncompressed) and 8 (DEFLATE) are likely to be seen in modern portable ZIP files. In old ZIP files, types 1 (Shrink) and 6 (Implode) are common.

Code Compression scheme Notes and references
0 Uncompressed
1 Shrink (LZW) Used by PKZIP prior to v2.0.
2–5 Reduce Used by PKZIP v0.x.
6 Implode (Shannon–Fano coding) Used by PKZIP v1.x. See also TTComp archive.
8 DEFLATE Used by PKZIP v2.0+.
9 Deflate64, a.k.a. Enhanced Deflate Defined in ZIP specification v2.1+.
10 PKWARE Data Compression Library Imploding (old IBM TERSE)
12 Bzip2 Defined in ZIP specification v4.6+.
14 LZMA (EFS) Defined in ZIP specification v6.3+.
18 IBM TERSE (new)
19 IBM LZ77 z Architecture (PFS)
96 (JPEG, according to WinZip)
97 WavPack Defined in ZIP specification v6.3.2+.
98 PPMd version I, Rev 1 Defined in ZIP specification v6.3+.
99 (AES encryption, according to WinZip)

Specifications

Metaformat files

Software

Sample files

  • 1608A.ZIP → D1-MAC.ZIP: Example of a file that uses the uncommon "Reduce" compression scheme

References

  1. http://www.pkware.com/documents/casestudies/APPNOTE.TXT
  2. http://kikaku.itscj.ipsj.or.jp/sc34/open/1855.pdf

Links

Personal tools
Namespaces

Variants
Actions
Navigation
Toolbox