tree a1ed614391936d455da2b0610ef8e8caf88b4289
parent 3af18990f50d8f040038aaa08c41f5d27d62efb5
author Eugene Kliuchnikov <eustas@google.com> 1519653876 -0500
committer GitHub <noreply@github.com> 1519653876 -0500
gpgsig -----BEGIN PGP SIGNATURE-----
 
 wsBcBAABCAAQBQJalBP0CRBK7hj4Ov3rIwAAdHIIAHhVSeXVG/PewXHwvXKASQkP
 fA396v0zfVW3nry18edBUqGBBGohbcHoKdSfeD2u8gTCyhn86iv6nfbbvFpjIBug
 WS4onY1CNwqPWJrNQedIlKi5USAUIVdwJSFLCJvs21kK2TmlwTfR7VUjlHKO5GW2
 rmZF8UEqFgvipfrXEP+I0ZpN59/PdB9N8dpI8nPzmgM7juk3PXYtZtLeaJsPWACh
 Hl70IWGyd4uUyhIcsQ+X0PIaKZUoXmOays6eQa3/9zQ0/sci9viLEXGAxM/tJNUG
 2MWSDrkoZzKiLo62qLUH1HFNmGDmr/WvGfmPgEX4WJm9gez5bB0hCjI5nkGvwYA=
 =ceKO
 -----END PGP SIGNATURE-----
 

New feature: "Large Window Brotli" (#640)

* New feature: "Large Window Brotli"

By setting special encoder/decoder flag it is now possible to extend
LZ-window up to 30 bits; though produced stream will not be RFC7932
compliant.

Added new dictionary generator - "DSH". It combines speed of "Sieve"
and quality of "DM". Plus utilities to prepare train corpora
(remove unique strings).

Improved compression ratio: now two sub-blocks could be stitched:
the last copy command could be extended to span the next sub-block.

Fixed compression ineffectiveness caused by floating numbers rounding and
wrong cost heuristic.

Other C changes:
 - combined / moved `context.h` to `common`
 - moved transforms to `common`
 - unified some aspects of code formatting
 - added an abstraction for encoder (static) dictionary
 - moved default allocator/deallocator functions to `common`

brotli CLI:
 - window size is auto-adjusted if not specified explicitly

Java:
 - added "eager" decoding both to JNI wrapper and pure decoder
 - huge speed-up of `DictionaryData` initialization

* Add dictionaryless compressed dictionary

* Fix `sources.lst`

* Fix `sources.lst` and add a note that `libtool` is also required.

* Update setup.py

* Fix `EagerStreamTest`

* Fix BUILD file

* Add missing `libdivsufsort` dependency

* Fix "unused parameter" warning.