Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

deflate: Improve entropy compression #338

Merged
merged 1 commit into from
Mar 19, 2021
Merged

Conversation

klauspost
Copy link
Owner

Improve entropy coding and make various cleanups.

Before:

file	out	level	insize	outsize	millis	mb/s
dickens	flatekp	-2	1019244600	589553800	3460	280.86
dickens	flatekp	1	1019244600	460143946	7778	124.96
dickens	flatekp	2	1019244600	447624657	7993	121.60
dickens	flatekp	3	1019244600	442275633	10105	96.19
dickens	flatekp	4	1019244600	411669371	10310	94.28
dickens	flatekp	5	1019244600	406856462	11506	84.48
dickens	flatekp	6	1019244600	403864317	11894	81.72
dickens	flatekp	7	1019244600	391734230	27703	35.09
dickens	flatekp	8	1019244600	386774915	38643	25.15
dickens	flatekp	9	1019244600	385598868	48084	20.21

After:

file	out	level	insize	outsize	millis	mb/s
dickens	flatekp	-2	1019244600	582799774	3812	254.97
dickens	flatekp	1	1019244600	458664090	7490	129.76
dickens	flatekp	2	1019244600	445420813	7872	123.47
dickens	flatekp	3	1019244600	439874073	9659	100.63
dickens	flatekp	4	1019244600	407860161	9766	99.52
dickens	flatekp	5	1019244600	404161695	11432	85.02
dickens	flatekp	6	1019244600	400997375	11605	83.75
dickens	flatekp	7	1019244600	391734230	26570	36.58
dickens	flatekp	8	1019244600	386774915	37690	25.79
dickens	flatekp	9	1019244600	385598868	47283	20.56

Improve entropy coding and make various cleanups.

Before:
```
file	out	level	insize	outsize	millis	mb/s
dickens	flatekp	-2	1019244600	589553800	3460	280.86
dickens	flatekp	1	1019244600	460143946	7778	124.96
dickens	flatekp	2	1019244600	447624657	7993	121.60
dickens	flatekp	3	1019244600	442275633	10105	96.19
dickens	flatekp	4	1019244600	411669371	10310	94.28
dickens	flatekp	5	1019244600	406856462	11506	84.48
dickens	flatekp	6	1019244600	403864317	11894	81.72
dickens	flatekp	7	1019244600	391734230	27703	35.09
dickens	flatekp	8	1019244600	386774915	38643	25.15
dickens	flatekp	9	1019244600	385598868	48084	20.21
```

After:
```
file	out	level	insize	outsize	millis	mb/s
dickens	flatekp	-2	1019244600	582799774	3812	254.97
dickens	flatekp	1	1019244600	458664090	7490	129.76
dickens	flatekp	2	1019244600	445420813	7872	123.47
dickens	flatekp	3	1019244600	439874073	9659	100.63
dickens	flatekp	4	1019244600	407860161	9766	99.52
dickens	flatekp	5	1019244600	404161695	11432	85.02
dickens	flatekp	6	1019244600	400997375	11605	83.75
dickens	flatekp	7	1019244600	391734230	26570	36.58
dickens	flatekp	8	1019244600	386774915	37690	25.79
dickens	flatekp	9	1019244600	385598868	47283	20.56
```
@klauspost klauspost merged commit 4fd183f into master Mar 19, 2021
@klauspost klauspost deleted the deflate-improve-entropy branch March 19, 2021 09:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant