Groups | Search | Server Info | Keyboard shortcuts | Login | Register [http] [https] [nntp] [nntps]

Groups > comp.programming.threads > #3930

My Parallel Compression Library for Windows and Linux version 4.2 is here..

Show all headers | View raw

Hello...


My Parallel Compression Library for Windows and Linux version 4.2 is here..

I have enhanced my Parallel Compression Library, now the process of 
calculating the CRC is much more optimized and fast, and the process of
testing the integrity is much more faster, also i have stress tested it
much more and i have found a bug that i have corrected, and now i think
that you can be more confident because it is much more stable and very fast.

Description:

Parallel Compression Library implements Parallel LZ4 , Parallel LZMA , 
and Parallel Zstd algorithms using my Thread Pool Engine.

- It supports memory streams, file streams and files

- 64 bit supports - lets you create archive files over 4 GB ,   supports 
archives up  to 2^63 bytes, compresses and  decompresses files up to 
2^63 bytes.

- Parallel compression and parallel decompression are extremely fast

- Now it supports processor groups on windows, so that it can use more 
than 64 logical processors and it scales well.

- It's NUMA-aware and NUMA efficient on windows

- It minimizes efficiently the contention so that it scales well.

- It supports both compression and decompression rate indicator

- You can test the integrity of your compressed file or stream

- Easy programming interface

- Full source codes available.

Now my Parallel compression library is optimized for NUMA and it 
supports processor groups on windows and it uses only two threads that 
do the IO (and they are not contending) so that it reduces at best the 
contention, so that it scales well.

Here are the parameters of the constructor:

First parameter is: The number of cores you have specify to run the 
compression algorithm in parallel.

Second parameter is: A boolean parameter that is processorgroups to 
support processor groups on windows , if it is set to true it will 
enable you to scale beyond 64 logical processors and it will be NUMA 
efficient.


You can download and read about my Parallel Compression Library from:

https://sites.google.com/site/aminer68/parallel-compression-library



Thank you,
Amine Moulay Ramdane.

Back to comp.programming.threads | Previous | Next | Find similar | Unroll thread

Thread

My Parallel Compression Library for Windows and Linux version 4.2 is here.. Intelli2 <intelli2@mama.com> - 2017-11-18 22:12 -0500

csiph-web