]jb d dl Z d dlZd dlmZ d dlmZ n# e$ r G d d ZY nw xY w ddlT ddlmZm Z m
Z
n1# e$ r) ddl T ddl mZm Z m
Z
d Z n# e$ r ed
w xY wY nw xY wd Z
d Zd
Zd dZd dZd Zd Zd ZdZ G d de j Zd ZdZdZ G d dej Z d dddddddZ dS ) N)maxsize)PathLikec e Zd ZdS )r N)__name__
__module__ __qualname__ q/builddir/build/BUILD/imunify360-venv-2.6.3/opt/imunify360/venv/lib64/python3.11/site-packages/pyzstd/__init__.pyr r s r
r )*) _train_dict_finalize_dict_ZSTD_DStreamInSizeTa pyzstd module: Neither C implementation nor CFFI implementation can be imported. If pyzstd module is dynamically linked to zstd library, make sure not to remove zstd library, and the run-time zstd library's version can't be lower than that at compile-time.z0.15.3zPython bindings to Zstandard (zstd) compression library, the API is similar to
Python's bz2/lzma/zlib modules.
Documentation: https://pyzstd.readthedocs.io
GitHub: https://github.com/animalize/pyzstd
PyPI: https://pypi.org/project/pyzstd)ZstdCompressorRichMemZstdCompressorZstdDecompressorEndlessZstdDecompressor
CParameter
DParameterStrategy ZstdErrorcompressrichmem_compress
decompresscompress_streamdecompress_streamZstdDict
train_dict
finalize_dictget_frame_infoget_frame_sizeZstdFileopen zstd_versionzstd_version_infozstd_support_multithreadcompressionLevel_valuesc b t || }| | t j S )a Compress a block of data, return a bytes object.
Compressing b'' will get an empty content frame (9 bytes or more).
Parameters
data: A bytes-like object, data to be compressed.
level_or_option: When it's an int object, it represents compression level.
When it's a dict object, it contains advanced compression
parameters.
zstd_dict: A ZstdDict object, pre-trained dictionary for compression.
)r r FLUSH_FRAMEdatalevel_or_option zstd_dictcomps r r r 3 s* /9 5 5D ==~ 9 : ::r
c L t || }| | S )aB Compress a block of data, return a bytes object.
Use rich memory mode, it's faster than compress() in some cases, but
allocates more memory.
Compressing b'' will get an empty content frame (9 bytes or more).
Parameters
data: A bytes-like object, data to be compressed.
level_or_option: When it's an int object, it represents compression level.
When it's a dict object, it contains advanced compression
parameters.
zstd_dict: A ZstdDict object, pre-trained dictionary for compression.
)r r r+ s r r r C s% ! ) < <D == r
c t | t t f rt | S t | j S N)
isinstancebytes bytearraylen
memoryviewnbytes)dats r _nbytesr: V s3 #y)** 3xx c?? !!r
c V t |t st d g }g }| D ]9}| | | t | :d | }|st
d t ||| }t | S )zTrain a zstd dictionary, return a ZstdDict object.
Parameters
samples: An iterable of samples, a sample is a bytes-like object
represents a file.
dict_size: The dictionary's maximum size, in bytes.
+dict_size argument should be an int object.r
z6The samples are empty content, can't train dictionary.) r3 int TypeErrorappendr: join
ValueErrorr r )samples dict_sizechunks chunk_sizeschunk dict_contents r r r \ s i % % GEFFF FK + +
e 75>>****
XXf
F SQRRR
v{I>>L L ! !!r
c < t dk rdt z }t | t | t st d t |t st d t |t st d g }g }|D ]9}| | | t | :d | }|st d t | j |||| }t | S )a Finalize a zstd dictionary, return a ZstdDict object.
Given a custom content as a basis for dictionary, and a set of samples,
finalize dictionary by adding headers and statistics according to the zstd
dictionary format.
You may compose an effective dictionary content by hand, which is used as
basis dictionary, and use some samples to finalize a dictionary. The basis
dictionary can be a "raw content" dictionary, see is_raw parameter in
ZstdDict.__init__ method.
Parameters
zstd_dict: A ZstdDict object, basis dictionary.
samples: An iterable of samples, a sample is a bytes-like object
represents a file.
dict_size: The dictionary's maximum size, in bytes.
level: The compression level expected to use in production. The
statistics for each compression level differ, so tuning the
dictionary for the compression level can help quite a bit.
)r zThis function only available when the underlying zstd library's version is greater than or equal to v1.4.5, the current underlying zstd library's version is v%s./zstd_dict argument should be a ZstdDict object.r< z'level argument should be an int object.r
z9The samples are empty content, can't finalize dictionary.)
r& r% NotImplementedErrorr3 r r> r= r? r: r@ rA r rG ) r. rB rC levelmsgrD rE rF rG s r r r { s; * 9$$GJVW "#&&& i * * KIJJJ i % % GEFFF eS ! ! CABBB FK + +
e 75>>****
XXf
F VTUUU ")"8"(+"+U4 4L L ! !!r
i c 0 e Zd Zd ZddZej fdZdS )ZstdDecompressReaderc g } | t }|sn| | 3d | S )NTr
)readr r? r@ )selfrD r, s r readallz ZstdDecompressReader.readall sU 99W%%D
MM$ xx r
c |dk r| S |r| j rdS | j j rR| j t }|s0| j j rd| _ | j | _ dS t d nd}| j || }|r | xj t | z
c_ |S )Nr r
TzACompressed file ended before the end-of-stream marker was reached)
rT _eof
_decompressor needs_input_fprR r
at_frame_edge_pos_sizeEOFErrorr r6 )rS sizerawblockr, s r rR zZstdDecompressReader.read s !88<<>> ! ty 3 !-
8==)<== K)7 K$( %)Y
"s & (J K K K
K %004@@D
SYY& # r
c H |t j k rn|t j k r | j |z }n}|t j k rK| j dk r5| t r | t | j |z }n"t d | || j k r|
n
|| j z }|dk rC| t t | }|sn|t | z }|dk C| j S )Nr z Invalid value for whence: {})
ioSEEK_SETSEEK_CURr\ SEEK_ENDr] rR _32_KiBrA format_rewindminr6 )rS offsetwhencer, s r seekzZstdDecompressReader.seek s R[
r{
"
"Y'FF
r{
"
"zA~~ii(( ii(( Z&(FF ; B B6 J JKK K DI LLNNNN di F qjj99S& 1 122D
c$ii F qjj yr
NrU )r r r rT rR rb rc rl r r
r rP rP sR
: #%+ r
rP c e Zd ZdZdddddZd ZddZd Zd Zdd Z dd Z
d
Z d Z ddZ
ej fdZddZd Zd Zed Zd Zd Zd ZdS )r# a? A file object providing transparent zstd (de)compression.
A ZstdFile can act as a wrapper for an existing file object, or refer
directly to a named file on disk.
Note that ZstdFile provides a *binary* file interface - data read is
returned as bytes, and data to be written must be given as bytes.
rNr- r. c d| _ d| _ t | _ t |t d t f st d |dv r=t |t d t f sd}t | t }n|dv r_t |t d t t f sd}t | t }t || | _
d| _ n"t d | t |t" t$ t& f r2d
|vr|d
z
}t) j || | _ d | _ || _ n>t- |d st- |d
r|| _ || _ nt d |t k rDt/ | j t0 t2 || }t) j |t6 | _ dS dS )a Open a zstd compressed file in binary mode.
filename can be either an actual file name (given as a str, bytes, or
PathLike object), in which case the named file is opened, or it can be
an existing file object to read from or write to.
mode can be "r" for reading (default), "w" for (over)writing, "x" for
creating exclusively, or "a" for appending. These can equivalently be
given as "rb", "wb", "xb" and "ab" respectively.
Parameters
level_or_option: When it's an int object, it represents compression
level. When it's a dict object, it contains advanced compression
parameters. Note, in read mode (decompression), it can only be a
dict object, that represents decompression option. It doesn't
support int type compression level in this case.
zstd_dict: A ZstdDict object, pre-trained dictionary for compression /
decompression.
NFrK )rp rbzIn read mode (decompression), level_or_option argument should be a dict object, that represents decompression option. It doesn't support int type compression level in this case.)wwbaabxxbz6level_or_option argument should be int or dict object.r zInvalid mode: {!r}bTrR writez6filename must be a str, bytes, file or PathLike object)trailing_errorr. option) rZ _closefp _MODE_CLOSED_moder3 typer r> dict
_MODE_READr= _MODE_WRITEr _compressorr\ rA rg strr4 r rb r$ hasattrrP r r BufferedReaderrf _buffer)rS filenamemoder- r. rN mode_coderaws r __init__zZstdFile.__init__. s *
!
)d4jj(%;<< O MNN N ; oT
D/ABB
%' nn$"II
6
6
6 oT
C/FGG
%N nn$#I -oy I ID DII 1 8 8 > >?? ? heX 6 7 7
V$ wx..DH DM #DJJ
Xv
&
& V'(G*D*D V DH"DJJ TUU U
" "&tx1H6?1:?T T TC ,S'::DLLL # "r
c | j t k rdS t | d r. | j d| _ nb# d| _ w xY w| j t
k rF | j | j d| _ n # d| _ w xY w | j
r| j d| _ d| _
t | _ dS # d| _ d| _
t | _ w xY w# | j
r| j d| _ d| _
t | _ n # d| _ d| _
t | _ w xY ww xY w)zFlush and close the file.
May be called more than once without error. Once the file is
closed, any other operation on it will raise a ValueError.
Nr F) r r r r closer rZ r{ r flushr~ rS s r r zZstdFile.closet s : % % F * tY''
,(L&&((( $(DLL4DL''''{**,HNN4#3#9#9#;#;<<< (,D$$tD$++++
*= %HNN$$$ %
)
%
)
))))
*= %HNN$$$ %
)
%
)
))))))))s] D A D AD #1B D B%%D ) C% % DE! E&E! E E!c | j t k rt d |t k r%| j t k rt j d n/|t k r$| j t k rt j d )Nz I/O operation on closed filezFile not open for readingzFile not open for writing)r r rA r rb UnsupportedOperationr )rS
expected_modes r _check_modezZstdFile._check_mode s~ : % % ;<< < J & &zZ''-.IJJJ (
k
)
)z[((-.IJJJ r
c n t |t t f rt | }nt | }|j } | j | }n*# t $ r | t Y nw xY w|r| j | | xj
|z
c_
|S )a Write a bytes-like object to the file.
Returns the number of uncompressed bytes written, which is
always the length of data in bytes. Note that due to buffering,
the file on disk may not reflect the data written until close()
is called.
)r3 r4 r5 r6 r7 r8 r r AttributeErrorr r rZ r{ r\ )rS r, length
compresseds r r{ zZstdFile.write s dUI . / / !YYFF d##D[F * )22488JJ * * * [ ) ) ) ) ) *
' HNN: & & & V
s A $BBc V | j t k rdS | j t j }n$# t $ r | Y nw xY w|r| j | t | j d r| j dS dS )a Flush remaining data to the underlying stream.
It uses ZstdCompressor.FLUSH_BLOCK mode. Abuse of this method will
reduce compression ratio, use it only when necessary.
If the program is interrupted afterwards, all data can be recovered.
To ensure saving to disk, also need to use os.fsync(fd).
This method does nothing in reading mode.
Nr ) r r r r r FLUSH_BLOCKr r rZ r{ r )rS r s r r zZstdFile.flush s : # # F )//0JKKJJ
' HNN: & & & 48W % % HNN s $9 AArU c | j | S # t $ r | t Y dS w xY w)zRead up to size uncompressed bytes from the file.
If size is negative or omitted, read until EOF is reached.
Returns b"" if the file is already at EOF.
N)r rR r r r rS r_ s r rR z
ZstdFile.read sU )<$$T** * ) ) ) Z ( ( ( ( ( ( ) $AAc |dk rt } | j | S # t $ r | t
Y dS w xY w)zRead up to size uncompressed bytes, while trying to avoid
making multiple reads from the underlying stream. Reads up to a
buffer's worth of data if size is negative.
Returns b"" if the file is at EOF.
r N)rf r read1r r r r s r r zZstdFile.read1 se !88D )<%%d++ + ) ) ) Z ( ( ( ( ( ( )s ) $AAc | j | S # t $ r | t Y dS w xY w)zRRead bytes into b.
Returns the number of bytes read (0 for EOF).
N)r readintor r r rS rz s r r zZstdFile.readinto sU
)<((++ + ) ) ) Z ( ( ( ( ( ( )r c | j | S # t $ r | t Y dS w xY w)zRead bytes into b, while trying to avoid making multiple reads
from the underlying stream.
Returns the number of bytes read (0 for EOF).
N)r readinto1r r r r s r r zZstdFile.readinto1 sU )<))!,, , ) ) ) Z ( ( ( ( ( ( )r c | j | S # t $ r | t Y dS w xY w)a
Read a line of uncompressed bytes from the file.
The terminating newline (if present) is retained. If size is
non-negative, no more than size bytes will be read (in which
case the line may be incomplete). Returns b'' if already at EOF.
N)r readliner r r r s r r zZstdFile.readline sU )<((.. . ) ) ) Z ( ( ( ( ( ( )r c | j || S # t $ r | t Y dS w xY w)a Change the file position.
The new position is specified by offset, relative to the
position indicated by whence. Possible values for whence are:
0: start of stream (default): offset must not be negative
1: current stream position
2: end of stream; offset must not be positive
Returns the new file position.
Note that seeking is emulated, so depending on the arguments,
this operation may be extremely slow.
N)r rl r r r )rS rj rk s r rl z
ZstdFile.seek sW )<$$VV44 4 ) ) ) Z ( ( ( ( ( ( )s $AAc | j | S # t $ r | t Y dS w xY w)zReturn buffered data without advancing the file position.
Always returns at least one byte of data, unless at EOF.
The exact number of bytes returned is unspecified.
N)r peekr r r r s r r z
ZstdFile.peek3 sU )<$$T** * ) ) ) Z ( ( ( ( ( ( )r c | j t k r| j S | j t k r| j S | dS )z!Return the current file position.N)r r r tellr r\ r r s r r z
ZstdFile.tell@ sR : # #<$$&& &
Z;
&
&9
r
c | j S # t $ r | Y dS w xY w)z3Return the file descriptor for the underlying file.N)rZ filenor r r s r r zZstdFile.filenoJ sO 8??$$ $ s ==c " | j t k S )z True if this file is closed.)r r r s r closedzZstdFile.closedR s z\))r
c v | j t k rdS | j t k rdS | dS )z/Return whether the file was opened for writing.TFN)r r r r r s r writablezZstdFile.writableW s@ : $ $4
Z:
%
%5
r
c v | j t k rdS | j t k rdS | dS )z/Return whether the file was opened for reading.TFN)r r r r r s r readablezZstdFile.readablea s@ : # #4
Z;
&
&5
r
c | j t k r| j S | j t k rdS | dS )z)Return whether the file supports seeking.FN)r r r seekabler r r s r r zZstdFile.seekablek sO : # #<((** *
Z;
&
&5
r
)rp r2 rm )r r r __doc__r r r r{ r rR r r r r rb rc rl r r r propertyr r r r r r
r r# r# $ sy D;!%D; D; D; D; D;L * * *D < > ) ) ) )
)
)
)
) ) ) ) ) ) )
)
)
)
) #%+ ) ) ) )* ) ) ) ) * * X* r
r# rs )r- r. encodingerrorsnewlinec * d|v rd|v rt d| n3|t d |t d |t d | dd }t | ||| }d|v rt j |||| S |S )
a] Open a zstd compressed file in binary or text mode.
filename can be either an actual file name (given as a str, bytes, or
PathLike object), in which case the named file is opened, or it can be an
existing file object to read from or write to.
The mode parameter can be "r", "rb" (default), "w", "wb", "x", "xb", "a",
"ab" for binary mode, or "rt", "wt", "xt", "at" for text mode.
The level_or_option and zstd_dict parameters specify the settings, as for
ZstdCompressor, ZstdDecompressor and ZstdFile.
When using read mode (decompression), the level_or_option parameter can
only be a dict object, that represents decompression option. It doesn't
support int type compression level in this case.
For binary mode, this function is equivalent to the ZstdFile constructor:
ZstdFile(filename, mode, ...). In this case, the encoding, errors and
newline parameters must not be provided.
For text mode, an ZstdFile object is created, and wrapped in an
io.TextIOWrapper instance with the specified encoding, error handling
behavior, and line ending(s).
trz zInvalid mode: Nz0Argument 'encoding' not supported in binary modez.Argument 'errors' not supported in binary modez/Argument 'newline' not supported in binary mode rq )rA replacer# rb
TextIOWrapper) r r r- r. r r r zstd_mode binary_files r r$ r$ w s 6 d{{ $;; *44 9:: : OPP P MNN N NOO O S"%%I8Y+:iQ Q QK d{{ XvwGGGr
)NN)rs ) _compressionrb sysr osr ImportError
c.c_pyzstdr r r cffi.cffi_pyzstd CFFI_PYZSTD __version__r __all__r r r: r r rf DecompressReaderrP r r r BufferedIOBaser# r$ r r
r <module>r s
P 0 0 0 0 0 0 0 0 0 0 0 P P P P'''' : : : : : : : : : : P P Pk
OP P PP
P ) B
;
;
;
; &" " " " " ">7" 7" 7"z K K K K K<8 K K K\
&O O O O Or O O Of
-tT- - - - - - -s3 ,,? A-AA-A''A-,A-