compression.cpython-312.pyc•7.24 kB
�
lMg � �� � d Z ddlmZ ddlZddlmZ d� ZdeiZd d�Z d d�Z
e de
d� dd l m Z e d
e d
� dd lmZ d!d �Z e d
ed� ddlmZ e ded� e ded� ddlZ e dej& dd�� e dej& dd�� G d� de� Z ddlZ ej. d� e deg � ddlZ e dej8 j: d� ddl Z d!d�Z e d e d � d � Z!y# e
$ r Y ��w xY w# e
$ r ddlmZ e d
d� d� Y ��w xY w# e
$ r Y ��w xY w# e
$ r Y ��w xY w# e
eef$ r Y ��w xY w# e
$ r Y �iw xY w# e
$ r Y d � Z!yw xY w)"z9Helper functions for a standard streaming compression API� )�ZipFileN)�AbstractBufferedFilec � � | S �N� )�file�mode�kwargss �^C:\Users\noahv\Documents\GitHub\clickup-operator\.venv\Lib\site-packages\fsspec/compression.py� noop_filer s � � �K� c �$ � t |t � r|g}| t v r|st d| � �� �|D ]3 }|t j
j v s� |r�#t d|� d| � d�� � |t | < |D ] }| t j
j |< �! y)aA Register an "inferable" file compression type.
Registers transparent file compression type for use with fsspec.open.
Compression can be specified by name in open, or "infer"-ed for any files
ending with the given extensions.
Args:
name: (str) The compression type name. Eg. "gzip".
callback: A callable of form (infile, mode, **kwargs) -> file-like.
Accepts an input file-like object, the target mode and kwargs.
Returns a wrapped file-like object.
extensions: (str, Iterable[str]) A file extension, or list of file
extensions for which to infer this compression scheme. Eg. "gz".
force: (bool) Force re-registration of compression type or extensions.
Raises:
ValueError: If name or extensions already registered, and not force.
z$Duplicate compression registration: z&Duplicate compression file extension: z (�)N)�
isinstance�str�compr�
ValueError�fsspec�utils� compressions)�name�callback�
extensions�force�exts r �register_compressionr s� � �( �*�c�"� �\�
� �u�}�U��?��v�F�G�G��� �&�,�,�+�+� +�E� � E�c�U�"�T�F�RS� T�U� U� � �E�$�K���)-�� � �!�!�#�&� r
c �� �� d|vr?|xs d}t | fddi|����j |d�� }|j f�fd� |_ |S t | � �|��j � d } �j |fddi|��S )N�rr r �w)r c �6 �� | � xs �j � S r )�close)�closer�zs �r �<lambda>zunzip.<locals>.<lambda>< s �� �6�8�+@�q�w�w�y�+@r
r )r �openr! �namelist)�infiler �filenamer
�for# s @r �unzipr* 7 s� �� �
�$���%�v�� �F� /�� /�� /��
�V�V�H�3�V�
'��!#���@���� ����A����:�:�<��?�� �1�6�6�(� /�� /�� /�/r
�zip)�BZ2File�bz2)�igzipc �2 � t j d| |d�|��S )N)�fileobjr r )r. � IGzipFile)r' r r
s r �isalr2 P s � ����C�v�D�C�F�C�Cr
�gzip�gz��GzipFilec � � t dd| i|��S )Nr0 r r5 )�fr
s r r$ r$ X s � �H�$A�Q�$A�&�$Ar
)�LZMAFile�lzma�xzT)r c �: � � e Zd Z� fd�Zdd�Zdd�Zd� Zd� Z� xZS )�
SnappyFilec �� �� dd l }t �| � dd d|j d� dz dd�|�� || _ d|v r |j
� | _ y |j � | _ y )Nr �snappy�bi�ɚ;)�fs�pathr �sizer r )r? �super�__init__�stripr' �StreamDecompressor�codec�StreamCompressor)�selfr' r r
r? � __class__s �r rE zSnappyFile.__init__m sj �� ��
���
��(����C� �3�)>�Y�
�RX�
� �� � �$�;�2��2�2�4�D�J�0��0�0�2�D�Jr
c �� � | j j d� | j j | j j � � }| j
j
|� y)Nr T)�buffer�seekrH � add_chunk�readr' �write)rJ �final�outs r �
_upload_chunkzSnappyFile._upload_chunky sJ � � � � ������j�j�"�"�4�;�;�#3�#3�#5�6�� � � ���#� �r
c � � t d� �)NzSnappyFile is not seekable)�NotImplementedError)rJ �loc�whences r rN zSnappyFile.seek s � �!�">�?�?r
c � � y)NFr )rJ s r �seekablezSnappyFile.seekable� s � �r
c �t � | j j ||z
� }| j j |� S )z*Get the specified set of bytes from remote)r' rP rH �
decompress)rJ �start�end�datas r � _fetch_rangezSnappyFile._fetch_range� s/ � ��{�{� � ��e� �,���z�z�$�$�T�*�*r
�F)r ) �__name__�
__module__� __qualname__rE rT rN rZ r` �
__classcell__)rK s @r r= r= l s �� �
3�� @��+r
r= r
r? �lz4c � � d|v r%t j � }|j | � S t j d�� }|j | � S )Nr �
)�level)�zstd�ZstdDecompressor�
stream_reader�ZstdCompressor�
stream_writer)r' r �cctxs r �zstandard_filerp � sI � � �$�;��(�(�*�D��%�%�f�-� -��&�&�R�0�D��%�%�f�-� -r
rj �zstc � � t t � S )z.Return a list of the implemented compressions.)�listr r r
r �available_compressionsrt � s � � ��;�r
ra )�rbN)ru )"�__doc__�zipfiler � fsspec.utilsr � fsspec.specr r r r r* r- r, � ImportErrorr2 r. r3 r6 r: r9 �lzmaffir= r? �compress� NameError�AttributeError� lz4.framerf �framer% � zstandardrj rp rt r r
r �<module>r� s� �� ?� � � ,��
�y���".�J
0� �U�E�5� )�0�� ����/� ��D� ���t�,� � ����6�2���x��.� �����!1�!1�6��F���w� /� /��T�B�
+�%� +�> ���F�O�O�C�� ��:�r�2�
����� � ����6�
� �.� �� ��7�
��K � �� �� � � ���A�4���� � �� �� � �� ��V �Y��/� �� �� � �� �� � ��� �s| �D �D �D+ �.0D6 �* E � "E �.E �D � D �D(�'D(�+D3�2D3�6D>�=D>�E � E �E�E�E%�$E%