o
�J�h�� � @ s
U d dl mZ d dlZd dlZd dlZd dlZd dlZd dlZd dlm Z m
Z
m Z m
ZmZmZmZ d dlmZ d dlZd dlmZmZ d dlmZmZmZ ddgZ zd dl Z d Z W n
e yf d
Z dZ Y nw e�!� Z"i Z#d e$d < ed
dd�Z%G dd� d�Z&dd� Z'G dd� dej(j)e&�Z*dd� Z+ej,dd�dd� �Z-ej,dd�dd� �Z.ej,dd�d d � �Z/d d � Z0d d!� Z1d
a2d"d#� Z3d$d%� Z4d8d'd(�Z5d)d*� Z6d9d-d.�Z7G d/d� d�Z8ej9e8j:_9e&j;j9e8j;_9e&j<j9e8j<_9ej9e8j=_9G d0d1� d1e:�Z>G d2d3� d3e8e>d4�Z?d:d6d7�Z@dS );� )� annotationsN)�Any�cast�Dict�Optional�Type�TypeVar�Union)�Self)�_to�_type)�_bool�_int�Storage� TypedStorage�UntypedStorageTFz_Dict[int, threading.RLock]�_share_memory_map�T�!Union[_StorageBase, TypedStorage])�boundc s, e Zd ZU ded< dZded< dZded< ded< d Zd
ed < d d
� Zd�dd�Zdd� Z dd� Z
d�d�dd�Z d�d d �Z d�d d �Z
d�d!d"�Z d�d�d%d&�Z d�d�d'd(�Zd�d�d)d*�Zd�d+d,�Zd�d-d.�Zd�d/d0�Zd�d1d2�Zd3d4� Zd5d6� Zed�d:d;��Zed�d<d=��Zed�d>d?��Zed d d@�d�dAdB��Z ed�dCdD��Z ed�dEdF��Z d�dGdH�Z dIdJ� Z d�dKdL�Z!d�dMdN�Z"dOdP� Z#dQdR� Z$dSdT� Z%d�dUdV�Z&ed�dWdX��Z'dYdZ� Z(ed[d\� �Z)e*d]d^� �Z+e*d_d`� �Z,ed�dadb��Z-ed�dcdd��Z.dedf� Z/d�dgdh�Z0didj� Z1dkdl� Z2dmdn� Z3dodp� Z4dqdr� Z5� fdsdt�Z6dudv� Z7dwdx� Z8dydz� Z9d{d|� Z:d}d~� Z;dd�d�d�d��Z<d�d�� Z=d�d�� Z>d�d�� Z?d�d�� Z@d�d�� ZAd�d�� ZBd�d�� ZCd�d�� ZDd�d�� ZEd�d�� ZFd�d�� ZGd�d�� ZHd�d�� ZId�d�� ZJd�d�� ZKd�d�� ZLd�d�d�d��ZMd�d�d�d��ZNd�d�� ZOed�d��d�d���ZPd�d�� ZQd�d�� ZR� ZSS )�� _StorageBaser �_cdataFr
� is_sparse�
is_sparse_csr� torch.device�deviceN�_Optional[torch.device]� _fake_devicec O s d S �N� ��self�args�kwargsr r �KC:\pinokio\api\whisper-webui.git\app\env\lib\site-packages\torch\storage.py�__init__- � z_StorageBase.__init__�returnr c C � t �r ��NotImplementedError�r! r r r$ �__len__0 r& z_StorageBase.__len__c C r( r r) �r! �idxr r r$ � __getitem__3 r& z_StorageBase.__getitem__c O r( r r) r r r r$ � __setitem__6 r& z_StorageBase.__setitem__�sourcer � non_blocking�_Optional[_bool]c C r( r r) �r! r1 r2 r r r$ �copy_9 r& z_StorageBase.copy_r c C r( r r) r+ r r r$ �new< r& z_StorageBase.newc C r( r r) r+ r r r$ �nbytes? r& z_StorageBase.nbytesc C � | � � S r )r7 r+ r r r$ �sizeB � z_StorageBase.size�dtype�_Optional[str]c C � t | ||�S r )r )r! r; r2 r r r$ �typeE � z_StorageBase.typec C �( |rt �d|�nt �d�}| j||d�S )a� Returns a copy of this object in CUDA memory.
If this object is already in CUDA memory and on the correct device, then
no copy is performed and the original object is returned.
Args:
device (int): The destination GPU id. Defaults to the current device.
non_blocking (bool): If ``True`` and the source is in pinned memory,
the copy will be asynchronous with respect to the host. Otherwise,
the argument has no effect.
�cuda�r r2 ��torchr �to�r! r r2 Zdevice2r r r$ rA J s z_StorageBase.cudac C r@ )a� Returns a copy of this object in HPU memory.
If this object is already in HPU memory and on the correct device, then
no copy is performed and the original object is returned.
Args:
device (int): The destination HPU id. Defaults to the current device.
non_blocking (bool): If ``True`` and the source is in pinned memory,
the copy will be asynchronous with respect to the host. Otherwise,
the argument has no effect.
�hpurB rC rF r r r$ rG [ s z_StorageBase.hpuc C r( r r) r+ r r r$ � element_sizej r& z_StorageBase.element_sizec C � | j jS r )r �indexr+ r r r$ �
get_devicem r: z_StorageBase.get_devicec C r( r r) r+ r r r$ �data_ptrp r& z_StorageBase.data_ptrc C r( r r) r+ r r r$ � resizables r& z_StorageBase.resizablec O r( r r) r r r r$ �_share_filename_cpu_w r& z!_StorageBase._share_filename_cpu_c O r( r r) r r r r$ �_share_fd_cpu_z r& z_StorageBase._share_fd_cpu_�cls�Type[T]r9 c C r( r r) �rP r9 r r r$ �_new_using_filename_cpu} � z$_StorageBase._new_using_filename_cpuc C r( r r) rR r r r$ �_new_using_fd_cpu� rT z _StorageBase._new_using_fd_cpuc O r( r r) �rP r" r# r r r$ � from_buffer� rT z_StorageBase.from_buffer)r r; c C r( r r) )rP �manager�objr9 r r; r r r$ �_new_shared_filename_cpu� s
z%_StorageBase._new_shared_filename_cpuc O r( r r) rV r r r$ �_release_ipc_counter_cuda� rT z&_StorageBase._release_ipc_counter_cudac O r( r r) rV r r r$ �_new_with_weak_ptr� rT z _StorageBase._new_with_weak_ptrc C r( r r) r+ r r r$ �_shared_decref� r& z_StorageBase._shared_decrefc O r( r r) r r r r$ � _write_file� r& z_StorageBase._write_filec C r( r r) �r! r9 r r r$ �resize_� r& z_StorageBase.resize_c O r( r r) r r r r$ � _weak_ref� r& z_StorageBase._weak_refc O r( r r) r r r r$ �_set_from_file� r& z_StorageBase._set_from_filec O r( r r) r r r r$ �
_set_cdata� r& z_StorageBase._set_cdatac O r( r r) r r r r$ � _share_cuda_� r& z_StorageBase._share_cuda_c C r( r r) r+ r r r$ � is_shared� r& z_StorageBase.is_sharedc O r( r r) rV r r r$ �_new_shared_cuda� rT z _StorageBase._new_shared_cudac O r( r r) r r r r$ �_shared_incref� r& z_StorageBase._shared_increfc O r( r r) rV r r r$ �_free_weak_ref� rT z_StorageBase._free_weak_refc C r( r r) r+ r r r$ �is_cuda� rT z_StorageBase.is_cudac C r( r r) r+ r r r$ �is_hpu� rT z_StorageBase.is_hpuc C r( r r) )rP �filename�sharedr7 r r r$ � from_file� rT z_StorageBase.from_filec O r( r r) rV r r r$ �_expired� rT z_StorageBase._expiredc O r( r r) r r r r$ � _byteswap� r& z_StorageBase._byteswapc O r( r r) r r r r$ �
_get_filename� r& z_StorageBase._get_filenamec sh dt �� �� d� j� dt� �� d�}� jjdkr d| S dd�� fd d
�t� �� �D �� }|d | S ) N�[z(device=�
) of size �]�meta�...
� �
c 3 � � | ] }t � | �V qd S r ��str��.0�ir+ r r$ � <genexpr>� � � z(_StorageBase.__repr__.<locals>.<genexpr>�
)rD �typenamer �lenr> �join�ranger9 �r! Zinfo_strZdata_strr r+ r$ �__repr__� s
$ $ z_StorageBase.__repr__c s t � fdd�t� �� �D ��S )Nc 3 � � | ]}� | V qd S r r r{ r+ r r$ r~ � � � z(_StorageBase.__iter__.<locals>.<genexpr>)�iterr� r9 r+ r r+ r$ �__iter__� s z_StorageBase.__iter__c C r8 r )�cloner+ r r r$ �__copy__� r: z_StorageBase.__copy__c C s6 |� di �}| j|v r|| j S | �� }||| j< |S )NrD )�
setdefaultr r� )r! �memo� new_storager r r$ � __deepcopy__� s
z_StorageBase.__deepcopy__c C �& t �� }tj| |dd� t|�� ffS �NF)Z _use_new_zipfile_serialization��io�BytesIOrD �save�_load_from_bytes�getvalue�r! �br r r$ �
__reduce__� � z_StorageBase.__reduce__c s t � �� | �� S r )�super�
__sizeof__r9 r+ �� __class__r r$ r� � � z_StorageBase.__sizeof__c C s t | �| �� | jd��| �S )� Return a copy of this storage.�r )r> r7 r r5 r+ r r r$ r� � s z_StorageBase.clonec C s t | �S �z6Return a list containing the elements of this storage.)�listr+ r r r$ �tolist� � z_StorageBase.tolistc C s& | j jdkrt�| �� ��| d�S | S )�AReturn a CPU copy of this storage if it's not already on the CPU.�cpuF�r r> rD r r9 r5 r+ r r r$ r� � s z_StorageBase.cpuc C s* | j jdkrtj| �� dd��| d�S | S )zAReturn a MPS copy of this storage if it's not already on the MPS.�mpsr� Fr� r+ r r r$ r� s z_StorageBase.mpsc C sd t |tj�stdt|�� ���tjg tj| jd��t t
| ��� |�� � }|�
� | �
� kr0|�� }|S �Nz*Argument 'dtype' must be torch.dtype, not �r; r )�
isinstancerD r; � TypeErrorr> �tensor�uint8r �set_r r rE �_typed_storagerL r� �r! r; �storager r r$ r s �z_StorageBase._to�r2 c C r= r )r )r! r r2 r r r$ rE r? z_StorageBase.toc C � | � tj�S �z"Casts this storage to double type.)r rD �doubler+ r r r$ r� � z_StorageBase.doublec C r� �z!Casts this storage to float type.)r rD �floatr+ r r r$ r� r� z_StorageBase.floatc C r� �z Casts this storage to half type.)r rD �halfr+ r r r$ r� ! r� z_StorageBase.halfc C r� �z Casts this storage to long type.)r rD �longr+ r r r$ r� % r� z_StorageBase.longc C r� �z Casts this storage to int type.)r rD �intr+ r r r$ r� ) r� z_StorageBase.intc C r� �z!Casts this storage to short type.)r rD �shortr+ r r r$ r� - r� z_StorageBase.shortc C r� �z Casts this storage to char type.)r rD �int8r+ r r r$ �char1 r� z_StorageBase.charc C r� �z Casts this storage to byte type.)r rD r� r+ r r r$ �byte5 r� z_StorageBase.bytec C r� �z Casts this storage to bool type.)r rD �boolr+ r r r$ r� 9 r� z_StorageBase.boolc C r� �z$Casts this storage to bfloat16 type.)r rD �bfloat16r+ r r r$ r� = r� z_StorageBase.bfloat16c C r� �z*Casts this storage to complex double type.)r rD �cdoubler+ r r r$ �complex_doubleA r� z_StorageBase.complex_doublec C r� �z)Casts this storage to complex float type.)r rD �cfloatr+ r r r$ �
complex_floatE r� z_StorageBase.complex_floatc C r� �z&Casts this storage to float8_e5m2 type)r rD � float8_e5m2r+ r r r$ r� I r� z_StorageBase.float8_e5m2c C r� �z(Casts this storage to float8_e4m3fn type)r rD �
float8_e4m3fnr+ r r r$ r� M r� z_StorageBase.float8_e4m3fnc C r� �z*Casts this storage to float8_e5m2fnuz type)r rD �float8_e5m2fnuzr+ r r r$ r� Q r� z _StorageBase.float8_e5m2fnuzc C r� �z*Casts this storage to float8_e4m3fnuz type)r rD �float8_e4m3fnuzr+ r r r$ r� U r� z _StorageBase.float8_e4m3fnuzrA �Union[str, torch.device]c C s& t jg t j| jd��tt| ���|�S )z�Determine whether the CPU storage is already pinned on device.
Args:
device (str or torch.device): The device to pin memory on. Default: ``'cuda'``.
Returns:
A boolean variable.
r� )rD r� r� r r� r r � is_pinned�r! r r r r$ r� Y s
�z_StorageBase.is_pinnedc C sN | j jdkrtd| �� � d���tjg tj| j d��tt| ��� |�}|�
� S )z�Copy the CPU storage to pinned memory, if it's not already pinned.
Args:
device (str or torch.device): The device to pin memory on. Default: ``'cuda'``.
Returns:
A pinned CPU storage.
r� z cannot pin 'z ' only CPU memory can be pinnedr� ) r r> r� rD r� r� r� r r �
pin_memory�untyped_storage)r! r Z
pinned_tensorr r r$ r� h s �z_StorageBase.pin_memoryc C sJ ddl m} | jjdtj�� fv r | S |� dkr | �� | S | �� | S )�.See :meth:`torch.UntypedStorage.share_memory_`r ��get_sharing_strategyrA � file_system) �torch.multiprocessingr� r r> rD �_C� _get_privateuse1_backend_namerN rO )r! r� r r r$ �
share_memory_{ s
��z_StorageBase.share_memory_r� r� c C sV ddl m} t�|�}|jdtj�� dfv r | ||d�S |� dkr&| �|�S | �|�S )�>Create a new storage in shared memory with the same data type.r r� rA rG r� r� ) r� r� rD r r> r� r� rS rU )rP r9 r r� r r r$ � _new_shared� s
z_StorageBase._new_sharedc C s | S r r r+ r r r$ �untyped� r& z_StorageBase.untypedc C s2 t j�|�}|jrtt|d �d�}| �|� dS )z Swap bytes in underlying data.� � N)rD �_utils�
_element_size�
is_complex�maxr� ro )r! r; Z elem_sizer r r$ �byteswap� s z_StorageBase.byteswap�r' r r )r1 r r2 r3 r' r )r' r �NF)r; r< r2 r
r' r )r' r
)rP rQ r9 r r' r )rP rQ r' r )r9 r �r' r< )r r r2 r
r' r �rA �r r� )T�__name__�
__module__� __qualname__�__annotations__r r r r% r, r/ r0 r5 r6 r7 r9 r> rA rG rH rK rL rM rN rO � classmethodrS rU rW rZ r[ r\ r] r^ r` ra rb rc rd re rf rg rh �propertyri rj rm rn ro rp r� r� r� r� r� r� r� r� r� r� r rE r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� �
__classcell__r r r� r$ r % s�
� �
�
� r c s t �� �� fdd��}|S )Nc sB d }d }t �" | j}|tv rt| }nt�� t|< t| �� |}W d � n1 s+w Y |d urF|� W d � n1 sAw Y z3� | g|�R i |��W |d ury| j|ks]J �t � t| �� t|= W d � S 1 ssw Y S S |d ur�| j|ks�J �t � t| �� t|= W d � w 1 s�w Y w r )�_share_memory_lockr r � threading�RLock�acquire�release)r! r" r# Zto_freeZto_wait�key��fnr r$ �wrapper� s:
� � � �
� �z-_share_memory_lock_protected.<locals>.wrapper)� functools�wraps)r r r r r$ � _share_memory_lock_protected� s r
c sr e Zd Z� fdd�Zedd� �Zedd� �Zedd d
��Ze� fd d ��Z e� fd
d��Z
e� fdd��Z � Z S )r c s& | j jdkr
td��t� j|i |��S )Nrt �$Not available for 'meta' device type)r r> r* r� r/ r r� r r$ r/ � s zUntypedStorage.__getitem__c C � | j jdkS �NrA �r r> r+ r r r$ ri � r� zUntypedStorage.is_cudac C r �NrG r r+ r r r$ rj � r� zUntypedStorage.is_hpur' r< c C r8 )z�Returns the file name associated with this storage.
The file name will be a string if the storage is on CPU and was created via
:meth:`~torch.from_file()` with ``shared`` as ``True``. This attribute is ``None`` otherwise.
)rp r+ r r r$ rk � s zUntypedStorage.filenamec � t � j|i |��S )a{
Moves the storage to shared memory.
This is a no-op for storages already in shared memory and for CUDA
storages, which do not need to be moved for sharing across processes.
Storages in shared memory cannot be resized.
Note that to mitigate issues like `this <https://github.com/pytorch/pytorch/issues/95606>`_
it is thread safe to call this function from multiple threads on the same object.
It is NOT thread safe though to call any other function on self without proper
synchronization. Please see :doc:`/notes/multiprocessing` for more details.
.. note::
When all references to a storage in shared memory are deleted, the associated shared memory
object will also be deleted. PyTorch has a special cleanup process to ensure that this happens
even if the current process exits unexpectedly.
It is worth noting the difference between :meth:`share_memory_` and :meth:`from_file` with ``shared = True``
#. ``share_memory_`` uses `shm_open(3) <https://man7.org/linux/man-pages/man3/shm_open.3.html>`_ to create a
POSIX shared memory object while :meth:`from_file` uses
`open(2) <https://man7.org/linux/man-pages/man2/open.2.html>`_ to open the filename passed by the user.
#. Both use an `mmap(2) call <https://man7.org/linux/man-pages/man2/mmap.2.html>`_ with ``MAP_SHARED``
to map the file/object into the current virtual address space
#. ``share_memory_`` will call ``shm_unlink(3)`` on the object after mapping it to make sure the shared memory
object is freed when no process has the object open. ``torch.from_file(shared=True)`` does not unlink the
file. This file is persistent and will remain until it is deleted by the user.
Returns:
``self``
)r� r� r r� r r$ r� � s !z UntypedStorage.share_memory_c r r )r� rO r r� r r$ rO � � z UntypedStorage._share_fd_cpu_c r r )r� rN r r� r r$ rN r z#UntypedStorage._share_filename_cpu_r� )
r� r� r� r/ r� ri rj rk r
r� rO rN r� r r r� r$ r � s
"c C s t jt�| �dd�S )NF)Z weights_only)rD �loadr� r� )r� r r r$ r� � r� )�maxsizec
C s, t jt jt jt jt jt jt jt jt j t j
h
S r ) rD r� r� r� r� Zbits8Zbits16Zbits1x8Zbits2x4Zbits4x2� complex32r r r r$ � _new_dtypes s �r c C s� i t jd�t jd�t jd�t jd�t jd�t jd�t jd�t jd�t j d �t j
d
�t j d �t j d �t j
d
�t jd�t jd�t jd�t jd�S )N�
DoubleStorage� FloatStorage� HalfStorage� LongStorage�
IntStorage� ShortStorage� CharStorage� ByteStorage� BoolStorage�BFloat16Storage�ComplexDoubleStorage�ComplexFloatStorage� QInt8Storage�
QInt32Storage�
QUInt8Storage�QUInt4x2Storage�QUInt2x4Storage)rD r� r� r� r� r� �int16r� r� r� r� r� r� �qint8�qint32�quint8�quint4x2�quint2x4r r r r$ �_dtype_to_storage_type_map sF �������� �
� � �
�����r. c C s dd� t � �� D �} | S )Nc S s i | ]\}}||�qS r r )r| r �valr r r$ �
<dictcomp>; s z._storage_type_to_dtype_map.<locals>.<dictcomp>)r. �items)Z dtype_mapr r r$ �_storage_type_to_dtype_map9 s r2 c
C sx |t jt jt jt jt jfv r/t jt jt jt jt jt jt jt jt jt ji}t j | || |d�}nt j | ||d�}|�
� j S )Nr� ) rD r+ r, r- r* r) r� �int32r� r� r� �_untyped_storage)�sequencer; r �interpret_dtypes�
tmp_tensorr r r$ �_get_storage_from_sequence? s$ ��
�
r8 c C s t r
t| ttjf�S t| t�S r )� HAS_NUMPYr� r� �np�integer)�xr r r$ �_isintX s
r= c C s t S r )�"_always_warn_typed_storage_removalr r r r$ �&_get_always_warn_typed_storage_removalb r& r? c C s t | t�sJ �| ad S r )r� r� r> )Z always_warnr r r$ �&_set_always_warn_typed_storage_removalf s r@ r� c C s> dd� }t � s
|� r d}tj|t| d d� dtjd< d S d S )Nc S s t td�sdS tjd S )N�
has_warnedT)�hasattr�_warn_typed_storage_removal�__dict__r r r r$ �
is_first_timeo s
z2_warn_typed_storage_removal.<locals>.is_first_timea TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage()r� )�
stacklevelTrA )r? �warnings�warn� UserWarningrC rD )rF rE �messager r r$ rC l s ��rC c C s dt jd< d S )NFrA )rC rD r r r r$ �!_reset_warn_typed_storage_removal� � rK �modulerz c C s, | � dd�d }|dtj�� dfv r|S dS )N�.r� �����rA rG r� )�rsplitrD r� r� )rM Z last_partr r r$ �_get_device_from_module� s rQ c s� e Zd ZU dZded< dZded< ded< ed d
� �Zed�d
d��Zdd� Z ddddd�� fdd�
Z
ddddd�dd�Z edd� �Z edd� �Z
dd � Zd�d d �Zd d!� Zd�d"d#�Zd$d%� Zd&d'� Zd(d)� Zd*d+� Zd�d�d0d1�Zd2d3� Zd4d5� Z d�d�d8d9�Zd�d�d:d;�Zd�d�d<d=�Zdd>�d�dAdB�Z dCdD� Z dEdF� Z d�dHdI�Z dJdK� Z dLdM� Z!dNdO� Z"dPdQ� Z#dRdS� Z$dTdU� Z%� fdVdW�Z&dXdY� Z'dZd[� Z(d\d]� Z)d�d�d`da�Z*d�d�dbdc�Z+ddde� Z,dfdg� Z-ddh�didj�Z.edkdl� �Z/edmdn� �Z0dodp� Z1dqdr� Z2dsdt� Z3dudv� Z4dwdx� Z5dydz� Z6d{d|� Z7d}d~� Z8dd�� Z9d�d�� Z:e;d�d�� �Z<d�d�� Z=e;d�d�� �Z>e;ddd��d�d���Z?d�d�� Z@d�d�� ZAd�d�� ZBd�d�� ZCd�d�� ZDd�d�� ZEd�d�� ZFd�d�� ZGd�d�� ZHd�d�� ZId�d�� ZJd�d�� ZKd�d�� ZLd�d�� ZMd�d�� ZNd�d�� ZOd�d�� ZPe;d�d�� �ZQe;d�d�� �ZRd�d�� ZSd�d�� ZTd�d�� ZUd�d�� ZVd�d�� ZWd�d�� ZXe;d�d�� �ZYd�d�� ZZd�dÄ Z[e;ddh�d�dń�Z\d�dDŽ Z]d�dɄ Z^d�d˄ Z_� Z`S )�r Fr
r Nr r � torch.dtyper; c C s | j S r )r; r+ r r r$ �_dtype� s zTypedStorage._dtyper' r< c C rI )z�Returns the file name associated with this storage if the storage was memory mapped from a file.
or ``None`` if the storage was not created by memory mapping a file.)r4 rk r+ r r r$ rk � s zTypedStorage.filenamec C s t � | �td| �� �|� | S )Nr )rC �_setitem�slice�_size)r! �valuer r r$ �fill_� s zTypedStorage.fill_)� wrap_storager; r � _internalc sb |st � | tjjkrtd��| tkrt� �| �S | � d�}|d ur(t|d ��|d ur2t|d ��|d u rqt|�dkrBt|d ��t|�dkrdt |d �sdt
|d t j j
�sdt|dt|d �� � ��t|| jt| j�d d
��S t|�dkr}t|d ��t
|tj�s�t|d t|�� � ��t| j�}|jj|kr�t|d
|� d|jj� � ��t||| jd d��S )Nz8Only child classes of _LegacyStorage can be instantiatedz�.__new__ received an invalid combination of arguments. Expected one of:
* no arguments
* (int size)
* (Sequence data)
* (*, UntypedStorage wrap_storage)z.
Keyword argument 'device' cannot be specifiedz-
Keyword argument 'dtype' cannot be specifiedr� �
Too many positional argumentsr �
Argument type not recognized: T)r; r rZ �B
No positional arguments should be given when using 'wrap_storage'�9
Argument 'wrap_storage' must be UntypedStorage, but got z"
Device of 'wrap_storage' must be z
, but got �rY r; rZ )rC rD r� �_LegacyStorage� RuntimeErrorr r� �__new__r� r= r� � collections�abc�Sequencer� r> rS rQ r� r r r; )rP rY r; r rZ r" �
arg_error_msg�
cls_devicer� r r$ rb � s� � � �� �
����� �� ��
����zTypedStorage.__new__)r r; rY rZ c G s� |st � d}|d urUt|�dkrt|d ��|d u r!t|d ��t|tj�s2t|dt|�� � ��|d ur<t|d ��|| _t|tj�sPt|dt|�� � ��|| _ d S |d u r]t�
� n|| _t� |d u rhdn|�}| jtj tj
tjtjtjfv r�|jd kr�td
��t|�dkr�tj|d �| _ d S t|�d kr�t|d �r�tjt|d �| �� |d �| _ d S t|d tjj�r�t|d | j|�| _ d S t|d
t|d �� � ��t|d ��)Na1 TypedStorage.__init__ received an invalid combination of arguments. Expected one of:
* (*, torch.device device, torch.dtype dtype)
* (int size, *, torch.device device, torch.dtype dtype)
* (Sequence data, *, torch.device device, torch.dtype dtype)
* (*, UntypedStorage wrap_storage, torch.dtype dtype)r r] z#
Argument 'dtype' must be specifiedz+
Argument 'dtype' must be torch.dtype, not zG
Argument 'device' should not be specified when 'wrap_storage' is givenr^ r� rA �/Cannot create CUDA storage with quantized dtyper� r� r\ r[ )rC r� ra r� rD r; r� r> r r4 �get_default_dtyper r+ r, r- r* r) r= r� r� rc rd re r8 )r! r r; rY rZ r" rf r r r$ r% � s� � ��� ���� ��
�
� �
��� zTypedStorage.__init__c C � t � | jjjdkS r
�rC r4 r r> r+ r r r$ ri Y � zTypedStorage.is_cudac C rj r rk r+ r r r$ rj ^ rl zTypedStorage.is_hpuc C s t � | jS )z2Return the internal :class:`torch.UntypedStorage`.)rC r4 r+ r r r$ r� c s zTypedStorage.untypedr
c C sB t |�tjks J �t | �tkrttt|| jdd��S t | �|d�S )NTr_ �rY )r> rD r r r r
r; )r! r� r r r$ �_new_wrapped_storageh s ��z!TypedStorage._new_wrapped_storagec C � t � | �� S r �rC rV r+ r r r$ r, u � zTypedStorage.__len__c C s� |d u r |r
| � � S dS t|�tkr tdt| �� dt|�� ���|rG|| � � ks/|| � � k r;td|� d| �� � ���|dkrA|S || � � S || � � ksT|| � � k r`td|� d| �� � ���|| � � S )Nr �can't index a � with zindex z" out of range for storage of size )rV r> r� r� �
IndexErrorr9 )r! r. Zis_stopr r r$ �_maybe_wrap_indexy s& � � z TypedStorage._maybe_wrap_indexc C s t � | �||�S r )rC rT )r! r. rW r r r$ r0 � s zTypedStorage.__setitem__c
C s� t |ttf�stdt| �� dt|�� ���t�|�r#tdt|�� ���| jtjtj tj
tj tj fv rctjtj
tj tj
tj
tj
tj tjtj tji}|| j }tjg || jjd�}|�t| j|dd�� ntjg | j| jjd��| �}|||< d S )Nrr rs z cannot set item with value type r� Tr_ )r� r� rU ra r> rD �
is_storager; r+ r, r- r* r) r� r3 r� r� r4 r r� r )r! r. rW r6 Z tmp_dtyper7 r r r$ rT � s@
��
��� �� zTypedStorage._setitemc C � t � | �|�S r )rC �_getitemr- r r r$ r/ � �
zTypedStorage.__getitem__c
C s | j jjdkr td��t|t�rtd��t|t�s'tdt| �� dt|�� ���| jt j
t j t j t j
t jfv rZt j
t jt j t jt j t jt j
t jt jt ji}t| j || j dd��|�S | �|�}dd lm} |� � t jg | j| j jd
��| �}|| �� W d � S 1 s�w Y d S ) Nrt r z7slices are only supported in UntypedStorage.__getitem__rr rs Tr_ r )�unset_fake_temporarilyr� )r4 r r> r* r� rU ra r� r; rD r+ r, r- r* r) r� r3 r� r rx ru Z torch._subclasses.fake_tensorrz r� r� �item)r! r. r6 Z idx_wrappedrz r7 r r r$ rx � sL
�
����
��
$�zTypedStorage._getitemr1 r r2 �_Optional[bool]c C s6 t � t|t�r| j�|j|� | S | j�||� | S r )rC r� r r4 r5 r4 r r r$ r5 � s
�zTypedStorage.copy_c C ro r )rC �_nbytesr+ r r r$ r7 � rq zTypedStorage.nbytesc C �
| j �� S r )r4 r7 r+ r r r$ r} � �
zTypedStorage._nbytesr� �&Union[_StorageBase, TypedStorage, str]c C sR t � |d u r"| �� }|d ur|jd |j S d�| jt| �jg�S | j�||�S )NrN )rC �_get_legacy_storage_classr� r� r� r> r4 )r! r; r2 Z legacy_classr r r$ r> � s zTypedStorage.typec C �D t � | jtjtjtjtjtjfv rtd��| j �
||�}| � |�S )Nrh ) rC r; rD r+ r, r- r* r) ra r4 rA rn )r! r r2 Z cuda_storager r r$ rA � �
zTypedStorage.cudac C r� )Nz.Cannot create HPU storage with quantized dtype) rC r; rD r+ r, r- r* r) ra r4 rG rn )r! r r2 Z hpu_storager r r$ rG r� zTypedStorage.hpur� r r c C sT t � | jtjtjtjtjtjfv r td|j �
� � d���| j j ||d�}| �
|�S )NzCannot create z storage with quantized dtyperB )rC r; rD r+ r, r- r* r) ra r> �upperr4 rE rn )r! r r2 Z
to_storager r r$ rE % s ��
zTypedStorage.toc C ro r )rC r� r+ r r r$ rH 4 rq zTypedStorage.element_sizec C s t j�| j�S r )rD r� r� r; r+ r r r$ r� 9 rL zTypedStorage._element_sizer c C � t � | j�� S r )rC r4 rK r+ r r r$ rK < ry zTypedStorage.get_devicec sv t � dt�� �� d� j� d� j� dt� �� d� }� jjdkr#d| S dd �� fd
d �t� � � �D �� }|d | S )
Nrq z(dtype=z , device=rr rs rt ru rv rw c 3 rx r ry r{ r+ r r$ r~ I r z'TypedStorage.__str__.<locals>.<genexpr>r� )
rC rD r� r; r r� r> r� r� r9 r� r r+ r$ �__str__@ s ��� $ zTypedStorage.__str__c C � t � t| �S r )rC rz r+ r r r$ r� L rq zTypedStorage.__repr__c s$ t � t� fdd�t� �� �D ��S )Nc 3 r� r r r{ r+ r r$ r~ R r� z(TypedStorage.__iter__.<locals>.<genexpr>)rC r� r� r9 r+ r r+ r$ r� P s zTypedStorage.__iter__c C s t � | �t�| j��S r )rC rn �copyr4 r+ r r r$ r� T � zTypedStorage.__copy__c C rw r )rC � _deepcopy�r! r� r r r$ r� X ry zTypedStorage.__deepcopy__c C s | � t�| j|��S r )rn r� �deepcopyr4 r� r r r$ r� ] r zTypedStorage._deepcopyc s t � t� �� | �� S r )rC r� r� r7 r+ r� r r$ r� ` r� zTypedStorage.__sizeof__c C � t � | �| j�� �S )r� )rC rn r4 r� r+ r r r$ r� d � zTypedStorage.clonec C r� r� )rC r� r+ r r r$ r� i � zTypedStorage.tolistc C r� )r� )rC rn r4 r� r+ r r r$ r� n r� zTypedStorage.cpurA r� c C s t � | j�|�S )z�Determine whether the CPU TypedStorage is already pinned on device.
Args:
device (str or torch.device): The device to pin memory on. Default: ``'cuda'``
Returns:
A boolean variable.
)rC r4 r� r� r r r$ r� s s zTypedStorage.is_pinnedc C s t � | �| jj|d��S )z�Copy the CPU TypedStorage to pinned memory, if it's not already pinned.
Args:
device (str or torch.device): The device to pin memory on. Default: ``'cuda'``.
Returns:
A pinned CPU storage.
r� )rC rn r4 r� r� r r r$ r� s �zTypedStorage.pin_memoryc C ro )r� )rC �_share_memory_r+ r r r$ r� � r� zTypedStorage.share_memory_c C � | j �� | S r )r4 r� r+ r r r$ r� � �
zTypedStorage._share_memory_r� c C s> |du rd}t �|�}t jj|| �� |d�}t|| jdd�S )r� Nr� r� Tr_ )rD r r r� r� r r; )r! r9 r r� r r r$ r� � s
��zTypedStorage._new_sharedc C rI r )r4 r r+ r r r$ r � r� zTypedStorage._cdatac C s t � | jjS r )rC r4 r r+ r r r$ r � r� zTypedStorage.devicec C ro r rp r+ r r r$ r9 � rq zTypedStorage.sizec C s | j �� | �� S r )r4 r7 r� r+ r r r$ rV � s zTypedStorage._sizec C ro r )rC �_pickle_storage_typer+ r r r$ �pickle_storage_type� rq z TypedStorage.pickle_storage_typec
C s< zt � | j W S ty } z
td| j� d��|�d }~ww )Nzdtype z is not recognized)r. r; �KeyError)r! �er r r$ r� � s ��z!TypedStorage._pickle_storage_typec C r� r� r� r� r r r$ r� � r� zTypedStorage.__reduce__c C ro r )rC � _data_ptrr+ r r r$ rL � rq zTypedStorage.data_ptrc C r~ r )r4 rL r+ r r r$ r� � r zTypedStorage._data_ptrc C r� r )rC r4 rM r+ r r r$ rM � ry zTypedStorage.resizablec C s t � | �|� d S r )rC �_resize_r_ r r r$ r` � s zTypedStorage.resize_c C s | j �|| �� � d S r )r4 r` r� r_ r r r$ r� � s zTypedStorage._resize_c O � t j|i |��S r )r rh rV r r r$ rh � � zTypedStorage._free_weak_refc O � | j j|i |��S r )r4 ra r r r r$ ra � r� zTypedStorage._weak_refc O s t � | j|i |��S r )rC � _from_bufferrV r r r$ rW � r� zTypedStorage.from_bufferr� c O s� | t kr2|d u r t�� n|}t�|d u rdn|�}|jdkr&td|j� ���tjj|d|i|��}n$|d us<t|�dkr@td��|d urHtd��| j }tjj|d|i|��}t ||dd�S ) Nr� z3TypedStorage.from_buffer: Not available for device r; � zefrom_buffer: 'dtype' can only be specified in UntypedStorage.from_buffer and TypedStorage.from_bufferzffrom_buffer: 'device' can only be specified in UntypedStorage.from_buffer and TypedStorage.from_bufferTr_ )
r rD ri r r> ra r rW r� rS )rP r; r r" r# r� r r r$ r� � s>
���������zTypedStorage._from_bufferc C s^ t |tj�stdt|�� ���tjg | j| jd��| ��|�� � }|�
� | �
� kr-|� � }|S r� ) r� rD r; r� r> r� r r� rE r� rL r� r� r r r$ r s �zTypedStorage._toc C � t � | �tj�S r� )rC r rD r� r+ r r r$ r� � zTypedStorage.doublec C r� r� )rC r rD r� r+ r r r$ r� r� zTypedStorage.floatc C r� r� )rC r rD r� r+ r r r$ r� r� zTypedStorage.halfc C r� r� )rC r rD r� r+ r r r$ r� " r� zTypedStorage.longc C r� r� )rC r rD r� r+ r r r$ r� ' r� zTypedStorage.intc C r� r� )rC r rD r� r+ r r r$ r� , r� zTypedStorage.shortc C r� r� )rC r rD r� r+ r r r$ r� 1 r� zTypedStorage.charc C r� r� )rC r rD r� r+ r r r$ r� 6 r� zTypedStorage.bytec C r� r� )rC r rD r� r+ r r r$ r� ; r� zTypedStorage.boolc C r� r� )rC r rD r� r+ r r r$ r� @ r� zTypedStorage.bfloat16c C r� r� )rC r rD r� r+ r r r$ r� E r� zTypedStorage.complex_doublec C r� r� )rC r rD r� r+ r r r$ r� J r� zTypedStorage.complex_floatc C r� r� )rC r rD r� r+ r r r$ r� O r� zTypedStorage.float8_e5m2c C r� r� )rC r rD r� r+ r r r$ r� T r� zTypedStorage.float8_e4m3fnc C r� r� )rC r rD r� r+ r r r$ r� Y r� z TypedStorage.float8_e5m2fnuzc C r� r� )rC r rD r� r+ r r r$ r� ^ r� z TypedStorage.float8_e4m3fnuzc C s@ t � | tkr td��t�|||tj�| j� �}| |d�}|S )a� from_file(filename, shared=False, size=0) -> Storage
Creates a CPU storage backed by a memory-mapped file.
If ``shared`` is ``True``, then memory is shared between all processes.
All changes are written to the file. If ``shared`` is ``False``, then the changes on
the storage do not affect the file.
``size`` is the number of elements in the storage. If ``shared`` is ``False``,
then the file must contain at least ``size * sizeof(Type)`` bytes
(``Type`` is the type of storage). If ``shared`` is ``True`` the file will be created if needed.
Args:
filename (str): file name to map
shared (bool): whether to share memory (whether ``MAP_SHARED`` or ``MAP_PRIVATE`` is passed to the
underlying `mmap(2) call <https://man7.org/linux/man-pages/man2/mmap.2.html>`_)
size (int): number of elements in the storage
z/from_file can only be called on derived classesrm ) rC r ra r rm rD r� r� r; )rP rk rl r9 r� r� r r r$ rm c s �
zTypedStorage.from_filec O r� r )r rn rV r r r$ rn � r� zTypedStorage._expiredc O r� r )r4 r^ r r r r$ r^ � r� zTypedStorage._write_filec O r� r )r4 rb r r r r$ rb � r� zTypedStorage._set_from_filec O r� r )r4 rc r r r r$ rc � r� zTypedStorage._set_cdatac O r� r )r4 rd r r r r$ rd � r� zTypedStorage._share_cuda_c C ro r )rC �
_is_sharedr+ r r r$ re � rq zTypedStorage.is_sharedc C r~ r )r4 re r+ r r r$ r� � r zTypedStorage._is_sharedc O � t jj|i |��S r )rD r rf rV r r r$ rf � r z TypedStorage._new_shared_cudac O s* | j j|i |��\}}}|||| �� fS r )r4 rN r� )r! r" r# Zmanager_handleZstorage_handler9 r r r$ rN � s �z!TypedStorage._share_filename_cpu_c C r� r )r4 r] r+ r r r$ r] � r� zTypedStorage._shared_decrefc O s t jj|i |��S r �rD r r[ )rP r r" r# r r r$ �_release_ipc_counter� r z!TypedStorage._release_ipc_counterc O r� r )r4 rg r r r r$ rg � r� zTypedStorage._shared_increfc O s& | j j|i |��\}}||| �� fS r )r4 rO r� )r! r" r# �fdr9 r r r$ rO � s zTypedStorage._share_fd_cpu_c C sz | j t� vrd S t� | j }| jjdddtj�� fvr d S | jjdkr%tntt| jj�}zt||�W S ty< Y d S w )Nr� rA rG ) r; r. r r> rD r� r� �getattr�AttributeError)r! Z storage_namerM r r r$ r� � s" � � �z&TypedStorage._get_legacy_storage_classr� )r' r
)Fr )r1 r r2 r| r� )r; r< r2 r� r' r� )r r r2 r� r' r
r� r� r� )ar� r� r� r r� r r� rS rk rX rb r% ri rj r� rn r, ru r0 rT r/ rx r5 r7 r} r> rA rG rE rH r� rK r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r r r9 rV r� r� r� rL r� rM r` r� r� rh ra rW r� r r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� rm rn r^ rb rc rd re r� rf rN r] r� rg rO r� r� r r r� r$ r � s�
�_ �[
# , �
c @ s e Zd ZU ded< dd� ZdS )�_LegacyStorageMetarR r; c C s2 t |�tkrt| j�}||jj ko| j|jkS dS r� )r> r rQ r� r r; )rP �instancerg r r r$ �__instancecheck__� s
�z$_LegacyStorageMeta.__instancecheck__N)r� r� r� r� r� r r r r$ r� � s
r� c @ s0 e Zd Zedd� �Zedd� �Zedd� �ZdS )r` c C s t j�|| � �� �}| |d�S )r� rm )rD r r� r� )rP r9 r� r r r$ r� � s
z_LegacyStorage._new_sharedc O r� r r� rV r r r$ r� � r z#_LegacyStorage._release_ipc_counterc C s( |t j�| j� }| t j�|||�d�S )Nrm )rD r� r� r; r rZ )rP rX rY r9 Z
bytes_sizer r r$ �_new_shared_filename� s ��z#_LegacyStorage._new_shared_filenameN)r� r� r� r� r� r� r� r r r r$ r` � s
r` )� metaclassr� c
C s8 zt � | W S ty } z td| � d��|�d }~ww )Nzpickle storage type "z" is not recognized)r2 r� )r� r� r r r$ �#_get_dtype_from_pickle_storage_type� s
����r� )r� )rM rz )r� rz )A�
__future__r rc r� r r� r rG �typingr r r �_Dictr � _Optionalr r r �typing_extensionsr
rD � torch._utilsr r Z torch.typesr
r r �__all__�numpyr: r9 �ModuleNotFoundError�Lockr� r r� r r r
r� � StorageBaser r� � lru_cacher r. r2 r8 r= r> r? r@ rC rK rQ r �__doc__r> rA rG rE r� r` r� r r r r$ �<module> sr $ � }$C
E