o
�J�h�� � @ sx U d dl Z d dlZd dlZd dlZd dlZd dlZd dlZd dlmZm Z m
Z
m Z m Z m
Z
mZ d dlZd dlm mZ d dlmZ d dlmZmZ d dlmZ d dlm Z e ed�o_e ed�Z ej d d
� �Z G d d � d �Z!d
e!defdd�Z"i Z#e
e$df e%d< ej&ej'ej(ej)ej*ej+gZ,G dd� de!e j-�Z.dd� Z/dd� Z0dd� Z1dd� Z2G d d � d �Z3e3� a4dMd d �Z5d!d"� Z6d#d$� Z7d%d&� Z8d'd(� Z9d)d*� Z:d+d,� Z;e<� a=e d- e%d.< d/d0� Z>d1d2� Z?d3d4� Z@G d5d-� d-e!�ZAG d6d7� d7eA�ZBd8d9� ZCd:ejDd;eEfd<d=�ZFG d>d?� d?�ZGd
eGfd@dA�ZHG dBdC� dCejI�ZJdDdE� ZKdFdG� ZLG dHdI� dIeJ�ZMG dJdK� dKejI�ZNeN� ZOeNe%dL< dS )N� N)�Any�Callable�Dict�List�Set�Type�Union)�_utils_internal)� _dispatch_is_included_in_alias� DispatchKey)�dispatch_functorch)�TorchDispatchMode�getdlopenflags�setdlopenflagsc c sL � t sdV dS t�� } t�| tjB � z dV W t�| � dS t�| � w )z�
Context manager to set the RTLD_GLOBAL dynamic linker flag while we open a
shared library to load custom operators.
N)�_SET_GLOBAL_FLAGS�sysr r �ctypes� RTLD_GLOBAL)� old_flags� r �HC:\pinokio\api\whisper-webui.git\app\env\lib\site-packages\torch\_ops.py�
dl_open_guard s �r c @ sH e Zd ZdZdd� Zdd� Zdd� Zdd � Zd
d � Zd d
� Z dd� Z
dS )� OperatorBasez�
Base class for OpOverload (which represents C++ ATen operators) and HigherOrderOperator
(which represents Python-only operators that are unrepresentable in TorchScript).
c C s i | _ i | _i | _i | _d S �N)�_dispatch_cache�
py_kernels�python_key_table�functorch_table��selfr r r �__init__. s �
�
zOperatorBase.__init__c O � t �r ��NotImplementedError�r �args�kwargsr r r �__call__Z � zOperatorBase.__call__c C s
|| j v S r )r �r �kr r r �has_kernel_for_dispatch_key] �
z(OperatorBase.has_kernel_for_dispatch_keyc C s, | j D ]}tj�|�s|�|�r dS qdS )NTF)r �torch�_C�_dispatch_is_alias_key�has)r �ksr* r r r � has_kernel_for_any_dispatch_key` s
�z,OperatorBase.has_kernel_for_any_dispatch_keyc s � �fdd�}|S )Nc s� t �� �r#t� t�st� tj�r#� �jvsJ �| �j� < �j�� | S t � tj
j j �r9� �j
vs2J �| �j
� < | S t � t�s@J �� tjksIJ d��� �jv rZtd� � d��� � ���| �j� < �j�� | S )NzGPlease register a mode for the torch._C.DispatchKey.Python key instead.z%Trying to override a python impl for z
on operator )�inspect�isclass�
issubclassr
r- �Tensorr r �clear�
isinstancer. �
_functorch�
TransformTyper r �Pythonr � RuntimeError�name)�fn�r* r r r �innerg s0
�
�
�
�
z#OperatorBase.py_impl.<locals>.innerr )r r* r@ r r? r �py_implf s zOperatorBase.py_implc s| ddl m� m�m� � �fdd�}��fdd�}��fdd�}| �tj�|� | �tjj j
�|� | �tj j j
j�|� �S ) Nr )�CppFunctionalizeAPI�FunctorchFunctionalizeAPI�PythonFunctionalizeAPIc s �� � g| �R i |��S r r �r% r& )�_CppFunctionalizeAPIr> r r �functionalize_dk_fn� s z?OperatorBase.py_functionalize_impl.<locals>.functionalize_dk_fnc � �� | �g|�R i |��S r r )�moder% r& )�_PythonFunctionalizeAPIr> r r � functionalize_dispatch_mode_fn� � zJOperatorBase.py_functionalize_impl.<locals>.functionalize_dispatch_mode_fnc rH r r )� interpreterr% r& )�_FunctorchFunctionalizeAPIr> r r �functionalize_functorch_fn� rL zFOperatorBase.py_functionalize_impl.<locals>.functionalize_functorch_fn)�#torch._subclasses.functional_tensorrB rC rD rA r �
Functionalizer- � _subclasses�functional_tensor�FunctionalTensorModer. r9 r: )r r> rG rK rO r )rF rN rJ r> r �py_functionalize_impl� s ��z"OperatorBase.py_functionalize_implc C r! r r" r r r r r= � r( zOperatorBase.nameN) �__name__�
__module__� __qualname__�__doc__r r' r+ r2 rA rU r= r r r r r ( s ,* r �opr* c C sT | � |�r|S tj}|tjkst||�r| � |�r|S tj}|tjks(t||�r/| � |�r/|S | �tj� |��p=| � tj�}tj
}|tjkrTt||�rT| � |�rT|sT|S tj }|tjksat||�rz| � |�rz|tj krv| �tjj
�rvtd��|sz|S tj}t||�r�| � |�r�|S tj}t||�r�| � |�r�|S tj�|�r�|S td| � d|� ���)Nz ambiguous autogradother kernelzcould not find kernel for � at dispatch key )r+ r �&CompositeExplicitAutogradNonFunctional� Undefined�is_included_in_alias�CompositeExplicitAutogradr2 r- r. �*_dispatch_get_backend_keyset_from_autograd�%CompositeImplicitAutogradNestedTensor�CompositeImplicitAutograd�
AutogradOther� _dispatch_autogradother_backendsr< �Autograd� FuncTorchBatchedDecomposition� _dispatch_has_backend_fallbackr# )rZ r* �candZhas_backend_kernelr r r � resolve_key� sV
��
�
����� ri �HigherOrderOperator�_higher_order_opsc sb e Zd Z� fdd�Z� fdd�Zedd� �Zdd� Zd d
� Ze j
d d � �Z d
d� Z dd� Z
� ZS )rj c sb t � �� t| �tu rtd��|| _|| _| t|< d| _d| _ t
j � � | _
tD ]}| �|� q'd S )NzODirect instantiation of HigherOrderOperator is not allowed. Please subclass it.� higher_order�torch.ops.higher_order)�superr �typerj r< �_namerV rk �_nsrW r- r. �_dispatch_keyset_full�non_fallthrough_keys�2_HIGHER_ORDER_OP_DEFAULT_FALLTHROUGH_DISPATCH_KEYS� fallthrough)r r= � dispatch_key�� __class__r r r � s
� �z HigherOrderOperator.__init__c s0 t |t�r| j�|�s| j�|�| _t� �|�S r )r8 r rs r0 �addrn rA r) rw r r rA s zHigherOrderOperator.py_implc C � | j S r )rq r r r r � namespace � z HigherOrderOperator.namespacec C s | j �|�| _ d S r )rs �remove)r rv r r r ru � z HigherOrderOperator.fallthroughc s: ddl m} || jv r | j| }t|t�rJ �||i |��S |tjkr)t| ||�S |tjkr�g �dd� � � �fdd�}g |�|�� �R D ]}||� t|t t
f�rZ|D ]}||� qSqDt
��} t
dd� | D ��}
dd l m } |� } | d ur�t | �| j
v r�| j
t | � }
| � �}|
|g|�R i |��}W d � n1 s�w Y n td
| j� d | � d ���|tur�|S | D ]4}t |�}|jtjjkr�q�|| j
v r�| j
| }
|
|i |��}n td
| j� d
|� d ���|tur�| S q�td| j� d| � ddd� | D �� ���tj�|�}|tjk�radd l m } t� dk�ratj�tj��sat� } | d u�s*J d��t | �| j
v �s:J d| � d���| j
t | � }
| |��}|
|g|�R i |��W d � S 1 �s\w Y t| |�}|| j v�r{td| j� d|� d|� d���|tjk�r�| j | | j|< | j | }t|t��r�J �||i |��S )Nr ��_get_current_dispatch_modec S s t j�| ��d�S )Nr; )r- r. �_dispatch_keysr0 )�tensorr r r �has_python_key2 r~ z4HigherOrderOperator.dispatch.<locals>.has_python_keyc s* t | tj�r� | �r��| � d S d S d S r )r8 r- r6 �append)�arg�r� Zoverloaded_args_listr r �check_overloaded5 s �z6HigherOrderOperator.dispatch.<locals>.check_overloadedc s � � | ]}t |�V qd S r �ro ��.0r� r r r � <genexpr>@ s � z/HigherOrderOperator.dispatch.<locals>.<genexpr>)�_pop_mode_temporarilyz%There was no rule registered for HOP z
and mode z . We recommend filing an issue.z and subclass z Multiple dispatch failed for zl. There was no registered that did not return NotImplemented. Use HOP.py_impl to register some. Tried mode: z) and subclasses: c S s g | ]}t |��qS r r� )r� �ar r r �
<listcomp>o s z0HigherOrderOperator.dispatch.<locals>.<listcomp>zRIllegal invocation of dispatch on torch._C.DispatchKey.PreDispatch without a mode.zCurrent active mode z not registeredz.could not find kernel for HigherOrderOperator r[ z (resolved from �)) � torch.utils._python_dispatchr� r r8 r � FuncTorchDynamicLayerFrontModer r; �values�list�tupler� ro r r# rp �NotImplemented�__torch_dispatch__r- r. � _disabled_torch_dispatch_impl� TypeError�_to_functionality_key� PreDispatch�&_len_torch_dispatch_stack_pre_dispatch�&_dispatch_tls_is_dispatch_key_excluded�'_get_current_dispatch_mode_pre_dispatchri r )r rv r% r& r� �kernelr� r� r� �overloaded_args�overloaded_typesr� � curr_mode�handlerrI �resultZ
subclass_type�functionality_key� final_keyr r� r �dispatch! s�
� ����
��
� �� �� �
�
"�
���
z HigherOrderOperator.dispatchc s& ddl m} |� ��fdd��}|� S )Nr )�disablec s\ t � ��} tj�| �rtjj�| g� �R i ���S t� ��j�}�j|�� g� �R i ���S r ) �_to_flat_tupler- � overrides�has_torch_function�handle_torch_function�_compute_keysetrs r� �highestPriorityTypeId)� flat_args�dispatch_key_set�r% r& r r r �wrapper� s"
������z-HigherOrderOperator.__call__.<locals>.wrapper)�
torch._dynamor� )r r% r& r� r� r r� r r' � s z HigherOrderOperator.__call__c C s
| � � � S r )r= r r r r �__str__� r, zHigherOrderOperator.__str__c C rz r �rp r r r r r= � � zHigherOrderOperator.name)rV rW rX r rA �propertyr{ ru r� �abc�abstractmethodr' r� r= �
__classcell__r r rw r rj � s
}
c C s t j| i |��S r )�pytree�arg_tree_leavesrE r r r r� � � r� c C s t | |�}t||�S r )� _get_tensors�
key_extractor)r% r& rs �tensorsr r r r� � �
r� c C s t | |�}dd� |D �}t|�S )Nc S s g | ]
}t |tj�r|�qS r )r8 r- r6 )r� �tr r r r� � s z _get_tensors.<locals>.<listcomp>)r� r� )r% r& �flat_all� tensor_argsr r r r� � s
r� c C s> t j�� }| D ]
}|t j�|�B }q|t j�� }||@ }|S r )r- r. � _dispatch_tls_local_include_setr� � _dispatch_tls_local_exclude_set)r� Zkey_maskZkey_setr� r r r r� � s
r� c @ s, e Zd Zdd� Zdd� Zdd� Zdd� Zd S )
� _ModeStackStateForPreDispatchc C s d d g| _ d | _d S r )�*_ModeStackStateForPreDispatch__infra_modes�_schema_check_moder r r r r � r� z&_ModeStackStateForPreDispatch.__init__c C s |t | j�k s J �|| j|< d S r ��lenr� )r �indexrI r r r �set� s z!_ModeStackStateForPreDispatch.setc C s |t | j�k s J �| j| S r r� )r r� r r r �get� s
z!_ModeStackStateForPreDispatch.getc C s" t dd� | jD ��t| jd u� S )Nc S s g | ]}|d ur|�qS r r )r� �ir r r r� � � z7_ModeStackStateForPreDispatch.count.<locals>.<listcomp>)r� r� �intr� r r r r �count� s �z#_ModeStackStateForPreDispatch.countN)rV rW rX r r� r� r� r r r r r� � s
r� Fc sp t � � �d u s�tjjjtjjjfv sJ �|r �d u s J �� �fdd�}|� }t� }|dkr6tj�tj d� |S )Nc sh �t jjjkr� �d�} t� �dd � | S �t jjjkr*� �d�} t� �dd � | S t� j} d t� _| S �Nr � ) r- r. �_TorchDispatchModeKey�PROXYr� �!mode_stack_state_for_pre_dispatchr� �
FUNCTIONALr� )� current_mode�Z current_mode_stack_pre_dispatch�mode_keyr r � _unset_mode s
z,unset_mode_pre_dispatch.<locals>._unset_moder F)
r� r- r. r� r� r� r� �'_dispatch_tls_set_dispatch_key_includedr r� )r� � schema_checkr� r� Znew_pre_dispatch_lenr r� r �unset_mode_pre_dispatch� s
� r� c C s� ddl m} ddlm} ddlm} t| |||f�s J �t� }t| |�r5t� j }|dkr0t
d��| t� _ n,t| |�rNt� � d�}|d u sFJ �t� � d| � nt� � d�}|d u sZJ �t� � d| � |dkrot
j�tjd� d S d S )Nr )rT )�SchemaCheckMode)�ProxyTorchDispatchModezYSchemaCheckMode for pre-dispatch must be used exclusively, found other modes on the stackr� T)rP rT �#torch._subclasses.schema_check_moder� �"torch.fx.experimental.proxy_tensorr� r8 r� r� r� �AssertionErrorr� r� r- r. r� r r� )rI rT r� r� Zprevious_mode_stack_lenr� r r r �_set_mode_pre_dispatch s8 ��
�
�r� c C sn t � } t� }|dkrtd��| jd urtd dd�S | �d�d ur'ttjjj �S | �d�d ur5ttjjj
�S d S )Nr z Trying to pop empty mode stackT)r� r� ) r� r� r� r� r� r� r- r. r� r� r� )Z
mode_stackZpre_dispatch_lenr r r �_pop_mode_from_pre_dispatchB s
�r� c C s
t � �� S r )r� r� r r r r r� Q r, r� c C sB | t jjjt jjjfv sJ �| t jjjkrt� �d�S t� �d�S r� )r- r. r� r� r� r� r� )r� r r r � _get_dispatch_mode_pre_dispatchU s
� r� c C sf t � jd ur
t � jS t � �� } | dkrt � �d�S | dkr1t � �d�d ur+t � �d�S t � �d�S d S )N� r� r )r� r� r� r� )� stack_lenr r r r� ` s
��
�r� c C � t S r )�"_mode_stack_state_for_pre_dispatchr r r r r� p � r� �
OpOverload�
cached_opsc C s t �| � d S r )r� ry )� op_overloadr r r �
add_cached_opx s r� c C s t �� d S r )r� r7 r r r r �reset_cached_ops} s r� c C r� r )r� r r r r �get_cached_ops� r� r� c s� e Zd Z� fdd�Zedd� �Zedd� �Zedd� �Zd,d
d �Zd d
� Z dd� Z
dd� Z dd� Z dd� Z
� fdd�Z� fdd�Zedd� �Zd d � Zd d � Zd d!� Zd"d#� Zd$d%� Zed&d'� �Zed(d)� �Zed*d+� �Z� ZS )-r� c s t � �� || _|| _|| _|| _|| _|jdkrdn|j| _| jj | _
|jr1| j
d|j 7 _
| jj � d�d � d| j� �| _ |j
| _
|j
|_
| j
| _i | _d | _| jtjjv | _d }| jjD ]}|jd u riqa|d u rr|jj}qa|jjpw|}qa|d uo| | _d S )N� �default�.�::r� )rn r �_op�_op_dk�_schema�_overloadpacket�_tags�
overload_name�
_overloadnamer= rp �splitrV rW rX �__annotations__� _lazy_handler- �libraryZ_defsZ_defined_in_python� arguments�
alias_info�is_write�is_view)r �overloadpacketrZ Zop_dk�schema�tagsr r� rw r r r � s4
�
zOpOverload.__init__c C � | j j�d�d S �Nr� r �r� r= r� r r r r �
_namespace� � zOpOverload._namespacec C r )Nr� r� r r r r r �_opname� r
zOpOverload._opnamec C s( | j d u rtj�| jj| jj�| _ | j S r )r r- r. � _dispatch_find_schema_or_throwr� r= r� r r r r �_handle� s
�zOpOverload._handleNc C � | S r r �r �memor r r � __deepcopy__� r( zOpOverload.__deepcopy__c C � dj g | jj�d��| j�R � S )Nz'<OpOverload(op='{}.{}', overload='{}')>r� ��formatr� r= r� r� r r r r �__repr__� s
��zOpOverload.__repr__c O s | j |i |��S r �r� r$ r r r r' � r� zOpOverload.__call__c O s | j j|g|�R i |��S r )r �redispatch_boxed)r �keysetr% r& r r r �
redispatch� rL zOpOverload.redispatchc C �
t | j�S r ��hashr� r r r r �__hash__� r, zOpOverload.__hash__c C r )Nz{}.{}.{}r� r r r r r r� � s zOpOverload.__str__c s t � �|�ptj�| �� |�S r )rn r+ r- r. �%_dispatch_has_kernel_for_dispatch_keyr= r) rw r r r+ � s
��z&OpOverload.has_kernel_for_dispatch_keyc s t j�| �� |�pt� �|�S r )r- r. �)_dispatch_has_kernel_for_any_dispatch_keyr= rn r2 )r r1 rw r r r2 � s
�
�z*OpOverload.has_kernel_for_any_dispatch_keyc C r r
r r r r r r{ � r
zOpOverload.namespacec C s" t j}|| jv ptj�| �� |�S r )r rb r r- r. r! r= )r �dkr r r �_can_decompose� s �zOpOverload._can_decomposec O sR t j}|| jv r| j| |i |��S tj�| �� |�r'| j|g|�R i |��S tS r ) r rb r r- r. r! r= r� r� )r r% r& r# r r r � decompose� s
zOpOverload.decomposec C s | j �|d � d S r )r �pop)r �keyr r r �_uncache_dispatch r~ z OpOverload._uncache_dispatchc s6 � �j vsJ �� d� � ���� tjkr8t�t�s&�js&� �j � < t�� � S � �fdd�}|�j � < t�� |S tj� � �}|tj
krYt � }|dkrYtj� tj�sY�fdd�}|S t
�� �}� tj
k}� tjkr�dd lm m} |jr�|��|�}|r�|�j � < t�� |S �j�||�}|r�|�j � < t�� |S )N� c s� ddl m} t|� �}|d usJ d��|�jvrOt�t�rCtjj� � �}tj
jj |�g| �R i |��W d � S 1 s=w Y n �j � g| �R i |��S tjj� � �}�j| |g| �R i |��W d � S 1 snw Y d S )Nr r zMIllegal invocation of dispatch on torch._C.DispatchKey.Python without a mode.)
r� r� ro r r8 �TorchBindOpOverloadr- �utils�_python_dispatchr� �_library�handle_dispatch_moder� )r% r& r� r� rI �r' r r r r� s(
�
���"�$�z)OpOverload._get_dispatch.<locals>.handlerr c sV t jdd� �}|� �}tjjj|� g| �R i |��W d � S 1 s$w Y d S )Nc s s( � t � } z
| V W t| � d S t| � w r )r� r� )Ztop_moder r r �(_temporarily_pop_modes_from_pre_dispatch8 s
�z[OpOverload._get_dispatch.<locals>.handler.<locals>._temporarily_pop_modes_from_pre_dispatch)�
contextlib�contextmanagerr- r- r+ r. )r% r& r0 r� r r r r� 7 s
���$�)r r r; r8 r* r r� r- r. r� r� r� r� ri rQ Ztorch._dispatch.python� _dispatch�pythonZCROSSREF_FUNCTIONALIZEZmake_crossref_functionalizer r� ) r r' r� r� Zcurr_stack_lenr� Z cache_resultZ
pydispatch�rr r/ r �
_get_dispatch sF
��
zOpOverload._get_dispatchc C rz r r� r r r r r= d r� zOpOverload.namec C rz r )r� r r r r r g r| zOpOverload.overloadpacketc C rz r r r r r r rZ k r| z
OpOverload.opc C rz r )r� r r r r r o r| zOpOverload.tagsr )rV rW rX r r� r r r r r r' r r r� r+ r2 r{ r$ r% r( r6 r= r rZ r r� r r rw r r� � s: &
]
c @ s< e Zd Zdee fdd�Zejdd� �Zdd� Z dd � Z
d
S ) r* �returnc sD t jt jt jt jt jt jt jg}dt f�fdd� � � fdd�|D �S )Nr' c s@ t j�� �� | �rt j�� �� | �S | � jvp � j| t jju S r )r- r. r! r= �0_dispatch_kernel_for_dispatch_key_is_fallthroughr r Zfallthrough_kernel)r' r r r �(_may_use_fallthrough_instead_of_fallback� s �
�zWTorchBindOpOverload._fallthrough_keys.<locals>._may_use_fallthrough_instead_of_fallbackc s g | ]}� |�r|�qS r r )r� r' )r9 r r r� � s ��z9TorchBindOpOverload._fallthrough_keys.<locals>.<listcomp>)r re � AutogradCPU� AutogradCUDA�ADInplaceOrView�
BackendSelect�PythonTLSSnapshot�PythonDispatcher)r Z_DEFAULT_FALLTHROUGH_KEYSr )r9 r r �_fallthrough_keys{ s �
�z%TorchBindOpOverload._fallthrough_keysc c sZ � ddl m}m}m} z| |vr|| |j� d V W | |v r#|| = d S d S | |v r,|| = w )Nr )� _EffectType�_register_effectful_op� SIDE_EFFECTS)Z torch._higher_order_ops.effectsrA rB rC �ORDERED)r rA rB rC r r r �%_register_as_effectful_op_temporarily� s �
�z9TorchBindOpOverload._register_as_effectful_op_temporarilyc O sT t ||�r"| �� � | �||| �� �W d � S 1 s w Y | j|i |��S r )�_must_dispatch_in_pythonrE �_dispatch_in_pythonr@ r� r$ r r r r' � s
�z TorchBindOpOverload.__call__c C s� t j�� }|D ]}|�|�}qt|||�}|�� }|| jvr#| �|�n| j| }t|t �rNt j�
| � � |�r@| � ||||g �S t
d| � d|� d|� d���t|t�sUJ �||i |��S )Nz
Torchbind op z4 received a FakeScriptObject input when dispatching z�. but no python implementation is found. Please file an issue on this when you encounter this error. This error can happen when you export or compile the model. It can still happpen even if a C++ implementation for zz. has been registered. That's because FakeScriptObject purely lives in python and cannot work with a C++ implementation.)r- r. rr r} r� r� r r6 r8 r r8 r= rG r< r ) r r% r& Zfallthrough_keysrs r' r� rv r� r r r rG � s.
��
� ���
z'TorchBindOpOverload._dispatch_in_pythonN) rV rW rX r r r@ r1 r2 rE r' rG r r r r r* z s
r* c C s t �dd� | |f�S )Nc S s t | tjjj�S r )r8 r- r- Zfake_class_registryZFakeScriptObject)�objr r r �<lambda>� s
�z*_must_dispatch_in_python.<locals>.<lambda>)r� �tree_anyrE r r r rF � s �rF r r7 c C s t dd� | jD ��S )Nc s s � | ]
}t |jtj�V qd S r )r8 ro r- � ClassTyper� r r r r� � s � z)_has_script_object_arg.<locals>.<genexpr>)�anyr )r r r r �_has_script_object_arg� s rM c @ sn e Zd Zdd� Zddd�Zdd� Zdd � Zd
d � Zed d
� �Z edd� �Z
dd� Z dd� Z dd� Z
dd� ZdS )�OpOverloadPacketc C s< || _ || _|| _|| _g | _tdd� | j�� D ��| _d S )Nc s r� r )rM )r� r r r r r� � s �
�z,OpOverloadPacket.__init__.<locals>.<genexpr>) �_qualified_op_namerV r� �_overload_names�_dirrL �_schemasr� �_has_torchbind_op_overload)r �qualified_op_name�op_namerZ �overload_namesr r r r � s �zOpOverloadPacket.__init__Nc C r r r r r r r r � r( z OpOverloadPacket.__deepcopy__c C � dj | j�d�� S )Nz <OpOverloadPacket(op='{}.{}')>r� �r rO r� r r r r r s
�zOpOverloadPacket.__repr__c C r r r r r r r r r, zOpOverloadPacket.__hash__c C rW )Nz{}.{}r� rX r r r r r� r~ zOpOverloadPacket.__str__c C rz r r r r r r rZ r| zOpOverloadPacket.opc s � fdd�� j D �S )Nc s i | ] }|t j�� j|��qS r )r- r. � _get_schemarO )r� r� r r r �
<dictcomp> s ��z-OpOverloadPacket._schemas.<locals>.<dictcomp>�rP r r r r rR s
�zOpOverloadPacket._schemasc C s. |dkrdS z|� d�rt| j|�W S W n ty/ tdt| �� dt| j�� d|� d��d �w zQ|dkr7d n|}tj�| j|�}|d u rRtd
t| �� d |� d���|\}}}tj� | j|�}t
|�skt | ||||�nt | ||||�}t
| ||� | j�|� |W S ty� td
t| �� d |� d��d �w ) N�__file__� torch.ops�__�'zH' can't have an overload name beginning with '__' and the underlying op z has no attribute z either.r� r� zThe underlying op of 'z' has no overload name ')�
startswith�getattrr� �AttributeError�strr- r. �_get_operation_overloadrO rY rM r� r* �setattrrQ r� r< ) r r' Zuse_keyZ
op_dk_tagsZop_Zop_dk_r r �overloadr r r � __getattr__ sT
� �����
��
�� ���z OpOverloadPacket.__getattr__c C r r ��iterrQ r r r r �__iter__L r, zOpOverloadPacket.__iter__c O s0 | j rt||�rt| ||�S | j|i |pi ��S r )rS rF �!_call_overload_packet_from_pythonr� r$ r r r r' Q s zOpOverloadPacket.__call__c C s dd� | j D �S )Nc S s g | ]}|r|nd �qS )r� r )r� �nr r r r� ` r� z.OpOverloadPacket.overloads.<locals>.<listcomp>r[ r r r r � overloads_ r� zOpOverloadPacket.overloadsr )rV rW rX r r r r r� r� rZ rR rg rj r' rm r r r r rN � s
5 rN c C s� t jj| g|�R i |��\}}|r|S i }d }| �� D ]0}t| |�}zt jj|jg|�R i |��} |}W n tyK }
z
|
||< W Y d }
~
qd }
~
ww |rU||i |��S d| � d�} t|� � �D ]\} \}
}| d|
� d|� d�7 } qat| ��)Nz'Fail to match any TorchBindOverload of z with following exceptions:
zOverload name z:
�
)
r- r. �(_maybe_call_torch_function_for_op_packetrm ra �&_check_schema_allow_fake_script_objectr� r< � enumerate�items)rZ r% r& Ztorch_function_called�ret�
exceptionsZfound_opr� r� �_�e�err_msgr� r' �msgr r r rk e sD ��
�
�����
�rk c s0 e Zd ZdZ� fdd�Zdd� Zdd� Z� ZS )� _OpNamespacea0
An op namespace to dynamically bind Operators into Python.
Say a user has created a custom Operator called "my_namespace::my_op". To
call this op, the user will write torch.ops.my_namespace.my_op(...).
At startup, this operation will not yet be bound into Python. Instead, the
following sequence of magic tricks will occur:
1. `torch.ops.my_namespace` will invoke the `__getattr__` magic method
on the `torch.ops` object, which will create a new `_OpNamespace`
object called `my_namespace` and set it as an attribute on the `ops`
object.
2. `torch.ops.my_namespace.my_op` will then invoke `__getattr__` on
the `my_namespace` object, which will retrieve the operation via
`torch.get_operation`, a function bound from C++, and then in a similar
fashion bind this new object onto the `my_namespace` object.
3. `torch.ops.my_namespace.my_op(...)` then calls this new operation
and subsequent accesses will incur no further lookup (the namespace and
operation will already exist).
c s t � �d| � || _g | _d S )Nz
torch.ops.)rn r r= rQ )r r= rw r r r � s
z_OpNamespace.__init__c C r r rh r r r r rj � r, z_OpNamespace.__iter__c
C s� |dkrdS |dv rt d|� d| j� d���| j}|� d|� �}| jd | }zt||�\}}|d u r?t d | j� d
|� d���W n tyY } z
t d | j� d
|� d��|�d }~ww ||_t||||�}| jd | |_t| ||� | j�|� |S ) Nr\ r] )�
__origin__�__self__zInvalid attribute 'z' for '_OpNamespace' 'r_ r� r� z'_OpNamespace' '�' object has no attribute ') rb r= rW � _get_packetr< rN re rQ r� ) r rU Znamespace_namerT � module_namerZ rV rv Zopoverloadpacketr r r rg � s@ �������� z_OpNamespace.__getattr__)rV rW rX rY r rj rg r� r r rw r ry � s
ry c C s6 t j�| �\}}|d urt jj�|| � ||_||fS r )r- r. �_jit_get_operation�jit� _builtinsZ_register_builtinrW )�qualnameZ op_modulerZ rV r r r r} � s
r} c C s0 t | j| jj�\}}|d usJ �|| _|| _d S r )r} rO r� rW rP )ZpacketrZ rV r r r �_refresh_packet� s
r� c s$ e Zd Z� fdd�Zdd� Z� ZS )�_PyOpNamespacec s t � �|� || _d S r )rn r �_ops)r r= �opsrw r r r � s
z_PyOpNamespace.__init__c C s> | j �|d �}|d u rtd| j� d|� d���t| ||� |S )Nz'_PyOpNamespace' 'r| r_ )r� r� rb r= re )r r= rZ r r r rg � s � z_PyOpNamespace.__getattr__)rV rW rX r rg r� r r rw r r� � s r� c s@ e Zd ZdZ� fdd�Zdd� Zdd� Zdd � Zd
d � Z� Z S ) �_Opsz_ops.pyc s* t � �d� t� | _tdt�| _g | _d S )Nr] rm )rn r r� �loaded_librariesr� rk �_higher_order_op_namespacerQ r rw r r r s �
z
_Ops.__init__c C s2 |dkr| j S t|�}t| ||� | j�|� |S )Nrl )r� ry re rQ r� )r r= r{ r r r rg s z_Ops.__getattr__c C r r rh r r r r rj r, z
_Ops.__iter__c C s t �|� dS )a{
Imports a Python module that has torch.library registrations.
Generally, to extend PyTorch with custom operators, a user will
create a Python module whose import triggers registration of
the custom operators via a torch.ops.load_library call or a call
to one or more torch.library.* APIs.
It is unexpected for Python modules to have side effects, so some
linters and formatters will complain. Use this API to import Python
modules that contain these torch.library side effects.
Args:
module (str): The name of the Python module to import
N)� importlib�
import_module)r �moduler r r r� s z_Ops.import_modulec C sV t �� rdS t�|�}t� �
t�|� W d � n1 s w Y | j�|� dS )a
Loads a shared library from the given path into the current process.
The library being loaded may run global initialization code to register
custom operators with the PyTorch JIT runtime. This allows dynamically
loading custom operators. For this, you should compile your operator
and the static registration code into a shared library object, and then
call ``torch.ops.load_library('path/to/libcustom.so')`` to load the
shared object.
After the library is loaded, it is added to the
``torch.ops.loaded_libraries`` attribute, a set that may be inspected
for the paths of all libraries loaded using this function.
Args:
path (str): A path to a shared library to load.
N) r- �_running_with_deployr �resolve_library_pathr r �CDLLr� ry )r �pathr r r � load_library, s
�z_Ops.load_library)
rV rW rX r\ r rg rj r� r� r� r r rw r r� s r� r� )F)Pr� r1 r r� r3 r �types�typingr r r r r r r r- �torch.utils._pytreer+ �_pytreer� r �torch._Cr
r^ r Z torch._functorch.pyfunctorchr r� r
�hasattrr r2 r r ri rk rc r� r? r> r< r= � AutocastCPU� AutocastCUDArt �ABCrj r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r� r* rF �FunctionSchema�boolrM rN rk �
ModuleTypery r} r� r� r� r� r r r r �<module> sx
$
5�
I
$' rg u5E
K