o
�J�hW} � @ s� d dl mZ d dlZd dlZd dlZd dlZd dlZd dlZd dlZd dl Z
d dl Z d dl m
Z
d dlmZ d dlmZmZmZmZmZmZmZmZmZmZmZ d dlm Z d dl m Z d dl m!Z! d d l"m#Z# e�$e%�Z&erwd dl'Z'd dl(Z( G d
d � d e�Z)G d d
� d
e�Z*G dd� dej+�Z, G dd� d�Z-G dd� de�Z.ej/G dd� d��Z0ed�Z1 ej/G dd� d��Z2 ej/G dd� de2��Z3 G dd � d ee1 �Z4G d d � d �Z5G d d � d �Z6G d!d"� d"e4e6 �Z7G d#d$� d$�Z8G d%d&� d&e4e8 �Z9 G d'd(� d(�Z:G d)d*� d*e4e5 �Z;e�<� Z= G d+d,� d,�Z>G d-d.� d.�Z?edBd1d2��Z@edCd4d5��ZAej/d6d7�G d8d9� d9��ZBej/d6d7�G d:d;� d;eB��ZCdDdEd>d?�ZDd@dA� ZEdS )F� )� annotationsN)�abstractmethod)�contextmanager) �Any�Callable�Dict�Generic�List�
NamedTuple�Optional�Set�Tuple�
TYPE_CHECKING�TypeVar)�set_context_frame)�_pytree)�CapturedTraceback)�WeakTensorKeyDictionaryc @ �& e Zd ZU ded< ded< dd� ZdS )� CompileId�int�frame_id�frame_compile_idc C s | j � d| j� �S )N�/)r r ��self� r �KC:\pinokio\api\whisper-webui.git\app\env\lib\site-packages\torch\_guards.py�__str__@ s zCompileId.__str__N��__name__�
__module__� __qualname__�__annotations__r r r r r r 7 s
r c @ s& e Zd ZU ded< ded< dd� ZdS )�TraceIdr �
compile_idr �attemptc C s& | j dkr
t| j�S | j� d| j � �S )Nr �_)r& �strr% r r r r r J s
zTraceId.__str__Nr r r r r r$ D s
r$ c @ s| e Zd ZdZdZdZdZdZdZdZ dZ
d Z d
Z d Z
d Zd
ZdZdZdZd dd�Zd dd�Zd dd�Zd dd�Zdd � Zd S ) � GuardSourcer � � � � � � � � � �
� � �
� � �return�boolc C � | t jt jfv S �N)r) �GLOBAL_FSDP_MODULE�LOCAL_FSDP_MODULEr r r r �is_fsdp_modulec � zGuardSource.is_fsdp_modulec C s | t jt jfv p | �� S r< )r) � GLOBAL_SPECIALIZED_NN_MODULE�LOCAL_SPECIALIZED_NN_MODULEr? r r r r �is_specialized_nn_modulef s ���z$GuardSource.is_specialized_nn_modulec C s | t jt jt jt jfv S r< )r) � GLOBAL_UNSPECIALIZED_NN_MODULE� LOCAL_UNSPECIALIZED_NN_MODULE�&GLOBAL_UNSPECIALIZED_BUILTIN_NN_MODULE�%LOCAL_UNSPECIALIZED_BUILTIN_NN_MODULEr r r r �is_unspecialized_nn_moduleq s �z&GuardSource.is_unspecialized_nn_modulec C r; r< )r) rF rG r r r r �"is_unspecialized_builtin_nn_moduley s �z.GuardSource.is_unspecialized_builtin_nn_modulec C s | t jt jt jt jt jfv S r< )r) �LOCALrB r> rE rG r r r r �is_local s �zGuardSource.is_localN�r9 r: )r r! r" rJ �GLOBALrB rA �CONSTANTZ RANDOM_VALUEZ SHAPE_ENVr> r= ZBACKWARD_STATEZ EPHEMERAL�SYNTHETIC_LOCALrE rD rG rF r? rC rH rI rK r r r r r) Q s,
r) c @ � e Zd ZdS )�GuardBuilderBaseN�r r! r" r r r r rQ � s rQ c @ s e Zd ZU ded< ded< dS )�
ShapeGuardz
sympy.Expr�exprr �stackN)r r! r" r# r r r r rS � s
rS c @ s� e Zd ZU ded< ded< dZded< dZded< dZd ed
< dZd ed < dZd
ed< dZ ded< dZ
ded< dd� Z dd� Z dd� Z
dd� Zed4d d ��Zed5d d!��Zed"d#� �Zd$d%� Zd&d'� Zd6d*d+�Zd,d-� Zd.d/� Zd0d1� Zd2d3� ZdS )7�Guard�Source�originating_sourcez)Callable[[GuardBuilderBase, Guard], None]� create_fnNzOptional[List[str]]� guard_types� code_listzOptional[object]� obj_weakrefzOptional[type]�guarded_class_weakrefzOptional[CapturedTraceback]rU z Optional[traceback.StackSummary]�
user_stackz
Optional[int]�_hashc C s* | j d u rt| j| jt| j�f�| _ | j S r< )r_ �hash�name�source�idrY r r r r �__hash__� s
zGuard.__hash__c C sT ddl m} t| jtj�o| jj|ju }|| jr | jj ndt
| j �| j | � � j
jfS )Nr )� GuardBuilder�����)Ztorch._dynamo.guardsre �
isinstancerY � functools�partial�funcZDUPLICATE_INPUTrb �value�lenra �inner_create_fn�__code__�co_firstlineno)r re Zis_duplicate_inputr r r �sort_key� s �
�zGuard.sort_keyc C s | � � |� � k S r< )rp �r �otherr r r �__lt__� r@ z Guard.__lt__c C s t | jtj�r | jjS | jS r< )rg rY rh ri rj r r r r rm � s zGuard.inner_create_fnr9 r( c C �
| j �� S r< )rX ra r r r r ra � �
z
Guard.namer) c C rt r< )rX � guard_sourcer r r r rb � ru z Guard.sourcec C sb t | tj�r-| � }|dur#dtt| ��� d|jj� dtt|��� d�S dtt| ��� d�S t| �S )a�
This is a workaround of a Python weakref bug.
`obj_weakref` is instance returned by `weakref.ref`,
`str(obj_weakref)` is buggy if the original obj overrides __getattr__, e.g:
class MyConfig(dict):
def __getattr__(self, x):
return self[x]
obj = MyConfig(offset=5)
obj_weakref = weakref.ref(obj)
str(obj_weakref) # raise error: KeyError: '__name__'
Nz <weakref at z; to 'z' at �>z; dead>)rg �weakref�
ReferenceType�hexrc � __class__r r( )r\ �objr r r �weakref_to_str� s ,zGuard.weakref_to_strc C s` d| j r
| j j�� nd� dt| j�� d| �� j� d| j� d| j� d| �| j �� d| j
� d�}|S ) Nz
� � z&
{
'guard_types': z,
'code': z ,
'obj_weakref': z
'guarded_class': z
}
) rb ra �lower�reprrm r rZ r[ r} r\ r] )r �sr r r �__repr__ s �����
�� zGuard.__repr__c C s� dt | j�� d�}| jr| jj�� nd}|d|� d�7 }|d| �� j� d�7 }|d| j� d�7 }|d| j� d�7 }|d| �| j �� d�7 }|d | j
� d�7 }|S )
NzName: �
r~ z Source: z Create Function: z Guard Types: z Code List: z Object Weakref: z Guarded Class Weakref: ) r� ra rb r� rm r rZ r[ r} r\ r] )r �outputrb r r r r s z
Guard.__str__�builderrQ c C s^ z| � || �W S ty. t�dt| ��� � | jr-t�dd�| j� � dd � ��� � � w )Nz Error while creating guard:
%szCreated at:
%sr~ �����)
rY � Exception�log� exceptionr( �rstriprU �error�join�format)r r� r r r �create s $�z Guard.createc C rt r< )rb rC r r r r rC �
z Guard.is_specialized_nn_modulec C rt r< )rb r? r r r r r? # r� zGuard.is_fsdp_modulec C rt r< )rb rK r r r r rK & r� zGuard.is_localc C s� | j sg | _ | j �|� | j|d fv sJ d��|| _| js!|| _n| j�|� | j|d fv s=t| j�r9| �� d u s=J d��|| _d S )Nz+Guarded class id must be identical, or NonezBGuarded object must be identical, None or ephemeral (dead weakref))rZ �appendr] r[ �extendr\ �callable)r Z
guard_typeZ
guarded_classr[ r\ r r r �set_export_info) s( �� ��
zGuard.set_export_info�r9 r( �r9 r) )r� rQ )r r! r" r# rZ r[ r\ r] rU r^ r_ rd rp rs rm �propertyra rb � staticmethodr} r� r r� rC r? rK r� r r r r rV � s6
rV �Tc @ rP )� GuardEnvExprNrR r r r r r� P s r� c @ r )�DuplicateInputsrW �input_source_a�input_source_bc C s | j | jksJ �d S r< )r� r� r r r r �
__post_init__` s z DuplicateInputs.__post_init__N)r r! r" r# r� r r r r r� [ s
r� c @ s( e Zd Zed dd��Zed
dd��ZdS ) �Checkpointabler9 r� c C � d S r< r r r r r �copy_graphstater � z Checkpointable.copy_graphstate�statec C r� r< r �r r� r r r �restore_graphstateu r� z!Checkpointable.restore_graphstateN)r9 r� )r� r� )r r! r" r r� r� r r r r r� q s
r� c @ s8 e Zd ZU dZe� Zded< dd� Zdd� Zdd � Z d
S ) �GuardsCheckpointStatezW
The GuardCheckpointState - it is the T of Checkpointable[T] for GuardsContext
�
Set[Guard]�
dynamo_guardsc C �
|| _ d S r< )r� )r r� r r r �__init__� r� z GuardsCheckpointState.__init__c C s" | j �|j �}t|�dkrdS |S )z�
Produces a delta against another GuardsCheckpointState.
Returns None if no delta is found, otherwise, return a set() of mismatched
Guard type objects.
r N)r� �
differencerl �r rr �rr r r �diff� s zGuardsCheckpointState.diffc C � | � |�d u S r< �r� rq r r r �__eq__� � z GuardsCheckpointState.__eq__N)
r r! r" �__doc__�setr� r# r� r� r� r r r r r� y s
r� c @ �2 e Zd ZU i Zded< dd� Zdd� Zdd� Zd S )
� ModuleContextCheckpointStatezDict[str, torch.nn.Module]�
nn_modulesc C r� r< �r� )r r� r r r r� � r� z%ModuleContextCheckpointState.__init__c C �2 t | j�� ��t |j�� ��}t|�dkrdS |S )z�
Produces a delta against another ModuleContextCheckpointState.
Returns None if no delta is found, otherwise, return a set() of mismatched
module key names.
r N)r� r� �keysr� rl r� r r r r� � � z!ModuleContextCheckpointState.diffc C r� r< r� rq r r r r� � r� z#ModuleContextCheckpointState.__eq__N)r r! r" r� r# r� r� r� r r r r r� � �
r� c @ �& e Zd Zd
dd�Zdd� Zdd� Zd S ) �
ModuleContextr9 �Nonec C �
i | _ d S r< r� r r r r r� � r� zModuleContext.__init__c C � t t| j��S r< )r� �dictr� r r r r r� � r� z ModuleContext.copy_graphstatec C s t |t�sJ �|j| _d S r< )rg r� r� r� r r r r� � s z ModuleContext.restore_graphstateN�r9 r� �r r! r" r� r� r� r r r r r� � s
r� c @ r� )
� GlobalContextCheckpointStatez Dict[str, Tuple[Callable, ...]]� global_statec C r� r< �r� )r Z
global_statesr r r r� � r� z%GlobalContextCheckpointState.__init__c C r� )z�
Produces a delta against another GlobalContextCheckpointState.
Returns None if no delta is found, otherwise, return a set() of mismatched
global key names.
r N)r� r� r� r� rl r� r r r r� � r� z!GlobalContextCheckpointState.diffc C r� r< r� rq r r r r� � r� z#GlobalContextCheckpointState.__eq__N)r r! r" r� r# r� r� r� r r r r r� � r� r� c @ s2 e Zd ZdZh d�Zd dd�Zdd� Zd d
� Zd S )
�
GlobalContextzz
This keeps track of the global torch state during tracing of a function.
For example, torch.is_grad_enabled.
> Zautocast_gpu_dtype� grad_enabledZautocast_cpu_dtypeZautocast_cache_enabled�autocast_enabledZtorch_function_enabledZautocast_cpu_enabledr9 r� c C r� r< r� r r r r r� � r� zGlobalContext.__init__c C r� r< )r� r� r� r r r r r� � r� z GlobalContext.copy_graphstatec C sf t |t�sJ �|j| _t| j�t| j�kr t| j�� �| jks#J d��| j�� D ]\}}||� q(d S )NzGlobal state mismatch)rg r� r� rl �_supported_global_statesr� r� �values)r r� rj �argsr r r r� � s �
�z GlobalContext.restore_graphstateNr� )r r! r" r� r� r� r� r� r r r r r� � s
r� c @ sZ e Zd Zddd�Zdd� Zdd� Zdd � Zd
d � Zd d
d�ddd�Zddd�Z dd� Z
dS ) � GuardsSetNc C s |d u rt � }|| _d S r< )r� �inner)r r� r r r r� � s
zGuardsSet.__init__c C �
t | j�S r< )�iterr� r r r r �__iter__� r� zGuardsSet.__iter__c C r� r< )rl r� r r r r �__len__� r� zGuardsSet.__len__c C s t | j|j �S r< )r� r� rq r r r �__sub__ r@ zGuardsSet.__sub__c C r� r< )r: r� r r r r �__bool__ r� zGuardsSet.__bool__Tr )�collect_debug_stack�skip�guardrV c C sR || j v rd S |r!|jd u rtjd| d�|_|jd u r!t�� |_| j �|� d S �Nr* )r� )r� rU r �extractr^ �TracingContext�
extract_stack�add)r r� r� r� r r r r�
s
z
GuardsSet.add�othersr� c G s& |D ]}|D ] }| j |dd� qqd S r� )r� )r r� �o�gr r r �update s
��zGuardsSet.updatec s � fdd�| j D �| _ dS )z%Delete all guards with a given sourcec s h | ] }|j � kr|�qS r )rX )�.0r� �rb r r � <setcomp> s z6GuardsSet.remove_guards_with_source.<locals>.<setcomp>N)r� )r rb r r� r �remove_guards_with_source s z#GuardsSet.remove_guards_with_sourcer< )r� rV )r� r� ) r r! r" r� r� r� r� r� r� r� r� r r r r r� � s
r� c @ r� ) �
GuardsContextr9 r� c C s t � | _g | _d S r< )r� r� Zaotautograd_guardsr r r r r� s
zGuardsContext.__init__c C s t t| jj��S r< )r� r� r� r� r r r r r� # r@ z GuardsContext.copy_graphstatec C s t |t�sJ �t|j�| _d S r< )rg r� r� r� r� r r r r� & s z GuardsContext.restore_graphstateNr� r� r r r r r� s
r� c @ sH e Zd Zeddd��Zeddd��Zdd� Zed d
� �Zed d � �Zd
S )�CompileContextr9 c C s t jd usJ �t jS r< )�_TLS�compile_contextr r r r �getB s zCompileContext.get�Optional[CompileContext]c C � t tdd �S �Nr� ��getattrr� r r r r �try_getG � zCompileContext.try_getc C s& |d u s t |t�s J �|| _d| _d S )Nr )rg r r% r& )r r% r r r r� K s
zCompileContext.__init__c C s t �� } | d u r
d S | jS r< )r� r� r% r r r r �current_compile_idP s z!CompileContext.current_compile_idc C s0 t �� } | d u r
d S | jd u rd S t| j| j�S r< )r� r� r% r$ r& r r r r �current_trace_idW s
z CompileContext.current_trace_idN)r9 r� )r9 r� ) r r! r" r� r� r� r� r� r� r r r r r� A s
r� c @ s� e Zd ZdZeddd��Zeddd��Zdd � Zd
d � Zee d d
� ��Z
edd� �Z ee j dd� ��Z
ee j dd� ��Zee j dd� ��Zedd� �ZdS )r� z�
Provides the currently installed TracingContext, or None.
Note that it is a staticmethod, and invocations outside of `with tracing()` (see below), are valid but
will return None.
r9 �Optional[TracingContext]c C r� )N�tracing_contextr� r r r r r� i r� zTracingContext.try_getc C s t �� } r| S td��)Nz<TracingContext.get() must be called within an ongoing trace.)r� r� � RuntimeError)�ctxr r r r� m s
�zTracingContext.getc C sZ t � | _t� | _t� | _|| _g | _d | _d | _ d | _
d | _ d | _ d| _
t� | _d| _d S �NF)r� Zguards_contextr� Zmodule_contextr� �global_context� fake_mode�frame_summary_stack� loc_in_frameZ fw_metadataZaot_graph_nameZ params_flat�output_stridesZ#force_unspec_int_unbacked_size_liker Ztensor_to_contextZfakify_first_call)r r� r r r r� u s
zTracingContext.__init__c C s i | j _d S r< )r� r� r r r r �clear� s zTracingContext.clearc k s� � i }t �� }| �� D ] }t||�||< q | �� D ]
\}}t|||� qzd V W |�� D ]
\}}t|||� q-d S |�� D ]
\}}t|||� q>w r< )r� r� r� r� �items�setattr)�kwargs�priorr� �key�valr r r �patch� s � ��zTracingContext.patchc C s@ t �� } | d u r t�� S | j}| jd ur|| jg }tj�|�S r< )r� r� � traceback� StackSummaryr� r� � from_list)r rU r r r r� � s
z TracingContext.extract_stackc c s� � t �� } tjj�| dg ��E tjj�| dd ��# zd V W n ty3 } z t|d�s.d |_� d }~ww W d � n1 s>w Y W d � d S W d � d S 1 sVw Y d S )Nr� r� �
real_stack) r� r� �unittest�mockr �objectr� �hasattrr )�tc�er r r � clear_frame� s" ���
���P�zTracingContext.clear_framec
c s� � t �� }| d ur|j�| � |j}d |_z,zd V W n ty2 } z t|d�s-|�� |_� d }~ww W | d ur=|j� � ||_d S | d urK|j� � ||_w )Nr )
r� r� r� r� r� r� r
r� r �pop)�
frame_summaryr �oldr r r r �
current_frame� s* �
���
�
z TracingContext.current_framec c sF � t �� } | d u rd V d S | j}g | _z
| jV W || _d S || _w r< )r� r� r� )r Zold_output_stridesr r r �report_output_strides� s �
z$TracingContext.report_output_stridesc C s t j| ||dd�t�� _d S )NF)� lookup_line)r � FrameSummaryr� r� r� )�filename�lineno�
frame_namer r r �set_current_loc s �z TracingContext.set_current_locN)r9 r� )r9 r� )r r! r" r� r� r� r� r� r� r r r� �
contextlibr r r r r r r r r� a s0 *
r� �contextr� c
c s� � t tdd �}| t_z | V W | d ur$| jd ur$t| jj| jj| jf� |t_d S | d ur>| jd ur>t| jj| jj| jf� |t_w r� )r� r� r� r% r r r r& )r � old_contextr r r r�
s. �
��
�
��r� r� c
c s� � t tdd�}| t_z<z| V W n ty+ } zt|d�s&| dur&| �� |_� d}~ww W | durB| jdurB| jjdurB| jj� � |t_dS | dur\| jdur\| jjdur\| jj� � |t_w )z�
This function installs the passed in tracing context as a dynamic scoped
global variable.
Calls to TracingContext.get() while not under a `with tracing()` context
will return None.
r� Nr )
r� r� r� r� r
r� r r� � shape_env�cleanup)r r r r r r �tracing s, �
���
�
r! T)�frozenc @ sT e Zd Zdd� Zdd� Zdd� Zdd d
�Zdd d
�Zddd�Zddd�Z dd� Z
dS )rW c C � dS r� r r r r r � is_dict_key< r� zSource.is_dict_keyc C r# r� r r r r r � is_ephemeral? r� zSource.is_ephemeralc C � t �r< ��NotImplementedError)r �codegenr r r � reconstructB r� zSource.reconstructr9 r) c C r& r< r' r r r r rv E r� zSource.guard_sourcer( c C r& r< r' r r r r ra H r� z Source.namerV c C s | � � tju r t�t| |�S r< )rv r) rN r( rV )r �fnr r r �
make_guardK s
zSource.make_guardr: c C s | � � �� S r< )rv rC r r r r rC P s z Source.is_specialized_nn_modulec C s | � � tjkS )z+True if you can guard on attributes of this)rv r) rO r r r r �subguards_allowedS s zSource.subguards_allowedNr� r� )r9 rV rL ) r r! r" r$ r% r* rv ra r, rC r- r r r r rW : s
rW c @ s& e Zd ZU ded< dd� Zdd� ZdS )�
ChainedSourcerW �basec C rt r< )r/ r$ r r r r r$ ] ru zChainedSource.is_dict_keyc C rt r< )r/ r% r r r r r% a r� zChainedSource.is_ephemeralN)r r! r" r# r$ r% r r r r r. Y s
r. �inputsr c C sB ddl m}m} g }t�� }r |j}|dur |�|ddf� ddlm} t t
|� ��D ]\}}t ||�r=|�|d|f� q,t �
| �} t | �D ]\}}
t |
|�rY|�|
jd|f� qG|r�|d \}} } |dd� D ]3\}}
}||u s�J d |� d
| � d | � d |� d
|
� d |� d
| � d | � d|j� d|
� d |� d|j� ���qi|S dS )a�
Attempts to "detect" what the current fake mode is. If there is one ambiently
available from TracingContext, we preferentially use that. Otherwise, we
heuristically detect the fake mode via the following sources, in order of
priority:
- Currently active fake mode on stack
- Fake mode associated with passed in tensors (inputs does not
have to be flattened)
r )�
FakeTensor�FakeTensorModeNztracing context�� _get_current_dispatch_mode_stackzactive fake modezfake tensor inputr* z fake mode (z) from r z doesn't match mode (z
fake mode from z allocated at:
z
fake mode from )� torch._subclasses.fake_tensorr1 r2 r� r� r� r� � torch.utils._python_dispatchr4 � enumerate�reversedrg �pytree� tree_leavesrU )r0 r1 r2 Z
fake_modesr r� r4 �i�mZ flat_inputs�
flat_inputZdesc1�i1Zdesc2�i2r r r �detect_fake_modee sH
�
�
&�������r@ c C sF ddl m} ddlm} tt|� ��D ]
\}}t|| �r | S qdS )z~
Inspects the dispatch mode stack for an active fake mode and returns it.
Returns None if no fake mode is active.
r )r2 r3 N)r5 r2 r6 r4 r7 r8 rg )r2 r4 r' r< r r r �active_fake_mode� s
�rA )r r� )r r� r< )r0 r )F�
__future__r r � dataclasses�enumrh �logging� threadingr �
unittest.mockr
rx �abcr r �typingr r r r r r
r r r
r r Ztorch._C._dynamo.eval_framer Z torch.utilsr r9 �torch.utils._tracebackr Ztorch.utils.weakr � getLoggerr r� �sympy�torchr r$ �Enumr) rQ rS � dataclassrV r� r� r� r� r� r� r� r� r� r� r� �localr� r� r� r� r! rW r. r@ rA r r r r �<module> s~ 4
8 &
!
( *
,