o
�J�hoD � @ s� d dl Z d dlZd dlZd dlZd dlZd dlmZmZmZm Z m
Z
m Z m Z d dl
m
Z
d dlmZmZ ddlmZ d2d ed
ed ed efd
d�Zd3ded ed efdd�Zdee d ee fdd�Zdee d ee fdd�ZG dd� d�ZG dd� de�Z G dd � d e�Z G d d � d e �Z G d d � d e �Z G d!d"� d"e �Z G d#d$� d$e�Z!G d%d&� d&e�Z"d'ed(ed eee egdf fd)d*�Z# d4d'ed(ed+e
eee f d,ed-ed e eef f d.d/�Z$d0d1� Z%dS )5� N)�Callable�List�Optional�TextIO�Union�Dict�Tuple)�datetime)�Segment�Word� )� read_fileT�,�seconds�always_include_hours�decimal_marker�returnc C s� | d ur| dks J d��t | d �}|d }||d 8 }|d }||d 8 }|d } || d 8 }|s6|dkr<|d�d�nd }|� |d�d| d�|� |d
��S ) Nr zWrong timestamp providedg @�@i��6 i`� �� �02d�:� �03d)�round)r r r � milliseconds�hours�minutes� hours_marker� r �FC:\pinokio\api\whisper-webui.git\app\modules\utils\subtitle_manager.py�format_timestamp s �r �time_strc C sx | � d�}t|�dkr|\}}}t|�}nd}|\}}|� |�\}}t|�}t|�}td| �}|d |d | | S )Nr � r z0.i �< )�split�len�int�float) r r �timesr r �restr �
fractionalZfractional_secondsr r r �time_str_to_seconds% s
r* �segmentsc C s& t dd� | D �| r| d d �S d �S )Nc s s& � | ]}|d D ]}|d V qqdS )�words�startNr ��.0�s�wr r r � <genexpr>: s �$ z get_start.<locals>.<genexpr>r r- )�next�r+ r r r � get_start8 s ��r5 c C s* t dd� t| �D �| r| d d �S d �S )Nc s s* � | ]}t |d �D ]}|d V q
qdS )r, �endN)�reversedr. r r r r2 A s �( zget_end.<locals>.<genexpr>�����r6 )r3 r7 r4 r r r �get_end? s ��r9 c @ sz e Zd ZU eed< defdd�Z ddeeee f dede
e fd d
�Z dded e de
e fd d
�Z
defdd�ZdS )� ResultWriter� extension�
output_dirc C s
|| _ d S �N�r< )�selfr< r r r �__init__I s
zResultWriter.__init__N�result�output_file_name�optionsc K s� t |t�r|rt |d t�rddd� |D �i}tj�| j|d | j �}t|ddd��}| j |f||d �|�� W d � d S 1 sCw Y d S )
Nr r+ c S s g | ]}|� � �qS r )�
model_dump)r/ �segr r r �
<listcomp>Q � z)ResultWriter.__call__.<locals>.<listcomp>�.r1 zutf-8)�encoding)�filerC )
�
isinstancer r
�os�path�joinr< r; �open� write_result)r? rA rB rC �kwargs� output_path�fr r r �__call__L s �"�zResultWriter.__call__rJ c K � t �r= ��NotImplementedError�r? rA rJ rC rQ r r r rP Z s zResultWriter.write_result� file_pathc C rU r= rV )r? rY r r r � to_segments_ s zResultWriter.to_segmentsr= )�__name__�
__module__� __qualname__�str�__annotations__r@ r �dictr r
r rT r rP rZ r r r r r: F s(
���
����
�r: c @ sR e Zd ZU dZeed< d deeee f de
de e fdd�Z
d efd
d �ZdS )
�WriteTXT�txtr; NrA rJ rC c K s( |d D ]
}t |d �� |dd� qd S )Nr+ �textT�rJ �flush)�print�strip�r? rA rJ rC rQ �segmentr r r rP f s �zWriteTXT.write_resultrY c C s4 g }t |��d�}|D ] }|�td d |d�� q |S )N�
�r- r6 rc )r
r# �appendr
)r? rY r+ �blocks�blockr r r rZ l s
�zWriteTXT.to_segmentsr= )r[ r\ r] r; r^ r_ r r r r
r r r` rP rZ r r r r ra c s
���
�ra c @ st e Zd ZU eed< eed< ddddddd�dedee dee d ee d
ed ed ee fd
d�Z de
fdd�Z dS )�SubtitlesWriterr r NF)�max_line_width�max_line_count�highlight_words�align_lrc_words�max_words_per_linerA rC rp rq rr rs rt c # sl � |pi }�p |� d���p|� d��|p|� dd�}|p"|� dd�}�p)|� d���d u p1�d u ��p5d��p9d������fdd �}t�d
�d k�rd �d
d v �r�d
d d �r|� D ]�} ��| d d
�}
��| d d �} d�dd� | D ��} |r�|
}
dd� | D �}t| �D ]0\� }��|d
�}��|d �}|
|kr�|
|| fV ||d�� fdd�t|�D ��fV |}
q�|r��fdd�| D �}��| d d
���| d d �}}d|� d| d d � d|� d�|d< d�|�}d d |fV qb|
| | fV qbd S �d
D ]*}|d d u �r�q ��|d
�}��|d �}|d �� �dd �}|||fV �q d S ) Nrp rq rr Frs rt r c 3 s� � d} d}g }t �d �pd}�d D ]�}d}�}|t|d �k r�t|d �| }�t|d �| kr5|}t|d ||| � �D ]\}} | �� }
� oS|
d | dk} | t|
d � �k} |dkoit|�dkoi�}
| dkr}| r}| s}|
s}| t|
d �7 } n:|
d �� |
d< t|�dkr�� d ur�| s�|� ks�|
r�|V g }d}n| dkr�|d7 }d |
d |
d< t|
d �� �} |�|
� |
d }qA|�7 }|t|d �k s!qt|�dkr�|V d S d S )
Nr r r+ g r, r- g @�wordrj )r5 r$ � enumerate�copyrg rl )�line_len�
line_count�subtitle�lastri � chunk_index� words_count�remaining_words�i�original_timing�timing�
long_pause�has_room� seg_break)rq rp rt �preserve_segmentsrA r r �iterate_subtitles� sf � ����� ��
�� *
�z9SubtitlesWriter.iterate_result.<locals>.iterate_subtitlesr+ r r, r- r8 r6 r c S � g | ]}|d �qS �ru r )r/ ru r r r rF � rG z2SubtitlesWriter.iterate_result.<locals>.<listcomp>c S r� r� r )r/ r� r r r rF � rG c s* g | ]\}}|� krt �d d|�n|�qS )z ^(\s*)(.*)$z \1<u>\2</u>)�re�sub)r/ �jru )r r r rF � s ���c s* g | ]}d � � |d �� d|d � ��qS )�[r- �]ru )r )r/ r� )r? r r rF � s * r� r� ru � rc z-->z->)�getr$ r rN rv rg �replace)r? rA rC rp rq rr rs rt r� rz �subtitle_start� subtitle_end�
subtitle_textr{ � all_words� this_wordr- r6 Zlrc_aligned_wordsZl_start�l_endri �
segment_start� segment_end� segment_textr )r rq rp rt r� rA r? r �iterate_result~ s\ � 66
��&$
� !�z SubtitlesWriter.iterate_resultr c C s t || j| jd�S )N)r r r )r r r )r? r r r r r � s
�z SubtitlesWriter.format_timestampr= ) r[ r\ r] �boolr_ r^ r` r r% r� r& r r r r r ro z s4
��������
�vro c @ �f e Zd ZU dZeed< dZeed< dZeed< dde d e
d
e e fd d �Z d
ede
e fdd�ZdS )�WriteVTT�vttr; Fr rH r NrA rJ rC c K sP t d|d� | j||fi |��D ]\}}}t |� d|� d|� d�|dd� qd S )NzWEBVTT
)rJ � --> rj Trd )rf r� )r? rA rJ rC rQ r- r6 rc r r r rP s "�zWriteVTT.write_resultrY r c
C s� g }t |��d�}|D ]A}|�� dkrL|�� �d�sL|�� �d�}|d �d�}t|d | j�t|d | j�}}d�|dd � �} |�t||| d �� q |S )
N�
r ZWEBVTTrj r r� r r� rk ) r
r# rg �
startswithr* r rN rl r
)
r? rY r+ rm rn �lines� time_liner- r6 �sentencer r r rZ s "��zWriteVTT.to_segmentsr= �r[ r\ r] r; r^ r_ r r� r r` r r rP r r
rZ r r r r r� � s
���
�r� c @ r� )�WriteSRT�srtr; Tr r r NrA rJ rC c
K sV t | j||fi |��dd�D ]\}\}}}t|� d|� d|� d|� d�|dd� qd S )Nr �r- rj r� Trd �rv r� rf � r? rA rJ rC rQ r r- r6 rc r r r rP " s
�(�zWriteSRT.write_resultrY r c C s� g }t |��d�}|D ]>}|�� dkrI|�� �d�}|d }|d �d�}t|d | j�t|d | j�}} d�|dd � �}
|�t|| |
d �� q |S )
Nr� r rj r r r� r� � rk )r
r# rg r* r rN rl r
) r? rY r+ rm rn r� �indexr� r- r6 r� r r r rZ * s "��zWriteSRT.to_segmentsr= r� r r r r r� s
���
�r� c @ r� )�WriteLRC�lrcr; Fr rH r NrA rJ rC c K sx t | j||fi |��dd�D ]+\}\}}}d|v r(|d r(t|� d�|dd� qtd|� d|� d|� d �|dd� qd S )
Nr r� rs rj Trd r� r� z]
r� r� r r r rP E s �$�zWriteLRC.write_resultrY r c C s� g }t |��d�}|D ]j}|�� dkru|�� }d}t�||�}dd� |D �}t|�D ]J\}} |d }
|
dkrt||
d ||
||
d } } }
| �dd��d d�|
�dd��d d�} }
t| | j�t|
| j�}}|�t ||| d
�� q*q |S ) Nrj r z (\[.*?\])c S s g | ]}|r|� � �qS r )rg )r/ �partr r r rF Z s z(WriteLRC.to_segments.<locals>.<listcomp>r� r r� r� rk )
r
r# rg r� rv r� r* r rl r
)r? rY r+ rm rn r� �pattern�partsr r� Z
sentence_iZ start_strrc Zend_strr- r6 r r r rZ P s* $*��zWriteLRC.to_segmentsr= r� r r r r r� @ s
���
� r� c @ s< e Zd ZU dZdZeed< d
dedede e fdd �Z
dS ) �WriteTSVa�
Write a transcript to a file in TSV (tab-separated values) format containing lines like:
<start time in integer milliseconds> <end time in integer milliseconds> <transcript text>
Using integer milliseconds as start and end times means there's no chance of interference from
an environment setting a language encoding that causes the decimal in a floating point number
to appear as a comma; also is faster and more efficient to parse & store, e.g., in C++.
�tsvr; NrA rJ rC c K sv t dddd|d� |d D ]+}t td|d �|dd� t td|d �|dd� t |d �� �dd �|d
d � q
d S ) Nr- r6 rc � )�seprJ r+ r )rJ r6 r� Trd )rf r rg r� rh r r r rP x s �zWriteTSV.write_resultr= ) r[ r\ r] �__doc__r; r^ r_ r` r r rP r r r r r� l s
����r� c @ s8 e Zd ZU dZeed< d dededee fdd�Z dS )
� WriteJSON�jsonr; NrA rJ rC c K s t �||� d S r= )r� �dumprX r r r rP � s zWriteJSON.write_resultr= )
r[ r\ r] r; r^ r_ r` r r rP r r r r r� � s
����r� �
output_formatr< c sv | � � �� �dd�} ttttttd�}| dkr5�fdd�|� � D �� d dt
dt d t t
f� fd
d �
}|S || ��S )
NrH r )rb r� r� r� r� r� �allc s g | ]}|� ��qS r r )r/ �writerr> r r rF � rG z get_writer.<locals>.<listcomp>rA rJ rC c s" � D ] }|| ||fi |�� qd S r= r )rA rJ rC rQ r� )� all_writersr r � write_all� s �z get_writer.<locals>.write_allr= )
rg �lowerr� ra r� r� r� r� r� �valuesr` r r )r� r< �writersr� r )r� r< r �
get_writer� s( � ���� r� rA rB �
add_timestampc
K s� | � � �� �dd�} | dkrdn| } |r"t�� �d�}|d|� �7 }tj�||� d| � ��}t | |d�}t
|t �rG|� dd �rGd
\|d< |d < |d
||d �|�� t
|�} | |fS )NrH r Zwebvttr� z
%m%d%H%M%S�-)r� r< rr F)FTrs )rA rB r )rg r� r� r �now�strftimerL rM rN r� rK r� r� r
)
r� r< rA rB r� rQ � timestamprY � file_writer�contentr r r �
generate_file� s r� c C sx d}d}t �|d| �}t|�|kr:|�d�d }t|�d |k r4|d |t|� d � }|d | }|S |d |� }|S )Nz[<>:"/\\|?*\x00-\x1f]�� �_rH r8 r )r� r� r$ r# )�nameZINVALID_FILENAME_CHARSZMAX_FILENAME_LENGTH� safe_name�file_extensionZtruncated_namer r r �
safe_filename� s �r� )Tr )r )T)&r� rL r� �sys�zlib�typingr r r r r r r r � modules.whisper.data_classesr
r �
files_managerr
r& r� r^ r r* r` r5 r9 r: ra ro r� r� r� r� r� r� r� r� r r r r �<module> sj $ ����
� !#, ��
� ������
�