Path: blob/main/models/__pycache__/bert_tdlstm.cpython-38.pyc
153 views
U
=za� � @ sH d dl Z d dlmZ d dlmZ d dlmZ dd� ZG dd� de�ZdS )� N)� BertForSequenceClassification)� DynamicLSTMc C s� t �ddd��d�}g }td�D ]�}| | �� d d }|�|� t �|d | dt �ttd|d ����d��}t �d| d��d�}t j t j
||fdd�dd�}t j
||fdd�}q t � |��d�}t �|dt �ttdt j
d ����d��}||fS ) N� �@ � �cuda� r �����)�dim)�torch�zeros�to�range�tolist�append� index_select�tensor�list� unsqueeze�cat�
LongTensor�args�
batch_size)�character_in_text�all_hidden_statesZx_l_sumZx_l_lenZi_sample�len_lZx_lZzero_l� r �%D:\CCF-BDCI\AQY\models\bert_tdlstm.py�get_x_l s
� *r c s& e Zd Z� fdd�Zddd�Z� ZS )� Bert_TD_LSTMc sX t � �|� d| jj_tddddd�| _tddddd�| _t� t�
dd�t� � �| _ d S )NTr r )�
num_layers� batch_firsti )
�super�__init__�bert�config�output_hidden_statesr Zlstm_lZlstm_r�nn�
Sequential�Linear�Tanh�linear)�selfr% �� __class__r r r# s
�zBert_TD_LSTM.__init__Nc C s< |
d k r |
n| j j}
| j|||||||| |
d� } | d }
d S )N)�attention_mask�token_type_ids� position_ids� head_mask�
inputs_embeds�output_attentionsr& � return_dict� )r% �use_return_dictr$ )r, � input_idsr/ r0 r1 r2 r3 �labelsr4 r& r5 r �outputsr r r r �forward# s �
zBert_TD_LSTM.forward) NNNNNNNNNNN)�__name__�
__module__� __qualname__r# r; �
__classcell__r r r- r r s �r ) r �torch.nnr' � transformersr Z
models.layersr r r r r r r �<module> s