Path: blob/main/C2 - Advanced Learning Algorithms/week2/C2W2A1/__pycache__/autils.cpython-37.pyc
3540 views
B
\�b� � @ s d dl Zd dlmZ d dlZd dlmZ d dl m
Z
d dl m Z m
Z
mZ eddddd d
d d �ZdZdZdZdZd Zd
Zd ZeeeeegZej�d
� dd� Zdd� Z dd� Z dd� Z dd� Z dd� Z dd� Z!d d � Z"d d � Z#d d!� Z$d"d#� Z%d$d%� Z&d&d'� Z'd(d)� Z(dS )*� N)�
Sequential)�Dense)�linear�relu�sigmoidz#0096ffz#FF9300z#C00000z#FF40FFz#7030A0z#0D5BDCz#4285F4)�dlblue�dlorange� dldarkred� dlmagenta�dlpurple�
dldarkblue� dlmedbluez./deeplearning.mplstylec C s t �d�} t �d�}| |fS )Nz
data/X.npyz
data/y.npy)�np�load)�X�y� r �/home/jovyan/work/autils.py� load_data s
r c C s@ t �ddd�} tjdddd�\}}t|� |d �| tjj� | �� |d j
dd d
d � |d j dd d
d � |d � d � |d �| tjj�
| �� |d j
dd d
d � |d j dd d
d � |d � d
� |d �| tjj�| �� |d j dd d
d � |d j
dd d
d � |d � d� |jddd� |jdd� t�� d S )N������ �d � � )� � )�figsizer g333333�?�black)�lw�c�Linear�Sigmoidr ZReLuzCommon Activation Functions� )�fontsizeg�������?)�pad)r �linspace�plt�subplots�widgvis�plot�tf�keras� activationsr �axvline�axhline� set_titler r �suptitle� tight_layout�show)r �fig�axr r r � plt_act_trio s$ r5 c C s d| j _d| j _d| j _d S )NF)�canvas�toolbar_visible�header_visible�footer_visible)r3 r r r r( ' s r( c C s� t �ddt j d�} t �| �d }d|dd�< tjdddd�\}}t|� |�d� |�d � |� d
� |�
| |� |j d d � t� � | |fS )
Nr r r r �2 )r r )r �Target�xr g�������?)r$ )
r r% �pi�cosr& r' r( r/ �
set_xlabel�
set_ylabelr) r1 r2 )r r r3 r4 r r r �plt_ex1, s
rA c C s� t �ddt j d�} t �| �d }d|dd�< tjdddd�\}}t|� |�d� |�d � |� d
� |�
| |� |j d d � t� � | |fS )
Nr r r r �1 )r r )r r; r< r g�������?)r$ )
r r% r= r> r& r' r( r/ r? r@ r) r1 r2 )r r r3 r4 r r r �plt_ex2: s
rC c C s6 t �ddt j d�} t �| �d }| �dd�} | |fS )Nr r r r �����)r r% r= r> �reshape)r r r r r �gen_dataH s rF c C s� t jdddd�\}}t|� |d �d� |d �d� |d �d� |d �| |� |d �d � |d �d� |d �d� |d �| |� |d �| |� |jd
d � t �� d S ) Nr r )� r )r r r; r< r �
Predictiong�������?)r$ ) r& r' r( r/ r? r@ r) r1 r2 )r r �yhatr3 r4 r r r �plt_dualN s rJ c C sh t jdddd�\}}t|� |d j| |dd� |d jddd d
� |d jddd d
� |d �d � |d j| |dd� |d j| |td d
d� |d jddd d
� |d jddd d
� |d �d� |d jdd� |d j| |dd� |d j| |td dd� |d jddd d
� |d jddd d
� |d �d� |d �� |j ddd� |j
dd� |S )Nr r )r g @)r r �target)�labelg333333�?r )r r z
y - targetr �z)r rL z$z = w \cdot x+b$z upper center)�locr zReLu(z)zmax(0,z)z Role of Non-Linear Activation� )r# g)\���(�?)r$ ) r& r' r( r) r- r. r/ �dlc�legendr0 r1 )r r rM �ar3 r4 r r r �plt_act1] s* rS c
C sv | d j ddddttd ddd �d
� | d j d d d
dttd ddd �d
� | d j ddddttd ddd �d
� d S )Nr z
matches
here)g �?g �?)g�������?g ��� r r � )� facecolor�width� headwidth)�text�xy�xytextr# �
arrowpropsz
but not
here)r g �)r �����z ReLu
'off')g������@r )g�������?g�������?)�annotate�dictrP )r4 r r r �plt_add_notationu s r` c C sj | j tjj�� tjj�d�d� | j||ddd� | �d�}| �d�}|� � \}}|� � \}}||||fS )Ng{�G�z�?)�loss� optimizerr r )�epochs�verbose�l1�l2)
�compiler* r+ �losses�MeanSquaredError�
optimizers�Adam�fit� get_layer� get_weights) �modelr r re rf �w1�b1�w2�b2r r r � compile_fit� s
rt c C s t jdddd�\}}t|� |d �d� |d �d� |d �d� |d �| |� |d �d � |d �d� |d �d� |d �| |� |d �| |� |d
�d � |d
�d� |d
�d� |d
�| |� |d
�| |� |jd d
� t �� d S )Nr r )rU r )r r r; r< r zPrediction, pre-trainingr zPrediction, post-trainingg�������?)r$ ) r& r' r( r/ r? r@ r) r1 r2 )r r Zyhat_preZ yhat_postr3 r4 r r r � plt_model� s$ ru c C sN | � |�}tj|dd�}||d d �df k}t�||d d �df k�d }t|�dkr`td� n�tdt|��}tjd|dd�\}} |j ddd dd
gd � t
|� x�t |�D ]�}
||
} || � d �j
} | |
j| d
d� | � || � dd��}
tj�|
�}t�|�}| |
j|| df � d|� �dd� | |
�� |jddd� q�W t|�S )Nr )�axisr zno errors foundrU )r g333333�?)r g�p=
ף�?g� ��Q��?g�������?)r$ �rect)� rx �gray)�cmapi� �,�
)r# z Label, yhatrO )�predictr �argmax�where�len�print�minr& r' r1 r( �rangerE �T�imshowr* �nn�softmaxr/ � set_axis_offr0 )ro r r �frI Zdoo�idxs�cntr3 r4 �i�j�
X_reshaped�
predictionZ prediction_pr r r �display_errors� s*
$ r� c C sB t jdddd�\}}t|� | �d�j}|j|dd� t �� dS )z8 display a single digit. The input is one digit (400,). r )g �?g �?)r )rx rx ry )rz N)r& r' r( rE r� r� r2 )r r3 r4 r� r r r �
display_digit� s
r� c C sp t jdddd�\}}t|� |j| jd dd� |�ddg� |�d� |�d � |�� |� d
� t �
� d S ) Nr )rG r )r ra )rL r r ZEpochz loss (cost)T) r& r' r( r) �history�set_ylimr? r@ rQ �gridr2 )r� r3 r4 r r r � plot_loss_tf� s
r� ))�numpyr �matplotlib.pyplot�pyplotr& �
tensorflowr* �tensorflow.keras.modelsr �tensorflow.keras.layersr � tensorflow.keras.activationsr r r r_ rP r r r r
r r r
Zdlcolors�style�user r5 r( rA rC rF rJ rS r` rt ru r� r� r� r r r r �<module> s: