Path: blob/master/logs/IMAGENET/ContraGAN256-train-2021_02_01_13_59_48.log
534 views
[INFO] 2021-02-01 13:59:48 > Run name : ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-01 13:59:48 > {'config_path': 'src/configs/ILSVRC2012/ContraGAN256.json', 'checkpoint_folder': None, 'load_current': False, 'log_output_path': None, 'seed': -1, 'distributed_data_parallel': False, 'num_workers': 8, 'synchronized_bn': True, 'mixed_precision': False, 'LARS_optimizer': False, 'disable_debugging_API': True, 'reduce_train_dataset': 1.0, 'standing_statistics': False, 'standing_step': -1, 'freeze_layers': -1, 'load_all_data_in_memory': True, 'train': True, 'eval': True, 'save_images': False, 'image_visualization': False, 'k_nearest_neighbor': False, 'interpolation': False, 'frequency_analysis': False, 'tsne_analysis': False, 'nrow': 10, 'ncol': 8, 'print_every': 100, 'save_every': 2000, 'eval_type': 'valid'}
[INFO] 2021-02-01 13:59:48 > {'data_processing': {'dataset_name': 'imagenet', 'data_path': './data/ILSVRC2012', 'img_size': 128, 'num_classes': 1000, 'batch_size4prcsing': 256, 'chunk_size': 500, 'compression': False}, 'train': {'model': {'architecture': 'big_resnet', 'conditional_strategy': 'ContraGAN', 'pos_collected_numerator': False, 'hypersphere_dim': 1536, 'bottleneck_dim': 384, 'nonlinear_embed': False, 'normalize_embed': True, 'g_spectral_norm': True, 'd_spectral_norm': True, 'activation_fn': 'ReLU', 'attention': True, 'attention_after_nth_gen_block': 4, 'attention_after_nth_dis_block': 1, 'z_dim': 120, 'shared_dim': 128, 'g_conv_dim': 96, 'd_conv_dim': 96, 'G_depth': 'N/A', 'D_depth': 'N/A'}, 'optimization': {'optimizer': 'Adam', 'batch_size': 256, 'accumulation_steps': 1, 'd_lr': 0.0002, 'g_lr': 5e-05, 'momentum': 'N/A', 'nesterov': 'N/A', 'alpha': 'N/A', 'beta1': 0.0, 'beta2': 0.999, 'g_steps_per_iter': 1, 'd_steps_per_iter': 2, 'total_step': 200000}, 'loss_function': {'adv_loss': 'hinge', 'contrastive_lambda': 1.0, 'margin': 0.9, 'tempering_type': 'constant', 'tempering_step': 'N/A', 'start_temperature': 0.25, 'end_temperature': 0.25, 'weight_clipping_for_dis': False, 'weight_clipping_bound': 'N/A', 'gradient_penalty_for_dis': False, 'gradient_penalty_lambda': 'N/A', 'deep_regret_analysis_for_dis': False, 'regret_penalty_lambda': 'N/A', 'cr': False, 'cr_lambda': 'N/A', 'bcr': False, 'real_lambda': 'N/A', 'fake_lambda': 'N/A', 'zcr': False, 'gen_lambda': 'N/A', 'dis_lambda': 'N/A', 'sigma_noise': 'N/A'}, 'initialization': {'g_init': 'ortho', 'd_init': 'ortho'}, 'training_and_sampling_setting': {'random_flip_preprocessing': True, 'diff_aug': False, 'ada': False, 'ada_target': 'N/A', 'ada_length': 'N/A', 'prior': 'gaussian', 'truncated_factor': 1, 'latent_op': False, 'latent_op_rate': 'N/A', 'latent_op_step': 'N/A', 'latent_op_step4eval': 'N/A', 'latent_op_alpha': 'N/A', 'latent_op_beta': 'N/A', 'latent_norm_reg_weight': 'N/A', 'ema': True, 'ema_decay': 0.9999, 'ema_start': 20000}}}
[INFO] 2021-02-01 13:59:48 > Load train datasets...
[INFO] 2021-02-01 14:01:37 > Train dataset size : 1281167
[INFO] 2021-02-01 14:01:37 > Load valid datasets...
[INFO] 2021-02-01 14:01:38 > Eval dataset size : 50000
[INFO] 2021-02-01 14:01:38 > Build model...
[INFO] 2021-02-01 14:01:38 > Modules are located on models.big_resnet.
[INFO] 2021-02-01 14:01:45 > Prepare EMA for G with decay of 0.9999.
[INFO] 2021-02-01 14:01:45 > Number of parameters: 70433988
[INFO] 2021-02-01 14:01:45 > Generator(
(linear0): Linear(in_features=20, out_features=24576, bias=True)
(shared): Embedding(1000, 128)
(blocks): ModuleList(
(0): ModuleList(
(0): GenBlock(
(bn1): ConditionalBatchNorm2d_for_skip_and_shared(
(bn): BatchNorm2d(1536, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
(gain): Linear(in_features=148, out_features=1536, bias=False)
(bias): Linear(in_features=148, out_features=1536, bias=False)
)
(bn2): ConditionalBatchNorm2d_for_skip_and_shared(
(bn): BatchNorm2d(1536, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
(gain): Linear(in_features=148, out_features=1536, bias=False)
(bias): Linear(in_features=148, out_features=1536, bias=False)
)
(activation): ReLU(inplace=True)
(conv2d0): Conv2d(1536, 1536, kernel_size=(1, 1), stride=(1, 1))
(conv2d1): Conv2d(1536, 1536, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(conv2d2): Conv2d(1536, 1536, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
)
)
(1): ModuleList(
(0): GenBlock(
(bn1): ConditionalBatchNorm2d_for_skip_and_shared(
(bn): BatchNorm2d(1536, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
(gain): Linear(in_features=148, out_features=1536, bias=False)
(bias): Linear(in_features=148, out_features=1536, bias=False)
)
(bn2): ConditionalBatchNorm2d_for_skip_and_shared(
(bn): BatchNorm2d(768, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
(gain): Linear(in_features=148, out_features=768, bias=False)
(bias): Linear(in_features=148, out_features=768, bias=False)
)
(activation): ReLU(inplace=True)
(conv2d0): Conv2d(1536, 768, kernel_size=(1, 1), stride=(1, 1))
(conv2d1): Conv2d(1536, 768, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(conv2d2): Conv2d(768, 768, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
)
)
(2): ModuleList(
(0): GenBlock(
(bn1): ConditionalBatchNorm2d_for_skip_and_shared(
(bn): BatchNorm2d(768, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
(gain): Linear(in_features=148, out_features=768, bias=False)
(bias): Linear(in_features=148, out_features=768, bias=False)
)
(bn2): ConditionalBatchNorm2d_for_skip_and_shared(
(bn): BatchNorm2d(384, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
(gain): Linear(in_features=148, out_features=384, bias=False)
(bias): Linear(in_features=148, out_features=384, bias=False)
)
(activation): ReLU(inplace=True)
(conv2d0): Conv2d(768, 384, kernel_size=(1, 1), stride=(1, 1))
(conv2d1): Conv2d(768, 384, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(conv2d2): Conv2d(384, 384, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
)
)
(3): ModuleList(
(0): GenBlock(
(bn1): ConditionalBatchNorm2d_for_skip_and_shared(
(bn): BatchNorm2d(384, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
(gain): Linear(in_features=148, out_features=384, bias=False)
(bias): Linear(in_features=148, out_features=384, bias=False)
)
(bn2): ConditionalBatchNorm2d_for_skip_and_shared(
(bn): BatchNorm2d(192, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
(gain): Linear(in_features=148, out_features=192, bias=False)
(bias): Linear(in_features=148, out_features=192, bias=False)
)
(activation): ReLU(inplace=True)
(conv2d0): Conv2d(384, 192, kernel_size=(1, 1), stride=(1, 1))
(conv2d1): Conv2d(384, 192, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(conv2d2): Conv2d(192, 192, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
)
)
(4): ModuleList(
(0): Self_Attn(
(conv1x1_theta): Conv2d(192, 24, kernel_size=(1, 1), stride=(1, 1), bias=False)
(conv1x1_phi): Conv2d(192, 24, kernel_size=(1, 1), stride=(1, 1), bias=False)
(conv1x1_g): Conv2d(192, 96, kernel_size=(1, 1), stride=(1, 1), bias=False)
(conv1x1_attn): Conv2d(96, 192, kernel_size=(1, 1), stride=(1, 1), bias=False)
(maxpool): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
(softmax): Softmax(dim=-1)
)
)
(5): ModuleList(
(0): GenBlock(
(bn1): ConditionalBatchNorm2d_for_skip_and_shared(
(bn): BatchNorm2d(192, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
(gain): Linear(in_features=148, out_features=192, bias=False)
(bias): Linear(in_features=148, out_features=192, bias=False)
)
(bn2): ConditionalBatchNorm2d_for_skip_and_shared(
(bn): BatchNorm2d(96, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True)
(gain): Linear(in_features=148, out_features=96, bias=False)
(bias): Linear(in_features=148, out_features=96, bias=False)
)
(activation): ReLU(inplace=True)
(conv2d0): Conv2d(192, 96, kernel_size=(1, 1), stride=(1, 1))
(conv2d1): Conv2d(192, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(conv2d2): Conv2d(96, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
)
)
)
(bn4): BatchNorm2d(96, eps=0.0001, momentum=0.1, affine=True, track_running_stats=True)
(activation): ReLU(inplace=True)
(conv2d5): Conv2d(96, 3, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(tanh): Tanh()
)
[INFO] 2021-02-01 14:01:45 > Number of parameters: 91524770
[INFO] 2021-02-01 14:01:45 > Discriminator(
(blocks): ModuleList(
(0): ModuleList(
(0): DiscOptBlock(
(conv2d0): Conv2d(3, 96, kernel_size=(1, 1), stride=(1, 1))
(conv2d1): Conv2d(3, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(conv2d2): Conv2d(96, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(activation): ReLU(inplace=True)
(average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0)
)
)
(1): ModuleList(
(0): Self_Attn(
(conv1x1_theta): Conv2d(96, 12, kernel_size=(1, 1), stride=(1, 1), bias=False)
(conv1x1_phi): Conv2d(96, 12, kernel_size=(1, 1), stride=(1, 1), bias=False)
(conv1x1_g): Conv2d(96, 48, kernel_size=(1, 1), stride=(1, 1), bias=False)
(conv1x1_attn): Conv2d(48, 96, kernel_size=(1, 1), stride=(1, 1), bias=False)
(maxpool): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False)
(softmax): Softmax(dim=-1)
)
)
(2): ModuleList(
(0): DiscBlock(
(activation): ReLU(inplace=True)
(conv2d0): Conv2d(96, 192, kernel_size=(1, 1), stride=(1, 1))
(conv2d1): Conv2d(96, 192, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(conv2d2): Conv2d(192, 192, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0)
)
)
(3): ModuleList(
(0): DiscBlock(
(activation): ReLU(inplace=True)
(conv2d0): Conv2d(192, 384, kernel_size=(1, 1), stride=(1, 1))
(conv2d1): Conv2d(192, 384, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(conv2d2): Conv2d(384, 384, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0)
)
)
(4): ModuleList(
(0): DiscBlock(
(activation): ReLU(inplace=True)
(conv2d0): Conv2d(384, 768, kernel_size=(1, 1), stride=(1, 1))
(conv2d1): Conv2d(384, 768, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(conv2d2): Conv2d(768, 768, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0)
)
)
(5): ModuleList(
(0): DiscBlock(
(activation): ReLU(inplace=True)
(conv2d0): Conv2d(768, 1536, kernel_size=(1, 1), stride=(1, 1))
(conv2d1): Conv2d(768, 1536, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(conv2d2): Conv2d(1536, 1536, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0)
)
)
(6): ModuleList(
(0): DiscBlock(
(activation): ReLU(inplace=True)
(conv2d1): Conv2d(1536, 1536, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(conv2d2): Conv2d(1536, 1536, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1))
(average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0)
)
)
)
(activation): ReLU(inplace=True)
(linear1): Linear(in_features=1536, out_features=1, bias=True)
(proj1): Linear(in_features=1536, out_features=1536, bias=True)
(pred1): Linear(in_features=1536, out_features=384, bias=True)
(pred2): Linear(in_features=384, out_features=1536, bias=True)
(embedding): Embedding(1000, 1536)
)
[INFO] 2021-02-01 14:01:48 > Start training....
[INFO] 2021-02-01 14:06:36 > Step: 100 Progress: 0.1% Elapsed: 0:04:48 temperature: 0.25 ada_p: No Discriminator_loss: 15.5786 Generator_loss: 6.60491
[INFO] 2021-02-01 14:10:47 > Step: 200 Progress: 0.1% Elapsed: 0:08:58 temperature: 0.25 ada_p: No Discriminator_loss: 14.8437 Generator_loss: 6.78804
[INFO] 2021-02-01 14:14:56 > Step: 300 Progress: 0.1% Elapsed: 0:13:08 temperature: 0.25 ada_p: No Discriminator_loss: 14.5174 Generator_loss: 6.75338
[INFO] 2021-02-01 14:19:08 > Step: 400 Progress: 0.2% Elapsed: 0:17:20 temperature: 0.25 ada_p: No Discriminator_loss: 14.4828 Generator_loss: 6.42571
[INFO] 2021-02-01 14:23:21 > Step: 500 Progress: 0.2% Elapsed: 0:21:32 temperature: 0.25 ada_p: No Discriminator_loss: 13.8753 Generator_loss: 7.29442
[INFO] 2021-02-01 14:27:33 > Step: 600 Progress: 0.3% Elapsed: 0:25:45 temperature: 0.25 ada_p: No Discriminator_loss: 13.9797 Generator_loss: 6.82748
[INFO] 2021-02-01 14:31:45 > Step: 700 Progress: 0.4% Elapsed: 0:29:57 temperature: 0.25 ada_p: No Discriminator_loss: 13.6641 Generator_loss: 6.55113
[INFO] 2021-02-01 14:35:59 > Step: 800 Progress: 0.4% Elapsed: 0:34:11 temperature: 0.25 ada_p: No Discriminator_loss: 13.5599 Generator_loss: 6.5911
[INFO] 2021-02-01 14:40:11 > Step: 900 Progress: 0.4% Elapsed: 0:38:23 temperature: 0.25 ada_p: No Discriminator_loss: 13.3211 Generator_loss: 5.80523
[INFO] 2021-02-01 14:44:24 > Step: 1000 Progress: 0.5% Elapsed: 0:42:35 temperature: 0.25 ada_p: No Discriminator_loss: 13.0047 Generator_loss: 7.11559
[INFO] 2021-02-01 14:48:35 > Step: 1100 Progress: 0.5% Elapsed: 0:46:47 temperature: 0.25 ada_p: No Discriminator_loss: 13.217 Generator_loss: 6.51471
[INFO] 2021-02-01 14:52:47 > Step: 1200 Progress: 0.6% Elapsed: 0:50:59 temperature: 0.25 ada_p: No Discriminator_loss: 13.2609 Generator_loss: 5.36781
[INFO] 2021-02-01 14:56:59 > Step: 1300 Progress: 0.7% Elapsed: 0:55:11 temperature: 0.25 ada_p: No Discriminator_loss: 13.1079 Generator_loss: 5.88197
[INFO] 2021-02-01 15:01:11 > Step: 1400 Progress: 0.7% Elapsed: 0:59:23 temperature: 0.25 ada_p: No Discriminator_loss: 12.9489 Generator_loss: 6.99757
[INFO] 2021-02-01 15:05:22 > Step: 1500 Progress: 0.8% Elapsed: 1:03:33 temperature: 0.25 ada_p: No Discriminator_loss: 12.7952 Generator_loss: 6.78531
[INFO] 2021-02-01 15:09:32 > Step: 1600 Progress: 0.8% Elapsed: 1:07:44 temperature: 0.25 ada_p: No Discriminator_loss: 12.8667 Generator_loss: 5.22687
[INFO] 2021-02-01 15:13:43 > Step: 1700 Progress: 0.9% Elapsed: 1:11:55 temperature: 0.25 ada_p: No Discriminator_loss: 13.0029 Generator_loss: 5.7479
[INFO] 2021-02-01 15:17:54 > Step: 1800 Progress: 0.9% Elapsed: 1:16:05 temperature: 0.25 ada_p: No Discriminator_loss: 12.2609 Generator_loss: 6.17056
[INFO] 2021-02-01 15:22:02 > Step: 1900 Progress: 0.9% Elapsed: 1:20:14 temperature: 0.25 ada_p: No Discriminator_loss: 12.342 Generator_loss: 6.87445
[INFO] 2021-02-01 15:26:13 > Step: 2000 Progress: 1.0% Elapsed: 1:24:25 temperature: 0.25 ada_p: No Discriminator_loss: 12.5322 Generator_loss: 6.59964
[INFO] 2021-02-01 15:26:13 > Start Evaluation (2000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-01 15:26:13 > Calculating FID Score....
[INFO] 2021-02-01 15:28:31 > Calculating Inception Score....
[INFO] 2021-02-01 15:30:38 > Calculate F_beta Score....
[INFO] 2021-02-01 15:42:12 > Calculate Accuracies....
[INFO] 2021-02-01 15:43:58 > Calculate Accuracies....
[INFO] 2021-02-01 15:48:52 > F_8 score (Step: 2000, Using valid images): 0.26524993868154406
[INFO] 2021-02-01 15:48:52 > F_1/8 score (Step: 2000, Using valid images): 0.1845951044381739
[INFO] 2021-02-01 15:48:52 > FID score (Step: 2000, Using valid moments): 141.94169789861138
[INFO] 2021-02-01 15:48:52 > Inception score (Step: 2000, 50000 generated images): 5.42019510269165
[INFO] 2021-02-01 15:48:52 > Best FID score (Step: 2000, Using valid moments): 141.94169789861138
[INFO] 2021-02-01 15:49:06 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-01 15:53:16 > Step: 2100 Progress: 1.1% Elapsed: 1:51:27 temperature: 0.25 ada_p: No Discriminator_loss: 12.0679 Generator_loss: 5.17352
[INFO] 2021-02-01 15:57:43 > Step: 2200 Progress: 1.1% Elapsed: 1:55:55 temperature: 0.25 ada_p: No Discriminator_loss: 12.2953 Generator_loss: 5.51932
[INFO] 2021-02-01 16:01:54 > Step: 2300 Progress: 1.1% Elapsed: 2:00:06 temperature: 0.25 ada_p: No Discriminator_loss: 12.2377 Generator_loss: 5.64179
[INFO] 2021-02-01 16:06:05 > Step: 2400 Progress: 1.2% Elapsed: 2:04:17 temperature: 0.25 ada_p: No Discriminator_loss: 12.1553 Generator_loss: 6.51355
[INFO] 2021-02-01 16:10:18 > Step: 2500 Progress: 1.2% Elapsed: 2:08:30 temperature: 0.25 ada_p: No Discriminator_loss: 12.0224 Generator_loss: 6.9801
[INFO] 2021-02-01 16:14:34 > Step: 2600 Progress: 1.3% Elapsed: 2:12:45 temperature: 0.25 ada_p: No Discriminator_loss: 12.011 Generator_loss: 5.97048
[INFO] 2021-02-01 16:18:46 > Step: 2700 Progress: 1.4% Elapsed: 2:16:58 temperature: 0.25 ada_p: No Discriminator_loss: 12.2041 Generator_loss: 5.94569
[INFO] 2021-02-01 16:22:59 > Step: 2800 Progress: 1.4% Elapsed: 2:21:11 temperature: 0.25 ada_p: No Discriminator_loss: 12.0734 Generator_loss: 5.62373
[INFO] 2021-02-01 16:27:12 > Step: 2900 Progress: 1.5% Elapsed: 2:25:23 temperature: 0.25 ada_p: No Discriminator_loss: 12.314 Generator_loss: 5.49382
[INFO] 2021-02-01 16:31:24 > Step: 3000 Progress: 1.5% Elapsed: 2:29:36 temperature: 0.25 ada_p: No Discriminator_loss: 11.8119 Generator_loss: 6.63321
[INFO] 2021-02-01 16:35:37 > Step: 3100 Progress: 1.6% Elapsed: 2:33:48 temperature: 0.25 ada_p: No Discriminator_loss: 11.939 Generator_loss: 5.56672
[INFO] 2021-02-01 16:39:50 > Step: 3200 Progress: 1.6% Elapsed: 2:38:01 temperature: 0.25 ada_p: No Discriminator_loss: 11.5713 Generator_loss: 5.51846
[INFO] 2021-02-01 16:44:02 > Step: 3300 Progress: 1.7% Elapsed: 2:42:14 temperature: 0.25 ada_p: No Discriminator_loss: 12.1061 Generator_loss: 5.14836
[INFO] 2021-02-01 16:48:15 > Step: 3400 Progress: 1.7% Elapsed: 2:46:27 temperature: 0.25 ada_p: No Discriminator_loss: 11.7942 Generator_loss: 5.79813
[INFO] 2021-02-01 16:52:28 > Step: 3500 Progress: 1.8% Elapsed: 2:50:39 temperature: 0.25 ada_p: No Discriminator_loss: 11.9162 Generator_loss: 5.61107
[INFO] 2021-02-01 16:56:40 > Step: 3600 Progress: 1.8% Elapsed: 2:54:52 temperature: 0.25 ada_p: No Discriminator_loss: 11.5171 Generator_loss: 5.09448
[INFO] 2021-02-01 17:00:52 > Step: 3700 Progress: 1.8% Elapsed: 2:59:04 temperature: 0.25 ada_p: No Discriminator_loss: 11.5573 Generator_loss: 5.91629
[INFO] 2021-02-01 17:05:04 > Step: 3800 Progress: 1.9% Elapsed: 3:03:16 temperature: 0.25 ada_p: No Discriminator_loss: 11.5181 Generator_loss: 5.8382
[INFO] 2021-02-01 17:09:17 > Step: 3900 Progress: 1.9% Elapsed: 3:07:29 temperature: 0.25 ada_p: No Discriminator_loss: 11.6164 Generator_loss: 5.51343
[INFO] 2021-02-01 17:13:29 > Step: 4000 Progress: 2.0% Elapsed: 3:11:41 temperature: 0.25 ada_p: No Discriminator_loss: 11.5482 Generator_loss: 5.3413
[INFO] 2021-02-01 17:13:29 > Start Evaluation (4000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-01 17:13:29 > Calculating FID Score....
[INFO] 2021-02-01 17:15:47 > Calculating Inception Score....
[INFO] 2021-02-01 17:17:54 > Calculate F_beta Score....
[INFO] 2021-02-01 17:29:22 > Calculate Accuracies....
[INFO] 2021-02-01 17:31:08 > Calculate Accuracies....
[INFO] 2021-02-01 17:35:58 > F_8 score (Step: 4000, Using valid images): 0.3466127916372429
[INFO] 2021-02-01 17:35:58 > F_1/8 score (Step: 4000, Using valid images): 0.48935823644250204
[INFO] 2021-02-01 17:35:58 > FID score (Step: 4000, Using valid moments): 102.75625729800481
[INFO] 2021-02-01 17:35:58 > Inception score (Step: 4000, 50000 generated images): 8.297012329101562
[INFO] 2021-02-01 17:35:58 > Best FID score (Step: 4000, Using valid moments): 102.75625729800481
[INFO] 2021-02-01 17:36:12 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-01 17:40:22 > Step: 4100 Progress: 2.1% Elapsed: 3:38:34 temperature: 0.25 ada_p: No Discriminator_loss: 11.236 Generator_loss: 5.73173
[INFO] 2021-02-01 17:44:32 > Step: 4200 Progress: 2.1% Elapsed: 3:42:44 temperature: 0.25 ada_p: No Discriminator_loss: 11.4898 Generator_loss: 5.07659
[INFO] 2021-02-01 17:49:01 > Step: 4300 Progress: 2.1% Elapsed: 3:47:12 temperature: 0.25 ada_p: No Discriminator_loss: 11.6387 Generator_loss: 5.6038
[INFO] 2021-02-01 17:53:13 > Step: 4400 Progress: 2.2% Elapsed: 3:51:25 temperature: 0.25 ada_p: No Discriminator_loss: 11.0765 Generator_loss: 4.95954
[INFO] 2021-02-01 17:57:26 > Step: 4500 Progress: 2.2% Elapsed: 3:55:38 temperature: 0.25 ada_p: No Discriminator_loss: 11.0606 Generator_loss: 5.34733
[INFO] 2021-02-01 18:01:39 > Step: 4600 Progress: 2.3% Elapsed: 3:59:50 temperature: 0.25 ada_p: No Discriminator_loss: 11.181 Generator_loss: 5.32139
[INFO] 2021-02-01 18:05:51 > Step: 4700 Progress: 2.4% Elapsed: 4:04:03 temperature: 0.25 ada_p: No Discriminator_loss: 11.0295 Generator_loss: 5.90371
[INFO] 2021-02-01 18:10:03 > Step: 4800 Progress: 2.4% Elapsed: 4:08:15 temperature: 0.25 ada_p: No Discriminator_loss: 10.7953 Generator_loss: 5.08115
[INFO] 2021-02-01 18:14:15 > Step: 4900 Progress: 2.5% Elapsed: 4:12:27 temperature: 0.25 ada_p: No Discriminator_loss: 11.0781 Generator_loss: 4.82973
[INFO] 2021-02-01 18:18:28 > Step: 5000 Progress: 2.5% Elapsed: 4:16:40 temperature: 0.25 ada_p: No Discriminator_loss: 11.1212 Generator_loss: 5.30063
[INFO] 2021-02-01 18:22:45 > Step: 5100 Progress: 2.5% Elapsed: 4:20:57 temperature: 0.25 ada_p: No Discriminator_loss: 11.0206 Generator_loss: 5.47851
[INFO] 2021-02-01 18:26:57 > Step: 5200 Progress: 2.6% Elapsed: 4:25:09 temperature: 0.25 ada_p: No Discriminator_loss: 11.0815 Generator_loss: 5.49062
[INFO] 2021-02-01 18:31:10 > Step: 5300 Progress: 2.6% Elapsed: 4:29:22 temperature: 0.25 ada_p: No Discriminator_loss: 10.6702 Generator_loss: 5.50801
[INFO] 2021-02-01 18:35:23 > Step: 5400 Progress: 2.7% Elapsed: 4:33:35 temperature: 0.25 ada_p: No Discriminator_loss: 11.1267 Generator_loss: 5.16478
[INFO] 2021-02-01 18:39:36 > Step: 5500 Progress: 2.8% Elapsed: 4:37:48 temperature: 0.25 ada_p: No Discriminator_loss: 10.6809 Generator_loss: 5.20256
[INFO] 2021-02-01 18:43:49 > Step: 5600 Progress: 2.8% Elapsed: 4:42:01 temperature: 0.25 ada_p: No Discriminator_loss: 10.8703 Generator_loss: 5.5166
[INFO] 2021-02-01 18:48:02 > Step: 5700 Progress: 2.9% Elapsed: 4:46:13 temperature: 0.25 ada_p: No Discriminator_loss: 10.4676 Generator_loss: 5.3744
[INFO] 2021-02-01 18:52:15 > Step: 5800 Progress: 2.9% Elapsed: 4:50:26 temperature: 0.25 ada_p: No Discriminator_loss: 10.6779 Generator_loss: 5.51032
[INFO] 2021-02-01 18:56:28 > Step: 5900 Progress: 2.9% Elapsed: 4:54:40 temperature: 0.25 ada_p: No Discriminator_loss: 10.8804 Generator_loss: 5.13606
[INFO] 2021-02-01 19:00:42 > Step: 6000 Progress: 3.0% Elapsed: 4:58:53 temperature: 0.25 ada_p: No Discriminator_loss: 10.8737 Generator_loss: 5.57215
[INFO] 2021-02-01 19:00:42 > Start Evaluation (6000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-01 19:00:42 > Calculating FID Score....
[INFO] 2021-02-01 19:02:59 > Calculating Inception Score....
[INFO] 2021-02-01 19:05:07 > Calculate F_beta Score....
[INFO] 2021-02-01 19:16:37 > Calculate Accuracies....
[INFO] 2021-02-01 19:18:23 > Calculate Accuracies....
[INFO] 2021-02-01 19:23:17 > F_8 score (Step: 6000, Using valid images): 0.4338787807984619
[INFO] 2021-02-01 19:23:17 > F_1/8 score (Step: 6000, Using valid images): 0.609356663412489
[INFO] 2021-02-01 19:23:17 > FID score (Step: 6000, Using valid moments): 90.93185293694722
[INFO] 2021-02-01 19:23:17 > Inception score (Step: 6000, 50000 generated images): 9.595322608947754
[INFO] 2021-02-01 19:23:17 > Best FID score (Step: 6000, Using valid moments): 90.93185293694722
[INFO] 2021-02-01 19:23:31 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-01 19:27:57 > Step: 6100 Progress: 3.0% Elapsed: 5:26:09 temperature: 0.25 ada_p: No Discriminator_loss: 10.9166 Generator_loss: 5.77086
[INFO] 2021-02-01 19:32:09 > Step: 6200 Progress: 3.1% Elapsed: 5:30:21 temperature: 0.25 ada_p: No Discriminator_loss: 10.5937 Generator_loss: 5.57776
[INFO] 2021-02-01 19:36:21 > Step: 6300 Progress: 3.1% Elapsed: 5:34:33 temperature: 0.25 ada_p: No Discriminator_loss: 10.5775 Generator_loss: 5.45886
[INFO] 2021-02-01 19:40:34 > Step: 6400 Progress: 3.2% Elapsed: 5:38:46 temperature: 0.25 ada_p: No Discriminator_loss: 10.385 Generator_loss: 5.86421
[INFO] 2021-02-01 19:44:47 > Step: 6500 Progress: 3.2% Elapsed: 5:42:59 temperature: 0.25 ada_p: No Discriminator_loss: 10.7206 Generator_loss: 5.20573
[INFO] 2021-02-01 19:49:00 > Step: 6600 Progress: 3.3% Elapsed: 5:47:12 temperature: 0.25 ada_p: No Discriminator_loss: 10.9849 Generator_loss: 5.79031
[INFO] 2021-02-01 19:53:14 > Step: 6700 Progress: 3.4% Elapsed: 5:51:26 temperature: 0.25 ada_p: No Discriminator_loss: 11.3104 Generator_loss: 6.14804
[INFO] 2021-02-01 19:57:27 > Step: 6800 Progress: 3.4% Elapsed: 5:55:39 temperature: 0.25 ada_p: No Discriminator_loss: 10.571 Generator_loss: 5.13887
[INFO] 2021-02-01 20:01:40 > Step: 6900 Progress: 3.5% Elapsed: 5:59:52 temperature: 0.25 ada_p: No Discriminator_loss: 10.3453 Generator_loss: 5.2936
[INFO] 2021-02-01 20:05:53 > Step: 7000 Progress: 3.5% Elapsed: 6:04:05 temperature: 0.25 ada_p: No Discriminator_loss: 10.6635 Generator_loss: 5.69834
[INFO] 2021-02-01 20:10:06 > Step: 7100 Progress: 3.5% Elapsed: 6:08:18 temperature: 0.25 ada_p: No Discriminator_loss: 10.547 Generator_loss: 5.18649
[INFO] 2021-02-01 20:14:20 > Step: 7200 Progress: 3.6% Elapsed: 6:12:32 temperature: 0.25 ada_p: No Discriminator_loss: 10.3968 Generator_loss: 5.15849
[INFO] 2021-02-01 20:18:33 > Step: 7300 Progress: 3.6% Elapsed: 6:16:45 temperature: 0.25 ada_p: No Discriminator_loss: 10.45 Generator_loss: 5.59488
[INFO] 2021-02-01 20:22:45 > Step: 7400 Progress: 3.7% Elapsed: 6:20:57 temperature: 0.25 ada_p: No Discriminator_loss: 11.2188 Generator_loss: 6.36178
[INFO] 2021-02-01 20:26:58 > Step: 7500 Progress: 3.8% Elapsed: 6:25:10 temperature: 0.25 ada_p: No Discriminator_loss: 10.5093 Generator_loss: 5.26655
[INFO] 2021-02-01 20:31:15 > Step: 7600 Progress: 3.8% Elapsed: 6:29:26 temperature: 0.25 ada_p: No Discriminator_loss: 10.2694 Generator_loss: 5.16582
[INFO] 2021-02-01 20:35:27 > Step: 7700 Progress: 3.9% Elapsed: 6:33:39 temperature: 0.25 ada_p: No Discriminator_loss: 10.3095 Generator_loss: 5.42974
[INFO] 2021-02-01 20:39:40 > Step: 7800 Progress: 3.9% Elapsed: 6:37:52 temperature: 0.25 ada_p: No Discriminator_loss: 10.0069 Generator_loss: 6.18945
[INFO] 2021-02-01 20:43:52 > Step: 7900 Progress: 4.0% Elapsed: 6:42:04 temperature: 0.25 ada_p: No Discriminator_loss: 10.1348 Generator_loss: 5.35923
[INFO] 2021-02-01 20:48:05 > Step: 8000 Progress: 4.0% Elapsed: 6:46:17 temperature: 0.25 ada_p: No Discriminator_loss: 10.0468 Generator_loss: 5.28696
[INFO] 2021-02-01 20:48:05 > Start Evaluation (8000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-01 20:48:05 > Calculating FID Score....
[INFO] 2021-02-01 20:50:23 > Calculating Inception Score....
[INFO] 2021-02-01 20:52:31 > Calculate F_beta Score....
[INFO] 2021-02-01 21:03:57 > Calculate Accuracies....
[INFO] 2021-02-01 21:05:43 > Calculate Accuracies....
[INFO] 2021-02-01 21:10:38 > F_8 score (Step: 8000, Using valid images): 0.4592540154737147
[INFO] 2021-02-01 21:10:38 > F_1/8 score (Step: 8000, Using valid images): 0.6461148503413029
[INFO] 2021-02-01 21:10:38 > FID score (Step: 8000, Using valid moments): 83.27034032824338
[INFO] 2021-02-01 21:10:38 > Inception score (Step: 8000, 50000 generated images): 10.463540077209473
[INFO] 2021-02-01 21:10:38 > Best FID score (Step: 8000, Using valid moments): 83.27034032824338
[INFO] 2021-02-01 21:10:52 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-01 21:15:20 > Step: 8100 Progress: 4.0% Elapsed: 7:13:31 temperature: 0.25 ada_p: No Discriminator_loss: 10.0412 Generator_loss: 5.40745
[INFO] 2021-02-01 21:19:32 > Step: 8200 Progress: 4.1% Elapsed: 7:17:44 temperature: 0.25 ada_p: No Discriminator_loss: 10.4418 Generator_loss: 5.34464
[INFO] 2021-02-01 21:23:44 > Step: 8300 Progress: 4.2% Elapsed: 7:21:56 temperature: 0.25 ada_p: No Discriminator_loss: 9.92785 Generator_loss: 5.25649
[INFO] 2021-02-01 21:27:57 > Step: 8400 Progress: 4.2% Elapsed: 7:26:08 temperature: 0.25 ada_p: No Discriminator_loss: 9.9761 Generator_loss: 5.53205
[INFO] 2021-02-01 21:32:09 > Step: 8500 Progress: 4.2% Elapsed: 7:30:20 temperature: 0.25 ada_p: No Discriminator_loss: 10.1825 Generator_loss: 4.94883
[INFO] 2021-02-01 21:36:21 > Step: 8600 Progress: 4.3% Elapsed: 7:34:33 temperature: 0.25 ada_p: No Discriminator_loss: 9.91248 Generator_loss: 5.29375
[INFO] 2021-02-01 21:40:33 > Step: 8700 Progress: 4.3% Elapsed: 7:38:45 temperature: 0.25 ada_p: No Discriminator_loss: 9.98363 Generator_loss: 5.25651
[INFO] 2021-02-01 21:44:45 > Step: 8800 Progress: 4.4% Elapsed: 7:42:57 temperature: 0.25 ada_p: No Discriminator_loss: 10.2913 Generator_loss: 5.74095
[INFO] 2021-02-01 21:48:58 > Step: 8900 Progress: 4.5% Elapsed: 7:47:09 temperature: 0.25 ada_p: No Discriminator_loss: 9.99402 Generator_loss: 5.36085
[INFO] 2021-02-01 21:53:10 > Step: 9000 Progress: 4.5% Elapsed: 7:51:21 temperature: 0.25 ada_p: No Discriminator_loss: 10.2139 Generator_loss: 5.07388
[INFO] 2021-02-01 21:57:22 > Step: 9100 Progress: 4.5% Elapsed: 7:55:34 temperature: 0.25 ada_p: No Discriminator_loss: 10.2014 Generator_loss: 5.33868
[INFO] 2021-02-01 22:01:33 > Step: 9200 Progress: 4.6% Elapsed: 7:59:45 temperature: 0.25 ada_p: No Discriminator_loss: 9.92663 Generator_loss: 5.50227
[INFO] 2021-02-01 22:05:45 > Step: 9300 Progress: 4.7% Elapsed: 8:03:57 temperature: 0.25 ada_p: No Discriminator_loss: 10.1572 Generator_loss: 5.18694
[INFO] 2021-02-01 22:09:57 > Step: 9400 Progress: 4.7% Elapsed: 8:08:09 temperature: 0.25 ada_p: No Discriminator_loss: 10.0833 Generator_loss: 5.09239
[INFO] 2021-02-01 22:14:09 > Step: 9500 Progress: 4.8% Elapsed: 8:12:21 temperature: 0.25 ada_p: No Discriminator_loss: 10.2325 Generator_loss: 5.00078
[INFO] 2021-02-01 22:18:21 > Step: 9600 Progress: 4.8% Elapsed: 8:16:33 temperature: 0.25 ada_p: No Discriminator_loss: 10.0092 Generator_loss: 5.53882
[INFO] 2021-02-01 22:22:33 > Step: 9700 Progress: 4.9% Elapsed: 8:20:45 temperature: 0.25 ada_p: No Discriminator_loss: 9.98633 Generator_loss: 5.30841
[INFO] 2021-02-01 22:26:45 > Step: 9800 Progress: 4.9% Elapsed: 8:24:57 temperature: 0.25 ada_p: No Discriminator_loss: 9.97101 Generator_loss: 5.33112
[INFO] 2021-02-01 22:30:57 > Step: 9900 Progress: 5.0% Elapsed: 8:29:09 temperature: 0.25 ada_p: No Discriminator_loss: 9.62991 Generator_loss: 5.85987
[INFO] 2021-02-01 22:35:10 > Step: 10000 Progress: 5.0% Elapsed: 8:33:21 temperature: 0.25 ada_p: No Discriminator_loss: 10.0623 Generator_loss: 5.27621
[INFO] 2021-02-01 22:35:10 > Start Evaluation (10000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-01 22:35:10 > Calculating FID Score....
[INFO] 2021-02-01 22:37:27 > Calculating Inception Score....
[INFO] 2021-02-01 22:39:35 > Calculate F_beta Score....
[INFO] 2021-02-01 22:51:09 > Calculate Accuracies....
[INFO] 2021-02-01 22:53:09 > Calculate Accuracies....
[INFO] 2021-02-01 22:58:04 > F_8 score (Step: 10000, Using valid images): 0.49605019628566416
[INFO] 2021-02-01 22:58:04 > F_1/8 score (Step: 10000, Using valid images): 0.665706242793746
[INFO] 2021-02-01 22:58:04 > FID score (Step: 10000, Using valid moments): 78.25069844267256
[INFO] 2021-02-01 22:58:04 > Inception score (Step: 10000, 50000 generated images): 11.445725440979004
[INFO] 2021-02-01 22:58:04 > Best FID score (Step: 10000, Using valid moments): 78.25069844267256
[INFO] 2021-02-01 22:58:19 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-01 23:02:35 > Step: 10100 Progress: 5.1% Elapsed: 9:00:47 temperature: 0.25 ada_p: No Discriminator_loss: 9.9838 Generator_loss: 5.15687
[INFO] 2021-02-01 23:06:47 > Step: 10200 Progress: 5.1% Elapsed: 9:04:59 temperature: 0.25 ada_p: No Discriminator_loss: 9.96397 Generator_loss: 5.28366
[INFO] 2021-02-01 23:10:59 > Step: 10300 Progress: 5.1% Elapsed: 9:09:11 temperature: 0.25 ada_p: No Discriminator_loss: 9.83585 Generator_loss: 5.40333
[INFO] 2021-02-01 23:15:10 > Step: 10400 Progress: 5.2% Elapsed: 9:13:22 temperature: 0.25 ada_p: No Discriminator_loss: 9.53805 Generator_loss: 5.14345
[INFO] 2021-02-01 23:20:04 > Step: 10500 Progress: 5.2% Elapsed: 9:18:15 temperature: 0.25 ada_p: No Discriminator_loss: 9.88289 Generator_loss: 5.11891
[INFO] 2021-02-01 23:24:15 > Step: 10600 Progress: 5.3% Elapsed: 9:22:27 temperature: 0.25 ada_p: No Discriminator_loss: 10.0075 Generator_loss: 5.36887
[INFO] 2021-02-01 23:28:27 > Step: 10700 Progress: 5.3% Elapsed: 9:26:39 temperature: 0.25 ada_p: No Discriminator_loss: 9.7937 Generator_loss: 5.59941
[INFO] 2021-02-01 23:32:39 > Step: 10800 Progress: 5.4% Elapsed: 9:30:51 temperature: 0.25 ada_p: No Discriminator_loss: 10.1413 Generator_loss: 5.30236
[INFO] 2021-02-01 23:36:52 > Step: 10900 Progress: 5.5% Elapsed: 9:35:04 temperature: 0.25 ada_p: No Discriminator_loss: 9.76745 Generator_loss: 5.54229
[INFO] 2021-02-01 23:41:05 > Step: 11000 Progress: 5.5% Elapsed: 9:39:16 temperature: 0.25 ada_p: No Discriminator_loss: 9.81424 Generator_loss: 6.22617
[INFO] 2021-02-01 23:45:17 > Step: 11100 Progress: 5.5% Elapsed: 9:43:28 temperature: 0.25 ada_p: No Discriminator_loss: 10.08 Generator_loss: 5.38793
[INFO] 2021-02-01 23:49:29 > Step: 11200 Progress: 5.6% Elapsed: 9:47:41 temperature: 0.25 ada_p: No Discriminator_loss: 9.83159 Generator_loss: 5.19357
[INFO] 2021-02-01 23:53:41 > Step: 11300 Progress: 5.7% Elapsed: 9:51:53 temperature: 0.25 ada_p: No Discriminator_loss: 9.60724 Generator_loss: 5.46806
[INFO] 2021-02-01 23:57:54 > Step: 11400 Progress: 5.7% Elapsed: 9:56:06 temperature: 0.25 ada_p: No Discriminator_loss: 9.9999 Generator_loss: 5.47145
[INFO] 2021-02-02 00:02:07 > Step: 11500 Progress: 5.8% Elapsed: 10:00:19 temperature: 0.25 ada_p: No Discriminator_loss: 10.5699 Generator_loss: 5.56878
[INFO] 2021-02-02 00:06:20 > Step: 11600 Progress: 5.8% Elapsed: 10:04:32 temperature: 0.25 ada_p: No Discriminator_loss: 9.75029 Generator_loss: 5.22313
[INFO] 2021-02-02 00:10:33 > Step: 11700 Progress: 5.9% Elapsed: 10:08:45 temperature: 0.25 ada_p: No Discriminator_loss: 9.85261 Generator_loss: 5.25229
[INFO] 2021-02-02 00:14:46 > Step: 11800 Progress: 5.9% Elapsed: 10:12:58 temperature: 0.25 ada_p: No Discriminator_loss: 9.7075 Generator_loss: 5.25656
[INFO] 2021-02-02 00:19:00 > Step: 11900 Progress: 5.9% Elapsed: 10:17:12 temperature: 0.25 ada_p: No Discriminator_loss: 9.73617 Generator_loss: 5.05698
[INFO] 2021-02-02 00:23:13 > Step: 12000 Progress: 6.0% Elapsed: 10:21:25 temperature: 0.25 ada_p: No Discriminator_loss: 9.84819 Generator_loss: 5.25768
[INFO] 2021-02-02 00:23:13 > Start Evaluation (12000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 00:23:13 > Calculating FID Score....
[INFO] 2021-02-02 00:25:31 > Calculating Inception Score....
[INFO] 2021-02-02 00:27:38 > Calculate F_beta Score....
[INFO] 2021-02-02 00:39:06 > Calculate Accuracies....
[INFO] 2021-02-02 00:40:52 > Calculate Accuracies....
[INFO] 2021-02-02 00:45:48 > F_8 score (Step: 12000, Using valid images): 0.5243643155232248
[INFO] 2021-02-02 00:45:48 > F_1/8 score (Step: 12000, Using valid images): 0.735848795099312
[INFO] 2021-02-02 00:45:48 > FID score (Step: 12000, Using valid moments): 72.92611901831913
[INFO] 2021-02-02 00:45:48 > Inception score (Step: 12000, 50000 generated images): 12.215989112854004
[INFO] 2021-02-02 00:45:48 > Best FID score (Step: 12000, Using valid moments): 72.92611901831913
[INFO] 2021-02-02 00:46:03 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 00:50:32 > Step: 12100 Progress: 6.0% Elapsed: 10:48:44 temperature: 0.25 ada_p: No Discriminator_loss: 10.3574 Generator_loss: 5.07272
[INFO] 2021-02-02 00:54:47 > Step: 12200 Progress: 6.1% Elapsed: 10:52:58 temperature: 0.25 ada_p: No Discriminator_loss: 9.58199 Generator_loss: 5.11403
[INFO] 2021-02-02 00:58:59 > Step: 12300 Progress: 6.2% Elapsed: 10:57:11 temperature: 0.25 ada_p: No Discriminator_loss: 10.0024 Generator_loss: 5.53237
[INFO] 2021-02-02 01:03:13 > Step: 12400 Progress: 6.2% Elapsed: 11:01:25 temperature: 0.25 ada_p: No Discriminator_loss: 9.85512 Generator_loss: 5.2032
[INFO] 2021-02-02 01:07:26 > Step: 12500 Progress: 6.2% Elapsed: 11:05:38 temperature: 0.25 ada_p: No Discriminator_loss: 9.49639 Generator_loss: 5.40434
[INFO] 2021-02-02 01:11:44 > Step: 12600 Progress: 6.3% Elapsed: 11:09:56 temperature: 0.25 ada_p: No Discriminator_loss: 9.89749 Generator_loss: 5.14114
[INFO] 2021-02-02 01:15:58 > Step: 12700 Progress: 6.3% Elapsed: 11:14:10 temperature: 0.25 ada_p: No Discriminator_loss: 9.62065 Generator_loss: 5.43583
[INFO] 2021-02-02 01:20:11 > Step: 12800 Progress: 6.4% Elapsed: 11:18:23 temperature: 0.25 ada_p: No Discriminator_loss: 9.71923 Generator_loss: 5.33661
[INFO] 2021-02-02 01:24:24 > Step: 12900 Progress: 6.5% Elapsed: 11:22:36 temperature: 0.25 ada_p: No Discriminator_loss: 9.60229 Generator_loss: 5.25299
[INFO] 2021-02-02 01:28:37 > Step: 13000 Progress: 6.5% Elapsed: 11:26:49 temperature: 0.25 ada_p: No Discriminator_loss: 9.82002 Generator_loss: 5.28211
[INFO] 2021-02-02 01:32:51 > Step: 13100 Progress: 6.6% Elapsed: 11:31:02 temperature: 0.25 ada_p: No Discriminator_loss: 9.71385 Generator_loss: 4.72977
[INFO] 2021-02-02 01:37:04 > Step: 13200 Progress: 6.6% Elapsed: 11:35:16 temperature: 0.25 ada_p: No Discriminator_loss: 9.52115 Generator_loss: 5.3344
[INFO] 2021-02-02 01:41:17 > Step: 13300 Progress: 6.7% Elapsed: 11:39:29 temperature: 0.25 ada_p: No Discriminator_loss: 9.81718 Generator_loss: 5.06718
[INFO] 2021-02-02 01:45:30 > Step: 13400 Progress: 6.7% Elapsed: 11:43:42 temperature: 0.25 ada_p: No Discriminator_loss: 9.63351 Generator_loss: 5.27129
[INFO] 2021-02-02 01:49:43 > Step: 13500 Progress: 6.8% Elapsed: 11:47:55 temperature: 0.25 ada_p: No Discriminator_loss: 9.84943 Generator_loss: 5.15506
[INFO] 2021-02-02 01:53:56 > Step: 13600 Progress: 6.8% Elapsed: 11:52:08 temperature: 0.25 ada_p: No Discriminator_loss: 10.8207 Generator_loss: 5.00252
[INFO] 2021-02-02 01:58:09 > Step: 13700 Progress: 6.9% Elapsed: 11:56:21 temperature: 0.25 ada_p: No Discriminator_loss: 9.57422 Generator_loss: 5.31294
[INFO] 2021-02-02 02:02:21 > Step: 13800 Progress: 6.9% Elapsed: 12:00:33 temperature: 0.25 ada_p: No Discriminator_loss: 10.0836 Generator_loss: 4.97473
[INFO] 2021-02-02 02:06:35 > Step: 13900 Progress: 7.0% Elapsed: 12:04:47 temperature: 0.25 ada_p: No Discriminator_loss: 9.84753 Generator_loss: 5.35722
[INFO] 2021-02-02 02:10:48 > Step: 14000 Progress: 7.0% Elapsed: 12:09:00 temperature: 0.25 ada_p: No Discriminator_loss: 9.83727 Generator_loss: 5.09703
[INFO] 2021-02-02 02:10:48 > Start Evaluation (14000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 02:10:48 > Calculating FID Score....
[INFO] 2021-02-02 02:13:04 > Calculating Inception Score....
[INFO] 2021-02-02 02:15:12 > Calculate F_beta Score....
[INFO] 2021-02-02 02:26:45 > Calculate Accuracies....
[INFO] 2021-02-02 02:28:30 > Calculate Accuracies....
[INFO] 2021-02-02 02:33:26 > F_8 score (Step: 14000, Using valid images): 0.5565500069971545
[INFO] 2021-02-02 02:33:26 > F_1/8 score (Step: 14000, Using valid images): 0.7992206574241401
[INFO] 2021-02-02 02:33:26 > FID score (Step: 14000, Using valid moments): 63.67104694246427
[INFO] 2021-02-02 02:33:26 > Inception score (Step: 14000, 50000 generated images): 13.09060287475586
[INFO] 2021-02-02 02:33:26 > Best FID score (Step: 14000, Using valid moments): 63.67104694246427
[INFO] 2021-02-02 02:33:41 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 02:38:08 > Step: 14100 Progress: 7.0% Elapsed: 12:36:20 temperature: 0.25 ada_p: No Discriminator_loss: 9.72337 Generator_loss: 5.33746
[INFO] 2021-02-02 02:42:21 > Step: 14200 Progress: 7.1% Elapsed: 12:40:33 temperature: 0.25 ada_p: No Discriminator_loss: 9.68142 Generator_loss: 4.85704
[INFO] 2021-02-02 02:46:34 > Step: 14300 Progress: 7.1% Elapsed: 12:44:46 temperature: 0.25 ada_p: No Discriminator_loss: 9.41563 Generator_loss: 5.55973
[INFO] 2021-02-02 02:50:47 > Step: 14400 Progress: 7.2% Elapsed: 12:48:59 temperature: 0.25 ada_p: No Discriminator_loss: 9.72228 Generator_loss: 5.10269
[INFO] 2021-02-02 02:55:00 > Step: 14500 Progress: 7.2% Elapsed: 12:53:12 temperature: 0.25 ada_p: No Discriminator_loss: 9.44156 Generator_loss: 5.36154
[INFO] 2021-02-02 02:59:13 > Step: 14600 Progress: 7.3% Elapsed: 12:57:25 temperature: 0.25 ada_p: No Discriminator_loss: 9.69585 Generator_loss: 5.38918
[INFO] 2021-02-02 03:03:26 > Step: 14700 Progress: 7.3% Elapsed: 13:01:38 temperature: 0.25 ada_p: No Discriminator_loss: 9.83762 Generator_loss: 5.14562
[INFO] 2021-02-02 03:07:38 > Step: 14800 Progress: 7.4% Elapsed: 13:05:50 temperature: 0.25 ada_p: No Discriminator_loss: 9.65011 Generator_loss: 5.34492
[INFO] 2021-02-02 03:11:51 > Step: 14900 Progress: 7.4% Elapsed: 13:10:02 temperature: 0.25 ada_p: No Discriminator_loss: 9.72895 Generator_loss: 5.21476
[INFO] 2021-02-02 03:16:03 > Step: 15000 Progress: 7.5% Elapsed: 13:14:15 temperature: 0.25 ada_p: No Discriminator_loss: 9.61843 Generator_loss: 5.40158
[INFO] 2021-02-02 03:20:21 > Step: 15100 Progress: 7.5% Elapsed: 13:18:33 temperature: 0.25 ada_p: No Discriminator_loss: 9.45757 Generator_loss: 5.32325
[INFO] 2021-02-02 03:24:34 > Step: 15200 Progress: 7.6% Elapsed: 13:22:46 temperature: 0.25 ada_p: No Discriminator_loss: 9.53665 Generator_loss: 5.41191
[INFO] 2021-02-02 03:28:46 > Step: 15300 Progress: 7.6% Elapsed: 13:26:58 temperature: 0.25 ada_p: No Discriminator_loss: 9.59977 Generator_loss: 5.18527
[INFO] 2021-02-02 03:32:59 > Step: 15400 Progress: 7.7% Elapsed: 13:31:11 temperature: 0.25 ada_p: No Discriminator_loss: 9.81131 Generator_loss: 5.11991
[INFO] 2021-02-02 03:37:12 > Step: 15500 Progress: 7.8% Elapsed: 13:35:24 temperature: 0.25 ada_p: No Discriminator_loss: 9.51667 Generator_loss: 5.15187
[INFO] 2021-02-02 03:41:25 > Step: 15600 Progress: 7.8% Elapsed: 13:39:37 temperature: 0.25 ada_p: No Discriminator_loss: 9.58923 Generator_loss: 5.1271
[INFO] 2021-02-02 03:45:38 > Step: 15700 Progress: 7.8% Elapsed: 13:43:50 temperature: 0.25 ada_p: No Discriminator_loss: 9.7256 Generator_loss: 5.04427
[INFO] 2021-02-02 03:49:51 > Step: 15800 Progress: 7.9% Elapsed: 13:48:03 temperature: 0.25 ada_p: No Discriminator_loss: 9.44585 Generator_loss: 5.33782
[INFO] 2021-02-02 03:54:04 > Step: 15900 Progress: 8.0% Elapsed: 13:52:16 temperature: 0.25 ada_p: No Discriminator_loss: 10.5373 Generator_loss: 6.70324
[INFO] 2021-02-02 03:58:16 > Step: 16000 Progress: 8.0% Elapsed: 13:56:28 temperature: 0.25 ada_p: No Discriminator_loss: 9.45474 Generator_loss: 5.44111
[INFO] 2021-02-02 03:58:16 > Start Evaluation (16000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 03:58:16 > Calculating FID Score....
[INFO] 2021-02-02 04:00:32 > Calculating Inception Score....
[INFO] 2021-02-02 04:02:40 > Calculate F_beta Score....
[INFO] 2021-02-02 04:14:14 > Calculate Accuracies....
[INFO] 2021-02-02 04:16:13 > Calculate Accuracies....
[INFO] 2021-02-02 04:21:08 > F_8 score (Step: 16000, Using valid images): 0.5359118090014544
[INFO] 2021-02-02 04:21:08 > F_1/8 score (Step: 16000, Using valid images): 0.8053603721248938
[INFO] 2021-02-02 04:21:08 > FID score (Step: 16000, Using valid moments): 63.03086040060168
[INFO] 2021-02-02 04:21:08 > Inception score (Step: 16000, 50000 generated images): 13.82630729675293
[INFO] 2021-02-02 04:21:08 > Best FID score (Step: 16000, Using valid moments): 63.03086040060168
[INFO] 2021-02-02 04:21:23 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 04:25:33 > Step: 16100 Progress: 8.1% Elapsed: 14:23:45 temperature: 0.25 ada_p: No Discriminator_loss: 9.55001 Generator_loss: 5.11299
[INFO] 2021-02-02 04:29:43 > Step: 16200 Progress: 8.1% Elapsed: 14:27:55 temperature: 0.25 ada_p: No Discriminator_loss: 9.68018 Generator_loss: 5.43398
[INFO] 2021-02-02 04:33:57 > Step: 16300 Progress: 8.2% Elapsed: 14:32:09 temperature: 0.25 ada_p: No Discriminator_loss: 9.80134 Generator_loss: 5.06499
[INFO] 2021-02-02 04:38:08 > Step: 16400 Progress: 8.2% Elapsed: 14:36:19 temperature: 0.25 ada_p: No Discriminator_loss: 9.45028 Generator_loss: 5.23074
[INFO] 2021-02-02 04:42:48 > Step: 16500 Progress: 8.2% Elapsed: 14:41:00 temperature: 0.25 ada_p: No Discriminator_loss: 9.64992 Generator_loss: 5.14083
[INFO] 2021-02-02 04:47:01 > Step: 16600 Progress: 8.3% Elapsed: 14:45:13 temperature: 0.25 ada_p: No Discriminator_loss: 9.47262 Generator_loss: 5.13714
[INFO] 2021-02-02 04:51:14 > Step: 16700 Progress: 8.3% Elapsed: 14:49:26 temperature: 0.25 ada_p: No Discriminator_loss: 9.44378 Generator_loss: 5.30425
[INFO] 2021-02-02 04:55:27 > Step: 16800 Progress: 8.4% Elapsed: 14:53:39 temperature: 0.25 ada_p: No Discriminator_loss: 9.42537 Generator_loss: 5.66158
[INFO] 2021-02-02 04:59:40 > Step: 16900 Progress: 8.5% Elapsed: 14:57:52 temperature: 0.25 ada_p: No Discriminator_loss: 9.44551 Generator_loss: 5.22618
[INFO] 2021-02-02 05:03:53 > Step: 17000 Progress: 8.5% Elapsed: 15:02:05 temperature: 0.25 ada_p: No Discriminator_loss: 9.37254 Generator_loss: 5.06625
[INFO] 2021-02-02 05:08:06 > Step: 17100 Progress: 8.6% Elapsed: 15:06:18 temperature: 0.25 ada_p: No Discriminator_loss: 9.31154 Generator_loss: 5.21244
[INFO] 2021-02-02 05:12:19 > Step: 17200 Progress: 8.6% Elapsed: 15:10:31 temperature: 0.25 ada_p: No Discriminator_loss: 9.70767 Generator_loss: 5.05604
[INFO] 2021-02-02 05:16:32 > Step: 17300 Progress: 8.6% Elapsed: 15:14:44 temperature: 0.25 ada_p: No Discriminator_loss: 9.4932 Generator_loss: 5.56448
[INFO] 2021-02-02 05:20:46 > Step: 17400 Progress: 8.7% Elapsed: 15:18:57 temperature: 0.25 ada_p: No Discriminator_loss: 9.37551 Generator_loss: 5.18051
[INFO] 2021-02-02 05:24:58 > Step: 17500 Progress: 8.8% Elapsed: 15:23:10 temperature: 0.25 ada_p: No Discriminator_loss: 9.32529 Generator_loss: 5.35889
[INFO] 2021-02-02 05:29:16 > Step: 17600 Progress: 8.8% Elapsed: 15:27:28 temperature: 0.25 ada_p: No Discriminator_loss: 9.58204 Generator_loss: 5.63183
[INFO] 2021-02-02 05:33:30 > Step: 17700 Progress: 8.8% Elapsed: 15:31:41 temperature: 0.25 ada_p: No Discriminator_loss: 9.26815 Generator_loss: 5.09008
[INFO] 2021-02-02 05:37:43 > Step: 17800 Progress: 8.9% Elapsed: 15:35:55 temperature: 0.25 ada_p: No Discriminator_loss: 9.37275 Generator_loss: 5.23713
[INFO] 2021-02-02 05:41:56 > Step: 17900 Progress: 8.9% Elapsed: 15:40:08 temperature: 0.25 ada_p: No Discriminator_loss: 9.38406 Generator_loss: 5.54373
[INFO] 2021-02-02 05:46:09 > Step: 18000 Progress: 9.0% Elapsed: 15:44:21 temperature: 0.25 ada_p: No Discriminator_loss: 9.4954 Generator_loss: 5.0976
[INFO] 2021-02-02 05:46:09 > Start Evaluation (18000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 05:46:09 > Calculating FID Score....
[INFO] 2021-02-02 05:48:27 > Calculating Inception Score....
[INFO] 2021-02-02 05:50:34 > Calculate F_beta Score....
[INFO] 2021-02-02 06:02:09 > Calculate Accuracies....
[INFO] 2021-02-02 06:04:07 > Calculate Accuracies....
[INFO] 2021-02-02 06:09:04 > F_8 score (Step: 18000, Using valid images): 0.5685213986523703
[INFO] 2021-02-02 06:09:04 > F_1/8 score (Step: 18000, Using valid images): 0.81413716823353
[INFO] 2021-02-02 06:09:04 > FID score (Step: 18000, Using valid moments): 59.86177251687457
[INFO] 2021-02-02 06:09:04 > Inception score (Step: 18000, 50000 generated images): 14.372142791748047
[INFO] 2021-02-02 06:09:04 > Best FID score (Step: 18000, Using valid moments): 59.86177251687457
[INFO] 2021-02-02 06:09:19 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 06:13:30 > Step: 18100 Progress: 9.0% Elapsed: 16:11:42 temperature: 0.25 ada_p: No Discriminator_loss: 9.22878 Generator_loss: 5.5928
[INFO] 2021-02-02 06:17:41 > Step: 18200 Progress: 9.1% Elapsed: 16:15:53 temperature: 0.25 ada_p: No Discriminator_loss: 9.35326 Generator_loss: 5.61746
[INFO] 2021-02-02 06:21:52 > Step: 18300 Progress: 9.2% Elapsed: 16:20:04 temperature: 0.25 ada_p: No Discriminator_loss: 9.30984 Generator_loss: 5.35997
[INFO] 2021-02-02 06:26:02 > Step: 18400 Progress: 9.2% Elapsed: 16:24:14 temperature: 0.25 ada_p: No Discriminator_loss: 9.44572 Generator_loss: 4.88029
[INFO] 2021-02-02 06:30:45 > Step: 18500 Progress: 9.2% Elapsed: 16:28:56 temperature: 0.25 ada_p: No Discriminator_loss: 9.4831 Generator_loss: 5.47004
[INFO] 2021-02-02 06:34:57 > Step: 18600 Progress: 9.3% Elapsed: 16:33:09 temperature: 0.25 ada_p: No Discriminator_loss: 9.59055 Generator_loss: 5.27351
[INFO] 2021-02-02 06:39:10 > Step: 18700 Progress: 9.3% Elapsed: 16:37:21 temperature: 0.25 ada_p: No Discriminator_loss: 9.36797 Generator_loss: 6.30504
[INFO] 2021-02-02 06:43:22 > Step: 18800 Progress: 9.4% Elapsed: 16:41:33 temperature: 0.25 ada_p: No Discriminator_loss: 9.38468 Generator_loss: 5.23232
[INFO] 2021-02-02 06:47:34 > Step: 18900 Progress: 9.4% Elapsed: 16:45:46 temperature: 0.25 ada_p: No Discriminator_loss: 9.25513 Generator_loss: 5.29739
[INFO] 2021-02-02 06:51:47 > Step: 19000 Progress: 9.5% Elapsed: 16:49:59 temperature: 0.25 ada_p: No Discriminator_loss: 9.39472 Generator_loss: 6.36654
[INFO] 2021-02-02 06:56:01 > Step: 19100 Progress: 9.6% Elapsed: 16:54:13 temperature: 0.25 ada_p: No Discriminator_loss: 9.3377 Generator_loss: 5.20126
[INFO] 2021-02-02 07:00:14 > Step: 19200 Progress: 9.6% Elapsed: 16:58:26 temperature: 0.25 ada_p: No Discriminator_loss: 9.35347 Generator_loss: 5.64162
[INFO] 2021-02-02 07:04:28 > Step: 19300 Progress: 9.7% Elapsed: 17:02:39 temperature: 0.25 ada_p: No Discriminator_loss: 9.24415 Generator_loss: 5.24696
[INFO] 2021-02-02 07:08:41 > Step: 19400 Progress: 9.7% Elapsed: 17:06:52 temperature: 0.25 ada_p: No Discriminator_loss: 9.62383 Generator_loss: 5.10571
[INFO] 2021-02-02 07:12:54 > Step: 19500 Progress: 9.8% Elapsed: 17:11:06 temperature: 0.25 ada_p: No Discriminator_loss: 9.24742 Generator_loss: 5.55929
[INFO] 2021-02-02 07:17:07 > Step: 19600 Progress: 9.8% Elapsed: 17:15:19 temperature: 0.25 ada_p: No Discriminator_loss: 9.57704 Generator_loss: 5.00507
[INFO] 2021-02-02 07:21:20 > Step: 19700 Progress: 9.8% Elapsed: 17:19:32 temperature: 0.25 ada_p: No Discriminator_loss: 9.65452 Generator_loss: 5.28779
[INFO] 2021-02-02 07:25:33 > Step: 19800 Progress: 9.9% Elapsed: 17:23:45 temperature: 0.25 ada_p: No Discriminator_loss: 9.39915 Generator_loss: 5.35284
[INFO] 2021-02-02 07:29:46 > Step: 19900 Progress: 10.0% Elapsed: 17:27:58 temperature: 0.25 ada_p: No Discriminator_loss: 9.2064 Generator_loss: 5.32091
[INFO] 2021-02-02 07:33:59 > Step: 20000 Progress: 10.0% Elapsed: 17:32:10 temperature: 0.25 ada_p: No Discriminator_loss: 9.08543 Generator_loss: 5.34246
[INFO] 2021-02-02 07:33:59 > Start Evaluation (20000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 07:33:59 > Calculating FID Score....
[INFO] 2021-02-02 07:36:16 > Calculating Inception Score....
[INFO] 2021-02-02 07:38:24 > Calculate F_beta Score....
[INFO] 2021-02-02 07:49:53 > Calculate Accuracies....
[INFO] 2021-02-02 07:51:39 > Calculate Accuracies....
[INFO] 2021-02-02 07:56:32 > F_8 score (Step: 20000, Using valid images): 0.5789026389828071
[INFO] 2021-02-02 07:56:32 > F_1/8 score (Step: 20000, Using valid images): 0.8320559165120073
[INFO] 2021-02-02 07:56:32 > FID score (Step: 20000, Using valid moments): 57.19234671573224
[INFO] 2021-02-02 07:56:32 > Inception score (Step: 20000, 50000 generated images): 15.06434440612793
[INFO] 2021-02-02 07:56:32 > Best FID score (Step: 20000, Using valid moments): 57.19234671573224
[INFO] 2021-02-02 07:56:47 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 08:01:04 > Step: 20100 Progress: 10.1% Elapsed: 17:59:16 temperature: 0.25 ada_p: No Discriminator_loss: 9.49694 Generator_loss: 5.39837
[INFO] 2021-02-02 08:05:16 > Step: 20200 Progress: 10.1% Elapsed: 18:03:27 temperature: 0.25 ada_p: No Discriminator_loss: 9.18854 Generator_loss: 5.66422
[INFO] 2021-02-02 08:09:51 > Step: 20300 Progress: 10.2% Elapsed: 18:08:03 temperature: 0.25 ada_p: No Discriminator_loss: 9.21576 Generator_loss: 5.46479
[INFO] 2021-02-02 08:14:05 > Step: 20400 Progress: 10.2% Elapsed: 18:12:16 temperature: 0.25 ada_p: No Discriminator_loss: 9.27514 Generator_loss: 5.40102
[INFO] 2021-02-02 08:18:18 > Step: 20500 Progress: 10.2% Elapsed: 18:16:30 temperature: 0.25 ada_p: No Discriminator_loss: 9.60373 Generator_loss: 5.14196
[INFO] 2021-02-02 08:22:32 > Step: 20600 Progress: 10.3% Elapsed: 18:20:44 temperature: 0.25 ada_p: No Discriminator_loss: 9.55961 Generator_loss: 5.32685
[INFO] 2021-02-02 08:26:46 > Step: 20700 Progress: 10.3% Elapsed: 18:24:58 temperature: 0.25 ada_p: No Discriminator_loss: 9.17348 Generator_loss: 6.22851
[INFO] 2021-02-02 08:31:00 > Step: 20800 Progress: 10.4% Elapsed: 18:29:11 temperature: 0.25 ada_p: No Discriminator_loss: 9.32602 Generator_loss: 5.5939
[INFO] 2021-02-02 08:35:13 > Step: 20900 Progress: 10.4% Elapsed: 18:33:25 temperature: 0.25 ada_p: No Discriminator_loss: 9.36332 Generator_loss: 4.84167
[INFO] 2021-02-02 08:39:27 > Step: 21000 Progress: 10.5% Elapsed: 18:37:39 temperature: 0.25 ada_p: No Discriminator_loss: 9.28872 Generator_loss: 5.3393
[INFO] 2021-02-02 08:43:40 > Step: 21100 Progress: 10.5% Elapsed: 18:41:52 temperature: 0.25 ada_p: No Discriminator_loss: 9.49144 Generator_loss: 5.31965
[INFO] 2021-02-02 08:47:54 > Step: 21200 Progress: 10.6% Elapsed: 18:46:05 temperature: 0.25 ada_p: No Discriminator_loss: 9.6348 Generator_loss: 5.17182
[INFO] 2021-02-02 08:52:07 > Step: 21300 Progress: 10.7% Elapsed: 18:50:18 temperature: 0.25 ada_p: No Discriminator_loss: 9.65903 Generator_loss: 5.56702
[INFO] 2021-02-02 08:56:20 > Step: 21400 Progress: 10.7% Elapsed: 18:54:32 temperature: 0.25 ada_p: No Discriminator_loss: 9.45801 Generator_loss: 4.96555
[INFO] 2021-02-02 09:00:33 > Step: 21500 Progress: 10.8% Elapsed: 18:58:44 temperature: 0.25 ada_p: No Discriminator_loss: 9.20503 Generator_loss: 5.40883
[INFO] 2021-02-02 09:04:46 > Step: 21600 Progress: 10.8% Elapsed: 19:02:58 temperature: 0.25 ada_p: No Discriminator_loss: 9.26517 Generator_loss: 5.07388
[INFO] 2021-02-02 09:08:59 > Step: 21700 Progress: 10.8% Elapsed: 19:07:11 temperature: 0.25 ada_p: No Discriminator_loss: 9.56055 Generator_loss: 5.28478
[INFO] 2021-02-02 09:13:13 > Step: 21800 Progress: 10.9% Elapsed: 19:11:25 temperature: 0.25 ada_p: No Discriminator_loss: 9.29393 Generator_loss: 5.28121
[INFO] 2021-02-02 09:17:27 > Step: 21900 Progress: 10.9% Elapsed: 19:15:38 temperature: 0.25 ada_p: No Discriminator_loss: 9.31222 Generator_loss: 5.21538
[INFO] 2021-02-02 09:21:41 > Step: 22000 Progress: 11.0% Elapsed: 19:19:53 temperature: 0.25 ada_p: No Discriminator_loss: 9.17959 Generator_loss: 5.38495
[INFO] 2021-02-02 09:21:41 > Start Evaluation (22000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 09:21:41 > Calculating FID Score....
[INFO] 2021-02-02 09:23:59 > Calculating Inception Score....
[INFO] 2021-02-02 09:26:07 > Calculate F_beta Score....
[INFO] 2021-02-02 09:37:41 > Calculate Accuracies....
[INFO] 2021-02-02 09:39:26 > Calculate Accuracies....
[INFO] 2021-02-02 09:44:20 > F_8 score (Step: 22000, Using valid images): 0.5953630493625061
[INFO] 2021-02-02 09:44:20 > F_1/8 score (Step: 22000, Using valid images): 0.8695375451894726
[INFO] 2021-02-02 09:44:20 > FID score (Step: 22000, Using valid moments): 52.07908382762645
[INFO] 2021-02-02 09:44:20 > Inception score (Step: 22000, 50000 generated images): 16.152698516845703
[INFO] 2021-02-02 09:44:20 > Best FID score (Step: 22000, Using valid moments): 52.07908382762645
[INFO] 2021-02-02 09:44:35 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 09:49:04 > Step: 22100 Progress: 11.1% Elapsed: 19:47:16 temperature: 0.25 ada_p: No Discriminator_loss: 9.06698 Generator_loss: 5.58471
[INFO] 2021-02-02 09:53:18 > Step: 22200 Progress: 11.1% Elapsed: 19:51:30 temperature: 0.25 ada_p: No Discriminator_loss: 9.32412 Generator_loss: 5.16542
[INFO] 2021-02-02 09:57:31 > Step: 22300 Progress: 11.2% Elapsed: 19:55:43 temperature: 0.25 ada_p: No Discriminator_loss: 9.26129 Generator_loss: 5.1187
[INFO] 2021-02-02 10:01:44 > Step: 22400 Progress: 11.2% Elapsed: 19:59:56 temperature: 0.25 ada_p: No Discriminator_loss: 9.12399 Generator_loss: 5.46056
[INFO] 2021-02-02 10:05:58 > Step: 22500 Progress: 11.2% Elapsed: 20:04:10 temperature: 0.25 ada_p: No Discriminator_loss: 9.53845 Generator_loss: 5.40924
[INFO] 2021-02-02 10:10:18 > Step: 22600 Progress: 11.3% Elapsed: 20:08:29 temperature: 0.25 ada_p: No Discriminator_loss: 9.17865 Generator_loss: 5.37343
[INFO] 2021-02-02 10:14:32 > Step: 22700 Progress: 11.3% Elapsed: 20:12:44 temperature: 0.25 ada_p: No Discriminator_loss: 9.1973 Generator_loss: 6.42694
[INFO] 2021-02-02 10:18:45 > Step: 22800 Progress: 11.4% Elapsed: 20:16:57 temperature: 0.25 ada_p: No Discriminator_loss: 9.05878 Generator_loss: 5.15551
[INFO] 2021-02-02 10:22:58 > Step: 22900 Progress: 11.5% Elapsed: 20:21:09 temperature: 0.25 ada_p: No Discriminator_loss: 9.15782 Generator_loss: 5.25748
[INFO] 2021-02-02 10:27:10 > Step: 23000 Progress: 11.5% Elapsed: 20:25:21 temperature: 0.25 ada_p: No Discriminator_loss: 9.19406 Generator_loss: 5.28566
[INFO] 2021-02-02 10:31:22 > Step: 23100 Progress: 11.6% Elapsed: 20:29:34 temperature: 0.25 ada_p: No Discriminator_loss: 9.26965 Generator_loss: 5.31469
[INFO] 2021-02-02 10:35:34 > Step: 23200 Progress: 11.6% Elapsed: 20:33:46 temperature: 0.25 ada_p: No Discriminator_loss: 9.32278 Generator_loss: 5.15009
[INFO] 2021-02-02 10:39:47 > Step: 23300 Progress: 11.7% Elapsed: 20:37:59 temperature: 0.25 ada_p: No Discriminator_loss: 9.05753 Generator_loss: 5.40044
[INFO] 2021-02-02 10:44:00 > Step: 23400 Progress: 11.7% Elapsed: 20:42:11 temperature: 0.25 ada_p: No Discriminator_loss: 9.34076 Generator_loss: 5.22707
[INFO] 2021-02-02 10:48:13 > Step: 23500 Progress: 11.8% Elapsed: 20:46:24 temperature: 0.25 ada_p: No Discriminator_loss: 9.20192 Generator_loss: 5.08327
[INFO] 2021-02-02 10:52:26 > Step: 23600 Progress: 11.8% Elapsed: 20:50:38 temperature: 0.25 ada_p: No Discriminator_loss: 9.13628 Generator_loss: 5.23001
[INFO] 2021-02-02 10:56:40 > Step: 23700 Progress: 11.8% Elapsed: 20:54:52 temperature: 0.25 ada_p: No Discriminator_loss: 9.36797 Generator_loss: 5.76815
[INFO] 2021-02-02 11:00:53 > Step: 23800 Progress: 11.9% Elapsed: 20:59:05 temperature: 0.25 ada_p: No Discriminator_loss: 9.02191 Generator_loss: 5.74042
[INFO] 2021-02-02 11:05:07 > Step: 23900 Progress: 11.9% Elapsed: 21:03:19 temperature: 0.25 ada_p: No Discriminator_loss: 9.27497 Generator_loss: 5.31999
[INFO] 2021-02-02 11:09:21 > Step: 24000 Progress: 12.0% Elapsed: 21:07:33 temperature: 0.25 ada_p: No Discriminator_loss: 9.08714 Generator_loss: 5.52017
[INFO] 2021-02-02 11:09:21 > Start Evaluation (24000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 11:09:21 > Calculating FID Score....
[INFO] 2021-02-02 11:11:40 > Calculating Inception Score....
[INFO] 2021-02-02 11:13:47 > Calculate F_beta Score....
[INFO] 2021-02-02 11:25:24 > Calculate Accuracies....
[INFO] 2021-02-02 11:27:10 > Calculate Accuracies....
[INFO] 2021-02-02 11:32:03 > F_8 score (Step: 24000, Using valid images): 0.6532727276176068
[INFO] 2021-02-02 11:32:03 > F_1/8 score (Step: 24000, Using valid images): 0.8755116104574747
[INFO] 2021-02-02 11:32:03 > FID score (Step: 24000, Using valid moments): 47.36777813311198
[INFO] 2021-02-02 11:32:03 > Inception score (Step: 24000, 50000 generated images): 16.965328216552734
[INFO] 2021-02-02 11:32:03 > Best FID score (Step: 24000, Using valid moments): 47.36777813311198
[INFO] 2021-02-02 11:32:18 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 11:36:29 > Step: 24100 Progress: 12.0% Elapsed: 21:34:41 temperature: 0.25 ada_p: No Discriminator_loss: 9.109 Generator_loss: 5.41051
[INFO] 2021-02-02 11:40:41 > Step: 24200 Progress: 12.1% Elapsed: 21:38:52 temperature: 0.25 ada_p: No Discriminator_loss: 9.27154 Generator_loss: 5.39159
[INFO] 2021-02-02 11:44:53 > Step: 24300 Progress: 12.2% Elapsed: 21:43:04 temperature: 0.25 ada_p: No Discriminator_loss: 9.06079 Generator_loss: 5.38823
[INFO] 2021-02-02 11:49:22 > Step: 24400 Progress: 12.2% Elapsed: 21:47:34 temperature: 0.25 ada_p: No Discriminator_loss: 9.4606 Generator_loss: 4.93116
[INFO] 2021-02-02 11:53:35 > Step: 24500 Progress: 12.2% Elapsed: 21:51:47 temperature: 0.25 ada_p: No Discriminator_loss: 9.16042 Generator_loss: 5.42518
[INFO] 2021-02-02 11:57:48 > Step: 24600 Progress: 12.3% Elapsed: 21:56:00 temperature: 0.25 ada_p: No Discriminator_loss: 9.12446 Generator_loss: 5.42182
[INFO] 2021-02-02 12:02:00 > Step: 24700 Progress: 12.3% Elapsed: 22:00:12 temperature: 0.25 ada_p: No Discriminator_loss: 9.14537 Generator_loss: 5.187
[INFO] 2021-02-02 12:06:13 > Step: 24800 Progress: 12.4% Elapsed: 22:04:25 temperature: 0.25 ada_p: No Discriminator_loss: 9.31999 Generator_loss: 5.09565
[INFO] 2021-02-02 12:10:26 > Step: 24900 Progress: 12.4% Elapsed: 22:08:37 temperature: 0.25 ada_p: No Discriminator_loss: 9.52112 Generator_loss: 5.44055
[INFO] 2021-02-02 12:14:38 > Step: 25000 Progress: 12.5% Elapsed: 22:12:50 temperature: 0.25 ada_p: No Discriminator_loss: 9.27603 Generator_loss: 5.15518
[INFO] 2021-02-02 12:18:56 > Step: 25100 Progress: 12.6% Elapsed: 22:17:08 temperature: 0.25 ada_p: No Discriminator_loss: 9.0387 Generator_loss: 5.39224
[INFO] 2021-02-02 12:23:10 > Step: 25200 Progress: 12.6% Elapsed: 22:21:22 temperature: 0.25 ada_p: No Discriminator_loss: 9.16121 Generator_loss: 5.26808
[INFO] 2021-02-02 12:27:24 > Step: 25300 Progress: 12.7% Elapsed: 22:25:36 temperature: 0.25 ada_p: No Discriminator_loss: 9.20892 Generator_loss: 5.47645
[INFO] 2021-02-02 12:31:38 > Step: 25400 Progress: 12.7% Elapsed: 22:29:50 temperature: 0.25 ada_p: No Discriminator_loss: 9.19272 Generator_loss: 5.28363
[INFO] 2021-02-02 12:35:52 > Step: 25500 Progress: 12.8% Elapsed: 22:34:04 temperature: 0.25 ada_p: No Discriminator_loss: 9.00403 Generator_loss: 5.31619
[INFO] 2021-02-02 12:40:06 > Step: 25600 Progress: 12.8% Elapsed: 22:38:17 temperature: 0.25 ada_p: No Discriminator_loss: 9.2875 Generator_loss: 4.99693
[INFO] 2021-02-02 12:44:18 > Step: 25700 Progress: 12.8% Elapsed: 22:42:30 temperature: 0.25 ada_p: No Discriminator_loss: 9.19905 Generator_loss: 5.17785
[INFO] 2021-02-02 12:48:31 > Step: 25800 Progress: 12.9% Elapsed: 22:46:43 temperature: 0.25 ada_p: No Discriminator_loss: 9.20083 Generator_loss: 5.14478
[INFO] 2021-02-02 12:52:45 > Step: 25900 Progress: 13.0% Elapsed: 22:50:56 temperature: 0.25 ada_p: No Discriminator_loss: 9.31526 Generator_loss: 5.21826
[INFO] 2021-02-02 12:56:58 > Step: 26000 Progress: 13.0% Elapsed: 22:55:10 temperature: 0.25 ada_p: No Discriminator_loss: 9.10746 Generator_loss: 5.74051
[INFO] 2021-02-02 12:56:58 > Start Evaluation (26000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 12:56:58 > Calculating FID Score....
[INFO] 2021-02-02 12:59:14 > Calculating Inception Score....
[INFO] 2021-02-02 13:01:23 > Calculate F_beta Score....
[INFO] 2021-02-02 13:12:57 > Calculate Accuracies....
[INFO] 2021-02-02 13:14:43 > Calculate Accuracies....
[INFO] 2021-02-02 13:19:37 > F_8 score (Step: 26000, Using valid images): 0.6863836714582828
[INFO] 2021-02-02 13:19:37 > F_1/8 score (Step: 26000, Using valid images): 0.893680512809986
[INFO] 2021-02-02 13:19:37 > FID score (Step: 26000, Using valid moments): 44.06897214324039
[INFO] 2021-02-02 13:19:37 > Inception score (Step: 26000, 50000 generated images): 17.76106834411621
[INFO] 2021-02-02 13:19:37 > Best FID score (Step: 26000, Using valid moments): 44.06897214324039
[INFO] 2021-02-02 13:19:51 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 13:27:59 > Generator checkpoint is checkpoints/ContraGAN256-train-2021_02_01_13_59_48/model=G-best-weights-step=26000.pth
[INFO] 2021-02-02 13:27:59 > Discriminator checkpoint is checkpoints/ContraGAN256-train-2021_02_01_13_59_48/model=D-best-weights-step=26000.pth
[INFO] 2021-02-02 13:28:02 > Start training....
[INFO] 2021-02-02 13:31:58 > Step: 26100 Progress: 13.1% Elapsed: 0:03:56 temperature: 0.25 ada_p: No Discriminator_loss: 10.2758 Generator_loss: 5.23259
[INFO] 2021-02-02 13:35:30 > Step: 26200 Progress: 13.1% Elapsed: 0:07:28 temperature: 0.25 ada_p: No Discriminator_loss: 9.05914 Generator_loss: 6.26141
[INFO] 2021-02-02 13:39:02 > Step: 26300 Progress: 13.2% Elapsed: 0:11:00 temperature: 0.25 ada_p: No Discriminator_loss: 9.39118 Generator_loss: 5.25628
[INFO] 2021-02-02 13:42:34 > Step: 26400 Progress: 13.2% Elapsed: 0:14:31 temperature: 0.25 ada_p: No Discriminator_loss: 10.0227 Generator_loss: 5.34528
[INFO] 2021-02-02 13:46:05 > Step: 26500 Progress: 13.2% Elapsed: 0:18:03 temperature: 0.25 ada_p: No Discriminator_loss: 9.19045 Generator_loss: 5.22351
[INFO] 2021-02-02 13:49:36 > Step: 26600 Progress: 13.3% Elapsed: 0:21:34 temperature: 0.25 ada_p: No Discriminator_loss: 9.05914 Generator_loss: 5.44527
[INFO] 2021-02-02 13:53:08 > Step: 26700 Progress: 13.4% Elapsed: 0:25:06 temperature: 0.25 ada_p: No Discriminator_loss: 9.16596 Generator_loss: 5.29234
[INFO] 2021-02-02 13:56:39 > Step: 26800 Progress: 13.4% Elapsed: 0:28:37 temperature: 0.25 ada_p: No Discriminator_loss: 9.18727 Generator_loss: 5.22061
[INFO] 2021-02-02 14:00:11 > Step: 26900 Progress: 13.5% Elapsed: 0:32:09 temperature: 0.25 ada_p: No Discriminator_loss: 9.24672 Generator_loss: 5.05707
[INFO] 2021-02-02 14:03:41 > Step: 27000 Progress: 13.5% Elapsed: 0:35:39 temperature: 0.25 ada_p: No Discriminator_loss: 9.20624 Generator_loss: 5.31127
[INFO] 2021-02-02 14:07:12 > Step: 27100 Progress: 13.6% Elapsed: 0:39:10 temperature: 0.25 ada_p: No Discriminator_loss: 9.10716 Generator_loss: 5.42551
[INFO] 2021-02-02 14:10:43 > Step: 27200 Progress: 13.6% Elapsed: 0:42:41 temperature: 0.25 ada_p: No Discriminator_loss: 9.05558 Generator_loss: 5.59877
[INFO] 2021-02-02 14:14:14 > Step: 27300 Progress: 13.7% Elapsed: 0:46:12 temperature: 0.25 ada_p: No Discriminator_loss: 9.10172 Generator_loss: 5.10761
[INFO] 2021-02-02 14:17:45 > Step: 27400 Progress: 13.7% Elapsed: 0:49:43 temperature: 0.25 ada_p: No Discriminator_loss: 9.6167 Generator_loss: 5.30681
[INFO] 2021-02-02 14:21:16 > Step: 27500 Progress: 13.8% Elapsed: 0:53:14 temperature: 0.25 ada_p: No Discriminator_loss: 9.31602 Generator_loss: 5.32156
[INFO] 2021-02-02 14:24:48 > Step: 27600 Progress: 13.8% Elapsed: 0:56:46 temperature: 0.25 ada_p: No Discriminator_loss: 9.33706 Generator_loss: 5.1576
[INFO] 2021-02-02 14:28:20 > Step: 27700 Progress: 13.9% Elapsed: 1:00:18 temperature: 0.25 ada_p: No Discriminator_loss: 9.42553 Generator_loss: 5.07163
[INFO] 2021-02-02 14:31:51 > Step: 27800 Progress: 13.9% Elapsed: 1:03:49 temperature: 0.25 ada_p: No Discriminator_loss: 8.96405 Generator_loss: 5.29249
[INFO] 2021-02-02 14:35:23 > Step: 27900 Progress: 14.0% Elapsed: 1:07:21 temperature: 0.25 ada_p: No Discriminator_loss: 9.12718 Generator_loss: 5.11815
[INFO] 2021-02-02 14:38:53 > Step: 28000 Progress: 14.0% Elapsed: 1:10:51 temperature: 0.25 ada_p: No Discriminator_loss: 9.04179 Generator_loss: 5.53382
[INFO] 2021-02-02 14:38:53 > Start Evaluation (28000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 14:38:53 > Calculating FID Score....
[INFO] 2021-02-02 14:40:07 > Calculating Inception Score....
[INFO] 2021-02-02 14:41:07 > Calculate F_beta Score....
[INFO] 2021-02-02 14:51:21 > Calculate Accuracies....
[INFO] 2021-02-02 14:52:31 > Calculate Accuracies....
[INFO] 2021-02-02 14:57:24 > F_8 score (Step: 28000, Using valid images): 0.706332304802014
[INFO] 2021-02-02 14:57:24 > F_1/8 score (Step: 28000, Using valid images): 0.9051282994087652
[INFO] 2021-02-02 14:57:24 > FID score (Step: 28000, Using valid moments): 41.375797003714524
[INFO] 2021-02-02 14:57:24 > Inception score (Step: 28000, 50000 generated images): 18.17317771911621
[INFO] 2021-02-02 14:57:24 > Best FID score (Step: 28000, Using valid moments): 41.375797003714524
[INFO] 2021-02-02 14:57:39 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 15:01:11 > Step: 28100 Progress: 14.1% Elapsed: 1:33:09 temperature: 0.25 ada_p: No Discriminator_loss: 9.22589 Generator_loss: 5.31771
[INFO] 2021-02-02 15:04:43 > Step: 28200 Progress: 14.1% Elapsed: 1:36:41 temperature: 0.25 ada_p: No Discriminator_loss: 9.1093 Generator_loss: 5.3836
[INFO] 2021-02-02 15:08:14 > Step: 28300 Progress: 14.1% Elapsed: 1:40:12 temperature: 0.25 ada_p: No Discriminator_loss: 9.01843 Generator_loss: 5.3531
[INFO] 2021-02-02 15:12:01 > Step: 28400 Progress: 14.2% Elapsed: 1:43:59 temperature: 0.25 ada_p: No Discriminator_loss: 9.28263 Generator_loss: 5.16319
[INFO] 2021-02-02 15:15:33 > Step: 28500 Progress: 14.2% Elapsed: 1:47:31 temperature: 0.25 ada_p: No Discriminator_loss: 9.18028 Generator_loss: 5.18151
[INFO] 2021-02-02 15:19:07 > Step: 28600 Progress: 14.3% Elapsed: 1:51:05 temperature: 0.25 ada_p: No Discriminator_loss: 9.32496 Generator_loss: 5.18492
[INFO] 2021-02-02 15:22:38 > Step: 28700 Progress: 14.3% Elapsed: 1:54:36 temperature: 0.25 ada_p: No Discriminator_loss: 9.29299 Generator_loss: 5.03277
[INFO] 2021-02-02 15:26:10 > Step: 28800 Progress: 14.4% Elapsed: 1:58:08 temperature: 0.25 ada_p: No Discriminator_loss: 9.06364 Generator_loss: 6.09272
[INFO] 2021-02-02 15:29:41 > Step: 28900 Progress: 14.4% Elapsed: 2:01:39 temperature: 0.25 ada_p: No Discriminator_loss: 9.28395 Generator_loss: 5.51353
[INFO] 2021-02-02 15:33:13 > Step: 29000 Progress: 14.5% Elapsed: 2:05:11 temperature: 0.25 ada_p: No Discriminator_loss: 9.14256 Generator_loss: 5.30384
[INFO] 2021-02-02 15:36:45 > Step: 29100 Progress: 14.5% Elapsed: 2:08:43 temperature: 0.25 ada_p: No Discriminator_loss: 9.34039 Generator_loss: 5.3759
[INFO] 2021-02-02 15:40:16 > Step: 29200 Progress: 14.6% Elapsed: 2:12:14 temperature: 0.25 ada_p: No Discriminator_loss: 9.31496 Generator_loss: 5.15989
[INFO] 2021-02-02 15:43:48 > Step: 29300 Progress: 14.6% Elapsed: 2:15:46 temperature: 0.25 ada_p: No Discriminator_loss: 9.29019 Generator_loss: 4.97795
[INFO] 2021-02-02 15:47:20 > Step: 29400 Progress: 14.7% Elapsed: 2:19:18 temperature: 0.25 ada_p: No Discriminator_loss: 9.20873 Generator_loss: 5.30715
[INFO] 2021-02-02 15:50:51 > Step: 29500 Progress: 14.8% Elapsed: 2:22:49 temperature: 0.25 ada_p: No Discriminator_loss: 8.93467 Generator_loss: 5.99896
[INFO] 2021-02-02 15:54:22 > Step: 29600 Progress: 14.8% Elapsed: 2:26:20 temperature: 0.25 ada_p: No Discriminator_loss: 9.14594 Generator_loss: 5.4695
[INFO] 2021-02-02 15:57:54 > Step: 29700 Progress: 14.8% Elapsed: 2:29:52 temperature: 0.25 ada_p: No Discriminator_loss: 9.01735 Generator_loss: 5.23071
[INFO] 2021-02-02 16:01:25 > Step: 29800 Progress: 14.9% Elapsed: 2:33:23 temperature: 0.25 ada_p: No Discriminator_loss: 9.31481 Generator_loss: 5.43187
[INFO] 2021-02-02 16:04:56 > Step: 29900 Progress: 14.9% Elapsed: 2:36:54 temperature: 0.25 ada_p: No Discriminator_loss: 9.20587 Generator_loss: 5.52619
[INFO] 2021-02-02 16:08:28 > Step: 30000 Progress: 15.0% Elapsed: 2:40:26 temperature: 0.25 ada_p: No Discriminator_loss: 9.15206 Generator_loss: 5.45511
[INFO] 2021-02-02 16:08:28 > Start Evaluation (30000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 16:08:28 > Calculating FID Score....
[INFO] 2021-02-02 16:09:39 > Calculating Inception Score....
[INFO] 2021-02-02 16:10:39 > Calculate F_beta Score....
[INFO] 2021-02-02 16:20:50 > Calculate Accuracies....
[INFO] 2021-02-02 16:22:00 > Calculate Accuracies....
[INFO] 2021-02-02 16:27:01 > F_8 score (Step: 30000, Using valid images): 0.6897020681822631
[INFO] 2021-02-02 16:27:01 > F_1/8 score (Step: 30000, Using valid images): 0.9067105865679114
[INFO] 2021-02-02 16:27:01 > FID score (Step: 30000, Using valid moments): 39.20587358301634
[INFO] 2021-02-02 16:27:01 > Inception score (Step: 30000, 50000 generated images): 18.96320343017578
[INFO] 2021-02-02 16:27:01 > Best FID score (Step: 30000, Using valid moments): 39.20587358301634
[INFO] 2021-02-02 16:27:15 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 16:30:47 > Step: 30100 Progress: 15.0% Elapsed: 3:02:45 temperature: 0.25 ada_p: No Discriminator_loss: 9.15644 Generator_loss: 5.41741
[INFO] 2021-02-02 16:34:19 > Step: 30200 Progress: 15.1% Elapsed: 3:06:17 temperature: 0.25 ada_p: No Discriminator_loss: 9.22515 Generator_loss: 5.03737
[INFO] 2021-02-02 16:37:51 > Step: 30300 Progress: 15.2% Elapsed: 3:09:49 temperature: 0.25 ada_p: No Discriminator_loss: 9.09402 Generator_loss: 5.44657
[INFO] 2021-02-02 16:41:21 > Step: 30400 Progress: 15.2% Elapsed: 3:13:19 temperature: 0.25 ada_p: No Discriminator_loss: 9.21681 Generator_loss: 5.40965
[INFO] 2021-02-02 16:44:52 > Step: 30500 Progress: 15.2% Elapsed: 3:16:50 temperature: 0.25 ada_p: No Discriminator_loss: 9.37579 Generator_loss: 5.17424
[INFO] 2021-02-02 16:48:23 > Step: 30600 Progress: 15.3% Elapsed: 3:20:21 temperature: 0.25 ada_p: No Discriminator_loss: 9.08969 Generator_loss: 5.59037
[INFO] 2021-02-02 16:51:55 > Step: 30700 Progress: 15.3% Elapsed: 3:23:53 temperature: 0.25 ada_p: No Discriminator_loss: 9.20309 Generator_loss: 5.50605
[INFO] 2021-02-02 16:55:28 > Step: 30800 Progress: 15.4% Elapsed: 3:27:26 temperature: 0.25 ada_p: No Discriminator_loss: 9.17897 Generator_loss: 5.46432
[INFO] 2021-02-02 16:59:18 > Step: 30900 Progress: 15.4% Elapsed: 3:31:16 temperature: 0.25 ada_p: No Discriminator_loss: 9.22816 Generator_loss: 5.21177
[INFO] 2021-02-02 17:02:50 > Step: 31000 Progress: 15.5% Elapsed: 3:34:48 temperature: 0.25 ada_p: No Discriminator_loss: 9.26427 Generator_loss: 4.89013
[INFO] 2021-02-02 17:06:24 > Step: 31100 Progress: 15.6% Elapsed: 3:38:21 temperature: 0.25 ada_p: No Discriminator_loss: 9.06639 Generator_loss: 5.25017
[INFO] 2021-02-02 17:09:55 > Step: 31200 Progress: 15.6% Elapsed: 3:41:53 temperature: 0.25 ada_p: No Discriminator_loss: 9.05503 Generator_loss: 5.34975
[INFO] 2021-02-02 17:13:27 > Step: 31300 Progress: 15.7% Elapsed: 3:45:25 temperature: 0.25 ada_p: No Discriminator_loss: 9.14529 Generator_loss: 5.22234
[INFO] 2021-02-02 17:16:58 > Step: 31400 Progress: 15.7% Elapsed: 3:48:56 temperature: 0.25 ada_p: No Discriminator_loss: 9.0863 Generator_loss: 5.30471
[INFO] 2021-02-02 17:20:28 > Step: 31500 Progress: 15.8% Elapsed: 3:52:26 temperature: 0.25 ada_p: No Discriminator_loss: 9.10048 Generator_loss: 5.29414
[INFO] 2021-02-02 17:24:00 > Step: 31600 Progress: 15.8% Elapsed: 3:55:58 temperature: 0.25 ada_p: No Discriminator_loss: 9.07551 Generator_loss: 5.27914
[INFO] 2021-02-02 17:27:31 > Step: 31700 Progress: 15.8% Elapsed: 3:59:29 temperature: 0.25 ada_p: No Discriminator_loss: 8.98141 Generator_loss: 5.31609
[INFO] 2021-02-02 17:31:02 > Step: 31800 Progress: 15.9% Elapsed: 4:03:00 temperature: 0.25 ada_p: No Discriminator_loss: 9.38247 Generator_loss: 5.20983
[INFO] 2021-02-02 17:34:34 > Step: 31900 Progress: 16.0% Elapsed: 4:06:32 temperature: 0.25 ada_p: No Discriminator_loss: 9.13214 Generator_loss: 5.61792
[INFO] 2021-02-02 17:38:05 > Step: 32000 Progress: 16.0% Elapsed: 4:10:03 temperature: 0.25 ada_p: No Discriminator_loss: 9.00292 Generator_loss: 5.29219
[INFO] 2021-02-02 17:38:05 > Start Evaluation (32000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 17:38:05 > Calculating FID Score....
[INFO] 2021-02-02 17:39:16 > Calculating Inception Score....
[INFO] 2021-02-02 17:40:16 > Calculate F_beta Score....
[INFO] 2021-02-02 17:50:38 > Calculate Accuracies....
[INFO] 2021-02-02 17:51:47 > Calculate Accuracies....
[INFO] 2021-02-02 17:56:41 > F_8 score (Step: 32000, Using valid images): 0.710627291807423
[INFO] 2021-02-02 17:56:41 > F_1/8 score (Step: 32000, Using valid images): 0.9123366774256081
[INFO] 2021-02-02 17:56:41 > FID score (Step: 32000, Using valid moments): 37.60652079239742
[INFO] 2021-02-02 17:56:41 > Inception score (Step: 32000, 50000 generated images): 19.475345611572266
[INFO] 2021-02-02 17:56:41 > Best FID score (Step: 32000, Using valid moments): 37.60652079239742
[INFO] 2021-02-02 17:56:55 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 18:00:25 > Step: 32100 Progress: 16.1% Elapsed: 4:32:23 temperature: 0.25 ada_p: No Discriminator_loss: 9.03101 Generator_loss: 5.3006
[INFO] 2021-02-02 18:03:56 > Step: 32200 Progress: 16.1% Elapsed: 4:35:54 temperature: 0.25 ada_p: No Discriminator_loss: 9.07104 Generator_loss: 5.13329
[INFO] 2021-02-02 18:07:27 > Step: 32300 Progress: 16.2% Elapsed: 4:39:25 temperature: 0.25 ada_p: No Discriminator_loss: 9.0474 Generator_loss: 6.12635
[INFO] 2021-02-02 18:10:58 > Step: 32400 Progress: 16.2% Elapsed: 4:42:56 temperature: 0.25 ada_p: No Discriminator_loss: 9.15482 Generator_loss: 5.58565
[INFO] 2021-02-02 18:14:29 > Step: 32500 Progress: 16.2% Elapsed: 4:46:27 temperature: 0.25 ada_p: No Discriminator_loss: 9.18306 Generator_loss: 4.95048
[INFO] 2021-02-02 18:18:00 > Step: 32600 Progress: 16.3% Elapsed: 4:49:58 temperature: 0.25 ada_p: No Discriminator_loss: 9.22617 Generator_loss: 5.43936
[INFO] 2021-02-02 18:21:32 > Step: 32700 Progress: 16.4% Elapsed: 4:53:29 temperature: 0.25 ada_p: No Discriminator_loss: 9.26311 Generator_loss: 5.0145
[INFO] 2021-02-02 18:25:02 > Step: 32800 Progress: 16.4% Elapsed: 4:57:00 temperature: 0.25 ada_p: No Discriminator_loss: 8.87247 Generator_loss: 5.69762
[INFO] 2021-02-02 18:28:33 > Step: 32900 Progress: 16.4% Elapsed: 5:00:31 temperature: 0.25 ada_p: No Discriminator_loss: 9.25821 Generator_loss: 5.17895
[INFO] 2021-02-02 18:32:04 > Step: 33000 Progress: 16.5% Elapsed: 5:04:02 temperature: 0.25 ada_p: No Discriminator_loss: 9.23599 Generator_loss: 5.05826
[INFO] 2021-02-02 18:35:35 > Step: 33100 Progress: 16.6% Elapsed: 5:07:33 temperature: 0.25 ada_p: No Discriminator_loss: 9.11621 Generator_loss: 5.32683
[INFO] 2021-02-02 18:39:05 > Step: 33200 Progress: 16.6% Elapsed: 5:11:03 temperature: 0.25 ada_p: No Discriminator_loss: 9.31148 Generator_loss: 4.91975
[INFO] 2021-02-02 18:42:36 > Step: 33300 Progress: 16.7% Elapsed: 5:14:34 temperature: 0.25 ada_p: No Discriminator_loss: 9.33299 Generator_loss: 5.27983
[INFO] 2021-02-02 18:46:23 > Step: 33400 Progress: 16.7% Elapsed: 5:18:21 temperature: 0.25 ada_p: No Discriminator_loss: 9.22237 Generator_loss: 4.98635
[INFO] 2021-02-02 18:49:54 > Step: 33500 Progress: 16.8% Elapsed: 5:21:52 temperature: 0.25 ada_p: No Discriminator_loss: 8.78309 Generator_loss: 6.16018
[INFO] 2021-02-02 18:53:28 > Step: 33600 Progress: 16.8% Elapsed: 5:25:26 temperature: 0.25 ada_p: No Discriminator_loss: 9.07709 Generator_loss: 5.47929
[INFO] 2021-02-02 18:57:00 > Step: 33700 Progress: 16.9% Elapsed: 5:28:58 temperature: 0.25 ada_p: No Discriminator_loss: 9.04958 Generator_loss: 5.04273
[INFO] 2021-02-02 19:00:31 > Step: 33800 Progress: 16.9% Elapsed: 5:32:29 temperature: 0.25 ada_p: No Discriminator_loss: 9.07936 Generator_loss: 5.21901
[INFO] 2021-02-02 19:04:03 > Step: 33900 Progress: 17.0% Elapsed: 5:36:01 temperature: 0.25 ada_p: No Discriminator_loss: 9.14274 Generator_loss: 5.28066
[INFO] 2021-02-02 19:07:35 > Step: 34000 Progress: 17.0% Elapsed: 5:39:33 temperature: 0.25 ada_p: No Discriminator_loss: 9.15485 Generator_loss: 5.35051
[INFO] 2021-02-02 19:07:35 > Start Evaluation (34000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 19:07:35 > Calculating FID Score....
[INFO] 2021-02-02 19:08:46 > Calculating Inception Score....
[INFO] 2021-02-02 19:09:46 > Calculate F_beta Score....
[INFO] 2021-02-02 19:19:45 > Calculate Accuracies....
[INFO] 2021-02-02 19:20:55 > Calculate Accuracies....
[INFO] 2021-02-02 19:25:46 > F_8 score (Step: 34000, Using valid images): 0.7357039602092779
[INFO] 2021-02-02 19:25:46 > F_1/8 score (Step: 34000, Using valid images): 0.9096136997198971
[INFO] 2021-02-02 19:25:46 > FID score (Step: 34000, Using valid moments): 36.01641420134007
[INFO] 2021-02-02 19:25:46 > Inception score (Step: 34000, 50000 generated images): 20.08079719543457
[INFO] 2021-02-02 19:25:46 > Best FID score (Step: 34000, Using valid moments): 36.01641420134007
[INFO] 2021-02-02 19:26:00 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 19:29:32 > Step: 34100 Progress: 17.1% Elapsed: 6:01:30 temperature: 0.25 ada_p: No Discriminator_loss: 9.1299 Generator_loss: 5.11256
[INFO] 2021-02-02 19:33:04 > Step: 34200 Progress: 17.1% Elapsed: 6:05:02 temperature: 0.25 ada_p: No Discriminator_loss: 9.26037 Generator_loss: 5.02592
[INFO] 2021-02-02 19:36:37 > Step: 34300 Progress: 17.2% Elapsed: 6:08:34 temperature: 0.25 ada_p: No Discriminator_loss: 9.02809 Generator_loss: 5.35405
[INFO] 2021-02-02 19:40:08 > Step: 34400 Progress: 17.2% Elapsed: 6:12:06 temperature: 0.25 ada_p: No Discriminator_loss: 9.02319 Generator_loss: 5.08848
[INFO] 2021-02-02 19:43:39 > Step: 34500 Progress: 17.2% Elapsed: 6:15:37 temperature: 0.25 ada_p: No Discriminator_loss: 8.8912 Generator_loss: 5.49009
[INFO] 2021-02-02 19:47:27 > Step: 34600 Progress: 17.3% Elapsed: 6:19:25 temperature: 0.25 ada_p: No Discriminator_loss: 8.99114 Generator_loss: 5.14907
[INFO] 2021-02-02 19:51:00 > Step: 34700 Progress: 17.3% Elapsed: 6:22:58 temperature: 0.25 ada_p: No Discriminator_loss: 9.01285 Generator_loss: 5.58779
[INFO] 2021-02-02 19:54:32 > Step: 34800 Progress: 17.4% Elapsed: 6:26:30 temperature: 0.25 ada_p: No Discriminator_loss: 9.14063 Generator_loss: 5.41274
[INFO] 2021-02-02 19:58:04 > Step: 34900 Progress: 17.4% Elapsed: 6:30:02 temperature: 0.25 ada_p: No Discriminator_loss: 8.83042 Generator_loss: 5.25975
[INFO] 2021-02-02 20:01:37 > Step: 35000 Progress: 17.5% Elapsed: 6:33:35 temperature: 0.25 ada_p: No Discriminator_loss: 9.11262 Generator_loss: 5.43336
[INFO] 2021-02-02 20:05:09 > Step: 35100 Progress: 17.5% Elapsed: 6:37:07 temperature: 0.25 ada_p: No Discriminator_loss: 9.04485 Generator_loss: 5.41953
[INFO] 2021-02-02 20:08:41 > Step: 35200 Progress: 17.6% Elapsed: 6:40:39 temperature: 0.25 ada_p: No Discriminator_loss: 9.34929 Generator_loss: 5.15219
[INFO] 2021-02-02 20:12:12 > Step: 35300 Progress: 17.6% Elapsed: 6:44:10 temperature: 0.25 ada_p: No Discriminator_loss: 8.9947 Generator_loss: 5.59606
[INFO] 2021-02-02 20:15:43 > Step: 35400 Progress: 17.7% Elapsed: 6:47:41 temperature: 0.25 ada_p: No Discriminator_loss: 9.03156 Generator_loss: 5.29982
[INFO] 2021-02-02 20:19:14 > Step: 35500 Progress: 17.8% Elapsed: 6:51:12 temperature: 0.25 ada_p: No Discriminator_loss: 8.86733 Generator_loss: 5.20609
[INFO] 2021-02-02 20:22:45 > Step: 35600 Progress: 17.8% Elapsed: 6:54:43 temperature: 0.25 ada_p: No Discriminator_loss: 9.58609 Generator_loss: 5.20574
[INFO] 2021-02-02 20:26:16 > Step: 35700 Progress: 17.8% Elapsed: 6:58:14 temperature: 0.25 ada_p: No Discriminator_loss: 9.14134 Generator_loss: 5.11099
[INFO] 2021-02-02 20:29:48 > Step: 35800 Progress: 17.9% Elapsed: 7:01:46 temperature: 0.25 ada_p: No Discriminator_loss: 9.28778 Generator_loss: 5.11585
[INFO] 2021-02-02 20:33:19 > Step: 35900 Progress: 17.9% Elapsed: 7:05:17 temperature: 0.25 ada_p: No Discriminator_loss: 8.99092 Generator_loss: 5.45889
[INFO] 2021-02-02 20:36:50 > Step: 36000 Progress: 18.0% Elapsed: 7:08:48 temperature: 0.25 ada_p: No Discriminator_loss: 9.13118 Generator_loss: 5.21819
[INFO] 2021-02-02 20:36:50 > Start Evaluation (36000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 20:36:50 > Calculating FID Score....
[INFO] 2021-02-02 20:38:02 > Calculating Inception Score....
[INFO] 2021-02-02 20:39:02 > Calculate F_beta Score....
[INFO] 2021-02-02 20:49:27 > Calculate Accuracies....
[INFO] 2021-02-02 20:50:37 > Calculate Accuracies....
[INFO] 2021-02-02 20:55:31 > F_8 score (Step: 36000, Using valid images): 0.7518973627149108
[INFO] 2021-02-02 20:55:31 > F_1/8 score (Step: 36000, Using valid images): 0.9218325319260222
[INFO] 2021-02-02 20:55:31 > FID score (Step: 36000, Using valid moments): 34.83134782995677
[INFO] 2021-02-02 20:55:31 > Inception score (Step: 36000, 50000 generated images): 20.551618576049805
[INFO] 2021-02-02 20:55:31 > Best FID score (Step: 36000, Using valid moments): 34.83134782995677
[INFO] 2021-02-02 20:55:46 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 20:59:20 > Step: 36100 Progress: 18.1% Elapsed: 7:31:18 temperature: 0.25 ada_p: No Discriminator_loss: 8.99173 Generator_loss: 5.30879
[INFO] 2021-02-02 21:02:52 > Step: 36200 Progress: 18.1% Elapsed: 7:34:50 temperature: 0.25 ada_p: No Discriminator_loss: 8.98457 Generator_loss: 5.16096
[INFO] 2021-02-02 21:06:23 > Step: 36300 Progress: 18.1% Elapsed: 7:38:21 temperature: 0.25 ada_p: No Discriminator_loss: 9.21874 Generator_loss: 5.28204
[INFO] 2021-02-02 21:09:55 > Step: 36400 Progress: 18.2% Elapsed: 7:41:53 temperature: 0.25 ada_p: No Discriminator_loss: 8.85835 Generator_loss: 5.78979
[INFO] 2021-02-02 21:13:26 > Step: 36500 Progress: 18.2% Elapsed: 7:45:24 temperature: 0.25 ada_p: No Discriminator_loss: 8.91984 Generator_loss: 5.5133
[INFO] 2021-02-02 21:17:15 > Step: 36600 Progress: 18.3% Elapsed: 7:49:13 temperature: 0.25 ada_p: No Discriminator_loss: 8.9411 Generator_loss: 5.53155
[INFO] 2021-02-02 21:20:48 > Step: 36700 Progress: 18.4% Elapsed: 7:52:46 temperature: 0.25 ada_p: No Discriminator_loss: 9.24528 Generator_loss: 4.83568
[INFO] 2021-02-02 21:24:19 > Step: 36800 Progress: 18.4% Elapsed: 7:56:17 temperature: 0.25 ada_p: No Discriminator_loss: 9.2448 Generator_loss: 5.26989
[INFO] 2021-02-02 21:27:51 > Step: 36900 Progress: 18.4% Elapsed: 7:59:49 temperature: 0.25 ada_p: No Discriminator_loss: 9.1573 Generator_loss: 5.1408
[INFO] 2021-02-02 21:31:23 > Step: 37000 Progress: 18.5% Elapsed: 8:03:21 temperature: 0.25 ada_p: No Discriminator_loss: 9.05892 Generator_loss: 5.32122
[INFO] 2021-02-02 21:34:54 > Step: 37100 Progress: 18.6% Elapsed: 8:06:52 temperature: 0.25 ada_p: No Discriminator_loss: 9.02246 Generator_loss: 5.2488
[INFO] 2021-02-02 21:38:25 > Step: 37200 Progress: 18.6% Elapsed: 8:10:23 temperature: 0.25 ada_p: No Discriminator_loss: 8.85049 Generator_loss: 5.38625
[INFO] 2021-02-02 21:41:57 > Step: 37300 Progress: 18.6% Elapsed: 8:13:55 temperature: 0.25 ada_p: No Discriminator_loss: 9.26645 Generator_loss: 4.78574
[INFO] 2021-02-02 21:45:28 > Step: 37400 Progress: 18.7% Elapsed: 8:17:26 temperature: 0.25 ada_p: No Discriminator_loss: 8.8798 Generator_loss: 5.51983
[INFO] 2021-02-02 21:48:59 > Step: 37500 Progress: 18.8% Elapsed: 8:20:57 temperature: 0.25 ada_p: No Discriminator_loss: 8.71176 Generator_loss: 5.69727
[INFO] 2021-02-02 21:52:31 > Step: 37600 Progress: 18.8% Elapsed: 8:24:29 temperature: 0.25 ada_p: No Discriminator_loss: 8.94777 Generator_loss: 5.26198
[INFO] 2021-02-02 21:56:02 > Step: 37700 Progress: 18.9% Elapsed: 8:28:00 temperature: 0.25 ada_p: No Discriminator_loss: 9.6387 Generator_loss: 5.88064
[INFO] 2021-02-02 21:59:33 > Step: 37800 Progress: 18.9% Elapsed: 8:31:31 temperature: 0.25 ada_p: No Discriminator_loss: 8.92837 Generator_loss: 5.51622
[INFO] 2021-02-02 22:03:05 > Step: 37900 Progress: 18.9% Elapsed: 8:35:03 temperature: 0.25 ada_p: No Discriminator_loss: 9.03842 Generator_loss: 5.17422
[INFO] 2021-02-02 22:06:36 > Step: 38000 Progress: 19.0% Elapsed: 8:38:34 temperature: 0.25 ada_p: No Discriminator_loss: 9.01291 Generator_loss: 5.46004
[INFO] 2021-02-02 22:06:36 > Start Evaluation (38000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 22:06:36 > Calculating FID Score....
[INFO] 2021-02-02 22:07:47 > Calculating Inception Score....
[INFO] 2021-02-02 22:08:46 > Calculate F_beta Score....
[INFO] 2021-02-02 22:19:01 > Calculate Accuracies....
[INFO] 2021-02-02 22:20:11 > Calculate Accuracies....
[INFO] 2021-02-02 22:25:04 > F_8 score (Step: 38000, Using valid images): 0.7761363053559559
[INFO] 2021-02-02 22:25:04 > F_1/8 score (Step: 38000, Using valid images): 0.92779667863768
[INFO] 2021-02-02 22:25:04 > FID score (Step: 38000, Using valid moments): 33.73320825094265
[INFO] 2021-02-02 22:25:04 > Inception score (Step: 38000, 50000 generated images): 21.099407196044922
[INFO] 2021-02-02 22:25:04 > Best FID score (Step: 38000, Using valid moments): 33.73320825094265
[INFO] 2021-02-02 22:25:18 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 22:28:49 > Step: 38100 Progress: 19.1% Elapsed: 9:00:47 temperature: 0.25 ada_p: No Discriminator_loss: 9.23401 Generator_loss: 4.97487
[INFO] 2021-02-02 22:32:21 > Step: 38200 Progress: 19.1% Elapsed: 9:04:19 temperature: 0.25 ada_p: No Discriminator_loss: 8.98344 Generator_loss: 5.19042
[INFO] 2021-02-02 22:35:53 > Step: 38300 Progress: 19.1% Elapsed: 9:07:51 temperature: 0.25 ada_p: No Discriminator_loss: 9.0999 Generator_loss: 5.3584
[INFO] 2021-02-02 22:39:24 > Step: 38400 Progress: 19.2% Elapsed: 9:11:22 temperature: 0.25 ada_p: No Discriminator_loss: 8.93228 Generator_loss: 5.34369
[INFO] 2021-02-02 22:42:57 > Step: 38500 Progress: 19.2% Elapsed: 9:14:55 temperature: 0.25 ada_p: No Discriminator_loss: 9.04023 Generator_loss: 5.3032
[INFO] 2021-02-02 22:46:50 > Step: 38600 Progress: 19.3% Elapsed: 9:18:48 temperature: 0.25 ada_p: No Discriminator_loss: 9.56809 Generator_loss: 5.02079
[INFO] 2021-02-02 22:50:23 > Step: 38700 Progress: 19.4% Elapsed: 9:22:21 temperature: 0.25 ada_p: No Discriminator_loss: 8.75644 Generator_loss: 5.97918
[INFO] 2021-02-02 22:53:55 > Step: 38800 Progress: 19.4% Elapsed: 9:25:53 temperature: 0.25 ada_p: No Discriminator_loss: 9.01509 Generator_loss: 5.26233
[INFO] 2021-02-02 22:57:26 > Step: 38900 Progress: 19.4% Elapsed: 9:29:24 temperature: 0.25 ada_p: No Discriminator_loss: 9.22853 Generator_loss: 5.35017
[INFO] 2021-02-02 23:00:58 > Step: 39000 Progress: 19.5% Elapsed: 9:32:56 temperature: 0.25 ada_p: No Discriminator_loss: 8.88813 Generator_loss: 5.51874
[INFO] 2021-02-02 23:04:30 > Step: 39100 Progress: 19.6% Elapsed: 9:36:28 temperature: 0.25 ada_p: No Discriminator_loss: 8.97772 Generator_loss: 5.41316
[INFO] 2021-02-02 23:08:02 > Step: 39200 Progress: 19.6% Elapsed: 9:40:00 temperature: 0.25 ada_p: No Discriminator_loss: 9.16777 Generator_loss: 5.13523
[INFO] 2021-02-02 23:11:35 > Step: 39300 Progress: 19.7% Elapsed: 9:43:33 temperature: 0.25 ada_p: No Discriminator_loss: 9.1804 Generator_loss: 5.23054
[INFO] 2021-02-02 23:15:07 > Step: 39400 Progress: 19.7% Elapsed: 9:47:05 temperature: 0.25 ada_p: No Discriminator_loss: 8.9448 Generator_loss: 5.42487
[INFO] 2021-02-02 23:18:38 > Step: 39500 Progress: 19.8% Elapsed: 9:50:36 temperature: 0.25 ada_p: No Discriminator_loss: 8.98705 Generator_loss: 5.23029
[INFO] 2021-02-02 23:22:10 > Step: 39600 Progress: 19.8% Elapsed: 9:54:08 temperature: 0.25 ada_p: No Discriminator_loss: 8.95221 Generator_loss: 5.16796
[INFO] 2021-02-02 23:25:41 > Step: 39700 Progress: 19.9% Elapsed: 9:57:39 temperature: 0.25 ada_p: No Discriminator_loss: 9.2418 Generator_loss: 5.05421
[INFO] 2021-02-02 23:29:13 > Step: 39800 Progress: 19.9% Elapsed: 10:01:11 temperature: 0.25 ada_p: No Discriminator_loss: 9.02232 Generator_loss: 5.2144
[INFO] 2021-02-02 23:32:44 > Step: 39900 Progress: 20.0% Elapsed: 10:04:42 temperature: 0.25 ada_p: No Discriminator_loss: 8.94497 Generator_loss: 5.20363
[INFO] 2021-02-02 23:36:16 > Step: 40000 Progress: 20.0% Elapsed: 10:08:14 temperature: 0.25 ada_p: No Discriminator_loss: 8.98359 Generator_loss: 5.55192
[INFO] 2021-02-02 23:36:16 > Start Evaluation (40000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 23:36:16 > Calculating FID Score....
[INFO] 2021-02-02 23:37:27 > Calculating Inception Score....
[INFO] 2021-02-02 23:38:28 > Calculate F_beta Score....
[INFO] 2021-02-02 23:48:33 > Calculate Accuracies....
[INFO] 2021-02-02 23:49:43 > Calculate Accuracies....
[INFO] 2021-02-02 23:54:38 > F_8 score (Step: 40000, Using valid images): 0.7873697875790335
[INFO] 2021-02-02 23:54:38 > F_1/8 score (Step: 40000, Using valid images): 0.924505887639849
[INFO] 2021-02-02 23:54:38 > FID score (Step: 40000, Using valid moments): 32.97395853090052
[INFO] 2021-02-02 23:54:38 > Inception score (Step: 40000, 50000 generated images): 21.370149612426758
[INFO] 2021-02-02 23:54:38 > Best FID score (Step: 40000, Using valid moments): 32.97395853090052
[INFO] 2021-02-02 23:54:52 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-02 23:58:24 > Step: 40100 Progress: 20.1% Elapsed: 10:30:22 temperature: 0.25 ada_p: No Discriminator_loss: 8.89122 Generator_loss: 5.44561
[INFO] 2021-02-03 00:01:55 > Step: 40200 Progress: 20.1% Elapsed: 10:33:53 temperature: 0.25 ada_p: No Discriminator_loss: 9.14741 Generator_loss: 5.32363
[INFO] 2021-02-03 00:05:26 > Step: 40300 Progress: 20.2% Elapsed: 10:37:24 temperature: 0.25 ada_p: No Discriminator_loss: 9.12967 Generator_loss: 5.29032
[INFO] 2021-02-03 00:08:57 > Step: 40400 Progress: 20.2% Elapsed: 10:40:55 temperature: 0.25 ada_p: No Discriminator_loss: 9.03226 Generator_loss: 5.37121
[INFO] 2021-02-03 00:12:28 > Step: 40500 Progress: 20.2% Elapsed: 10:44:26 temperature: 0.25 ada_p: No Discriminator_loss: 9.0519 Generator_loss: 5.37107
[INFO] 2021-02-03 00:15:58 > Step: 40600 Progress: 20.3% Elapsed: 10:47:56 temperature: 0.25 ada_p: No Discriminator_loss: 9.03947 Generator_loss: 5.51228
[INFO] 2021-02-03 00:19:28 > Step: 40700 Progress: 20.3% Elapsed: 10:51:26 temperature: 0.25 ada_p: No Discriminator_loss: 9.04331 Generator_loss: 5.28784
[INFO] 2021-02-03 00:22:59 > Step: 40800 Progress: 20.4% Elapsed: 10:54:57 temperature: 0.25 ada_p: No Discriminator_loss: 8.82969 Generator_loss: 5.39977
[INFO] 2021-02-03 00:26:46 > Step: 40900 Progress: 20.4% Elapsed: 10:58:44 temperature: 0.25 ada_p: No Discriminator_loss: 9.11102 Generator_loss: 5.25067
[INFO] 2021-02-03 00:30:17 > Step: 41000 Progress: 20.5% Elapsed: 11:02:15 temperature: 0.25 ada_p: No Discriminator_loss: 9.02605 Generator_loss: 5.18601
[INFO] 2021-02-03 00:33:51 > Step: 41100 Progress: 20.5% Elapsed: 11:05:49 temperature: 0.25 ada_p: No Discriminator_loss: 8.99336 Generator_loss: 5.18723
[INFO] 2021-02-03 00:37:22 > Step: 41200 Progress: 20.6% Elapsed: 11:09:20 temperature: 0.25 ada_p: No Discriminator_loss: 9.13077 Generator_loss: 5.37752
[INFO] 2021-02-03 00:40:54 > Step: 41300 Progress: 20.6% Elapsed: 11:12:52 temperature: 0.25 ada_p: No Discriminator_loss: 8.93535 Generator_loss: 5.38113
[INFO] 2021-02-03 00:44:25 > Step: 41400 Progress: 20.7% Elapsed: 11:16:23 temperature: 0.25 ada_p: No Discriminator_loss: 8.91409 Generator_loss: 5.59215
[INFO] 2021-02-03 00:47:56 > Step: 41500 Progress: 20.8% Elapsed: 11:19:54 temperature: 0.25 ada_p: No Discriminator_loss: 9.23479 Generator_loss: 5.02815
[INFO] 2021-02-03 00:51:28 > Step: 41600 Progress: 20.8% Elapsed: 11:23:26 temperature: 0.25 ada_p: No Discriminator_loss: 8.92679 Generator_loss: 5.48958
[INFO] 2021-02-03 00:55:00 > Step: 41700 Progress: 20.8% Elapsed: 11:26:58 temperature: 0.25 ada_p: No Discriminator_loss: 9.16686 Generator_loss: 5.05874
[INFO] 2021-02-03 00:58:31 > Step: 41800 Progress: 20.9% Elapsed: 11:30:29 temperature: 0.25 ada_p: No Discriminator_loss: 8.90233 Generator_loss: 5.66932
[INFO] 2021-02-03 01:02:04 > Step: 41900 Progress: 20.9% Elapsed: 11:34:02 temperature: 0.25 ada_p: No Discriminator_loss: 9.01877 Generator_loss: 5.38912
[INFO] 2021-02-03 01:05:35 > Step: 42000 Progress: 21.0% Elapsed: 11:37:33 temperature: 0.25 ada_p: No Discriminator_loss: 9.23715 Generator_loss: 5.5909
[INFO] 2021-02-03 01:05:35 > Start Evaluation (42000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 01:05:35 > Calculating FID Score....
[INFO] 2021-02-03 01:06:46 > Calculating Inception Score....
[INFO] 2021-02-03 01:07:46 > Calculate F_beta Score....
[INFO] 2021-02-03 01:18:09 > Calculate Accuracies....
[INFO] 2021-02-03 01:19:19 > Calculate Accuracies....
[INFO] 2021-02-03 01:24:12 > F_8 score (Step: 42000, Using valid images): 0.8024644949919566
[INFO] 2021-02-03 01:24:12 > F_1/8 score (Step: 42000, Using valid images): 0.9394676930438737
[INFO] 2021-02-03 01:24:12 > FID score (Step: 42000, Using valid moments): 31.912223883040667
[INFO] 2021-02-03 01:24:12 > Inception score (Step: 42000, 50000 generated images): 22.091705322265625
[INFO] 2021-02-03 01:24:12 > Best FID score (Step: 42000, Using valid moments): 31.912223883040667
[INFO] 2021-02-03 01:24:26 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 01:28:15 > Step: 42100 Progress: 21.1% Elapsed: 12:00:13 temperature: 0.25 ada_p: No Discriminator_loss: 9.0155 Generator_loss: 6.41496
[INFO] 2021-02-03 01:31:47 > Step: 42200 Progress: 21.1% Elapsed: 12:03:45 temperature: 0.25 ada_p: No Discriminator_loss: 8.94938 Generator_loss: 5.46461
[INFO] 2021-02-03 01:35:19 > Step: 42300 Progress: 21.1% Elapsed: 12:07:17 temperature: 0.25 ada_p: No Discriminator_loss: 8.81998 Generator_loss: 5.54729
[INFO] 2021-02-03 01:38:50 > Step: 42400 Progress: 21.2% Elapsed: 12:10:48 temperature: 0.25 ada_p: No Discriminator_loss: 8.77094 Generator_loss: 5.51743
[INFO] 2021-02-03 01:42:22 > Step: 42500 Progress: 21.2% Elapsed: 12:14:20 temperature: 0.25 ada_p: No Discriminator_loss: 8.84627 Generator_loss: 5.38941
[INFO] 2021-02-03 01:45:52 > Step: 42600 Progress: 21.3% Elapsed: 12:17:50 temperature: 0.25 ada_p: No Discriminator_loss: 9.19505 Generator_loss: 5.45516
[INFO] 2021-02-03 01:49:24 > Step: 42700 Progress: 21.3% Elapsed: 12:21:22 temperature: 0.25 ada_p: No Discriminator_loss: 9.04749 Generator_loss: 5.41654
[INFO] 2021-02-03 01:52:55 > Step: 42800 Progress: 21.4% Elapsed: 12:24:53 temperature: 0.25 ada_p: No Discriminator_loss: 9.2089 Generator_loss: 5.31374
[INFO] 2021-02-03 01:56:27 > Step: 42900 Progress: 21.4% Elapsed: 12:28:25 temperature: 0.25 ada_p: No Discriminator_loss: 8.91763 Generator_loss: 5.36189
[INFO] 2021-02-03 01:59:58 > Step: 43000 Progress: 21.5% Elapsed: 12:31:56 temperature: 0.25 ada_p: No Discriminator_loss: 9.12948 Generator_loss: 5.22503
[INFO] 2021-02-03 02:03:29 > Step: 43100 Progress: 21.6% Elapsed: 12:35:27 temperature: 0.25 ada_p: No Discriminator_loss: 9.29768 Generator_loss: 5.28842
[INFO] 2021-02-03 02:07:01 > Step: 43200 Progress: 21.6% Elapsed: 12:38:59 temperature: 0.25 ada_p: No Discriminator_loss: 8.88932 Generator_loss: 5.02841
[INFO] 2021-02-03 02:10:32 > Step: 43300 Progress: 21.6% Elapsed: 12:42:30 temperature: 0.25 ada_p: No Discriminator_loss: 9.20546 Generator_loss: 5.58266
[INFO] 2021-02-03 02:14:03 > Step: 43400 Progress: 21.7% Elapsed: 12:46:01 temperature: 0.25 ada_p: No Discriminator_loss: 9.00285 Generator_loss: 5.03801
[INFO] 2021-02-03 02:17:35 > Step: 43500 Progress: 21.8% Elapsed: 12:49:33 temperature: 0.25 ada_p: No Discriminator_loss: 8.92863 Generator_loss: 5.30632
[INFO] 2021-02-03 02:21:09 > Step: 43600 Progress: 21.8% Elapsed: 12:53:07 temperature: 0.25 ada_p: No Discriminator_loss: 8.94165 Generator_loss: 5.19251
[INFO] 2021-02-03 02:24:41 > Step: 43700 Progress: 21.9% Elapsed: 12:56:39 temperature: 0.25 ada_p: No Discriminator_loss: 9.433 Generator_loss: 5.09943
[INFO] 2021-02-03 02:28:12 > Step: 43800 Progress: 21.9% Elapsed: 13:00:10 temperature: 0.25 ada_p: No Discriminator_loss: 8.96738 Generator_loss: 5.06093
[INFO] 2021-02-03 02:31:43 > Step: 43900 Progress: 21.9% Elapsed: 13:03:41 temperature: 0.25 ada_p: No Discriminator_loss: 9.15661 Generator_loss: 5.20957
[INFO] 2021-02-03 02:35:15 > Step: 44000 Progress: 22.0% Elapsed: 13:07:13 temperature: 0.25 ada_p: No Discriminator_loss: 8.98543 Generator_loss: 5.16339
[INFO] 2021-02-03 02:35:15 > Start Evaluation (44000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 02:35:15 > Calculating FID Score....
[INFO] 2021-02-03 02:36:26 > Calculating Inception Score....
[INFO] 2021-02-03 02:37:26 > Calculate F_beta Score....
[INFO] 2021-02-03 02:47:34 > Calculate Accuracies....
[INFO] 2021-02-03 02:48:45 > Calculate Accuracies....
[INFO] 2021-02-03 02:53:37 > F_8 score (Step: 44000, Using valid images): 0.8058543961584349
[INFO] 2021-02-03 02:53:37 > F_1/8 score (Step: 44000, Using valid images): 0.939572323307478
[INFO] 2021-02-03 02:53:37 > FID score (Step: 44000, Using valid moments): 31.19609528757786
[INFO] 2021-02-03 02:53:37 > Inception score (Step: 44000, 50000 generated images): 22.396595001220703
[INFO] 2021-02-03 02:53:37 > Best FID score (Step: 44000, Using valid moments): 31.19609528757786
[INFO] 2021-02-03 02:53:52 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 02:57:23 > Step: 44100 Progress: 22.1% Elapsed: 13:29:21 temperature: 0.25 ada_p: No Discriminator_loss: 8.95649 Generator_loss: 5.30874
[INFO] 2021-02-03 03:00:54 > Step: 44200 Progress: 22.1% Elapsed: 13:32:52 temperature: 0.25 ada_p: No Discriminator_loss: 8.86999 Generator_loss: 5.40759
[INFO] 2021-02-03 03:04:42 > Step: 44300 Progress: 22.1% Elapsed: 13:36:40 temperature: 0.25 ada_p: No Discriminator_loss: 8.97153 Generator_loss: 5.17021
[INFO] 2021-02-03 03:08:14 > Step: 44400 Progress: 22.2% Elapsed: 13:40:12 temperature: 0.25 ada_p: No Discriminator_loss: 9.28217 Generator_loss: 5.08973
[INFO] 2021-02-03 03:11:46 > Step: 44500 Progress: 22.2% Elapsed: 13:43:44 temperature: 0.25 ada_p: No Discriminator_loss: 8.98981 Generator_loss: 5.48136
[INFO] 2021-02-03 03:15:17 > Step: 44600 Progress: 22.3% Elapsed: 13:47:15 temperature: 0.25 ada_p: No Discriminator_loss: 8.88056 Generator_loss: 5.20542
[INFO] 2021-02-03 03:18:49 > Step: 44700 Progress: 22.4% Elapsed: 13:50:47 temperature: 0.25 ada_p: No Discriminator_loss: 8.87098 Generator_loss: 5.54367
[INFO] 2021-02-03 03:22:20 > Step: 44800 Progress: 22.4% Elapsed: 13:54:18 temperature: 0.25 ada_p: No Discriminator_loss: 8.82484 Generator_loss: 5.71215
[INFO] 2021-02-03 03:25:51 > Step: 44900 Progress: 22.4% Elapsed: 13:57:49 temperature: 0.25 ada_p: No Discriminator_loss: 8.97444 Generator_loss: 5.22913
[INFO] 2021-02-03 03:29:23 > Step: 45000 Progress: 22.5% Elapsed: 14:01:21 temperature: 0.25 ada_p: No Discriminator_loss: 9.09155 Generator_loss: 5.13407
[INFO] 2021-02-03 03:32:54 > Step: 45100 Progress: 22.6% Elapsed: 14:04:52 temperature: 0.25 ada_p: No Discriminator_loss: 8.93178 Generator_loss: 4.77918
[INFO] 2021-02-03 03:36:25 > Step: 45200 Progress: 22.6% Elapsed: 14:08:23 temperature: 0.25 ada_p: No Discriminator_loss: 8.9945 Generator_loss: 5.43673
[INFO] 2021-02-03 03:39:57 > Step: 45300 Progress: 22.7% Elapsed: 14:11:55 temperature: 0.25 ada_p: No Discriminator_loss: 8.76615 Generator_loss: 6.10323
[INFO] 2021-02-03 03:43:28 > Step: 45400 Progress: 22.7% Elapsed: 14:15:26 temperature: 0.25 ada_p: No Discriminator_loss: 9.29486 Generator_loss: 5.2587
[INFO] 2021-02-03 03:46:59 > Step: 45500 Progress: 22.8% Elapsed: 14:18:57 temperature: 0.25 ada_p: No Discriminator_loss: 8.76843 Generator_loss: 5.41592
[INFO] 2021-02-03 03:50:30 > Step: 45600 Progress: 22.8% Elapsed: 14:22:28 temperature: 0.25 ada_p: No Discriminator_loss: 9.05282 Generator_loss: 5.2424
[INFO] 2021-02-03 03:54:01 > Step: 45700 Progress: 22.9% Elapsed: 14:25:59 temperature: 0.25 ada_p: No Discriminator_loss: 8.95279 Generator_loss: 5.12107
[INFO] 2021-02-03 03:57:32 > Step: 45800 Progress: 22.9% Elapsed: 14:29:30 temperature: 0.25 ada_p: No Discriminator_loss: 9.06063 Generator_loss: 5.06865
[INFO] 2021-02-03 04:01:04 > Step: 45900 Progress: 22.9% Elapsed: 14:33:02 temperature: 0.25 ada_p: No Discriminator_loss: 8.92725 Generator_loss: 5.30485
[INFO] 2021-02-03 04:04:35 > Step: 46000 Progress: 23.0% Elapsed: 14:36:33 temperature: 0.25 ada_p: No Discriminator_loss: 8.72373 Generator_loss: 5.71588
[INFO] 2021-02-03 04:04:35 > Start Evaluation (46000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 04:04:35 > Calculating FID Score....
[INFO] 2021-02-03 04:05:46 > Calculating Inception Score....
[INFO] 2021-02-03 04:06:46 > Calculate F_beta Score....
[INFO] 2021-02-03 04:17:02 > Calculate Accuracies....
[INFO] 2021-02-03 04:18:13 > Calculate Accuracies....
[INFO] 2021-02-03 04:23:09 > F_8 score (Step: 46000, Using valid images): 0.8087335610355613
[INFO] 2021-02-03 04:23:09 > F_1/8 score (Step: 46000, Using valid images): 0.9348788064818324
[INFO] 2021-02-03 04:23:09 > FID score (Step: 46000, Using valid moments): 30.497233819602513
[INFO] 2021-02-03 04:23:09 > Inception score (Step: 46000, 50000 generated images): 22.78033447265625
[INFO] 2021-02-03 04:23:09 > Best FID score (Step: 46000, Using valid moments): 30.497233819602513
[INFO] 2021-02-03 04:23:23 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 04:26:58 > Step: 46100 Progress: 23.1% Elapsed: 14:58:56 temperature: 0.25 ada_p: No Discriminator_loss: 9.0425 Generator_loss: 5.27686
[INFO] 2021-02-03 04:30:29 > Step: 46200 Progress: 23.1% Elapsed: 15:02:27 temperature: 0.25 ada_p: No Discriminator_loss: 8.9543 Generator_loss: 5.29054
[INFO] 2021-02-03 04:33:59 > Step: 46300 Progress: 23.2% Elapsed: 15:05:57 temperature: 0.25 ada_p: No Discriminator_loss: 9.06919 Generator_loss: 5.22879
[INFO] 2021-02-03 04:37:30 > Step: 46400 Progress: 23.2% Elapsed: 15:09:28 temperature: 0.25 ada_p: No Discriminator_loss: 8.83669 Generator_loss: 5.20509
[INFO] 2021-02-03 04:41:02 > Step: 46500 Progress: 23.2% Elapsed: 15:13:00 temperature: 0.25 ada_p: No Discriminator_loss: 9.1452 Generator_loss: 5.49479
[INFO] 2021-02-03 04:44:51 > Step: 46600 Progress: 23.3% Elapsed: 15:16:49 temperature: 0.25 ada_p: No Discriminator_loss: 9.5344 Generator_loss: 4.9497
[INFO] 2021-02-03 04:48:22 > Step: 46700 Progress: 23.4% Elapsed: 15:20:20 temperature: 0.25 ada_p: No Discriminator_loss: 9.23413 Generator_loss: 5.2807
[INFO] 2021-02-03 04:51:53 > Step: 46800 Progress: 23.4% Elapsed: 15:23:51 temperature: 0.25 ada_p: No Discriminator_loss: 9.04398 Generator_loss: 5.42428
[INFO] 2021-02-03 04:55:24 > Step: 46900 Progress: 23.4% Elapsed: 15:27:22 temperature: 0.25 ada_p: No Discriminator_loss: 8.83703 Generator_loss: 5.38876
[INFO] 2021-02-03 04:58:56 > Step: 47000 Progress: 23.5% Elapsed: 15:30:54 temperature: 0.25 ada_p: No Discriminator_loss: 8.7786 Generator_loss: 5.83328
[INFO] 2021-02-03 05:02:27 > Step: 47100 Progress: 23.5% Elapsed: 15:34:25 temperature: 0.25 ada_p: No Discriminator_loss: 8.93043 Generator_loss: 5.3686
[INFO] 2021-02-03 05:05:58 > Step: 47200 Progress: 23.6% Elapsed: 15:37:56 temperature: 0.25 ada_p: No Discriminator_loss: 9.31824 Generator_loss: 5.09525
[INFO] 2021-02-03 05:09:29 > Step: 47300 Progress: 23.6% Elapsed: 15:41:27 temperature: 0.25 ada_p: No Discriminator_loss: 9.22365 Generator_loss: 5.09743
[INFO] 2021-02-03 05:13:01 > Step: 47400 Progress: 23.7% Elapsed: 15:44:59 temperature: 0.25 ada_p: No Discriminator_loss: 9.15919 Generator_loss: 5.33505
[INFO] 2021-02-03 05:16:32 > Step: 47500 Progress: 23.8% Elapsed: 15:48:30 temperature: 0.25 ada_p: No Discriminator_loss: 9.03488 Generator_loss: 5.14201
[INFO] 2021-02-03 05:20:03 > Step: 47600 Progress: 23.8% Elapsed: 15:52:01 temperature: 0.25 ada_p: No Discriminator_loss: 9.05642 Generator_loss: 5.19903
[INFO] 2021-02-03 05:23:34 > Step: 47700 Progress: 23.8% Elapsed: 15:55:32 temperature: 0.25 ada_p: No Discriminator_loss: 8.84338 Generator_loss: 5.20358
[INFO] 2021-02-03 05:27:06 > Step: 47800 Progress: 23.9% Elapsed: 15:59:04 temperature: 0.25 ada_p: No Discriminator_loss: 9.02858 Generator_loss: 5.21426
[INFO] 2021-02-03 05:30:37 > Step: 47900 Progress: 23.9% Elapsed: 16:02:35 temperature: 0.25 ada_p: No Discriminator_loss: 8.92602 Generator_loss: 5.28667
[INFO] 2021-02-03 05:34:08 > Step: 48000 Progress: 24.0% Elapsed: 16:06:06 temperature: 0.25 ada_p: No Discriminator_loss: 9.0713 Generator_loss: 5.24143
[INFO] 2021-02-03 05:34:08 > Start Evaluation (48000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 05:34:08 > Calculating FID Score....
[INFO] 2021-02-03 05:35:19 > Calculating Inception Score....
[INFO] 2021-02-03 05:36:18 > Calculate F_beta Score....
[INFO] 2021-02-03 05:46:29 > Calculate Accuracies....
[INFO] 2021-02-03 05:47:39 > Calculate Accuracies....
[INFO] 2021-02-03 05:52:34 > F_8 score (Step: 48000, Using valid images): 0.8283982506899255
[INFO] 2021-02-03 05:52:34 > F_1/8 score (Step: 48000, Using valid images): 0.9315658480328453
[INFO] 2021-02-03 05:52:34 > FID score (Step: 48000, Using valid moments): 29.830774095722916
[INFO] 2021-02-03 05:52:34 > Inception score (Step: 48000, 50000 generated images): 23.226308822631836
[INFO] 2021-02-03 05:52:34 > Best FID score (Step: 48000, Using valid moments): 29.830774095722916
[INFO] 2021-02-03 05:52:48 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 05:56:19 > Step: 48100 Progress: 24.1% Elapsed: 16:28:17 temperature: 0.25 ada_p: No Discriminator_loss: 8.86139 Generator_loss: 5.00382
[INFO] 2021-02-03 05:59:50 > Step: 48200 Progress: 24.1% Elapsed: 16:31:48 temperature: 0.25 ada_p: No Discriminator_loss: 9.2293 Generator_loss: 5.36138
[INFO] 2021-02-03 06:03:22 > Step: 48300 Progress: 24.1% Elapsed: 16:35:20 temperature: 0.25 ada_p: No Discriminator_loss: 9.21328 Generator_loss: 5.29395
[INFO] 2021-02-03 06:06:53 > Step: 48400 Progress: 24.2% Elapsed: 16:38:51 temperature: 0.25 ada_p: No Discriminator_loss: 9.21606 Generator_loss: 4.97622
[INFO] 2021-02-03 06:10:24 > Step: 48500 Progress: 24.2% Elapsed: 16:42:22 temperature: 0.25 ada_p: No Discriminator_loss: 8.9928 Generator_loss: 5.25651
[INFO] 2021-02-03 06:13:59 > Step: 48600 Progress: 24.3% Elapsed: 16:45:57 temperature: 0.25 ada_p: No Discriminator_loss: 8.88306 Generator_loss: 5.45486
[INFO] 2021-02-03 06:17:30 > Step: 48700 Progress: 24.3% Elapsed: 16:49:28 temperature: 0.25 ada_p: No Discriminator_loss: 9.32815 Generator_loss: 5.08481
[INFO] 2021-02-03 06:21:01 > Step: 48800 Progress: 24.4% Elapsed: 16:52:59 temperature: 0.25 ada_p: No Discriminator_loss: 9.00098 Generator_loss: 5.26663
[INFO] 2021-02-03 06:24:32 > Step: 48900 Progress: 24.4% Elapsed: 16:56:30 temperature: 0.25 ada_p: No Discriminator_loss: 9.46377 Generator_loss: 5.21997
[INFO] 2021-02-03 06:28:03 > Step: 49000 Progress: 24.5% Elapsed: 17:00:01 temperature: 0.25 ada_p: No Discriminator_loss: 9.05417 Generator_loss: 5.23118
[INFO] 2021-02-03 06:31:34 > Step: 49100 Progress: 24.6% Elapsed: 17:03:32 temperature: 0.25 ada_p: No Discriminator_loss: 8.95093 Generator_loss: 4.98871
[INFO] 2021-02-03 06:35:24 > Step: 49200 Progress: 24.6% Elapsed: 17:07:22 temperature: 0.25 ada_p: No Discriminator_loss: 8.87941 Generator_loss: 5.42976
[INFO] 2021-02-03 06:38:55 > Step: 49300 Progress: 24.6% Elapsed: 17:10:53 temperature: 0.25 ada_p: No Discriminator_loss: 9.10528 Generator_loss: 5.18525
[INFO] 2021-02-03 06:42:27 > Step: 49400 Progress: 24.7% Elapsed: 17:14:25 temperature: 0.25 ada_p: No Discriminator_loss: 8.80954 Generator_loss: 5.50511
[INFO] 2021-02-03 06:45:58 > Step: 49500 Progress: 24.8% Elapsed: 17:17:56 temperature: 0.25 ada_p: No Discriminator_loss: 8.67785 Generator_loss: 5.79255
[INFO] 2021-02-03 06:49:30 > Step: 49600 Progress: 24.8% Elapsed: 17:21:28 temperature: 0.25 ada_p: No Discriminator_loss: 8.91787 Generator_loss: 5.6587
[INFO] 2021-02-03 06:53:01 > Step: 49700 Progress: 24.9% Elapsed: 17:24:59 temperature: 0.25 ada_p: No Discriminator_loss: 8.77009 Generator_loss: 5.64885
[INFO] 2021-02-03 06:56:33 > Step: 49800 Progress: 24.9% Elapsed: 17:28:31 temperature: 0.25 ada_p: No Discriminator_loss: 8.82271 Generator_loss: 5.30977
[INFO] 2021-02-03 07:00:04 > Step: 49900 Progress: 24.9% Elapsed: 17:32:02 temperature: 0.25 ada_p: No Discriminator_loss: 8.93539 Generator_loss: 5.45196
[INFO] 2021-02-03 07:03:36 > Step: 50000 Progress: 25.0% Elapsed: 17:35:34 temperature: 0.25 ada_p: No Discriminator_loss: 9.02054 Generator_loss: 5.30814
[INFO] 2021-02-03 07:03:36 > Start Evaluation (50000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 07:03:36 > Calculating FID Score....
[INFO] 2021-02-03 07:04:46 > Calculating Inception Score....
[INFO] 2021-02-03 07:05:46 > Calculate F_beta Score....
[INFO] 2021-02-03 07:15:56 > Calculate Accuracies....
[INFO] 2021-02-03 07:17:06 > Calculate Accuracies....
[INFO] 2021-02-03 07:22:01 > F_8 score (Step: 50000, Using valid images): 0.8308482413453664
[INFO] 2021-02-03 07:22:01 > F_1/8 score (Step: 50000, Using valid images): 0.9350516988214558
[INFO] 2021-02-03 07:22:01 > FID score (Step: 50000, Using valid moments): 29.124958299748528
[INFO] 2021-02-03 07:22:01 > Inception score (Step: 50000, 50000 generated images): 23.537029266357422
[INFO] 2021-02-03 07:22:01 > Best FID score (Step: 50000, Using valid moments): 29.124958299748528
[INFO] 2021-02-03 07:22:15 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 07:25:46 > Step: 50100 Progress: 25.1% Elapsed: 17:57:44 temperature: 0.25 ada_p: No Discriminator_loss: 9.09422 Generator_loss: 5.23119
[INFO] 2021-02-03 07:29:17 > Step: 50200 Progress: 25.1% Elapsed: 18:01:15 temperature: 0.25 ada_p: No Discriminator_loss: 8.97563 Generator_loss: 5.23988
[INFO] 2021-02-03 07:33:05 > Step: 50300 Progress: 25.1% Elapsed: 18:05:03 temperature: 0.25 ada_p: No Discriminator_loss: 8.85373 Generator_loss: 5.49527
[INFO] 2021-02-03 07:36:37 > Step: 50400 Progress: 25.2% Elapsed: 18:08:35 temperature: 0.25 ada_p: No Discriminator_loss: 8.80141 Generator_loss: 5.4411
[INFO] 2021-02-03 07:40:09 > Step: 50500 Progress: 25.2% Elapsed: 18:12:07 temperature: 0.25 ada_p: No Discriminator_loss: 8.80036 Generator_loss: 5.33303
[INFO] 2021-02-03 07:43:41 > Step: 50600 Progress: 25.3% Elapsed: 18:15:39 temperature: 0.25 ada_p: No Discriminator_loss: 9.39501 Generator_loss: 5.2528
[INFO] 2021-02-03 07:47:12 > Step: 50700 Progress: 25.4% Elapsed: 18:19:10 temperature: 0.25 ada_p: No Discriminator_loss: 8.92129 Generator_loss: 5.42774
[INFO] 2021-02-03 07:50:44 > Step: 50800 Progress: 25.4% Elapsed: 18:22:42 temperature: 0.25 ada_p: No Discriminator_loss: 9.13322 Generator_loss: 5.13954
[INFO] 2021-02-03 07:54:15 > Step: 50900 Progress: 25.4% Elapsed: 18:26:13 temperature: 0.25 ada_p: No Discriminator_loss: 9.02843 Generator_loss: 5.45589
[INFO] 2021-02-03 07:57:47 > Step: 51000 Progress: 25.5% Elapsed: 18:29:45 temperature: 0.25 ada_p: No Discriminator_loss: 9.01839 Generator_loss: 5.30032
[INFO] 2021-02-03 08:01:21 > Step: 51100 Progress: 25.6% Elapsed: 18:33:19 temperature: 0.25 ada_p: No Discriminator_loss: 8.91524 Generator_loss: 5.24691
[INFO] 2021-02-03 08:04:52 > Step: 51200 Progress: 25.6% Elapsed: 18:36:50 temperature: 0.25 ada_p: No Discriminator_loss: 8.90948 Generator_loss: 5.329
[INFO] 2021-02-03 08:08:24 > Step: 51300 Progress: 25.7% Elapsed: 18:40:22 temperature: 0.25 ada_p: No Discriminator_loss: 8.96364 Generator_loss: 5.23331
[INFO] 2021-02-03 08:11:55 > Step: 51400 Progress: 25.7% Elapsed: 18:43:53 temperature: 0.25 ada_p: No Discriminator_loss: 9.04399 Generator_loss: 5.32797
[INFO] 2021-02-03 08:15:26 > Step: 51500 Progress: 25.8% Elapsed: 18:47:24 temperature: 0.25 ada_p: No Discriminator_loss: 9.13592 Generator_loss: 5.09877
[INFO] 2021-02-03 08:18:57 > Step: 51600 Progress: 25.8% Elapsed: 18:50:55 temperature: 0.25 ada_p: No Discriminator_loss: 9.12324 Generator_loss: 5.69612
[INFO] 2021-02-03 08:22:29 > Step: 51700 Progress: 25.9% Elapsed: 18:54:27 temperature: 0.25 ada_p: No Discriminator_loss: 9.06107 Generator_loss: 5.12075
[INFO] 2021-02-03 08:26:00 > Step: 51800 Progress: 25.9% Elapsed: 18:57:58 temperature: 0.25 ada_p: No Discriminator_loss: 8.7016 Generator_loss: 5.65774
[INFO] 2021-02-03 08:29:31 > Step: 51900 Progress: 25.9% Elapsed: 19:01:29 temperature: 0.25 ada_p: No Discriminator_loss: 8.62175 Generator_loss: 5.88627
[INFO] 2021-02-03 08:33:03 > Step: 52000 Progress: 26.0% Elapsed: 19:05:01 temperature: 0.25 ada_p: No Discriminator_loss: 8.86555 Generator_loss: 5.3871
[INFO] 2021-02-03 08:33:03 > Start Evaluation (52000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 08:33:03 > Calculating FID Score....
[INFO] 2021-02-03 08:34:13 > Calculating Inception Score....
[INFO] 2021-02-03 08:35:13 > Calculate F_beta Score....
[INFO] 2021-02-03 08:45:19 > Calculate Accuracies....
[INFO] 2021-02-03 08:46:29 > Calculate Accuracies....
[INFO] 2021-02-03 08:51:24 > F_8 score (Step: 52000, Using valid images): 0.8255014161193507
[INFO] 2021-02-03 08:51:24 > F_1/8 score (Step: 52000, Using valid images): 0.9320510396334699
[INFO] 2021-02-03 08:51:24 > FID score (Step: 52000, Using valid moments): 28.509133438756862
[INFO] 2021-02-03 08:51:24 > Inception score (Step: 52000, 50000 generated images): 23.987804412841797
[INFO] 2021-02-03 08:51:24 > Best FID score (Step: 52000, Using valid moments): 28.509133438756862
[INFO] 2021-02-03 08:51:38 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 08:55:09 > Step: 52100 Progress: 26.1% Elapsed: 19:27:07 temperature: 0.25 ada_p: No Discriminator_loss: 8.74776 Generator_loss: 5.35358
[INFO] 2021-02-03 08:58:40 > Step: 52200 Progress: 26.1% Elapsed: 19:30:38 temperature: 0.25 ada_p: No Discriminator_loss: 8.80273 Generator_loss: 5.30028
[INFO] 2021-02-03 09:02:28 > Step: 52300 Progress: 26.2% Elapsed: 19:34:26 temperature: 0.25 ada_p: No Discriminator_loss: 8.83407 Generator_loss: 5.62816
[INFO] 2021-02-03 09:06:00 > Step: 52400 Progress: 26.2% Elapsed: 19:37:58 temperature: 0.25 ada_p: No Discriminator_loss: 8.72386 Generator_loss: 5.69527
[INFO] 2021-02-03 09:09:32 > Step: 52500 Progress: 26.2% Elapsed: 19:41:30 temperature: 0.25 ada_p: No Discriminator_loss: 8.96922 Generator_loss: 5.44032
[INFO] 2021-02-03 09:13:03 > Step: 52600 Progress: 26.3% Elapsed: 19:45:01 temperature: 0.25 ada_p: No Discriminator_loss: 8.7952 Generator_loss: 5.72374
[INFO] 2021-02-03 09:16:35 > Step: 52700 Progress: 26.4% Elapsed: 19:48:33 temperature: 0.25 ada_p: No Discriminator_loss: 8.86056 Generator_loss: 5.3734
[INFO] 2021-02-03 09:20:06 > Step: 52800 Progress: 26.4% Elapsed: 19:52:04 temperature: 0.25 ada_p: No Discriminator_loss: 8.75715 Generator_loss: 5.51245
[INFO] 2021-02-03 09:23:37 > Step: 52900 Progress: 26.5% Elapsed: 19:55:35 temperature: 0.25 ada_p: No Discriminator_loss: 9.03834 Generator_loss: 5.03456
[INFO] 2021-02-03 09:27:08 > Step: 53000 Progress: 26.5% Elapsed: 19:59:06 temperature: 0.25 ada_p: No Discriminator_loss: 8.75281 Generator_loss: 5.8106
[INFO] 2021-02-03 09:30:40 > Step: 53100 Progress: 26.6% Elapsed: 20:02:38 temperature: 0.25 ada_p: No Discriminator_loss: 8.80855 Generator_loss: 5.37692
[INFO] 2021-02-03 09:34:11 > Step: 53200 Progress: 26.6% Elapsed: 20:06:09 temperature: 0.25 ada_p: No Discriminator_loss: 8.78695 Generator_loss: 5.05865
[INFO] 2021-02-03 09:37:43 > Step: 53300 Progress: 26.7% Elapsed: 20:09:41 temperature: 0.25 ada_p: No Discriminator_loss: 8.86283 Generator_loss: 5.62222
[INFO] 2021-02-03 09:41:15 > Step: 53400 Progress: 26.7% Elapsed: 20:13:13 temperature: 0.25 ada_p: No Discriminator_loss: 8.77009 Generator_loss: 5.3839
[INFO] 2021-02-03 09:44:46 > Step: 53500 Progress: 26.8% Elapsed: 20:16:44 temperature: 0.25 ada_p: No Discriminator_loss: 8.83337 Generator_loss: 5.09861
[INFO] 2021-02-03 09:48:21 > Step: 53600 Progress: 26.8% Elapsed: 20:20:19 temperature: 0.25 ada_p: No Discriminator_loss: 8.75701 Generator_loss: 5.44842
[INFO] 2021-02-03 09:51:53 > Step: 53700 Progress: 26.9% Elapsed: 20:23:51 temperature: 0.25 ada_p: No Discriminator_loss: 8.81517 Generator_loss: 5.44717
[INFO] 2021-02-03 09:55:24 > Step: 53800 Progress: 26.9% Elapsed: 20:27:22 temperature: 0.25 ada_p: No Discriminator_loss: 8.77428 Generator_loss: 5.48839
[INFO] 2021-02-03 09:58:56 > Step: 53900 Progress: 27.0% Elapsed: 20:30:54 temperature: 0.25 ada_p: No Discriminator_loss: 9.09388 Generator_loss: 5.05716
[INFO] 2021-02-03 10:02:28 > Step: 54000 Progress: 27.0% Elapsed: 20:34:26 temperature: 0.25 ada_p: No Discriminator_loss: 8.96372 Generator_loss: 5.46077
[INFO] 2021-02-03 10:02:28 > Start Evaluation (54000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 10:02:28 > Calculating FID Score....
[INFO] 2021-02-03 10:03:39 > Calculating Inception Score....
[INFO] 2021-02-03 10:04:39 > Calculate F_beta Score....
[INFO] 2021-02-03 10:14:56 > Calculate Accuracies....
[INFO] 2021-02-03 10:16:06 > Calculate Accuracies....
[INFO] 2021-02-03 10:21:00 > F_8 score (Step: 54000, Using valid images): 0.7964624945199952
[INFO] 2021-02-03 10:21:00 > F_1/8 score (Step: 54000, Using valid images): 0.9337929584712532
[INFO] 2021-02-03 10:21:00 > FID score (Step: 54000, Using valid moments): 27.96695768841124
[INFO] 2021-02-03 10:21:00 > Inception score (Step: 54000, 50000 generated images): 24.498607635498047
[INFO] 2021-02-03 10:21:00 > Best FID score (Step: 54000, Using valid moments): 27.96695768841124
[INFO] 2021-02-03 10:21:15 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 10:24:46 > Step: 54100 Progress: 27.1% Elapsed: 20:56:44 temperature: 0.25 ada_p: No Discriminator_loss: 9.02829 Generator_loss: 5.20861
[INFO] 2021-02-03 10:28:17 > Step: 54200 Progress: 27.1% Elapsed: 21:00:15 temperature: 0.25 ada_p: No Discriminator_loss: 8.99962 Generator_loss: 5.41635
[INFO] 2021-02-03 10:31:48 > Step: 54300 Progress: 27.2% Elapsed: 21:03:45 temperature: 0.25 ada_p: No Discriminator_loss: 9.14655 Generator_loss: 5.17884
[INFO] 2021-02-03 10:35:19 > Step: 54400 Progress: 27.2% Elapsed: 21:07:17 temperature: 0.25 ada_p: No Discriminator_loss: 9.03487 Generator_loss: 5.38681
[INFO] 2021-02-03 10:38:50 > Step: 54500 Progress: 27.3% Elapsed: 21:10:48 temperature: 0.25 ada_p: No Discriminator_loss: 8.96771 Generator_loss: 5.35155
[INFO] 2021-02-03 10:42:22 > Step: 54600 Progress: 27.3% Elapsed: 21:14:20 temperature: 0.25 ada_p: No Discriminator_loss: 9.09718 Generator_loss: 5.06257
[INFO] 2021-02-03 10:45:53 > Step: 54700 Progress: 27.4% Elapsed: 21:17:51 temperature: 0.25 ada_p: No Discriminator_loss: 8.69466 Generator_loss: 5.67553
[INFO] 2021-02-03 10:49:24 > Step: 54800 Progress: 27.4% Elapsed: 21:21:22 temperature: 0.25 ada_p: No Discriminator_loss: 8.78197 Generator_loss: 5.55531
[INFO] 2021-02-03 10:52:56 > Step: 54900 Progress: 27.5% Elapsed: 21:24:54 temperature: 0.25 ada_p: No Discriminator_loss: 9.07552 Generator_loss: 5.11564
[INFO] 2021-02-03 10:56:27 > Step: 55000 Progress: 27.5% Elapsed: 21:28:25 temperature: 0.25 ada_p: No Discriminator_loss: 8.96099 Generator_loss: 5.22111
[INFO] 2021-02-03 10:59:58 > Step: 55100 Progress: 27.6% Elapsed: 21:31:56 temperature: 0.25 ada_p: No Discriminator_loss: 8.88459 Generator_loss: 5.19348
[INFO] 2021-02-03 11:03:30 > Step: 55200 Progress: 27.6% Elapsed: 21:35:28 temperature: 0.25 ada_p: No Discriminator_loss: 8.82997 Generator_loss: 5.46705
[INFO] 2021-02-03 11:07:18 > Step: 55300 Progress: 27.7% Elapsed: 21:39:16 temperature: 0.25 ada_p: No Discriminator_loss: 8.96528 Generator_loss: 5.33539
[INFO] 2021-02-03 11:10:49 > Step: 55400 Progress: 27.7% Elapsed: 21:42:47 temperature: 0.25 ada_p: No Discriminator_loss: 9.02841 Generator_loss: 5.21742
[INFO] 2021-02-03 11:14:21 > Step: 55500 Progress: 27.8% Elapsed: 21:46:19 temperature: 0.25 ada_p: No Discriminator_loss: 9.16282 Generator_loss: 5.12104
[INFO] 2021-02-03 11:17:52 > Step: 55600 Progress: 27.8% Elapsed: 21:49:50 temperature: 0.25 ada_p: No Discriminator_loss: 8.85798 Generator_loss: 5.38099
[INFO] 2021-02-03 11:21:24 > Step: 55700 Progress: 27.9% Elapsed: 21:53:22 temperature: 0.25 ada_p: No Discriminator_loss: 9.12938 Generator_loss: 4.00919
[INFO] 2021-02-03 11:24:55 > Step: 55800 Progress: 27.9% Elapsed: 21:56:53 temperature: 0.25 ada_p: No Discriminator_loss: 9.15252 Generator_loss: 5.34148
[INFO] 2021-02-03 11:28:26 > Step: 55900 Progress: 28.0% Elapsed: 22:00:24 temperature: 0.25 ada_p: No Discriminator_loss: 9.00533 Generator_loss: 6.1289
[INFO] 2021-02-03 11:31:58 > Step: 56000 Progress: 28.0% Elapsed: 22:03:56 temperature: 0.25 ada_p: No Discriminator_loss: 8.94368 Generator_loss: 5.48727
[INFO] 2021-02-03 11:31:58 > Start Evaluation (56000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 11:31:58 > Calculating FID Score....
[INFO] 2021-02-03 11:33:08 > Calculating Inception Score....
[INFO] 2021-02-03 11:34:08 > Calculate F_beta Score....
[INFO] 2021-02-03 11:44:16 > Calculate Accuracies....
[INFO] 2021-02-03 11:45:27 > Calculate Accuracies....
[INFO] 2021-02-03 11:50:18 > F_8 score (Step: 56000, Using valid images): 0.8355431633110015
[INFO] 2021-02-03 11:50:18 > F_1/8 score (Step: 56000, Using valid images): 0.9452987824507042
[INFO] 2021-02-03 11:50:18 > FID score (Step: 56000, Using valid moments): 27.509953517709164
[INFO] 2021-02-03 11:50:18 > Inception score (Step: 56000, 50000 generated images): 24.625244140625
[INFO] 2021-02-03 11:50:18 > Best FID score (Step: 56000, Using valid moments): 27.509953517709164
[INFO] 2021-02-03 11:50:32 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 11:54:26 > Step: 56100 Progress: 28.1% Elapsed: 22:26:24 temperature: 0.25 ada_p: No Discriminator_loss: 8.99123 Generator_loss: 5.4223
[INFO] 2021-02-03 11:57:57 > Step: 56200 Progress: 28.1% Elapsed: 22:29:55 temperature: 0.25 ada_p: No Discriminator_loss: 8.89045 Generator_loss: 5.37962
[INFO] 2021-02-03 12:01:28 > Step: 56300 Progress: 28.1% Elapsed: 22:33:26 temperature: 0.25 ada_p: No Discriminator_loss: 9.03261 Generator_loss: 5.13653
[INFO] 2021-02-03 12:05:00 > Step: 56400 Progress: 28.2% Elapsed: 22:36:58 temperature: 0.25 ada_p: No Discriminator_loss: 8.76253 Generator_loss: 5.47465
[INFO] 2021-02-03 12:08:31 > Step: 56500 Progress: 28.2% Elapsed: 22:40:29 temperature: 0.25 ada_p: No Discriminator_loss: 9.36231 Generator_loss: 5.07348
[INFO] 2021-02-03 12:12:02 > Step: 56600 Progress: 28.3% Elapsed: 22:44:00 temperature: 0.25 ada_p: No Discriminator_loss: 9.15373 Generator_loss: 5.09246
[INFO] 2021-02-03 12:15:34 > Step: 56700 Progress: 28.3% Elapsed: 22:47:32 temperature: 0.25 ada_p: No Discriminator_loss: 8.84933 Generator_loss: 5.39996
[INFO] 2021-02-03 12:19:05 > Step: 56800 Progress: 28.4% Elapsed: 22:51:03 temperature: 0.25 ada_p: No Discriminator_loss: 8.99645 Generator_loss: 5.02334
[INFO] 2021-02-03 12:22:37 > Step: 56900 Progress: 28.4% Elapsed: 22:54:35 temperature: 0.25 ada_p: No Discriminator_loss: 9.13678 Generator_loss: 5.50292
[INFO] 2021-02-03 12:26:08 > Step: 57000 Progress: 28.5% Elapsed: 22:58:06 temperature: 0.25 ada_p: No Discriminator_loss: 8.7502 Generator_loss: 6.2474
[INFO] 2021-02-03 12:29:39 > Step: 57100 Progress: 28.5% Elapsed: 23:01:37 temperature: 0.25 ada_p: No Discriminator_loss: 8.75094 Generator_loss: 5.71277
[INFO] 2021-02-03 12:33:11 > Step: 57200 Progress: 28.6% Elapsed: 23:05:09 temperature: 0.25 ada_p: No Discriminator_loss: 8.86985 Generator_loss: 5.28113
[INFO] 2021-02-03 12:36:43 > Step: 57300 Progress: 28.6% Elapsed: 23:08:41 temperature: 0.25 ada_p: No Discriminator_loss: 8.68813 Generator_loss: 5.53888
[INFO] 2021-02-03 12:40:14 > Step: 57400 Progress: 28.7% Elapsed: 23:12:12 temperature: 0.25 ada_p: No Discriminator_loss: 8.83701 Generator_loss: 5.45954
[INFO] 2021-02-03 12:43:45 > Step: 57500 Progress: 28.7% Elapsed: 23:15:43 temperature: 0.25 ada_p: No Discriminator_loss: 8.97611 Generator_loss: 5.41864
[INFO] 2021-02-03 12:47:16 > Step: 57600 Progress: 28.8% Elapsed: 23:19:14 temperature: 0.25 ada_p: No Discriminator_loss: 8.86178 Generator_loss: 5.26703
[INFO] 2021-02-03 12:50:47 > Step: 57700 Progress: 28.8% Elapsed: 23:22:45 temperature: 0.25 ada_p: No Discriminator_loss: 8.91005 Generator_loss: 5.48339
[INFO] 2021-02-03 12:54:18 > Step: 57800 Progress: 28.9% Elapsed: 23:26:16 temperature: 0.25 ada_p: No Discriminator_loss: 8.90388 Generator_loss: 5.52677
[INFO] 2021-02-03 12:57:50 > Step: 57900 Progress: 28.9% Elapsed: 23:29:48 temperature: 0.25 ada_p: No Discriminator_loss: 8.79787 Generator_loss: 5.36917
[INFO] 2021-02-03 13:01:23 > Step: 58000 Progress: 29.0% Elapsed: 23:33:21 temperature: 0.25 ada_p: No Discriminator_loss: 9.15454 Generator_loss: 5.23485
[INFO] 2021-02-03 13:01:23 > Start Evaluation (58000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 13:01:23 > Calculating FID Score....
[INFO] 2021-02-03 13:02:33 > Calculating Inception Score....
[INFO] 2021-02-03 13:03:32 > Calculate F_beta Score....
[INFO] 2021-02-03 13:13:37 > Calculate Accuracies....
[INFO] 2021-02-03 13:14:47 > Calculate Accuracies....
[INFO] 2021-02-03 13:19:42 > F_8 score (Step: 58000, Using valid images): 0.8431338832702454
[INFO] 2021-02-03 13:19:42 > F_1/8 score (Step: 58000, Using valid images): 0.9366494308336767
[INFO] 2021-02-03 13:19:42 > FID score (Step: 58000, Using valid moments): 26.976068016916088
[INFO] 2021-02-03 13:19:42 > Inception score (Step: 58000, 50000 generated images): 25.011680603027344
[INFO] 2021-02-03 13:19:42 > Best FID score (Step: 58000, Using valid moments): 26.976068016916088
[INFO] 2021-02-03 13:19:57 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 13:23:46 > Step: 58100 Progress: 29.0% Elapsed: 23:55:44 temperature: 0.25 ada_p: No Discriminator_loss: 8.79264 Generator_loss: 5.56349
[INFO] 2021-02-03 13:27:17 > Step: 58200 Progress: 29.1% Elapsed: 23:59:15 temperature: 0.25 ada_p: No Discriminator_loss: 8.90131 Generator_loss: 5.33843
[INFO] 2021-02-03 13:30:48 > Step: 58300 Progress: 29.1% Elapsed: 1 day, 0:02:46 temperature: 0.25 ada_p: No Discriminator_loss: 8.80414 Generator_loss: 5.49991
[INFO] 2021-02-03 13:34:19 > Step: 58400 Progress: 29.2% Elapsed: 1 day, 0:06:17 temperature: 0.25 ada_p: No Discriminator_loss: 8.90243 Generator_loss: 5.37669
[INFO] 2021-02-03 13:37:51 > Step: 58500 Progress: 29.2% Elapsed: 1 day, 0:09:49 temperature: 0.25 ada_p: No Discriminator_loss: 8.8104 Generator_loss: 5.19723
[INFO] 2021-02-03 13:41:25 > Step: 58600 Progress: 29.3% Elapsed: 1 day, 0:13:23 temperature: 0.25 ada_p: No Discriminator_loss: 9.00647 Generator_loss: 5.15621
[INFO] 2021-02-03 13:44:57 > Step: 58700 Progress: 29.3% Elapsed: 1 day, 0:16:55 temperature: 0.25 ada_p: No Discriminator_loss: 8.80682 Generator_loss: 5.33907
[INFO] 2021-02-03 13:48:28 > Step: 58800 Progress: 29.4% Elapsed: 1 day, 0:20:26 temperature: 0.25 ada_p: No Discriminator_loss: 8.90275 Generator_loss: 5.58961
[INFO] 2021-02-03 13:52:00 > Step: 58900 Progress: 29.4% Elapsed: 1 day, 0:23:58 temperature: 0.25 ada_p: No Discriminator_loss: 8.86947 Generator_loss: 5.35256
[INFO] 2021-02-03 13:55:31 > Step: 59000 Progress: 29.5% Elapsed: 1 day, 0:27:29 temperature: 0.25 ada_p: No Discriminator_loss: 8.98302 Generator_loss: 5.32694
[INFO] 2021-02-03 13:59:03 > Step: 59100 Progress: 29.5% Elapsed: 1 day, 0:31:01 temperature: 0.25 ada_p: No Discriminator_loss: 8.68985 Generator_loss: 5.67506
[INFO] 2021-02-03 14:02:35 > Step: 59200 Progress: 29.6% Elapsed: 1 day, 0:34:33 temperature: 0.25 ada_p: No Discriminator_loss: 8.76581 Generator_loss: 5.52651
[INFO] 2021-02-03 14:06:06 > Step: 59300 Progress: 29.6% Elapsed: 1 day, 0:38:04 temperature: 0.25 ada_p: No Discriminator_loss: 8.93612 Generator_loss: 5.28201
[INFO] 2021-02-03 14:09:37 > Step: 59400 Progress: 29.7% Elapsed: 1 day, 0:41:35 temperature: 0.25 ada_p: No Discriminator_loss: 8.94615 Generator_loss: 5.34456
[INFO] 2021-02-03 14:13:09 > Step: 59500 Progress: 29.8% Elapsed: 1 day, 0:45:07 temperature: 0.25 ada_p: No Discriminator_loss: 8.66123 Generator_loss: 5.67225
[INFO] 2021-02-03 14:16:41 > Step: 59600 Progress: 29.8% Elapsed: 1 day, 0:48:39 temperature: 0.25 ada_p: No Discriminator_loss: 8.71389 Generator_loss: 6.09874
[INFO] 2021-02-03 14:20:11 > Step: 59700 Progress: 29.8% Elapsed: 1 day, 0:52:09 temperature: 0.25 ada_p: No Discriminator_loss: 8.8694 Generator_loss: 5.51774
[INFO] 2021-02-03 14:23:42 > Step: 59800 Progress: 29.9% Elapsed: 1 day, 0:55:40 temperature: 0.25 ada_p: No Discriminator_loss: 8.83707 Generator_loss: 5.22728
[INFO] 2021-02-03 14:27:13 > Step: 59900 Progress: 29.9% Elapsed: 1 day, 0:59:11 temperature: 0.25 ada_p: No Discriminator_loss: 8.93398 Generator_loss: 5.46907
[INFO] 2021-02-03 14:30:44 > Step: 60000 Progress: 30.0% Elapsed: 1 day, 1:02:42 temperature: 0.25 ada_p: No Discriminator_loss: 8.76018 Generator_loss: 5.8017
[INFO] 2021-02-03 14:30:44 > Start Evaluation (60000 Step): ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 14:30:44 > Calculating FID Score....
[INFO] 2021-02-03 14:31:53 > Calculating Inception Score....
[INFO] 2021-02-03 14:32:49 > Calculate F_beta Score....
[INFO] 2021-02-03 14:42:58 > Calculate Accuracies....
[INFO] 2021-02-03 14:44:09 > Calculate Accuracies....
[INFO] 2021-02-03 14:49:02 > F_8 score (Step: 60000, Using valid images): 0.8654271438942832
[INFO] 2021-02-03 14:49:02 > F_1/8 score (Step: 60000, Using valid images): 0.9407339356560147
[INFO] 2021-02-03 14:49:02 > FID score (Step: 60000, Using valid moments): 26.596966560842134
[INFO] 2021-02-03 14:49:02 > Inception score (Step: 60000, 50000 generated images): 25.556901931762695
[INFO] 2021-02-03 14:49:02 > Best FID score (Step: 60000, Using valid moments): 26.596966560842134
[INFO] 2021-02-03 14:49:17 > Save model to checkpoints/ContraGAN256-train-2021_02_01_13_59_48
[INFO] 2021-02-03 14:52:47 > Step: 60100 Progress: 30.0% Elapsed: 1 day, 1:24:45 temperature: 0.25 ada_p: No Discriminator_loss: 8.96527 Generator_loss: 5.23794
[INFO] 2021-02-03 14:56:18 > Step: 60200 Progress: 30.1% Elapsed: 1 day, 1:28:16 temperature: 0.25 ada_p: No Discriminator_loss: 8.67954 Generator_loss: 6.12825