Path: blob/master/logs/IMAGENET/CCMGAN2048-train-2021_06_22_06_11_37.log
534 views
[INFO] 2021-06-22 06:11:37 > Run name : CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-22 06:11:37 > { "config_path": "src/configs/ILSVRC2012/CCMGAN2048.json", "checkpoint_folder": null, "load_current": false, "log_output_path": null, "distributed_data_parallel": false, "nodes": 1, "nr": 0, "seed": 3611, "num_workers": 8, "synchronized_bn": true, "mixed_precision": false, "LARS_optimizer": false, "disable_debugging_API": true, "reduce_train_dataset": 1.0, "neg_drop_rate": 0.0, "bn_stat_OnTheFly": false, "standing_statistics": false, "standing_step": -1, "freeze_layers": -1, "load_all_data_in_memory": true, "train": true, "eval": true, "save_images": false, "image_visualization": false, "k_nearest_neighbor": false, "interpolation": false, "frequency_analysis": false, "tsne_analysis": false, "intra_class_FID": false, "nrow": 10, "ncol": 8, "print_every": 100, "save_every": 2000, "eval_type": "valid", "eval_backbone": "Inception_V3" } [INFO] 2021-06-22 06:11:37 > { "data_processing": { "dataset_name": "imagenet", "data_path": "./data/ILSVRC2012", "img_size": 128, "num_classes": 1000, "batch_size4prcsing": 256, "chunk_size": 500, "compression": false }, "train": { "model": { "architecture": "big_resnet", "conditional_strategy": "CCMGAN", "pos_collected_numerator": false, "hypersphere_dim": 2048, "bottleneck_dim": 512, "nonlinear_embed": true, "normalize_embed": true, "g_spectral_norm": true, "d_spectral_norm": true, "activation_fn": "ReLU", "attention": true, "attention_after_nth_gen_block": 4, "attention_after_nth_dis_block": 1, "z_dim": 120, "shared_dim": 128, "g_conv_dim": 96, "d_conv_dim": 96, "G_depth": "N/A", "D_depth": "N/A" }, "optimization": { "optimizer": "Adam", "batch_size": 512, "accumulation_steps": 4, "d_lr": 0.0002, "g_lr": 5e-05, "momentum": "N/A", "nesterov": "N/A", "alpha": "N/A", "beta1": 0.0, "beta2": 0.999, "g_steps_per_iter": 1, "d_steps_per_iter": 2, "total_step": 200000 }, "loss_function": { "adv_loss": "hinge", "contrastive_lambda": 0.5, "margin": 0.9, "tempering_type": "constant", "tempering_step": "N/A", "start_temperature": 0.25, "end_temperature": 0.25, "weight_clipping_for_dis": false, "weight_clipping_bound": "N/A", "gradient_penalty_for_dis": false, "gradient_penalty_lambda": "N/A", "deep_regret_analysis_for_dis": false, "regret_penalty_lambda": "N/A", "cr": false, "cr_lambda": "N/A", "bcr": false, "real_lambda": "N/A", "fake_lambda": "N/A", "zcr": false, "gen_lambda": "N/A", "dis_lambda": "N/A", "sigma_noise": "N/A" }, "initialization": { "g_init": "ortho", "d_init": "ortho" }, "training_and_sampling_setting": { "random_flip_preprocessing": true, "diff_aug": false, "ada": false, "ada_target": "N/A", "ada_length": "N/A", "prior": "gaussian", "truncated_factor": 1, "latent_op": false, "latent_op_rate": "N/A", "latent_op_step": "N/A", "latent_op_step4eval": "N/A", "latent_op_alpha": "N/A", "latent_op_beta": "N/A", "latent_norm_reg_weight": "N/A", "ema": true, "ema_decay": 0.9999, "ema_start": 20000 } } } [INFO] 2021-06-22 06:11:37 > Load train datasets... [INFO] 2021-06-22 06:13:43 > Train dataset size : 1281167 [INFO] 2021-06-22 06:13:43 > Load valid datasets... [INFO] 2021-06-22 06:13:44 > Eval dataset size : 50000 [INFO] 2021-06-22 06:13:44 > Build model... [INFO] 2021-06-22 06:13:44 > Modules are located on models.big_resnet. [INFO] 2021-06-22 06:13:52 > Prepare EMA for G with decay of 0.9999. [INFO] 2021-06-22 06:13:52 > Number of parameters: 70433988 [INFO] 2021-06-22 06:13:52 > Generator( (linear0): Linear(in_features=20, out_features=24576, bias=True) (shared): Embedding(1000, 128) (blocks): ModuleList( (0): ModuleList( (0): GenBlock( (bn1): ConditionalBatchNorm2d_for_skip_and_shared( (bn): BatchNorm2d(1536, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True) (gain): Linear(in_features=148, out_features=1536, bias=False) (bias): Linear(in_features=148, out_features=1536, bias=False) ) (bn2): ConditionalBatchNorm2d_for_skip_and_shared( (bn): BatchNorm2d(1536, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True) (gain): Linear(in_features=148, out_features=1536, bias=False) (bias): Linear(in_features=148, out_features=1536, bias=False) ) (activation): ReLU(inplace=True) (conv2d0): Conv2d(1536, 1536, kernel_size=(1, 1), stride=(1, 1)) (conv2d1): Conv2d(1536, 1536, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (conv2d2): Conv2d(1536, 1536, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) ) ) (1): ModuleList( (0): GenBlock( (bn1): ConditionalBatchNorm2d_for_skip_and_shared( (bn): BatchNorm2d(1536, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True) (gain): Linear(in_features=148, out_features=1536, bias=False) (bias): Linear(in_features=148, out_features=1536, bias=False) ) (bn2): ConditionalBatchNorm2d_for_skip_and_shared( (bn): BatchNorm2d(768, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True) (gain): Linear(in_features=148, out_features=768, bias=False) (bias): Linear(in_features=148, out_features=768, bias=False) ) (activation): ReLU(inplace=True) (conv2d0): Conv2d(1536, 768, kernel_size=(1, 1), stride=(1, 1)) (conv2d1): Conv2d(1536, 768, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (conv2d2): Conv2d(768, 768, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) ) ) (2): ModuleList( (0): GenBlock( (bn1): ConditionalBatchNorm2d_for_skip_and_shared( (bn): BatchNorm2d(768, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True) (gain): Linear(in_features=148, out_features=768, bias=False) (bias): Linear(in_features=148, out_features=768, bias=False) ) (bn2): ConditionalBatchNorm2d_for_skip_and_shared( (bn): BatchNorm2d(384, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True) (gain): Linear(in_features=148, out_features=384, bias=False) (bias): Linear(in_features=148, out_features=384, bias=False) ) (activation): ReLU(inplace=True) (conv2d0): Conv2d(768, 384, kernel_size=(1, 1), stride=(1, 1)) (conv2d1): Conv2d(768, 384, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (conv2d2): Conv2d(384, 384, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) ) ) (3): ModuleList( (0): GenBlock( (bn1): ConditionalBatchNorm2d_for_skip_and_shared( (bn): BatchNorm2d(384, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True) (gain): Linear(in_features=148, out_features=384, bias=False) (bias): Linear(in_features=148, out_features=384, bias=False) ) (bn2): ConditionalBatchNorm2d_for_skip_and_shared( (bn): BatchNorm2d(192, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True) (gain): Linear(in_features=148, out_features=192, bias=False) (bias): Linear(in_features=148, out_features=192, bias=False) ) (activation): ReLU(inplace=True) (conv2d0): Conv2d(384, 192, kernel_size=(1, 1), stride=(1, 1)) (conv2d1): Conv2d(384, 192, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (conv2d2): Conv2d(192, 192, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) ) ) (4): ModuleList( (0): Self_Attn( (conv1x1_theta): Conv2d(192, 24, kernel_size=(1, 1), stride=(1, 1), bias=False) (conv1x1_phi): Conv2d(192, 24, kernel_size=(1, 1), stride=(1, 1), bias=False) (conv1x1_g): Conv2d(192, 96, kernel_size=(1, 1), stride=(1, 1), bias=False) (conv1x1_attn): Conv2d(96, 192, kernel_size=(1, 1), stride=(1, 1), bias=False) (maxpool): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False) (softmax): Softmax(dim=-1) ) ) (5): ModuleList( (0): GenBlock( (bn1): ConditionalBatchNorm2d_for_skip_and_shared( (bn): BatchNorm2d(192, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True) (gain): Linear(in_features=148, out_features=192, bias=False) (bias): Linear(in_features=148, out_features=192, bias=False) ) (bn2): ConditionalBatchNorm2d_for_skip_and_shared( (bn): BatchNorm2d(96, eps=0.0001, momentum=0.1, affine=False, track_running_stats=True) (gain): Linear(in_features=148, out_features=96, bias=False) (bias): Linear(in_features=148, out_features=96, bias=False) ) (activation): ReLU(inplace=True) (conv2d0): Conv2d(192, 96, kernel_size=(1, 1), stride=(1, 1)) (conv2d1): Conv2d(192, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (conv2d2): Conv2d(96, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) ) ) ) (bn4): BatchNorm2d(96, eps=0.0001, momentum=0.1, affine=True, track_running_stats=True) (activation): ReLU(inplace=True) (conv2d5): Conv2d(96, 3, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (tanh): Tanh() ) [INFO] 2021-06-22 06:13:52 > Number of parameters: 93741858 [INFO] 2021-06-22 06:13:52 > Discriminator( (blocks): ModuleList( (0): ModuleList( (0): DiscOptBlock( (conv2d0): Conv2d(3, 96, kernel_size=(1, 1), stride=(1, 1)) (conv2d1): Conv2d(3, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (conv2d2): Conv2d(96, 96, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (activation): ReLU(inplace=True) (average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0) ) ) (1): ModuleList( (0): Self_Attn( (conv1x1_theta): Conv2d(96, 12, kernel_size=(1, 1), stride=(1, 1), bias=False) (conv1x1_phi): Conv2d(96, 12, kernel_size=(1, 1), stride=(1, 1), bias=False) (conv1x1_g): Conv2d(96, 48, kernel_size=(1, 1), stride=(1, 1), bias=False) (conv1x1_attn): Conv2d(48, 96, kernel_size=(1, 1), stride=(1, 1), bias=False) (maxpool): MaxPool2d(kernel_size=2, stride=2, padding=0, dilation=1, ceil_mode=False) (softmax): Softmax(dim=-1) ) ) (2): ModuleList( (0): DiscBlock( (activation): ReLU(inplace=True) (conv2d0): Conv2d(96, 192, kernel_size=(1, 1), stride=(1, 1)) (conv2d1): Conv2d(96, 192, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (conv2d2): Conv2d(192, 192, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0) ) ) (3): ModuleList( (0): DiscBlock( (activation): ReLU(inplace=True) (conv2d0): Conv2d(192, 384, kernel_size=(1, 1), stride=(1, 1)) (conv2d1): Conv2d(192, 384, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (conv2d2): Conv2d(384, 384, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0) ) ) (4): ModuleList( (0): DiscBlock( (activation): ReLU(inplace=True) (conv2d0): Conv2d(384, 768, kernel_size=(1, 1), stride=(1, 1)) (conv2d1): Conv2d(384, 768, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (conv2d2): Conv2d(768, 768, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0) ) ) (5): ModuleList( (0): DiscBlock( (activation): ReLU(inplace=True) (conv2d0): Conv2d(768, 1536, kernel_size=(1, 1), stride=(1, 1)) (conv2d1): Conv2d(768, 1536, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (conv2d2): Conv2d(1536, 1536, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0) ) ) (6): ModuleList( (0): DiscBlock( (activation): ReLU(inplace=True) (conv2d1): Conv2d(1536, 1536, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (conv2d2): Conv2d(1536, 1536, kernel_size=(3, 3), stride=(1, 1), padding=(1, 1)) (average_pooling): AvgPool2d(kernel_size=2, stride=2, padding=0) ) ) ) (activation): ReLU(inplace=True) (linear1): Linear(in_features=1536, out_features=1, bias=True) (linear2): Linear(in_features=1536, out_features=2048, bias=True) (convert_head0): Linear(in_features=2048, out_features=512, bias=True) (convert_head1): Linear(in_features=512, out_features=2048, bias=True) (embedding): Embedding(1000, 2048) ) [INFO] 2021-06-22 06:13:55 > Start training.... [INFO] 2021-06-22 06:33:53 > Step: 100 Progress: 0.1% Elapsed: 0:19:57 temperature: 0.25 ada_p: No Discriminator_loss: 1.25404 Generator_loss: 0.868336 [INFO] 2021-06-22 06:53:00 > Step: 200 Progress: 0.1% Elapsed: 0:39:05 temperature: 0.25 ada_p: No Discriminator_loss: 1.11943 Generator_loss: 0.943885 [INFO] 2021-06-22 07:12:10 > Step: 300 Progress: 0.1% Elapsed: 0:58:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.97431 Generator_loss: 0.443613 [INFO] 2021-06-22 07:31:23 > Step: 400 Progress: 0.2% Elapsed: 1:17:28 temperature: 0.25 ada_p: No Discriminator_loss: 1.08837 Generator_loss: 0.957779 [INFO] 2021-06-22 07:50:33 > Step: 500 Progress: 0.2% Elapsed: 1:36:38 temperature: 0.25 ada_p: No Discriminator_loss: 1.15899 Generator_loss: 0.603825 [INFO] 2021-06-22 08:09:45 > Step: 600 Progress: 0.3% Elapsed: 1:55:49 temperature: 0.25 ada_p: No Discriminator_loss: 1.02714 Generator_loss: 1.02104 [INFO] 2021-06-22 08:29:02 > Step: 700 Progress: 0.4% Elapsed: 2:15:07 temperature: 0.25 ada_p: No Discriminator_loss: 1.11519 Generator_loss: 0.921492 [INFO] 2021-06-22 08:48:15 > Step: 800 Progress: 0.4% Elapsed: 2:34:19 temperature: 0.25 ada_p: No Discriminator_loss: 1.04227 Generator_loss: 0.781352 [INFO] 2021-06-22 09:07:27 > Step: 900 Progress: 0.4% Elapsed: 2:53:31 temperature: 0.25 ada_p: No Discriminator_loss: 1.06966 Generator_loss: 0.805407 [INFO] 2021-06-22 09:26:45 > Step: 1000 Progress: 0.5% Elapsed: 3:12:49 temperature: 0.25 ada_p: No Discriminator_loss: 1.04395 Generator_loss: 0.682764 [INFO] 2021-06-22 09:45:58 > Step: 1100 Progress: 0.5% Elapsed: 3:32:03 temperature: 0.25 ada_p: No Discriminator_loss: 1.07431 Generator_loss: 0.79342 [INFO] 2021-06-22 10:05:11 > Step: 1200 Progress: 0.6% Elapsed: 3:51:15 temperature: 0.25 ada_p: No Discriminator_loss: 1.17 Generator_loss: 0.868316 [INFO] 2021-06-22 10:24:27 > Step: 1300 Progress: 0.7% Elapsed: 4:10:31 temperature: 0.25 ada_p: No Discriminator_loss: 1.06438 Generator_loss: 0.662818 [INFO] 2021-06-22 10:43:38 > Step: 1400 Progress: 0.7% Elapsed: 4:29:43 temperature: 0.25 ada_p: No Discriminator_loss: 1.08885 Generator_loss: 0.937001 [INFO] 2021-06-22 11:02:51 > Step: 1500 Progress: 0.8% Elapsed: 4:48:55 temperature: 0.25 ada_p: No Discriminator_loss: 1.00054 Generator_loss: 0.959631 [INFO] 2021-06-22 11:22:03 > Step: 1600 Progress: 0.8% Elapsed: 5:08:08 temperature: 0.25 ada_p: No Discriminator_loss: 1.01552 Generator_loss: 0.471373 [INFO] 2021-06-22 11:41:14 > Step: 1700 Progress: 0.9% Elapsed: 5:27:18 temperature: 0.25 ada_p: No Discriminator_loss: 1.01318 Generator_loss: 0.614553 [INFO] 2021-06-22 12:00:26 > Step: 1800 Progress: 0.9% Elapsed: 5:46:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.994854 Generator_loss: 0.953588 [INFO] 2021-06-22 12:19:42 > Step: 1900 Progress: 0.9% Elapsed: 6:05:46 temperature: 0.25 ada_p: No Discriminator_loss: 1.03999 Generator_loss: 0.414957 [INFO] 2021-06-22 12:38:54 > Step: 2000 Progress: 1.0% Elapsed: 6:24:58 temperature: 0.25 ada_p: No Discriminator_loss: 1.07692 Generator_loss: 0.871526 [INFO] 2021-06-22 12:38:54 > Start Evaluation (2000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-22 12:38:54 > Calculating FID Score.... [INFO] 2021-06-22 12:40:02 > Calculating Inception Score.... [INFO] 2021-06-22 12:40:56 > Calculate F_beta Score.... [INFO] 2021-06-22 12:43:52 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-22 12:43:52 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-22 12:43:55 > Calculate Accuracies.... [INFO] 2021-06-22 12:44:43 > Calculate Accuracies.... [INFO] 2021-06-22 12:45:34 > F_8 score (Step: 2000, Using valid images): 0.34208914750544867 [INFO] 2021-06-22 12:45:34 > F_1/8 score (Step: 2000, Using valid images): 0.3701073606863497 [INFO] 2021-06-22 12:45:34 > FID score (Step: 2000, Using valid moments): 113.29325484956132 [INFO] 2021-06-22 12:45:34 > Inception score (Step: 2000, 50000 generated images): 6.684080600738525 [INFO] 2021-06-22 12:45:34 > Best FID score (Step: 2000, Using valid moments): 113.29325484956132 [INFO] 2021-06-22 12:45:49 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-22 13:04:57 > Step: 2100 Progress: 1.1% Elapsed: 6:51:01 temperature: 0.25 ada_p: No Discriminator_loss: 1.03644 Generator_loss: 0.86443 [INFO] 2021-06-22 13:24:10 > Step: 2200 Progress: 1.1% Elapsed: 7:10:15 temperature: 0.25 ada_p: No Discriminator_loss: 1.06696 Generator_loss: 0.977207 [INFO] 2021-06-22 13:43:22 > Step: 2300 Progress: 1.1% Elapsed: 7:29:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.996231 Generator_loss: 0.902315 [INFO] 2021-06-22 14:02:36 > Step: 2400 Progress: 1.2% Elapsed: 7:48:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.966747 Generator_loss: 0.807439 [INFO] 2021-06-22 14:21:50 > Step: 2500 Progress: 1.2% Elapsed: 8:07:55 temperature: 0.25 ada_p: No Discriminator_loss: 1.0274 Generator_loss: 0.452697 [INFO] 2021-06-22 14:41:05 > Step: 2600 Progress: 1.3% Elapsed: 8:27:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.987705 Generator_loss: 0.969569 [INFO] 2021-06-22 15:00:16 > Step: 2700 Progress: 1.4% Elapsed: 8:46:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.946145 Generator_loss: 0.85296 [INFO] 2021-06-22 15:19:27 > Step: 2800 Progress: 1.4% Elapsed: 9:05:32 temperature: 0.25 ada_p: No Discriminator_loss: 1.01995 Generator_loss: 0.930543 [INFO] 2021-06-22 15:38:45 > Step: 2900 Progress: 1.5% Elapsed: 9:24:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.947255 Generator_loss: 0.857761 [INFO] 2021-06-22 15:58:00 > Step: 3000 Progress: 1.5% Elapsed: 9:44:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.970822 Generator_loss: 0.925515 [INFO] 2021-06-22 16:17:15 > Step: 3100 Progress: 1.6% Elapsed: 10:03:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.981353 Generator_loss: 0.489943 [INFO] 2021-06-22 16:36:34 > Step: 3200 Progress: 1.6% Elapsed: 10:22:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.972473 Generator_loss: 0.925982 [INFO] 2021-06-22 16:55:47 > Step: 3300 Progress: 1.7% Elapsed: 10:41:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.994507 Generator_loss: 0.944 [INFO] 2021-06-22 17:15:00 > Step: 3400 Progress: 1.7% Elapsed: 11:01:05 temperature: 0.25 ada_p: No Discriminator_loss: 1.00309 Generator_loss: 0.925556 [INFO] 2021-06-22 17:34:17 > Step: 3500 Progress: 1.8% Elapsed: 11:20:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.900056 Generator_loss: 0.816851 [INFO] 2021-06-22 17:53:31 > Step: 3600 Progress: 1.8% Elapsed: 11:39:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.870998 Generator_loss: 0.868871 [INFO] 2021-06-22 18:12:47 > Step: 3700 Progress: 1.8% Elapsed: 11:58:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.900313 Generator_loss: 0.887346 [INFO] 2021-06-22 18:32:06 > Step: 3800 Progress: 1.9% Elapsed: 12:18:10 temperature: 0.25 ada_p: No Discriminator_loss: 1.07107 Generator_loss: 0.84598 [INFO] 2021-06-22 18:51:19 > Step: 3900 Progress: 1.9% Elapsed: 12:37:23 temperature: 0.25 ada_p: No Discriminator_loss: 1.01696 Generator_loss: 0.84098 [INFO] 2021-06-22 19:10:33 > Step: 4000 Progress: 2.0% Elapsed: 12:56:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.941113 Generator_loss: 0.880799 [INFO] 2021-06-22 19:10:33 > Start Evaluation (4000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-22 19:10:33 > Calculating FID Score.... [INFO] 2021-06-22 19:11:39 > Calculating Inception Score.... [INFO] 2021-06-22 19:12:33 > Calculate F_beta Score.... [INFO] 2021-06-22 19:15:28 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-22 19:15:28 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-22 19:15:30 > Calculate Accuracies.... [INFO] 2021-06-22 19:16:18 > Calculate Accuracies.... [INFO] 2021-06-22 19:17:09 > F_8 score (Step: 4000, Using valid images): 0.43324157056830603 [INFO] 2021-06-22 19:17:09 > F_1/8 score (Step: 4000, Using valid images): 0.5575888532333597 [INFO] 2021-06-22 19:17:09 > FID score (Step: 4000, Using valid moments): 90.8438405617141 [INFO] 2021-06-22 19:17:09 > Inception score (Step: 4000, 50000 generated images): 9.567434310913086 [INFO] 2021-06-22 19:17:09 > Best FID score (Step: 4000, Using valid moments): 90.8438405617141 [INFO] 2021-06-22 19:17:24 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-22 19:36:41 > Step: 4100 Progress: 2.1% Elapsed: 13:22:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.865589 Generator_loss: 0.562841 [INFO] 2021-06-22 19:55:53 > Step: 4200 Progress: 2.1% Elapsed: 13:41:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.975996 Generator_loss: 0.888589 [INFO] 2021-06-22 20:15:04 > Step: 4300 Progress: 2.1% Elapsed: 14:01:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.913268 Generator_loss: 0.923894 [INFO] 2021-06-22 20:34:21 > Step: 4400 Progress: 2.2% Elapsed: 14:20:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.812811 Generator_loss: 0.737546 [INFO] 2021-06-22 20:53:33 > Step: 4500 Progress: 2.2% Elapsed: 14:39:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.848198 Generator_loss: 0.782955 [INFO] 2021-06-22 21:12:45 > Step: 4600 Progress: 2.3% Elapsed: 14:58:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.932313 Generator_loss: 0.882723 [INFO] 2021-06-22 21:32:00 > Step: 4700 Progress: 2.4% Elapsed: 15:18:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.974627 Generator_loss: 0.80968 [INFO] 2021-06-22 21:51:11 > Step: 4800 Progress: 2.4% Elapsed: 15:37:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.993953 Generator_loss: 0.490533 [INFO] 2021-06-22 22:10:23 > Step: 4900 Progress: 2.5% Elapsed: 15:56:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.960308 Generator_loss: 0.857037 [INFO] 2021-06-22 22:29:38 > Step: 5000 Progress: 2.5% Elapsed: 16:15:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.913838 Generator_loss: 0.532599 [INFO] 2021-06-22 22:48:55 > Step: 5100 Progress: 2.5% Elapsed: 16:34:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.998076 Generator_loss: 0.48019 [INFO] 2021-06-22 23:08:09 > Step: 5200 Progress: 2.6% Elapsed: 16:54:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.914328 Generator_loss: 0.458547 [INFO] 2021-06-22 23:27:21 > Step: 5300 Progress: 2.6% Elapsed: 17:13:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.898401 Generator_loss: 0.819346 [INFO] 2021-06-22 23:46:39 > Step: 5400 Progress: 2.7% Elapsed: 17:32:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.884413 Generator_loss: 0.881945 [INFO] 2021-06-23 00:05:52 > Step: 5500 Progress: 2.8% Elapsed: 17:51:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.949583 Generator_loss: 0.545592 [INFO] 2021-06-23 00:25:05 > Step: 5600 Progress: 2.8% Elapsed: 18:11:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.901115 Generator_loss: 0.922625 [INFO] 2021-06-23 00:44:26 > Step: 5700 Progress: 2.9% Elapsed: 18:30:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.942566 Generator_loss: 0.54076 [INFO] 2021-06-23 01:03:39 > Step: 5800 Progress: 2.9% Elapsed: 18:49:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.943845 Generator_loss: 0.49005 [INFO] 2021-06-23 01:22:53 > Step: 5900 Progress: 2.9% Elapsed: 19:08:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.866026 Generator_loss: 0.910537 [INFO] 2021-06-23 01:42:11 > Step: 6000 Progress: 3.0% Elapsed: 19:28:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.936693 Generator_loss: 0.805156 [INFO] 2021-06-23 01:42:11 > Start Evaluation (6000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-23 01:42:11 > Calculating FID Score.... [INFO] 2021-06-23 01:43:16 > Calculating Inception Score.... [INFO] 2021-06-23 01:44:10 > Calculate F_beta Score.... [INFO] 2021-06-23 01:46:34 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-23 01:46:34 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-23 01:46:37 > Calculate Accuracies.... [INFO] 2021-06-23 01:47:27 > Calculate Accuracies.... [INFO] 2021-06-23 01:48:17 > F_8 score (Step: 6000, Using valid images): 0.49426002079623343 [INFO] 2021-06-23 01:48:18 > F_1/8 score (Step: 6000, Using valid images): 0.684127664095708 [INFO] 2021-06-23 01:48:18 > FID score (Step: 6000, Using valid moments): 75.29919015739648 [INFO] 2021-06-23 01:48:18 > Inception score (Step: 6000, 50000 generated images): 11.635403633117676 [INFO] 2021-06-23 01:48:18 > Best FID score (Step: 6000, Using valid moments): 75.29919015739648 [INFO] 2021-06-23 01:48:32 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-23 02:07:44 > Step: 6100 Progress: 3.0% Elapsed: 19:53:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.928673 Generator_loss: 0.69769 [INFO] 2021-06-23 02:26:56 > Step: 6200 Progress: 3.1% Elapsed: 20:13:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.817868 Generator_loss: 0.631606 [INFO] 2021-06-23 02:46:11 > Step: 6300 Progress: 3.1% Elapsed: 20:32:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.906819 Generator_loss: 0.724672 [INFO] 2021-06-23 03:05:24 > Step: 6400 Progress: 3.2% Elapsed: 20:51:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.890906 Generator_loss: 0.78925 [INFO] 2021-06-23 03:24:36 > Step: 6500 Progress: 3.2% Elapsed: 21:10:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.885417 Generator_loss: 0.622172 [INFO] 2021-06-23 03:43:55 > Step: 6600 Progress: 3.3% Elapsed: 21:30:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.893282 Generator_loss: 0.516036 [INFO] 2021-06-23 04:03:08 > Step: 6700 Progress: 3.4% Elapsed: 21:49:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.879606 Generator_loss: 0.7977 [INFO] 2021-06-23 04:22:21 > Step: 6800 Progress: 3.4% Elapsed: 22:08:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.885873 Generator_loss: 0.468655 [INFO] 2021-06-23 04:41:41 > Step: 6900 Progress: 3.5% Elapsed: 22:27:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.844966 Generator_loss: 0.708064 [INFO] 2021-06-23 05:00:56 > Step: 7000 Progress: 3.5% Elapsed: 22:47:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.898328 Generator_loss: 0.589285 [INFO] 2021-06-23 05:20:10 > Step: 7100 Progress: 3.5% Elapsed: 23:06:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.895235 Generator_loss: 0.786208 [INFO] 2021-06-23 05:39:28 > Step: 7200 Progress: 3.6% Elapsed: 23:25:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.888807 Generator_loss: 0.572056 [INFO] 2021-06-23 05:58:41 > Step: 7300 Progress: 3.6% Elapsed: 23:44:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.92968 Generator_loss: 0.466187 [INFO] 2021-06-23 06:17:55 > Step: 7400 Progress: 3.7% Elapsed: 1 day, 0:04:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.892156 Generator_loss: 0.546041 [INFO] 2021-06-23 06:37:10 > Step: 7500 Progress: 3.8% Elapsed: 1 day, 0:23:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.915501 Generator_loss: 0.515716 [INFO] 2021-06-23 06:56:26 > Step: 7600 Progress: 3.8% Elapsed: 1 day, 0:42:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.93459 Generator_loss: 0.633462 [INFO] 2021-06-23 07:15:40 > Step: 7700 Progress: 3.9% Elapsed: 1 day, 1:01:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.886384 Generator_loss: 0.543986 [INFO] 2021-06-23 07:34:57 > Step: 7800 Progress: 3.9% Elapsed: 1 day, 1:21:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.860725 Generator_loss: 0.69075 [INFO] 2021-06-23 07:54:15 > Step: 7900 Progress: 4.0% Elapsed: 1 day, 1:40:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.822857 Generator_loss: 0.570946 [INFO] 2021-06-23 08:13:28 > Step: 8000 Progress: 4.0% Elapsed: 1 day, 1:59:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.846638 Generator_loss: 0.679226 [INFO] 2021-06-23 08:13:28 > Start Evaluation (8000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-23 08:13:28 > Calculating FID Score.... [INFO] 2021-06-23 08:14:33 > Calculating Inception Score.... [INFO] 2021-06-23 08:15:27 > Calculate F_beta Score.... [INFO] 2021-06-23 08:17:50 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-23 08:17:50 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-23 08:17:53 > Calculate Accuracies.... [INFO] 2021-06-23 08:18:43 > Calculate Accuracies.... [INFO] 2021-06-23 08:19:33 > F_8 score (Step: 8000, Using valid images): 0.5699456923229973 [INFO] 2021-06-23 08:19:33 > F_1/8 score (Step: 8000, Using valid images): 0.7752865113451584 [INFO] 2021-06-23 08:19:33 > FID score (Step: 8000, Using valid moments): 62.851290687470396 [INFO] 2021-06-23 08:19:33 > Inception score (Step: 8000, 50000 generated images): 13.463611602783203 [INFO] 2021-06-23 08:19:33 > Best FID score (Step: 8000, Using valid moments): 62.851290687470396 [INFO] 2021-06-23 08:19:48 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-23 08:39:00 > Step: 8100 Progress: 4.0% Elapsed: 1 day, 2:25:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.884031 Generator_loss: 0.632817 [INFO] 2021-06-23 08:58:16 > Step: 8200 Progress: 4.1% Elapsed: 1 day, 2:44:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.873022 Generator_loss: 0.576182 [INFO] 2021-06-23 09:17:26 > Step: 8300 Progress: 4.2% Elapsed: 1 day, 3:03:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.892437 Generator_loss: 0.692599 [INFO] 2021-06-23 09:36:41 > Step: 8400 Progress: 4.2% Elapsed: 1 day, 3:22:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.864755 Generator_loss: 0.743824 [INFO] 2021-06-23 09:55:58 > Step: 8500 Progress: 4.2% Elapsed: 1 day, 3:42:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.858626 Generator_loss: 0.69445 [INFO] 2021-06-23 10:15:10 > Step: 8600 Progress: 4.3% Elapsed: 1 day, 4:01:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.857622 Generator_loss: 0.665076 [INFO] 2021-06-23 10:34:22 > Step: 8700 Progress: 4.3% Elapsed: 1 day, 4:20:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.869073 Generator_loss: 0.613079 [INFO] 2021-06-23 10:53:38 > Step: 8800 Progress: 4.4% Elapsed: 1 day, 4:39:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.861864 Generator_loss: 0.657309 [INFO] 2021-06-23 11:12:51 > Step: 8900 Progress: 4.5% Elapsed: 1 day, 4:58:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.868621 Generator_loss: 0.629257 [INFO] 2021-06-23 11:32:02 > Step: 9000 Progress: 4.5% Elapsed: 1 day, 5:18:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.875429 Generator_loss: 0.613379 [INFO] 2021-06-23 11:51:19 > Step: 9100 Progress: 4.5% Elapsed: 1 day, 5:37:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.821537 Generator_loss: 0.594948 [INFO] 2021-06-23 12:10:33 > Step: 9200 Progress: 4.6% Elapsed: 1 day, 5:56:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.826476 Generator_loss: 0.626554 [INFO] 2021-06-23 12:29:45 > Step: 9300 Progress: 4.7% Elapsed: 1 day, 6:15:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.843458 Generator_loss: 0.611574 [INFO] 2021-06-23 12:48:59 > Step: 9400 Progress: 4.7% Elapsed: 1 day, 6:35:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.810344 Generator_loss: 0.615391 [INFO] 2021-06-23 13:08:12 > Step: 9500 Progress: 4.8% Elapsed: 1 day, 6:54:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.859673 Generator_loss: 0.679427 [INFO] 2021-06-23 13:27:24 > Step: 9600 Progress: 4.8% Elapsed: 1 day, 7:13:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.83866 Generator_loss: 0.610522 [INFO] 2021-06-23 13:46:38 > Step: 9700 Progress: 4.9% Elapsed: 1 day, 7:32:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.881059 Generator_loss: 0.601995 [INFO] 2021-06-23 14:05:50 > Step: 9800 Progress: 4.9% Elapsed: 1 day, 7:51:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.794929 Generator_loss: 0.593973 [INFO] 2021-06-23 14:25:03 > Step: 9900 Progress: 5.0% Elapsed: 1 day, 8:11:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.82555 Generator_loss: 0.60651 [INFO] 2021-06-23 14:44:18 > Step: 10000 Progress: 5.0% Elapsed: 1 day, 8:30:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.852934 Generator_loss: 0.620808 [INFO] 2021-06-23 14:44:19 > Start Evaluation (10000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-23 14:44:19 > Calculating FID Score.... [INFO] 2021-06-23 14:45:24 > Calculating Inception Score.... [INFO] 2021-06-23 14:46:18 > Calculate F_beta Score.... [INFO] 2021-06-23 14:48:44 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-23 14:48:45 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-23 14:48:48 > Calculate Accuracies.... [INFO] 2021-06-23 14:49:36 > Calculate Accuracies.... [INFO] 2021-06-23 14:50:26 > F_8 score (Step: 10000, Using valid images): 0.5792632347961504 [INFO] 2021-06-23 14:50:26 > F_1/8 score (Step: 10000, Using valid images): 0.7877124346434523 [INFO] 2021-06-23 14:50:26 > FID score (Step: 10000, Using valid moments): 60.643643693434285 [INFO] 2021-06-23 14:50:26 > Inception score (Step: 10000, 50000 generated images): 14.565051078796387 [INFO] 2021-06-23 14:50:26 > Best FID score (Step: 10000, Using valid moments): 60.643643693434285 [INFO] 2021-06-23 14:50:41 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-23 15:10:00 > Step: 10100 Progress: 5.1% Elapsed: 1 day, 8:56:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.811305 Generator_loss: 0.615054 [INFO] 2021-06-23 15:29:13 > Step: 10200 Progress: 5.1% Elapsed: 1 day, 9:15:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.87108 Generator_loss: 0.618553 [INFO] 2021-06-23 15:48:23 > Step: 10300 Progress: 5.1% Elapsed: 1 day, 9:34:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.820977 Generator_loss: 0.620513 [INFO] 2021-06-23 16:07:40 > Step: 10400 Progress: 5.2% Elapsed: 1 day, 9:53:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.817862 Generator_loss: 0.631994 [INFO] 2021-06-23 16:26:54 > Step: 10500 Progress: 5.2% Elapsed: 1 day, 10:12:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.816645 Generator_loss: 0.642419 [INFO] 2021-06-23 16:46:10 > Step: 10600 Progress: 5.3% Elapsed: 1 day, 10:32:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.807431 Generator_loss: 0.70021 [INFO] 2021-06-23 17:05:31 > Step: 10700 Progress: 5.3% Elapsed: 1 day, 10:51:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.825995 Generator_loss: 0.6799 [INFO] 2021-06-23 17:24:44 > Step: 10800 Progress: 5.4% Elapsed: 1 day, 11:10:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.845836 Generator_loss: 0.657325 [INFO] 2021-06-23 17:43:59 > Step: 10900 Progress: 5.5% Elapsed: 1 day, 11:30:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.804629 Generator_loss: 0.668312 [INFO] 2021-06-23 18:03:19 > Step: 11000 Progress: 5.5% Elapsed: 1 day, 11:49:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.817742 Generator_loss: 0.626368 [INFO] 2021-06-23 18:22:35 > Step: 11100 Progress: 5.5% Elapsed: 1 day, 12:08:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.796136 Generator_loss: 0.650578 [INFO] 2021-06-23 18:41:49 > Step: 11200 Progress: 5.6% Elapsed: 1 day, 12:27:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.797877 Generator_loss: 0.611738 [INFO] 2021-06-23 19:01:10 > Step: 11300 Progress: 5.7% Elapsed: 1 day, 12:47:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.790725 Generator_loss: 0.62137 [INFO] 2021-06-23 19:20:25 > Step: 11400 Progress: 5.7% Elapsed: 1 day, 13:06:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.854144 Generator_loss: 0.697209 [INFO] 2021-06-23 19:39:39 > Step: 11500 Progress: 5.8% Elapsed: 1 day, 13:25:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.80301 Generator_loss: 0.611332 [INFO] 2021-06-23 19:58:58 > Step: 11600 Progress: 5.8% Elapsed: 1 day, 13:45:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.843943 Generator_loss: 0.637924 [INFO] 2021-06-23 20:18:13 > Step: 11700 Progress: 5.9% Elapsed: 1 day, 14:04:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.806491 Generator_loss: 0.616093 [INFO] 2021-06-23 20:37:25 > Step: 11800 Progress: 5.9% Elapsed: 1 day, 14:23:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.822121 Generator_loss: 0.670911 [INFO] 2021-06-23 20:56:45 > Step: 11900 Progress: 5.9% Elapsed: 1 day, 14:42:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.777595 Generator_loss: 0.617685 [INFO] 2021-06-23 21:16:00 > Step: 12000 Progress: 6.0% Elapsed: 1 day, 15:02:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.809139 Generator_loss: 0.679187 [INFO] 2021-06-23 21:16:00 > Start Evaluation (12000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-23 21:16:00 > Calculating FID Score.... [INFO] 2021-06-23 21:17:06 > Calculating Inception Score.... [INFO] 2021-06-23 21:18:00 > Calculate F_beta Score.... [INFO] 2021-06-23 21:20:25 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-23 21:20:26 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-23 21:20:29 > Calculate Accuracies.... [INFO] 2021-06-23 21:21:18 > Calculate Accuracies.... [INFO] 2021-06-23 21:22:09 > F_8 score (Step: 12000, Using valid images): 0.6654886132948138 [INFO] 2021-06-23 21:22:09 > F_1/8 score (Step: 12000, Using valid images): 0.8384339653758667 [INFO] 2021-06-23 21:22:09 > FID score (Step: 12000, Using valid moments): 51.886667435834 [INFO] 2021-06-23 21:22:09 > Inception score (Step: 12000, 50000 generated images): 16.772409439086914 [INFO] 2021-06-23 21:22:09 > Best FID score (Step: 12000, Using valid moments): 51.886667435834 [INFO] 2021-06-23 21:22:24 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-23 21:41:39 > Step: 12100 Progress: 6.0% Elapsed: 1 day, 15:27:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.831378 Generator_loss: 0.601008 [INFO] 2021-06-23 22:01:01 > Step: 12200 Progress: 6.1% Elapsed: 1 day, 15:47:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.844402 Generator_loss: 0.617413 [INFO] 2021-06-23 22:20:16 > Step: 12300 Progress: 6.2% Elapsed: 1 day, 16:06:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.836559 Generator_loss: 0.703404 [INFO] 2021-06-23 22:39:32 > Step: 12400 Progress: 6.2% Elapsed: 1 day, 16:25:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.790808 Generator_loss: 0.628106 [INFO] 2021-06-23 22:58:49 > Step: 12500 Progress: 6.2% Elapsed: 1 day, 16:44:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.817528 Generator_loss: 0.635295 [INFO] 2021-06-23 23:18:07 > Step: 12600 Progress: 6.3% Elapsed: 1 day, 17:04:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.817857 Generator_loss: 0.619709 [INFO] 2021-06-23 23:37:21 > Step: 12700 Progress: 6.3% Elapsed: 1 day, 17:23:26 temperature: 0.25 ada_p: No Discriminator_loss: 1.08489 Generator_loss: 0.820437 [INFO] 2021-06-23 23:56:35 > Step: 12800 Progress: 6.4% Elapsed: 1 day, 17:42:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.787901 Generator_loss: 0.632281 [INFO] 2021-06-24 00:15:56 > Step: 12900 Progress: 6.5% Elapsed: 1 day, 18:02:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.789434 Generator_loss: 0.694048 [INFO] 2021-06-24 00:35:08 > Step: 13000 Progress: 6.5% Elapsed: 1 day, 18:21:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.759999 Generator_loss: 0.643227 [INFO] 2021-06-24 00:54:23 > Step: 13100 Progress: 6.6% Elapsed: 1 day, 18:40:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.777925 Generator_loss: 0.646085 [INFO] 2021-06-24 01:13:44 > Step: 13200 Progress: 6.6% Elapsed: 1 day, 18:59:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.809702 Generator_loss: 0.670001 [INFO] 2021-06-24 01:33:00 > Step: 13300 Progress: 6.7% Elapsed: 1 day, 19:19:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.829116 Generator_loss: 0.716646 [INFO] 2021-06-24 01:52:13 > Step: 13400 Progress: 6.7% Elapsed: 1 day, 19:38:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.799892 Generator_loss: 0.657164 [INFO] 2021-06-24 02:11:32 > Step: 13500 Progress: 6.8% Elapsed: 1 day, 19:57:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.849195 Generator_loss: 0.626006 [INFO] 2021-06-24 02:30:47 > Step: 13600 Progress: 6.8% Elapsed: 1 day, 20:16:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.799424 Generator_loss: 0.6602 [INFO] 2021-06-24 02:50:03 > Step: 13700 Progress: 6.9% Elapsed: 1 day, 20:36:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.77771 Generator_loss: 0.64787 [INFO] 2021-06-24 03:09:23 > Step: 13800 Progress: 6.9% Elapsed: 1 day, 20:55:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.862694 Generator_loss: 0.691178 [INFO] 2021-06-24 03:28:36 > Step: 13900 Progress: 7.0% Elapsed: 1 day, 21:14:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.847859 Generator_loss: 0.691926 [INFO] 2021-06-24 03:47:52 > Step: 14000 Progress: 7.0% Elapsed: 1 day, 21:33:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.796231 Generator_loss: 0.656763 [INFO] 2021-06-24 03:47:52 > Start Evaluation (14000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-24 03:47:52 > Calculating FID Score.... [INFO] 2021-06-24 03:48:57 > Calculating Inception Score.... [INFO] 2021-06-24 03:49:51 > Calculate F_beta Score.... [INFO] 2021-06-24 03:52:19 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-24 03:52:20 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-24 03:52:23 > Calculate Accuracies.... [INFO] 2021-06-24 03:53:13 > Calculate Accuracies.... [INFO] 2021-06-24 03:54:03 > F_8 score (Step: 14000, Using valid images): 0.7060629129684817 [INFO] 2021-06-24 03:54:03 > F_1/8 score (Step: 14000, Using valid images): 0.853452068452698 [INFO] 2021-06-24 03:54:03 > FID score (Step: 14000, Using valid moments): 49.5478796441314 [INFO] 2021-06-24 03:54:03 > Inception score (Step: 14000, 50000 generated images): 17.46697998046875 [INFO] 2021-06-24 03:54:03 > Best FID score (Step: 14000, Using valid moments): 49.5478796441314 [INFO] 2021-06-24 03:54:18 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-24 04:13:36 > Step: 14100 Progress: 7.0% Elapsed: 1 day, 21:59:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.757704 Generator_loss: 0.639611 [INFO] 2021-06-24 04:32:51 > Step: 14200 Progress: 7.1% Elapsed: 1 day, 22:18:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.778625 Generator_loss: 0.661866 [INFO] 2021-06-24 04:52:04 > Step: 14300 Progress: 7.1% Elapsed: 1 day, 22:38:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.796026 Generator_loss: 0.697036 [INFO] 2021-06-24 05:11:22 > Step: 14400 Progress: 7.2% Elapsed: 1 day, 22:57:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.782923 Generator_loss: 0.637609 [INFO] 2021-06-24 05:30:37 > Step: 14500 Progress: 7.2% Elapsed: 1 day, 23:16:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.784751 Generator_loss: 0.711653 [INFO] 2021-06-24 05:49:52 > Step: 14600 Progress: 7.3% Elapsed: 1 day, 23:35:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.802328 Generator_loss: 0.636087 [INFO] 2021-06-24 06:09:10 > Step: 14700 Progress: 7.3% Elapsed: 1 day, 23:55:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.765879 Generator_loss: 0.704765 [INFO] 2021-06-24 06:28:25 > Step: 14800 Progress: 7.4% Elapsed: 2 days, 0:14:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.826471 Generator_loss: 0.618874 [INFO] 2021-06-24 06:47:40 > Step: 14900 Progress: 7.4% Elapsed: 2 days, 0:33:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.757226 Generator_loss: 0.630917 [INFO] 2021-06-24 07:06:55 > Step: 15000 Progress: 7.5% Elapsed: 2 days, 0:52:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.765069 Generator_loss: 0.684482 [INFO] 2021-06-24 07:26:14 > Step: 15100 Progress: 7.5% Elapsed: 2 days, 1:12:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.783061 Generator_loss: 0.654415 [INFO] 2021-06-24 07:45:28 > Step: 15200 Progress: 7.6% Elapsed: 2 days, 1:31:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.776139 Generator_loss: 0.65338 [INFO] 2021-06-24 08:04:44 > Step: 15300 Progress: 7.6% Elapsed: 2 days, 1:50:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.751041 Generator_loss: 0.665128 [INFO] 2021-06-24 08:24:02 > Step: 15400 Progress: 7.7% Elapsed: 2 days, 2:10:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.768736 Generator_loss: 0.617468 [INFO] 2021-06-24 08:43:15 > Step: 15500 Progress: 7.8% Elapsed: 2 days, 2:29:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.811342 Generator_loss: 0.653235 [INFO] 2021-06-24 09:02:30 > Step: 15600 Progress: 7.8% Elapsed: 2 days, 2:48:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.76153 Generator_loss: 0.624295 [INFO] 2021-06-24 09:21:50 > Step: 15700 Progress: 7.8% Elapsed: 2 days, 3:07:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.935783 Generator_loss: 0.808883 [INFO] 2021-06-24 09:41:03 > Step: 15800 Progress: 7.9% Elapsed: 2 days, 3:27:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.749705 Generator_loss: 0.695512 [INFO] 2021-06-24 10:00:19 > Step: 15900 Progress: 8.0% Elapsed: 2 days, 3:46:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.797152 Generator_loss: 0.652662 [INFO] 2021-06-24 10:19:38 > Step: 16000 Progress: 8.0% Elapsed: 2 days, 4:05:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.762137 Generator_loss: 0.671358 [INFO] 2021-06-24 10:19:38 > Start Evaluation (16000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-24 10:19:38 > Calculating FID Score.... [INFO] 2021-06-24 10:20:43 > Calculating Inception Score.... [INFO] 2021-06-24 10:21:38 > Calculate F_beta Score.... [INFO] 2021-06-24 10:24:07 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-24 10:24:08 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-24 10:24:11 > Calculate Accuracies.... [INFO] 2021-06-24 10:25:01 > Calculate Accuracies.... [INFO] 2021-06-24 10:25:52 > F_8 score (Step: 16000, Using valid images): 0.7451392246810061 [INFO] 2021-06-24 10:25:52 > F_1/8 score (Step: 16000, Using valid images): 0.8698992025029699 [INFO] 2021-06-24 10:25:52 > FID score (Step: 16000, Using valid moments): 45.386629525038984 [INFO] 2021-06-24 10:25:52 > Inception score (Step: 16000, 50000 generated images): 18.802148818969727 [INFO] 2021-06-24 10:25:52 > Best FID score (Step: 16000, Using valid moments): 45.386629525038984 [INFO] 2021-06-24 10:26:07 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-24 10:45:22 > Step: 16100 Progress: 8.1% Elapsed: 2 days, 4:31:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.758449 Generator_loss: 0.695861 [INFO] 2021-06-24 11:04:38 > Step: 16200 Progress: 8.1% Elapsed: 2 days, 4:50:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.72192 Generator_loss: 0.679763 [INFO] 2021-06-24 11:23:59 > Step: 16300 Progress: 8.2% Elapsed: 2 days, 5:10:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.755644 Generator_loss: 0.653652 [INFO] 2021-06-24 11:43:13 > Step: 16400 Progress: 8.2% Elapsed: 2 days, 5:29:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.759238 Generator_loss: 0.632512 [INFO] 2021-06-24 12:02:27 > Step: 16500 Progress: 8.2% Elapsed: 2 days, 5:48:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.702089 Generator_loss: 0.663164 [INFO] 2021-06-24 12:21:44 > Step: 16600 Progress: 8.3% Elapsed: 2 days, 6:07:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.763346 Generator_loss: 0.650365 [INFO] 2021-06-24 12:40:59 > Step: 16700 Progress: 8.3% Elapsed: 2 days, 6:27:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.75417 Generator_loss: 0.693018 [INFO] 2021-06-24 13:00:13 > Step: 16800 Progress: 8.4% Elapsed: 2 days, 6:46:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.749322 Generator_loss: 0.66221 [INFO] 2021-06-24 13:19:36 > Step: 16900 Progress: 8.5% Elapsed: 2 days, 7:05:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.797702 Generator_loss: 0.690279 [INFO] 2021-06-24 13:38:54 > Step: 17000 Progress: 8.5% Elapsed: 2 days, 7:24:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.742382 Generator_loss: 0.675833 [INFO] 2021-06-24 13:58:10 > Step: 17100 Progress: 8.6% Elapsed: 2 days, 7:44:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.795696 Generator_loss: 0.637243 [INFO] 2021-06-24 14:17:27 > Step: 17200 Progress: 8.6% Elapsed: 2 days, 8:03:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.776063 Generator_loss: 0.663541 [INFO] 2021-06-24 14:36:48 > Step: 17300 Progress: 8.6% Elapsed: 2 days, 8:22:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.760779 Generator_loss: 0.657331 [INFO] 2021-06-24 14:56:04 > Step: 17400 Progress: 8.7% Elapsed: 2 days, 8:42:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.763646 Generator_loss: 0.714517 [INFO] 2021-06-24 15:15:19 > Step: 17500 Progress: 8.8% Elapsed: 2 days, 9:01:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.766227 Generator_loss: 0.655734 [INFO] 2021-06-24 15:34:41 > Step: 17600 Progress: 8.8% Elapsed: 2 days, 9:20:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.752408 Generator_loss: 0.693474 [INFO] 2021-06-24 15:54:00 > Step: 17700 Progress: 8.8% Elapsed: 2 days, 9:40:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.74649 Generator_loss: 0.692857 [INFO] 2021-06-24 16:13:15 > Step: 17800 Progress: 8.9% Elapsed: 2 days, 9:59:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.764185 Generator_loss: 0.658766 [INFO] 2021-06-24 16:32:38 > Step: 17900 Progress: 8.9% Elapsed: 2 days, 10:18:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.742316 Generator_loss: 0.708432 [INFO] 2021-06-24 16:51:55 > Step: 18000 Progress: 9.0% Elapsed: 2 days, 10:37:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.685875 Generator_loss: 0.675752 [INFO] 2021-06-24 16:51:55 > Start Evaluation (18000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-24 16:51:55 > Calculating FID Score.... [INFO] 2021-06-24 16:53:01 > Calculating Inception Score.... [INFO] 2021-06-24 16:53:56 > Calculate F_beta Score.... [INFO] 2021-06-24 16:56:52 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-24 16:56:52 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-24 16:56:54 > Calculate Accuracies.... [INFO] 2021-06-24 16:57:43 > Calculate Accuracies.... [INFO] 2021-06-24 16:58:34 > F_8 score (Step: 18000, Using valid images): 0.7528115503333725 [INFO] 2021-06-24 16:58:34 > F_1/8 score (Step: 18000, Using valid images): 0.9003750849319315 [INFO] 2021-06-24 16:58:34 > FID score (Step: 18000, Using valid moments): 41.672136337174265 [INFO] 2021-06-24 16:58:34 > Inception score (Step: 18000, 50000 generated images): 20.086835861206055 [INFO] 2021-06-24 16:58:34 > Best FID score (Step: 18000, Using valid moments): 41.672136337174265 [INFO] 2021-06-24 16:58:49 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-24 17:18:06 > Step: 18100 Progress: 9.0% Elapsed: 2 days, 11:04:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.76061 Generator_loss: 0.663001 [INFO] 2021-06-24 17:37:28 > Step: 18200 Progress: 9.1% Elapsed: 2 days, 11:23:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.715097 Generator_loss: 0.672222 [INFO] 2021-06-24 17:56:40 > Step: 18300 Progress: 9.2% Elapsed: 2 days, 11:42:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.721765 Generator_loss: 0.681428 [INFO] 2021-06-24 18:15:51 > Step: 18400 Progress: 9.2% Elapsed: 2 days, 12:01:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.805874 Generator_loss: 0.66924 [INFO] 2021-06-24 18:35:07 > Step: 18500 Progress: 9.2% Elapsed: 2 days, 12:21:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.730861 Generator_loss: 0.67903 [INFO] 2021-06-24 18:54:23 > Step: 18600 Progress: 9.3% Elapsed: 2 days, 12:40:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.758289 Generator_loss: 0.67232 [INFO] 2021-06-24 19:13:38 > Step: 18700 Progress: 9.3% Elapsed: 2 days, 12:59:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.811326 Generator_loss: 0.64391 [INFO] 2021-06-24 19:33:01 > Step: 18800 Progress: 9.4% Elapsed: 2 days, 13:19:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.732498 Generator_loss: 0.642659 [INFO] 2021-06-24 19:52:18 > Step: 18900 Progress: 9.4% Elapsed: 2 days, 13:38:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.72486 Generator_loss: 0.662129 [INFO] 2021-06-24 20:11:35 > Step: 19000 Progress: 9.5% Elapsed: 2 days, 13:57:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.746799 Generator_loss: 0.693551 [INFO] 2021-06-24 20:30:56 > Step: 19100 Progress: 9.6% Elapsed: 2 days, 14:17:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.761487 Generator_loss: 0.681523 [INFO] 2021-06-24 20:50:14 > Step: 19200 Progress: 9.6% Elapsed: 2 days, 14:36:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.744733 Generator_loss: 0.693997 [INFO] 2021-06-24 21:09:31 > Step: 19300 Progress: 9.7% Elapsed: 2 days, 14:55:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.715761 Generator_loss: 0.691572 [INFO] 2021-06-24 21:28:53 > Step: 19400 Progress: 9.7% Elapsed: 2 days, 15:14:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.712379 Generator_loss: 0.701621 [INFO] 2021-06-24 21:48:08 > Step: 19500 Progress: 9.8% Elapsed: 2 days, 15:34:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.712187 Generator_loss: 0.676938 [INFO] 2021-06-24 22:07:26 > Step: 19600 Progress: 9.8% Elapsed: 2 days, 15:53:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.714096 Generator_loss: 0.66676 [INFO] 2021-06-24 22:26:41 > Step: 19700 Progress: 9.8% Elapsed: 2 days, 16:12:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.763815 Generator_loss: 0.677968 [INFO] 2021-06-24 22:46:03 > Step: 19800 Progress: 9.9% Elapsed: 2 days, 16:32:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.790222 Generator_loss: 0.616616 [INFO] 2021-06-24 23:05:20 > Step: 19900 Progress: 10.0% Elapsed: 2 days, 16:51:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.769789 Generator_loss: 0.679893 [INFO] 2021-06-24 23:24:36 > Step: 20000 Progress: 10.0% Elapsed: 2 days, 17:10:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.687496 Generator_loss: 0.731455 [INFO] 2021-06-24 23:24:36 > Start Evaluation (20000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-24 23:24:36 > Calculating FID Score.... [INFO] 2021-06-24 23:25:42 > Calculating Inception Score.... [INFO] 2021-06-24 23:26:37 > Calculate F_beta Score.... [INFO] 2021-06-24 23:29:35 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-24 23:29:35 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-24 23:29:38 > Calculate Accuracies.... [INFO] 2021-06-24 23:30:26 > Calculate Accuracies.... [INFO] 2021-06-24 23:31:16 > F_8 score (Step: 20000, Using valid images): 0.7491654635620241 [INFO] 2021-06-24 23:31:16 > F_1/8 score (Step: 20000, Using valid images): 0.9049492778889824 [INFO] 2021-06-24 23:31:16 > FID score (Step: 20000, Using valid moments): 40.54753243012698 [INFO] 2021-06-24 23:31:16 > Inception score (Step: 20000, 50000 generated images): 21.37925148010254 [INFO] 2021-06-24 23:31:16 > Best FID score (Step: 20000, Using valid moments): 40.54753243012698 [INFO] 2021-06-24 23:31:31 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-24 23:50:55 > Step: 20100 Progress: 10.1% Elapsed: 2 days, 17:36:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.705733 Generator_loss: 0.703628 [INFO] 2021-06-25 00:10:10 > Step: 20200 Progress: 10.1% Elapsed: 2 days, 17:56:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.710876 Generator_loss: 0.688486 [INFO] 2021-06-25 00:29:23 > Step: 20300 Progress: 10.2% Elapsed: 2 days, 18:15:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.706966 Generator_loss: 0.719538 [INFO] 2021-06-25 00:48:44 > Step: 20400 Progress: 10.2% Elapsed: 2 days, 18:34:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.742419 Generator_loss: 0.685316 [INFO] 2021-06-25 01:08:00 > Step: 20500 Progress: 10.2% Elapsed: 2 days, 18:54:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.714781 Generator_loss: 0.660995 [INFO] 2021-06-25 01:27:14 > Step: 20600 Progress: 10.3% Elapsed: 2 days, 19:13:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.73765 Generator_loss: 0.662098 [INFO] 2021-06-25 01:46:34 > Step: 20700 Progress: 10.3% Elapsed: 2 days, 19:32:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.722586 Generator_loss: 0.684604 [INFO] 2021-06-25 02:05:50 > Step: 20800 Progress: 10.4% Elapsed: 2 days, 19:51:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.730654 Generator_loss: 0.691033 [INFO] 2021-06-25 02:25:08 > Step: 20900 Progress: 10.4% Elapsed: 2 days, 20:11:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.736344 Generator_loss: 0.710477 [INFO] 2021-06-25 02:44:27 > Step: 21000 Progress: 10.5% Elapsed: 2 days, 20:30:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.707585 Generator_loss: 0.695855 [INFO] 2021-06-25 03:03:43 > Step: 21100 Progress: 10.5% Elapsed: 2 days, 20:49:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.733606 Generator_loss: 0.695568 [INFO] 2021-06-25 03:23:03 > Step: 21200 Progress: 10.6% Elapsed: 2 days, 21:09:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.716102 Generator_loss: 0.681333 [INFO] 2021-06-25 03:42:23 > Step: 21300 Progress: 10.7% Elapsed: 2 days, 21:28:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.750058 Generator_loss: 0.639807 [INFO] 2021-06-25 04:01:40 > Step: 21400 Progress: 10.7% Elapsed: 2 days, 21:47:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.706751 Generator_loss: 0.717266 [INFO] 2021-06-25 04:20:55 > Step: 21500 Progress: 10.8% Elapsed: 2 days, 22:06:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.694004 Generator_loss: 0.664539 [INFO] 2021-06-25 04:40:16 > Step: 21600 Progress: 10.8% Elapsed: 2 days, 22:26:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.693917 Generator_loss: 0.685482 [INFO] 2021-06-25 04:59:34 > Step: 21700 Progress: 10.8% Elapsed: 2 days, 22:45:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.701081 Generator_loss: 0.702982 [INFO] 2021-06-25 05:18:50 > Step: 21800 Progress: 10.9% Elapsed: 2 days, 23:04:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.728865 Generator_loss: 0.701675 [INFO] 2021-06-25 05:38:11 > Step: 21900 Progress: 10.9% Elapsed: 2 days, 23:24:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.741138 Generator_loss: 0.676212 [INFO] 2021-06-25 05:57:27 > Step: 22000 Progress: 11.0% Elapsed: 2 days, 23:43:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.7646 Generator_loss: 0.648182 [INFO] 2021-06-25 05:57:27 > Start Evaluation (22000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-25 05:57:27 > Calculating FID Score.... [INFO] 2021-06-25 05:58:33 > Calculating Inception Score.... [INFO] 2021-06-25 05:59:28 > Calculate F_beta Score.... [INFO] 2021-06-25 06:02:21 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-25 06:02:21 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-25 06:02:23 > Calculate Accuracies.... [INFO] 2021-06-25 06:03:12 > Calculate Accuracies.... [INFO] 2021-06-25 06:04:03 > F_8 score (Step: 22000, Using valid images): 0.8035600667601869 [INFO] 2021-06-25 06:04:03 > F_1/8 score (Step: 22000, Using valid images): 0.9269556417027367 [INFO] 2021-06-25 06:04:03 > FID score (Step: 22000, Using valid moments): 36.36967888911772 [INFO] 2021-06-25 06:04:03 > Inception score (Step: 22000, 50000 generated images): 22.914445877075195 [INFO] 2021-06-25 06:04:03 > Best FID score (Step: 22000, Using valid moments): 36.36967888911772 [INFO] 2021-06-25 06:04:18 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-25 06:23:35 > Step: 22100 Progress: 11.1% Elapsed: 3 days, 0:09:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.778161 Generator_loss: 0.764118 [INFO] 2021-06-25 06:42:51 > Step: 22200 Progress: 11.1% Elapsed: 3 days, 0:28:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.701374 Generator_loss: 0.713191 [INFO] 2021-06-25 07:02:12 > Step: 22300 Progress: 11.2% Elapsed: 3 days, 0:48:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.721761 Generator_loss: 0.674568 [INFO] 2021-06-25 07:21:30 > Step: 22400 Progress: 11.2% Elapsed: 3 days, 1:07:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.720373 Generator_loss: 0.694707 [INFO] 2021-06-25 07:40:48 > Step: 22500 Progress: 11.2% Elapsed: 3 days, 1:26:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.714687 Generator_loss: 0.657995 [INFO] 2021-06-25 08:00:12 > Step: 22600 Progress: 11.3% Elapsed: 3 days, 1:46:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.704636 Generator_loss: 0.663247 [INFO] 2021-06-25 08:19:29 > Step: 22700 Progress: 11.3% Elapsed: 3 days, 2:05:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.712676 Generator_loss: 0.681889 [INFO] 2021-06-25 08:38:44 > Step: 22800 Progress: 11.4% Elapsed: 3 days, 2:24:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.68836 Generator_loss: 0.743147 [INFO] 2021-06-25 08:58:06 > Step: 22900 Progress: 11.5% Elapsed: 3 days, 2:44:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.713216 Generator_loss: 0.692191 [INFO] 2021-06-25 09:17:24 > Step: 23000 Progress: 11.5% Elapsed: 3 days, 3:03:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.714579 Generator_loss: 0.676516 [INFO] 2021-06-25 09:36:41 > Step: 23100 Progress: 11.6% Elapsed: 3 days, 3:22:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.727108 Generator_loss: 0.710424 [INFO] 2021-06-25 09:56:03 > Step: 23200 Progress: 11.6% Elapsed: 3 days, 3:42:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.659712 Generator_loss: 0.676658 [INFO] 2021-06-25 10:15:21 > Step: 23300 Progress: 11.7% Elapsed: 3 days, 4:01:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.715732 Generator_loss: 0.708563 [INFO] 2021-06-25 10:34:38 > Step: 23400 Progress: 11.7% Elapsed: 3 days, 4:20:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.767793 Generator_loss: 0.661694 [INFO] 2021-06-25 10:53:59 > Step: 23500 Progress: 11.8% Elapsed: 3 days, 4:40:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.751238 Generator_loss: 0.7121 [INFO] 2021-06-25 11:13:15 > Step: 23600 Progress: 11.8% Elapsed: 3 days, 4:59:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.748648 Generator_loss: 0.69268 [INFO] 2021-06-25 11:32:30 > Step: 23700 Progress: 11.8% Elapsed: 3 days, 5:18:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.706807 Generator_loss: 0.66312 [INFO] 2021-06-25 11:51:52 > Step: 23800 Progress: 11.9% Elapsed: 3 days, 5:37:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.711435 Generator_loss: 0.717724 [INFO] 2021-06-25 12:11:08 > Step: 23900 Progress: 11.9% Elapsed: 3 days, 5:57:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.71081 Generator_loss: 0.699854 [INFO] 2021-06-25 12:30:23 > Step: 24000 Progress: 12.0% Elapsed: 3 days, 6:16:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.703758 Generator_loss: 0.660751 [INFO] 2021-06-25 12:30:23 > Start Evaluation (24000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-25 12:30:23 > Calculating FID Score.... [INFO] 2021-06-25 12:31:29 > Calculating Inception Score.... [INFO] 2021-06-25 12:32:24 > Calculate F_beta Score.... [INFO] 2021-06-25 12:35:18 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-25 12:35:19 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-25 12:35:21 > Calculate Accuracies.... [INFO] 2021-06-25 12:36:10 > Calculate Accuracies.... [INFO] 2021-06-25 12:37:00 > F_8 score (Step: 24000, Using valid images): 0.8255481440641829 [INFO] 2021-06-25 12:37:00 > F_1/8 score (Step: 24000, Using valid images): 0.9304572059561871 [INFO] 2021-06-25 12:37:00 > FID score (Step: 24000, Using valid moments): 32.66157771402794 [INFO] 2021-06-25 12:37:00 > Inception score (Step: 24000, 50000 generated images): 24.546585083007812 [INFO] 2021-06-25 12:37:00 > Best FID score (Step: 24000, Using valid moments): 32.66157771402794 [INFO] 2021-06-25 12:37:15 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-25 12:56:36 > Step: 24100 Progress: 12.0% Elapsed: 3 days, 6:42:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.746285 Generator_loss: 0.656056 [INFO] 2021-06-25 13:15:51 > Step: 24200 Progress: 12.1% Elapsed: 3 days, 7:01:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.751249 Generator_loss: 0.656563 [INFO] 2021-06-25 13:35:05 > Step: 24300 Progress: 12.2% Elapsed: 3 days, 7:21:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.701661 Generator_loss: 0.701161 [INFO] 2021-06-25 13:54:23 > Step: 24400 Progress: 12.2% Elapsed: 3 days, 7:40:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.676592 Generator_loss: 0.701427 [INFO] 2021-06-25 14:13:39 > Step: 24500 Progress: 12.2% Elapsed: 3 days, 7:59:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.677041 Generator_loss: 0.678928 [INFO] 2021-06-25 14:32:53 > Step: 24600 Progress: 12.3% Elapsed: 3 days, 8:18:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.720946 Generator_loss: 0.690674 [INFO] 2021-06-25 14:52:08 > Step: 24700 Progress: 12.3% Elapsed: 3 days, 8:38:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.702754 Generator_loss: 0.70192 [INFO] 2021-06-25 15:11:30 > Step: 24800 Progress: 12.4% Elapsed: 3 days, 8:57:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.760897 Generator_loss: 0.677482 [INFO] 2021-06-25 15:30:42 > Step: 24900 Progress: 12.4% Elapsed: 3 days, 9:16:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.686661 Generator_loss: 0.679145 [INFO] 2021-06-25 15:49:56 > Step: 25000 Progress: 12.5% Elapsed: 3 days, 9:36:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.710348 Generator_loss: 0.658816 [INFO] 2021-06-25 16:09:15 > Step: 25100 Progress: 12.6% Elapsed: 3 days, 9:55:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.693839 Generator_loss: 0.678806 [INFO] 2021-06-25 16:28:30 > Step: 25200 Progress: 12.6% Elapsed: 3 days, 10:14:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.715793 Generator_loss: 0.718683 [INFO] 2021-06-25 16:47:45 > Step: 25300 Progress: 12.7% Elapsed: 3 days, 10:33:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.75774 Generator_loss: 0.617406 [INFO] 2021-06-25 17:07:06 > Step: 25400 Progress: 12.7% Elapsed: 3 days, 10:53:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.77263 Generator_loss: 0.674483 [INFO] 2021-06-25 17:26:20 > Step: 25500 Progress: 12.8% Elapsed: 3 days, 11:12:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.678056 Generator_loss: 0.719154 [INFO] 2021-06-25 17:45:34 > Step: 25600 Progress: 12.8% Elapsed: 3 days, 11:31:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.695835 Generator_loss: 0.699651 [INFO] 2021-06-25 18:04:52 > Step: 25700 Progress: 12.8% Elapsed: 3 days, 11:50:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.699165 Generator_loss: 0.71606 [INFO] 2021-06-25 18:24:09 > Step: 25800 Progress: 12.9% Elapsed: 3 days, 12:10:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.702609 Generator_loss: 0.680358 [INFO] 2021-06-25 18:43:24 > Step: 25900 Progress: 13.0% Elapsed: 3 days, 12:29:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.686203 Generator_loss: 0.670307 [INFO] 2021-06-25 19:02:43 > Step: 26000 Progress: 13.0% Elapsed: 3 days, 12:48:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.726127 Generator_loss: 0.720166 [INFO] 2021-06-25 19:02:43 > Start Evaluation (26000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-25 19:02:43 > Calculating FID Score.... [INFO] 2021-06-25 19:03:49 > Calculating Inception Score.... [INFO] 2021-06-25 19:04:44 > Calculate F_beta Score.... [INFO] 2021-06-25 19:07:13 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-25 19:07:14 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-25 19:07:17 > Calculate Accuracies.... [INFO] 2021-06-25 19:08:07 > Calculate Accuracies.... [INFO] 2021-06-25 19:08:57 > F_8 score (Step: 26000, Using valid images): 0.8394296881928053 [INFO] 2021-06-25 19:08:57 > F_1/8 score (Step: 26000, Using valid images): 0.9361982089128111 [INFO] 2021-06-25 19:08:57 > FID score (Step: 26000, Using valid moments): 29.46212590492064 [INFO] 2021-06-25 19:08:57 > Inception score (Step: 26000, 50000 generated images): 26.340229034423828 [INFO] 2021-06-25 19:08:57 > Best FID score (Step: 26000, Using valid moments): 29.46212590492064 [INFO] 2021-06-25 19:09:11 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-25 19:28:28 > Step: 26100 Progress: 13.1% Elapsed: 3 days, 13:14:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.695186 Generator_loss: 0.659877 [INFO] 2021-06-25 19:47:43 > Step: 26200 Progress: 13.1% Elapsed: 3 days, 13:33:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.692671 Generator_loss: 0.707338 [INFO] 2021-06-25 20:07:02 > Step: 26300 Progress: 13.2% Elapsed: 3 days, 13:53:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.693359 Generator_loss: 0.701056 [INFO] 2021-06-25 20:26:18 > Step: 26400 Progress: 13.2% Elapsed: 3 days, 14:12:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.712029 Generator_loss: 0.660479 [INFO] 2021-06-25 20:45:33 > Step: 26500 Progress: 13.2% Elapsed: 3 days, 14:31:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.677752 Generator_loss: 0.716996 [INFO] 2021-06-25 21:04:53 > Step: 26600 Progress: 13.3% Elapsed: 3 days, 14:50:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.691396 Generator_loss: 0.701109 [INFO] 2021-06-25 21:24:10 > Step: 26700 Progress: 13.4% Elapsed: 3 days, 15:10:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.692667 Generator_loss: 0.691921 [INFO] 2021-06-25 21:43:25 > Step: 26800 Progress: 13.4% Elapsed: 3 days, 15:29:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.679424 Generator_loss: 0.699027 [INFO] 2021-06-25 22:02:50 > Step: 26900 Progress: 13.5% Elapsed: 3 days, 15:48:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.667193 Generator_loss: 0.70237 [INFO] 2021-06-25 22:22:06 > Step: 27000 Progress: 13.5% Elapsed: 3 days, 16:08:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.651875 Generator_loss: 0.684965 [INFO] 2021-06-25 22:41:20 > Step: 27100 Progress: 13.6% Elapsed: 3 days, 16:27:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.691535 Generator_loss: 0.707313 [INFO] 2021-06-25 23:00:36 > Step: 27200 Progress: 13.6% Elapsed: 3 days, 16:46:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.741992 Generator_loss: 0.686174 [INFO] 2021-06-25 23:19:58 > Step: 27300 Progress: 13.7% Elapsed: 3 days, 17:06:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.719706 Generator_loss: 0.703487 [INFO] 2021-06-25 23:39:13 > Step: 27400 Progress: 13.7% Elapsed: 3 days, 17:25:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.729667 Generator_loss: 0.67832 [INFO] 2021-06-25 23:58:29 > Step: 27500 Progress: 13.8% Elapsed: 3 days, 17:44:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.665915 Generator_loss: 0.699216 [INFO] 2021-06-26 00:17:51 > Step: 27600 Progress: 13.8% Elapsed: 3 days, 18:03:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.712965 Generator_loss: 0.705225 [INFO] 2021-06-26 00:37:08 > Step: 27700 Progress: 13.9% Elapsed: 3 days, 18:23:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.691817 Generator_loss: 0.719997 [INFO] 2021-06-26 00:56:23 > Step: 27800 Progress: 13.9% Elapsed: 3 days, 18:42:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.696774 Generator_loss: 0.672752 [INFO] 2021-06-26 01:15:45 > Step: 27900 Progress: 14.0% Elapsed: 3 days, 19:01:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.670801 Generator_loss: 0.721446 [INFO] 2021-06-26 01:35:00 > Step: 28000 Progress: 14.0% Elapsed: 3 days, 19:21:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.709021 Generator_loss: 0.65753 [INFO] 2021-06-26 01:35:00 > Start Evaluation (28000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-26 01:35:00 > Calculating FID Score.... [INFO] 2021-06-26 01:36:05 > Calculating Inception Score.... [INFO] 2021-06-26 01:37:00 > Calculate F_beta Score.... [INFO] 2021-06-26 01:39:41 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-26 01:39:41 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-26 01:39:44 > Calculate Accuracies.... [INFO] 2021-06-26 01:40:34 > Calculate Accuracies.... [INFO] 2021-06-26 01:41:26 > F_8 score (Step: 28000, Using valid images): 0.857265338471877 [INFO] 2021-06-26 01:41:26 > F_1/8 score (Step: 28000, Using valid images): 0.948669465203302 [INFO] 2021-06-26 01:41:26 > FID score (Step: 28000, Using valid moments): 27.147594620727375 [INFO] 2021-06-26 01:41:26 > Inception score (Step: 28000, 50000 generated images): 28.262174606323242 [INFO] 2021-06-26 01:41:26 > Best FID score (Step: 28000, Using valid moments): 27.147594620727375 [INFO] 2021-06-26 01:41:40 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-26 02:00:55 > Step: 28100 Progress: 14.1% Elapsed: 3 days, 19:46:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.634525 Generator_loss: 0.709759 [INFO] 2021-06-26 02:20:13 > Step: 28200 Progress: 14.1% Elapsed: 3 days, 20:06:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.674455 Generator_loss: 0.729073 [INFO] 2021-06-26 02:39:30 > Step: 28300 Progress: 14.1% Elapsed: 3 days, 20:25:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.70972 Generator_loss: 0.685085 [INFO] 2021-06-26 02:58:45 > Step: 28400 Progress: 14.2% Elapsed: 3 days, 20:44:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.694013 Generator_loss: 0.682103 [INFO] 2021-06-26 03:18:07 > Step: 28500 Progress: 14.2% Elapsed: 3 days, 21:04:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.686738 Generator_loss: 0.679427 [INFO] 2021-06-26 03:37:23 > Step: 28600 Progress: 14.3% Elapsed: 3 days, 21:23:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.703674 Generator_loss: 0.710478 [INFO] 2021-06-26 03:56:39 > Step: 28700 Progress: 14.3% Elapsed: 3 days, 21:42:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.749652 Generator_loss: 0.760367 [INFO] 2021-06-26 04:16:01 > Step: 28800 Progress: 14.4% Elapsed: 3 days, 22:02:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.71899 Generator_loss: 0.675279 [INFO] 2021-06-26 04:35:17 > Step: 28900 Progress: 14.4% Elapsed: 3 days, 22:21:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.708432 Generator_loss: 0.652732 [INFO] 2021-06-26 04:54:34 > Step: 29000 Progress: 14.5% Elapsed: 3 days, 22:40:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.715127 Generator_loss: 0.724815 [INFO] 2021-06-26 05:13:55 > Step: 29100 Progress: 14.5% Elapsed: 3 days, 23:00:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.685234 Generator_loss: 0.713544 [INFO] 2021-06-26 05:33:10 > Step: 29200 Progress: 14.6% Elapsed: 3 days, 23:19:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.749326 Generator_loss: 0.672453 [INFO] 2021-06-26 05:52:29 > Step: 29300 Progress: 14.6% Elapsed: 3 days, 23:38:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.701998 Generator_loss: 0.719702 [INFO] 2021-06-26 06:11:48 > Step: 29400 Progress: 14.7% Elapsed: 3 days, 23:57:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.722475 Generator_loss: 0.684493 [INFO] 2021-06-26 06:31:02 > Step: 29500 Progress: 14.8% Elapsed: 4 days, 0:17:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.765794 Generator_loss: 0.727218 [INFO] 2021-06-26 06:50:17 > Step: 29600 Progress: 14.8% Elapsed: 4 days, 0:36:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.70055 Generator_loss: 0.696127 [INFO] 2021-06-26 07:09:33 > Step: 29700 Progress: 14.8% Elapsed: 4 days, 0:55:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.703281 Generator_loss: 0.728962 [INFO] 2021-06-26 07:28:55 > Step: 29800 Progress: 14.9% Elapsed: 4 days, 1:15:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.668101 Generator_loss: 0.729878 [INFO] 2021-06-26 07:48:12 > Step: 29900 Progress: 14.9% Elapsed: 4 days, 1:34:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.661919 Generator_loss: 0.697139 [INFO] 2021-06-26 08:07:32 > Step: 30000 Progress: 15.0% Elapsed: 4 days, 1:53:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.676237 Generator_loss: 0.722697 [INFO] 2021-06-26 08:07:32 > Start Evaluation (30000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-26 08:07:32 > Calculating FID Score.... [INFO] 2021-06-26 08:08:37 > Calculating Inception Score.... [INFO] 2021-06-26 08:09:31 > Calculate F_beta Score.... [INFO] 2021-06-26 08:12:04 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-26 08:12:04 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-26 08:12:07 > Calculate Accuracies.... [INFO] 2021-06-26 08:12:57 > Calculate Accuracies.... [INFO] 2021-06-26 08:13:47 > F_8 score (Step: 30000, Using valid images): 0.8821710409513227 [INFO] 2021-06-26 08:13:47 > F_1/8 score (Step: 30000, Using valid images): 0.9484209095504411 [INFO] 2021-06-26 08:13:47 > FID score (Step: 30000, Using valid moments): 25.079734577242675 [INFO] 2021-06-26 08:13:47 > Inception score (Step: 30000, 50000 generated images): 29.259052276611328 [INFO] 2021-06-26 08:13:47 > Best FID score (Step: 30000, Using valid moments): 25.079734577242675 [INFO] 2021-06-26 08:14:02 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-26 08:33:24 > Step: 30100 Progress: 15.0% Elapsed: 4 days, 2:19:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.691025 Generator_loss: 0.704976 [INFO] 2021-06-26 08:52:37 > Step: 30200 Progress: 15.1% Elapsed: 4 days, 2:38:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.71321 Generator_loss: 0.668888 [INFO] 2021-06-26 09:11:51 > Step: 30300 Progress: 15.2% Elapsed: 4 days, 2:57:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.706854 Generator_loss: 0.70577 [INFO] 2021-06-26 09:31:11 > Step: 30400 Progress: 15.2% Elapsed: 4 days, 3:17:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.671379 Generator_loss: 0.700688 [INFO] 2021-06-26 09:50:24 > Step: 30500 Progress: 15.2% Elapsed: 4 days, 3:36:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.68967 Generator_loss: 0.74787 [INFO] 2021-06-26 10:09:37 > Step: 30600 Progress: 15.3% Elapsed: 4 days, 3:55:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.690965 Generator_loss: 0.730027 [INFO] 2021-06-26 10:28:58 > Step: 30700 Progress: 15.3% Elapsed: 4 days, 4:15:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.655526 Generator_loss: 0.710322 [INFO] 2021-06-26 10:48:16 > Step: 30800 Progress: 15.4% Elapsed: 4 days, 4:34:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.665412 Generator_loss: 0.69087 [INFO] 2021-06-26 11:07:31 > Step: 30900 Progress: 15.4% Elapsed: 4 days, 4:53:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.667805 Generator_loss: 0.74918 [INFO] 2021-06-26 11:26:50 > Step: 31000 Progress: 15.5% Elapsed: 4 days, 5:12:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.699913 Generator_loss: 0.726704 [INFO] 2021-06-26 11:46:06 > Step: 31100 Progress: 15.6% Elapsed: 4 days, 5:32:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.661745 Generator_loss: 0.923903 [INFO] 2021-06-26 12:05:19 > Step: 31200 Progress: 15.6% Elapsed: 4 days, 5:51:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.713141 Generator_loss: 0.682812 [INFO] 2021-06-26 12:24:37 > Step: 31300 Progress: 15.7% Elapsed: 4 days, 6:10:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.683671 Generator_loss: 0.776723 [INFO] 2021-06-26 12:43:53 > Step: 31400 Progress: 15.7% Elapsed: 4 days, 6:29:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.691819 Generator_loss: 0.678732 [INFO] 2021-06-26 13:03:11 > Step: 31500 Progress: 15.8% Elapsed: 4 days, 6:49:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.724585 Generator_loss: 0.69864 [INFO] 2021-06-26 13:22:32 > Step: 31600 Progress: 15.8% Elapsed: 4 days, 7:08:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.659419 Generator_loss: 0.750821 [INFO] 2021-06-26 13:41:49 > Step: 31700 Progress: 15.8% Elapsed: 4 days, 7:27:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.694256 Generator_loss: 0.702088 [INFO] 2021-06-26 14:01:04 > Step: 31800 Progress: 15.9% Elapsed: 4 days, 7:47:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.678491 Generator_loss: 0.700346 [INFO] 2021-06-26 14:20:16 > Step: 31900 Progress: 16.0% Elapsed: 4 days, 8:06:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.667729 Generator_loss: 0.703833 [INFO] 2021-06-26 14:39:34 > Step: 32000 Progress: 16.0% Elapsed: 4 days, 8:25:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.693683 Generator_loss: 0.681893 [INFO] 2021-06-26 14:39:34 > Start Evaluation (32000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-26 14:39:34 > Calculating FID Score.... [INFO] 2021-06-26 14:40:40 > Calculating Inception Score.... [INFO] 2021-06-26 14:41:34 > Calculate F_beta Score.... [INFO] 2021-06-26 14:44:03 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-26 14:44:03 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-26 14:44:07 > Calculate Accuracies.... [INFO] 2021-06-26 14:44:57 > Calculate Accuracies.... [INFO] 2021-06-26 14:45:48 > F_8 score (Step: 32000, Using valid images): 0.9023691833909194 [INFO] 2021-06-26 14:45:48 > F_1/8 score (Step: 32000, Using valid images): 0.9510082736829271 [INFO] 2021-06-26 14:45:48 > FID score (Step: 32000, Using valid moments): 23.582230090633857 [INFO] 2021-06-26 14:45:48 > Inception score (Step: 32000, 50000 generated images): 30.717185974121094 [INFO] 2021-06-26 14:45:48 > Best FID score (Step: 32000, Using valid moments): 23.582230090633857 [INFO] 2021-06-26 14:46:03 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-26 15:05:19 > Step: 32100 Progress: 16.1% Elapsed: 4 days, 8:51:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.638 Generator_loss: 0.715455 [INFO] 2021-06-26 15:24:34 > Step: 32200 Progress: 16.1% Elapsed: 4 days, 9:10:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.656988 Generator_loss: 0.720036 [INFO] 2021-06-26 15:43:53 > Step: 32300 Progress: 16.2% Elapsed: 4 days, 9:29:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.685929 Generator_loss: 0.720723 [INFO] 2021-06-26 16:03:07 > Step: 32400 Progress: 16.2% Elapsed: 4 days, 9:49:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.715109 Generator_loss: 0.675859 [INFO] 2021-06-26 16:22:19 > Step: 32500 Progress: 16.2% Elapsed: 4 days, 10:08:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.686757 Generator_loss: 0.726864 [INFO] 2021-06-26 16:41:41 > Step: 32600 Progress: 16.3% Elapsed: 4 days, 10:27:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.637055 Generator_loss: 0.725049 [INFO] 2021-06-26 17:00:57 > Step: 32700 Progress: 16.4% Elapsed: 4 days, 10:47:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.693685 Generator_loss: 0.681587 [INFO] 2021-06-26 17:20:17 > Step: 32800 Progress: 16.4% Elapsed: 4 days, 11:06:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.666317 Generator_loss: 0.68395 [INFO] 2021-06-26 17:39:37 > Step: 32900 Progress: 16.4% Elapsed: 4 days, 11:25:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.689458 Generator_loss: 0.68692 [INFO] 2021-06-26 17:58:54 > Step: 33000 Progress: 16.5% Elapsed: 4 days, 11:44:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.685377 Generator_loss: 0.737 [INFO] 2021-06-26 18:18:09 > Step: 33100 Progress: 16.6% Elapsed: 4 days, 12:04:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.675869 Generator_loss: 0.679937 [INFO] 2021-06-26 18:37:34 > Step: 33200 Progress: 16.6% Elapsed: 4 days, 12:23:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.744977 Generator_loss: 0.681878 [INFO] 2021-06-26 18:56:51 > Step: 33300 Progress: 16.7% Elapsed: 4 days, 12:42:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.669758 Generator_loss: 0.752196 [INFO] 2021-06-26 19:16:06 > Step: 33400 Progress: 16.7% Elapsed: 4 days, 13:02:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.677411 Generator_loss: 0.720371 [INFO] 2021-06-26 19:35:29 > Step: 33500 Progress: 16.8% Elapsed: 4 days, 13:21:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.688701 Generator_loss: 0.69426 [INFO] 2021-06-26 19:54:45 > Step: 33600 Progress: 16.8% Elapsed: 4 days, 13:40:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.66962 Generator_loss: 0.678074 [INFO] 2021-06-26 20:14:02 > Step: 33700 Progress: 16.9% Elapsed: 4 days, 14:00:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.703478 Generator_loss: 0.704728 [INFO] 2021-06-26 20:33:22 > Step: 33800 Progress: 16.9% Elapsed: 4 days, 14:19:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.636471 Generator_loss: 0.719645 [INFO] 2021-06-26 20:52:39 > Step: 33900 Progress: 17.0% Elapsed: 4 days, 14:38:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.691657 Generator_loss: 0.695291 [INFO] 2021-06-26 21:11:54 > Step: 34000 Progress: 17.0% Elapsed: 4 days, 14:57:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.700371 Generator_loss: 0.684548 [INFO] 2021-06-26 21:11:54 > Start Evaluation (34000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-26 21:11:54 > Calculating FID Score.... [INFO] 2021-06-26 21:13:00 > Calculating Inception Score.... [INFO] 2021-06-26 21:13:54 > Calculate F_beta Score.... [INFO] 2021-06-26 21:16:33 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-26 21:16:34 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-26 21:16:36 > Calculate Accuracies.... [INFO] 2021-06-26 21:17:26 > Calculate Accuracies.... [INFO] 2021-06-26 21:18:17 > F_8 score (Step: 34000, Using valid images): 0.9071807502342543 [INFO] 2021-06-26 21:18:17 > F_1/8 score (Step: 34000, Using valid images): 0.9583862116190621 [INFO] 2021-06-26 21:18:17 > FID score (Step: 34000, Using valid moments): 22.612172810563493 [INFO] 2021-06-26 21:18:17 > Inception score (Step: 34000, 50000 generated images): 32.289249420166016 [INFO] 2021-06-26 21:18:17 > Best FID score (Step: 34000, Using valid moments): 22.612172810563493 [INFO] 2021-06-26 21:18:32 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-26 21:37:53 > Step: 34100 Progress: 17.1% Elapsed: 4 days, 15:23:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.699545 Generator_loss: 0.692355 [INFO] 2021-06-26 21:57:10 > Step: 34200 Progress: 17.1% Elapsed: 4 days, 15:43:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.664734 Generator_loss: 0.715444 [INFO] 2021-06-26 22:16:28 > Step: 34300 Progress: 17.2% Elapsed: 4 days, 16:02:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.668167 Generator_loss: 0.702605 [INFO] 2021-06-26 22:35:46 > Step: 34400 Progress: 17.2% Elapsed: 4 days, 16:21:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.646858 Generator_loss: 0.689873 [INFO] 2021-06-26 22:55:08 > Step: 34500 Progress: 17.2% Elapsed: 4 days, 16:41:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.640155 Generator_loss: 0.718827 [INFO] 2021-06-26 23:14:23 > Step: 34600 Progress: 17.3% Elapsed: 4 days, 17:00:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.680982 Generator_loss: 0.711389 [INFO] 2021-06-26 23:33:39 > Step: 34700 Progress: 17.3% Elapsed: 4 days, 17:19:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.640694 Generator_loss: 0.710969 [INFO] 2021-06-26 23:53:03 > Step: 34800 Progress: 17.4% Elapsed: 4 days, 17:39:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.619755 Generator_loss: 0.714735 [INFO] 2021-06-27 00:12:18 > Step: 34900 Progress: 17.4% Elapsed: 4 days, 17:58:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.622344 Generator_loss: 0.737519 [INFO] 2021-06-27 00:31:34 > Step: 35000 Progress: 17.5% Elapsed: 4 days, 18:17:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.701946 Generator_loss: 0.698334 [INFO] 2021-06-27 00:50:58 > Step: 35100 Progress: 17.5% Elapsed: 4 days, 18:37:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.728711 Generator_loss: 0.694765 [INFO] 2021-06-27 01:10:13 > Step: 35200 Progress: 17.6% Elapsed: 4 days, 18:56:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.646654 Generator_loss: 0.818139 [INFO] 2021-06-27 01:29:29 > Step: 35300 Progress: 17.6% Elapsed: 4 days, 19:15:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.645295 Generator_loss: 0.728546 [INFO] 2021-06-27 01:48:51 > Step: 35400 Progress: 17.7% Elapsed: 4 days, 19:34:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.661229 Generator_loss: 0.761593 [INFO] 2021-06-27 02:08:07 > Step: 35500 Progress: 17.8% Elapsed: 4 days, 19:54:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.662732 Generator_loss: 0.731543 [INFO] 2021-06-27 02:27:23 > Step: 35600 Progress: 17.8% Elapsed: 4 days, 20:13:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.620473 Generator_loss: 0.919232 [INFO] 2021-06-27 02:46:46 > Step: 35700 Progress: 17.8% Elapsed: 4 days, 20:32:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.646551 Generator_loss: 0.72302 [INFO] 2021-06-27 03:06:03 > Step: 35800 Progress: 17.9% Elapsed: 4 days, 20:52:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.649936 Generator_loss: 0.832882 [INFO] 2021-06-27 03:25:21 > Step: 35900 Progress: 17.9% Elapsed: 4 days, 21:11:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.648329 Generator_loss: 0.700539 [INFO] 2021-06-27 03:44:43 > Step: 36000 Progress: 18.0% Elapsed: 4 days, 21:30:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.662084 Generator_loss: 0.694169 [INFO] 2021-06-27 03:44:43 > Start Evaluation (36000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-27 03:44:43 > Calculating FID Score.... [INFO] 2021-06-27 03:45:49 > Calculating Inception Score.... [INFO] 2021-06-27 03:46:44 > Calculate F_beta Score.... [INFO] 2021-06-27 03:49:34 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-27 03:49:35 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-27 03:49:37 > Calculate Accuracies.... [INFO] 2021-06-27 03:50:28 > Calculate Accuracies.... [INFO] 2021-06-27 03:51:18 > F_8 score (Step: 36000, Using valid images): 0.914234098537487 [INFO] 2021-06-27 03:51:18 > F_1/8 score (Step: 36000, Using valid images): 0.9549215738393613 [INFO] 2021-06-27 03:51:18 > FID score (Step: 36000, Using valid moments): 21.554355765220635 [INFO] 2021-06-27 03:51:18 > Inception score (Step: 36000, 50000 generated images): 33.331722259521484 [INFO] 2021-06-27 03:51:18 > Best FID score (Step: 36000, Using valid moments): 21.554355765220635 [INFO] 2021-06-27 03:51:33 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-27 04:10:48 > Step: 36100 Progress: 18.1% Elapsed: 4 days, 21:56:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.675772 Generator_loss: 0.734447 [INFO] 2021-06-27 04:30:04 > Step: 36200 Progress: 18.1% Elapsed: 4 days, 22:16:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.655772 Generator_loss: 0.722679 [INFO] 2021-06-27 04:49:24 > Step: 36300 Progress: 18.1% Elapsed: 4 days, 22:35:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.72463 Generator_loss: 0.69028 [INFO] 2021-06-27 05:08:39 > Step: 36400 Progress: 18.2% Elapsed: 4 days, 22:54:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.684507 Generator_loss: 0.710513 [INFO] 2021-06-27 05:27:56 > Step: 36500 Progress: 18.2% Elapsed: 4 days, 23:14:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.646945 Generator_loss: 0.691136 [INFO] 2021-06-27 05:47:12 > Step: 36600 Progress: 18.3% Elapsed: 4 days, 23:33:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.659921 Generator_loss: 0.758549 [INFO] 2021-06-27 06:06:29 > Step: 36700 Progress: 18.4% Elapsed: 4 days, 23:52:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.72148 Generator_loss: 0.701441 [INFO] 2021-06-27 06:25:45 > Step: 36800 Progress: 18.4% Elapsed: 5 days, 0:11:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.652725 Generator_loss: 0.705042 [INFO] 2021-06-27 06:45:04 > Step: 36900 Progress: 18.4% Elapsed: 5 days, 0:31:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.661116 Generator_loss: 0.721864 [INFO] 2021-06-27 07:04:24 > Step: 37000 Progress: 18.5% Elapsed: 5 days, 0:50:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.633078 Generator_loss: 0.732172 [INFO] 2021-06-27 07:23:39 > Step: 37100 Progress: 18.6% Elapsed: 5 days, 1:09:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.607367 Generator_loss: 0.747321 [INFO] 2021-06-27 07:42:53 > Step: 37200 Progress: 18.6% Elapsed: 5 days, 1:28:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.816567 Generator_loss: 0.628561 [INFO] 2021-06-27 08:02:12 > Step: 37300 Progress: 18.6% Elapsed: 5 days, 1:48:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.654238 Generator_loss: 0.729424 [INFO] 2021-06-27 08:21:27 > Step: 37400 Progress: 18.7% Elapsed: 5 days, 2:07:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.632356 Generator_loss: 0.851907 [INFO] 2021-06-27 08:40:41 > Step: 37500 Progress: 18.8% Elapsed: 5 days, 2:26:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.645181 Generator_loss: 0.722186 [INFO] 2021-06-27 09:00:02 > Step: 37600 Progress: 18.8% Elapsed: 5 days, 2:46:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.628202 Generator_loss: 0.686247 [INFO] 2021-06-27 09:19:16 > Step: 37700 Progress: 18.9% Elapsed: 5 days, 3:05:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.654138 Generator_loss: 0.737656 [INFO] 2021-06-27 09:38:33 > Step: 37800 Progress: 18.9% Elapsed: 5 days, 3:24:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.67131 Generator_loss: 0.67843 [INFO] 2021-06-27 09:57:56 > Step: 37900 Progress: 18.9% Elapsed: 5 days, 3:44:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.615367 Generator_loss: 0.751242 [INFO] 2021-06-27 10:17:13 > Step: 38000 Progress: 19.0% Elapsed: 5 days, 4:03:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.619802 Generator_loss: 0.754116 [INFO] 2021-06-27 10:17:13 > Start Evaluation (38000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-27 10:17:13 > Calculating FID Score.... [INFO] 2021-06-27 10:18:18 > Calculating Inception Score.... [INFO] 2021-06-27 10:19:12 > Calculate F_beta Score.... [INFO] 2021-06-27 10:21:35 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-27 10:21:35 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-27 10:21:39 > Calculate Accuracies.... [INFO] 2021-06-27 10:22:28 > Calculate Accuracies.... [INFO] 2021-06-27 10:23:19 > F_8 score (Step: 38000, Using valid images): 0.9156367175029241 [INFO] 2021-06-27 10:23:19 > F_1/8 score (Step: 38000, Using valid images): 0.9603100289291814 [INFO] 2021-06-27 10:23:19 > FID score (Step: 38000, Using valid moments): 20.68072571150242 [INFO] 2021-06-27 10:23:19 > Inception score (Step: 38000, 50000 generated images): 34.3124885559082 [INFO] 2021-06-27 10:23:19 > Best FID score (Step: 38000, Using valid moments): 20.68072571150242 [INFO] 2021-06-27 10:23:33 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-27 10:42:50 > Step: 38100 Progress: 19.1% Elapsed: 5 days, 4:28:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.630357 Generator_loss: 0.709035 [INFO] 2021-06-27 11:02:12 > Step: 38200 Progress: 19.1% Elapsed: 5 days, 4:48:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.657284 Generator_loss: 0.699701 [INFO] 2021-06-27 11:21:27 > Step: 38300 Progress: 19.1% Elapsed: 5 days, 5:07:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.632245 Generator_loss: 0.752488 [INFO] 2021-06-27 11:40:43 > Step: 38400 Progress: 19.2% Elapsed: 5 days, 5:26:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.644228 Generator_loss: 0.725365 [INFO] 2021-06-27 12:00:04 > Step: 38500 Progress: 19.2% Elapsed: 5 days, 5:46:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.631228 Generator_loss: 0.717579 [INFO] 2021-06-27 12:19:20 > Step: 38600 Progress: 19.3% Elapsed: 5 days, 6:05:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.638035 Generator_loss: 0.722489 [INFO] 2021-06-27 12:38:35 > Step: 38700 Progress: 19.4% Elapsed: 5 days, 6:24:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.619281 Generator_loss: 0.771095 [INFO] 2021-06-27 12:57:56 > Step: 38800 Progress: 19.4% Elapsed: 5 days, 6:44:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.715369 Generator_loss: 0.647894 [INFO] 2021-06-27 13:17:10 > Step: 38900 Progress: 19.4% Elapsed: 5 days, 7:03:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.660373 Generator_loss: 0.728373 [INFO] 2021-06-27 13:36:24 > Step: 39000 Progress: 19.5% Elapsed: 5 days, 7:22:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.676513 Generator_loss: 0.724595 [INFO] 2021-06-27 13:55:43 > Step: 39100 Progress: 19.6% Elapsed: 5 days, 7:41:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.638457 Generator_loss: 0.714494 [INFO] 2021-06-27 14:15:00 > Step: 39200 Progress: 19.6% Elapsed: 5 days, 8:01:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.663275 Generator_loss: 0.693449 [INFO] 2021-06-27 14:34:15 > Step: 39300 Progress: 19.7% Elapsed: 5 days, 8:20:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.910087 Generator_loss: 0.57996 [INFO] 2021-06-27 14:53:29 > Step: 39400 Progress: 19.7% Elapsed: 5 days, 8:39:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.644315 Generator_loss: 0.736007 [INFO] 2021-06-27 15:12:51 > Step: 39500 Progress: 19.8% Elapsed: 5 days, 8:58:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.669796 Generator_loss: 0.667838 [INFO] 2021-06-27 15:32:06 > Step: 39600 Progress: 19.8% Elapsed: 5 days, 9:18:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.631836 Generator_loss: 0.703022 [INFO] 2021-06-27 15:51:21 > Step: 39700 Progress: 19.9% Elapsed: 5 days, 9:37:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.618959 Generator_loss: 0.913123 [INFO] 2021-06-27 16:10:43 > Step: 39800 Progress: 19.9% Elapsed: 5 days, 9:56:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.634594 Generator_loss: 0.75539 [INFO] 2021-06-27 16:30:00 > Step: 39900 Progress: 20.0% Elapsed: 5 days, 10:16:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.615808 Generator_loss: 0.759058 [INFO] 2021-06-27 16:49:14 > Step: 40000 Progress: 20.0% Elapsed: 5 days, 10:35:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.638768 Generator_loss: 0.711986 [INFO] 2021-06-27 16:49:14 > Start Evaluation (40000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-27 16:49:14 > Calculating FID Score.... [INFO] 2021-06-27 16:50:19 > Calculating Inception Score.... [INFO] 2021-06-27 16:51:13 > Calculate F_beta Score.... [INFO] 2021-06-27 16:53:49 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-27 16:53:50 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-27 16:53:53 > Calculate Accuracies.... [INFO] 2021-06-27 16:54:43 > Calculate Accuracies.... [INFO] 2021-06-27 16:55:35 > F_8 score (Step: 40000, Using valid images): 0.9307826745627417 [INFO] 2021-06-27 16:55:35 > F_1/8 score (Step: 40000, Using valid images): 0.9560256936539687 [INFO] 2021-06-27 16:55:35 > FID score (Step: 40000, Using valid moments): 20.159398873766804 [INFO] 2021-06-27 16:55:35 > Inception score (Step: 40000, 50000 generated images): 35.44784164428711 [INFO] 2021-06-27 16:55:35 > Best FID score (Step: 40000, Using valid moments): 20.159398873766804 [INFO] 2021-06-27 16:55:49 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-27 17:15:12 > Step: 40100 Progress: 20.1% Elapsed: 5 days, 11:01:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.633844 Generator_loss: 0.741633 [INFO] 2021-06-27 17:34:28 > Step: 40200 Progress: 20.1% Elapsed: 5 days, 11:20:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.62093 Generator_loss: 0.755433 [INFO] 2021-06-27 17:53:46 > Step: 40300 Progress: 20.2% Elapsed: 5 days, 11:39:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.644633 Generator_loss: 0.755881 [INFO] 2021-06-27 18:13:09 > Step: 40400 Progress: 20.2% Elapsed: 5 days, 11:59:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.605027 Generator_loss: 0.734353 [INFO] 2021-06-27 18:32:24 > Step: 40500 Progress: 20.2% Elapsed: 5 days, 12:18:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.666418 Generator_loss: 0.727165 [INFO] 2021-06-27 18:51:41 > Step: 40600 Progress: 20.3% Elapsed: 5 days, 12:37:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.625087 Generator_loss: 0.777416 [INFO] 2021-06-27 19:11:01 > Step: 40700 Progress: 20.3% Elapsed: 5 days, 12:57:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.634819 Generator_loss: 0.740808 [INFO] 2021-06-27 19:30:21 > Step: 40800 Progress: 20.4% Elapsed: 5 days, 13:16:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.631101 Generator_loss: 0.727217 [INFO] 2021-06-27 19:49:39 > Step: 40900 Progress: 20.4% Elapsed: 5 days, 13:35:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.737358 Generator_loss: 0.70681 [INFO] 2021-06-27 20:09:01 > Step: 41000 Progress: 20.5% Elapsed: 5 days, 13:55:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.685612 Generator_loss: 0.67996 [INFO] 2021-06-27 20:28:17 > Step: 41100 Progress: 20.5% Elapsed: 5 days, 14:14:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.671019 Generator_loss: 0.732121 [INFO] 2021-06-27 20:47:32 > Step: 41200 Progress: 20.6% Elapsed: 5 days, 14:33:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.627253 Generator_loss: 0.744837 [INFO] 2021-06-27 21:06:52 > Step: 41300 Progress: 20.6% Elapsed: 5 days, 14:52:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.618484 Generator_loss: 0.706912 [INFO] 2021-06-27 21:26:08 > Step: 41400 Progress: 20.7% Elapsed: 5 days, 15:12:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.618966 Generator_loss: 0.717953 [INFO] 2021-06-27 21:45:23 > Step: 41500 Progress: 20.8% Elapsed: 5 days, 15:31:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.635515 Generator_loss: 0.753521 [INFO] 2021-06-27 22:04:43 > Step: 41600 Progress: 20.8% Elapsed: 5 days, 15:50:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.621201 Generator_loss: 0.762463 [INFO] 2021-06-27 22:23:56 > Step: 41700 Progress: 20.8% Elapsed: 5 days, 16:10:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.743859 Generator_loss: 0.644905 [INFO] 2021-06-27 22:43:10 > Step: 41800 Progress: 20.9% Elapsed: 5 days, 16:29:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.638444 Generator_loss: 0.711898 [INFO] 2021-06-27 23:02:27 > Step: 41900 Progress: 20.9% Elapsed: 5 days, 16:48:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.608382 Generator_loss: 0.756384 [INFO] 2021-06-27 23:21:45 > Step: 42000 Progress: 21.0% Elapsed: 5 days, 17:07:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.579845 Generator_loss: 0.744723 [INFO] 2021-06-27 23:21:45 > Start Evaluation (42000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-27 23:21:45 > Calculating FID Score.... [INFO] 2021-06-27 23:22:50 > Calculating Inception Score.... [INFO] 2021-06-27 23:23:44 > Calculate F_beta Score.... [INFO] 2021-06-27 23:26:12 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-27 23:26:13 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-27 23:26:16 > Calculate Accuracies.... [INFO] 2021-06-27 23:27:06 > Calculate Accuracies.... [INFO] 2021-06-27 23:27:56 > F_8 score (Step: 42000, Using valid images): 0.9224702657389258 [INFO] 2021-06-27 23:27:56 > F_1/8 score (Step: 42000, Using valid images): 0.9653473106973746 [INFO] 2021-06-27 23:27:56 > FID score (Step: 42000, Using valid moments): 19.433276140261682 [INFO] 2021-06-27 23:27:56 > Inception score (Step: 42000, 50000 generated images): 36.97374725341797 [INFO] 2021-06-27 23:27:56 > Best FID score (Step: 42000, Using valid moments): 19.433276140261682 [INFO] 2021-06-27 23:28:11 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-27 23:47:28 > Step: 42100 Progress: 21.1% Elapsed: 5 days, 17:33:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.645141 Generator_loss: 0.7731 [INFO] 2021-06-28 00:06:43 > Step: 42200 Progress: 21.1% Elapsed: 5 days, 17:52:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.670067 Generator_loss: 0.681068 [INFO] 2021-06-28 00:26:05 > Step: 42300 Progress: 21.1% Elapsed: 5 days, 18:12:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.614847 Generator_loss: 0.71333 [INFO] 2021-06-28 00:45:22 > Step: 42400 Progress: 21.2% Elapsed: 5 days, 18:31:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.627519 Generator_loss: 0.764596 [INFO] 2021-06-28 01:04:36 > Step: 42500 Progress: 21.2% Elapsed: 5 days, 18:50:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.585487 Generator_loss: 0.790779 [INFO] 2021-06-28 01:23:58 > Step: 42600 Progress: 21.3% Elapsed: 5 days, 19:10:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.676451 Generator_loss: 0.710436 [INFO] 2021-06-28 01:43:14 > Step: 42700 Progress: 21.3% Elapsed: 5 days, 19:29:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.61813 Generator_loss: 0.74282 [INFO] 2021-06-28 02:02:30 > Step: 42800 Progress: 21.4% Elapsed: 5 days, 19:48:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.611392 Generator_loss: 0.760356 [INFO] 2021-06-28 02:21:50 > Step: 42900 Progress: 21.4% Elapsed: 5 days, 20:07:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.608723 Generator_loss: 0.708322 [INFO] 2021-06-28 02:41:05 > Step: 43000 Progress: 21.5% Elapsed: 5 days, 20:27:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.65555 Generator_loss: 0.773251 [INFO] 2021-06-28 03:00:21 > Step: 43100 Progress: 21.6% Elapsed: 5 days, 20:46:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.612445 Generator_loss: 0.710303 [INFO] 2021-06-28 03:19:41 > Step: 43200 Progress: 21.6% Elapsed: 5 days, 21:05:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.651323 Generator_loss: 0.66395 [INFO] 2021-06-28 03:38:56 > Step: 43300 Progress: 21.6% Elapsed: 5 days, 21:25:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.662721 Generator_loss: 0.756353 [INFO] 2021-06-28 03:58:12 > Step: 43400 Progress: 21.7% Elapsed: 5 days, 21:44:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.616814 Generator_loss: 0.758119 [INFO] 2021-06-28 04:17:34 > Step: 43500 Progress: 21.8% Elapsed: 5 days, 22:03:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.627823 Generator_loss: 0.721871 [INFO] 2021-06-28 04:36:49 > Step: 43600 Progress: 21.8% Elapsed: 5 days, 22:22:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.653263 Generator_loss: 0.740231 [INFO] 2021-06-28 04:56:03 > Step: 43700 Progress: 21.9% Elapsed: 5 days, 22:42:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.581038 Generator_loss: 0.75452 [INFO] 2021-06-28 05:15:26 > Step: 43800 Progress: 21.9% Elapsed: 5 days, 23:01:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.645981 Generator_loss: 0.752027 [INFO] 2021-06-28 05:34:41 > Step: 43900 Progress: 21.9% Elapsed: 5 days, 23:20:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.634622 Generator_loss: 0.722374 [INFO] 2021-06-28 05:53:54 > Step: 44000 Progress: 22.0% Elapsed: 5 days, 23:39:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.62361 Generator_loss: 0.763444 [INFO] 2021-06-28 05:53:54 > Start Evaluation (44000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-28 05:53:54 > Calculating FID Score.... [INFO] 2021-06-28 05:55:00 > Calculating Inception Score.... [INFO] 2021-06-28 05:55:55 > Calculate F_beta Score.... [INFO] 2021-06-28 05:58:17 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-28 05:58:17 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-28 05:58:20 > Calculate Accuracies.... [INFO] 2021-06-28 05:59:10 > Calculate Accuracies.... [INFO] 2021-06-28 06:00:01 > F_8 score (Step: 44000, Using valid images): 0.9396569796253195 [INFO] 2021-06-28 06:00:01 > F_1/8 score (Step: 44000, Using valid images): 0.9657465182742895 [INFO] 2021-06-28 06:00:01 > FID score (Step: 44000, Using valid moments): 18.588629354514183 [INFO] 2021-06-28 06:00:01 > Inception score (Step: 44000, 50000 generated images): 38.34970474243164 [INFO] 2021-06-28 06:00:01 > Best FID score (Step: 44000, Using valid moments): 18.588629354514183 [INFO] 2021-06-28 06:00:15 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-28 06:19:39 > Step: 44100 Progress: 22.1% Elapsed: 6 days, 0:05:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.673894 Generator_loss: 0.751556 [INFO] 2021-06-28 06:38:56 > Step: 44200 Progress: 22.1% Elapsed: 6 days, 0:25:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.611281 Generator_loss: 0.755637 [INFO] 2021-06-28 06:58:13 > Step: 44300 Progress: 22.1% Elapsed: 6 days, 0:44:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.624297 Generator_loss: 0.704723 [INFO] 2021-06-28 07:17:32 > Step: 44400 Progress: 22.2% Elapsed: 6 days, 1:03:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.655336 Generator_loss: 0.730887 [INFO] 2021-06-28 07:36:54 > Step: 44500 Progress: 22.2% Elapsed: 6 days, 1:22:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.59302 Generator_loss: 0.752904 [INFO] 2021-06-28 07:56:11 > Step: 44600 Progress: 22.3% Elapsed: 6 days, 1:42:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.654759 Generator_loss: 0.713479 [INFO] 2021-06-28 08:15:26 > Step: 44700 Progress: 22.4% Elapsed: 6 days, 2:01:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.706282 Generator_loss: 0.770688 [INFO] 2021-06-28 08:34:48 > Step: 44800 Progress: 22.4% Elapsed: 6 days, 2:20:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.616114 Generator_loss: 0.747657 [INFO] 2021-06-28 08:54:02 > Step: 44900 Progress: 22.4% Elapsed: 6 days, 2:40:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.826209 Generator_loss: 0.785476 [INFO] 2021-06-28 09:13:16 > Step: 45000 Progress: 22.5% Elapsed: 6 days, 2:59:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.646491 Generator_loss: 0.708616 [INFO] 2021-06-28 09:32:35 > Step: 45100 Progress: 22.6% Elapsed: 6 days, 3:18:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.6188 Generator_loss: 0.747736 [INFO] 2021-06-28 09:51:53 > Step: 45200 Progress: 22.6% Elapsed: 6 days, 3:37:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.652696 Generator_loss: 0.723527 [INFO] 2021-06-28 10:11:09 > Step: 45300 Progress: 22.7% Elapsed: 6 days, 3:57:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.612146 Generator_loss: 0.754597 [INFO] 2021-06-28 10:30:31 > Step: 45400 Progress: 22.7% Elapsed: 6 days, 4:16:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.613649 Generator_loss: 0.745234 [INFO] 2021-06-28 10:49:49 > Step: 45500 Progress: 22.8% Elapsed: 6 days, 4:35:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.610158 Generator_loss: 0.709561 [INFO] 2021-06-28 11:09:07 > Step: 45600 Progress: 22.8% Elapsed: 6 days, 4:55:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.584861 Generator_loss: 0.961475 [INFO] 2021-06-28 11:28:26 > Step: 45700 Progress: 22.9% Elapsed: 6 days, 5:14:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.637939 Generator_loss: 0.718784 [INFO] 2021-06-28 11:47:40 > Step: 45800 Progress: 22.9% Elapsed: 6 days, 5:33:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.634411 Generator_loss: 0.758076 [INFO] 2021-06-28 12:06:56 > Step: 45900 Progress: 22.9% Elapsed: 6 days, 5:53:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.641584 Generator_loss: 0.678127 [INFO] 2021-06-28 12:26:18 > Step: 46000 Progress: 23.0% Elapsed: 6 days, 6:12:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.605138 Generator_loss: 0.762624 [INFO] 2021-06-28 12:26:18 > Start Evaluation (46000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-28 12:26:18 > Calculating FID Score.... [INFO] 2021-06-28 12:27:25 > Calculating Inception Score.... [INFO] 2021-06-28 12:28:20 > Calculate F_beta Score.... [INFO] 2021-06-28 12:30:43 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-28 12:30:43 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-28 12:30:47 > Calculate Accuracies.... [INFO] 2021-06-28 12:31:37 > Calculate Accuracies.... [INFO] 2021-06-28 12:32:28 > F_8 score (Step: 46000, Using valid images): 0.9485513917322895 [INFO] 2021-06-28 12:32:28 > F_1/8 score (Step: 46000, Using valid images): 0.9680242470740297 [INFO] 2021-06-28 12:32:28 > FID score (Step: 46000, Using valid moments): 17.98766369313904 [INFO] 2021-06-28 12:32:28 > Inception score (Step: 46000, 50000 generated images): 40.06394958496094 [INFO] 2021-06-28 12:32:28 > Best FID score (Step: 46000, Using valid moments): 17.98766369313904 [INFO] 2021-06-28 12:32:43 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-28 12:51:59 > Step: 46100 Progress: 23.1% Elapsed: 6 days, 6:38:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.630023 Generator_loss: 0.714584 [INFO] 2021-06-28 13:11:13 > Step: 46200 Progress: 23.1% Elapsed: 6 days, 6:57:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.586429 Generator_loss: 0.770157 [INFO] 2021-06-28 13:30:34 > Step: 46300 Progress: 23.2% Elapsed: 6 days, 7:16:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.68214 Generator_loss: 0.714234 [INFO] 2021-06-28 13:49:51 > Step: 46400 Progress: 23.2% Elapsed: 6 days, 7:35:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.679114 Generator_loss: 0.712424 [INFO] 2021-06-28 14:09:07 > Step: 46500 Progress: 23.2% Elapsed: 6 days, 7:55:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.637681 Generator_loss: 0.749028 [INFO] 2021-06-28 14:28:26 > Step: 46600 Progress: 23.3% Elapsed: 6 days, 8:14:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.605469 Generator_loss: 0.785192 [INFO] 2021-06-28 14:47:43 > Step: 46700 Progress: 23.4% Elapsed: 6 days, 8:33:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.627007 Generator_loss: 0.748789 [INFO] 2021-06-28 15:06:59 > Step: 46800 Progress: 23.4% Elapsed: 6 days, 8:53:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.669603 Generator_loss: 0.712987 [INFO] 2021-06-28 15:26:12 > Step: 46900 Progress: 23.4% Elapsed: 6 days, 9:12:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.640933 Generator_loss: 0.740012 [INFO] 2021-06-28 15:45:34 > Step: 47000 Progress: 23.5% Elapsed: 6 days, 9:31:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.598029 Generator_loss: 0.732308 [INFO] 2021-06-28 16:04:50 > Step: 47100 Progress: 23.5% Elapsed: 6 days, 9:50:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.617686 Generator_loss: 0.716151 [INFO] 2021-06-28 16:24:08 > Step: 47200 Progress: 23.6% Elapsed: 6 days, 10:10:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.593566 Generator_loss: 0.7804 [INFO] 2021-06-28 16:43:27 > Step: 47300 Progress: 23.6% Elapsed: 6 days, 10:29:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.611874 Generator_loss: 0.733646 [INFO] 2021-06-28 17:02:43 > Step: 47400 Progress: 23.7% Elapsed: 6 days, 10:48:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.651164 Generator_loss: 0.726936 [INFO] 2021-06-28 17:21:59 > Step: 47500 Progress: 23.8% Elapsed: 6 days, 11:08:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.590338 Generator_loss: 0.858531 [INFO] 2021-06-28 17:41:21 > Step: 47600 Progress: 23.8% Elapsed: 6 days, 11:27:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.62142 Generator_loss: 0.753414 [INFO] 2021-06-28 18:00:36 > Step: 47700 Progress: 23.8% Elapsed: 6 days, 11:46:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.646515 Generator_loss: 0.746323 [INFO] 2021-06-28 18:19:54 > Step: 47800 Progress: 23.9% Elapsed: 6 days, 12:05:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.691976 Generator_loss: 0.71916 [INFO] 2021-06-28 18:39:20 > Step: 47900 Progress: 23.9% Elapsed: 6 days, 12:25:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.62191 Generator_loss: 0.727778 [INFO] 2021-06-28 18:58:36 > Step: 48000 Progress: 24.0% Elapsed: 6 days, 12:44:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.627809 Generator_loss: 0.739831 [INFO] 2021-06-28 18:58:36 > Start Evaluation (48000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-28 18:58:36 > Calculating FID Score.... [INFO] 2021-06-28 18:59:41 > Calculating Inception Score.... [INFO] 2021-06-28 19:00:35 > Calculate F_beta Score.... [INFO] 2021-06-28 19:03:05 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-28 19:03:06 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-28 19:03:09 > Calculate Accuracies.... [INFO] 2021-06-28 19:03:59 > Calculate Accuracies.... [INFO] 2021-06-28 19:04:50 > F_8 score (Step: 48000, Using valid images): 0.9380779906719477 [INFO] 2021-06-28 19:04:50 > F_1/8 score (Step: 48000, Using valid images): 0.9617340289042977 [INFO] 2021-06-28 19:04:50 > FID score (Step: 48000, Using valid moments): 17.588255428083926 [INFO] 2021-06-28 19:04:50 > Inception score (Step: 48000, 50000 generated images): 41.03060531616211 [INFO] 2021-06-28 19:04:50 > Best FID score (Step: 48000, Using valid moments): 17.588255428083926 [INFO] 2021-06-28 19:05:05 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-28 19:24:20 > Step: 48100 Progress: 24.1% Elapsed: 6 days, 13:10:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.603726 Generator_loss: 0.774657 [INFO] 2021-06-28 19:43:43 > Step: 48200 Progress: 24.1% Elapsed: 6 days, 13:29:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.638569 Generator_loss: 0.697043 [INFO] 2021-06-28 20:03:02 > Step: 48300 Progress: 24.1% Elapsed: 6 days, 13:49:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.618321 Generator_loss: 0.732582 [INFO] 2021-06-28 20:22:22 > Step: 48400 Progress: 24.2% Elapsed: 6 days, 14:08:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.592812 Generator_loss: 0.777506 [INFO] 2021-06-28 20:41:44 > Step: 48500 Progress: 24.2% Elapsed: 6 days, 14:27:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.620734 Generator_loss: 0.73367 [INFO] 2021-06-28 21:01:00 > Step: 48600 Progress: 24.3% Elapsed: 6 days, 14:47:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.597479 Generator_loss: 0.760328 [INFO] 2021-06-28 21:20:15 > Step: 48700 Progress: 24.3% Elapsed: 6 days, 15:06:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.692011 Generator_loss: 0.654459 [INFO] 2021-06-28 21:39:38 > Step: 48800 Progress: 24.4% Elapsed: 6 days, 15:25:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.553185 Generator_loss: 0.782786 [INFO] 2021-06-28 21:58:56 > Step: 48900 Progress: 24.4% Elapsed: 6 days, 15:45:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.631948 Generator_loss: 0.70292 [INFO] 2021-06-28 22:18:13 > Step: 49000 Progress: 24.5% Elapsed: 6 days, 16:04:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.63651 Generator_loss: 0.747444 [INFO] 2021-06-28 22:37:30 > Step: 49100 Progress: 24.6% Elapsed: 6 days, 16:23:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.643029 Generator_loss: 0.763008 [INFO] 2021-06-28 22:56:55 > Step: 49200 Progress: 24.6% Elapsed: 6 days, 16:42:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.596866 Generator_loss: 0.745724 [INFO] 2021-06-28 23:16:12 > Step: 49300 Progress: 24.6% Elapsed: 6 days, 17:02:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.581427 Generator_loss: 0.764552 [INFO] 2021-06-28 23:35:30 > Step: 49400 Progress: 24.7% Elapsed: 6 days, 17:21:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.59472 Generator_loss: 0.805144 [INFO] 2021-06-28 23:54:52 > Step: 49500 Progress: 24.8% Elapsed: 6 days, 17:40:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.627498 Generator_loss: 0.752204 [INFO] 2021-06-29 00:14:07 > Step: 49600 Progress: 24.8% Elapsed: 6 days, 18:00:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.591133 Generator_loss: 0.766484 [INFO] 2021-06-29 00:33:25 > Step: 49700 Progress: 24.9% Elapsed: 6 days, 18:19:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.59463 Generator_loss: 0.746319 [INFO] 2021-06-29 00:52:47 > Step: 49800 Progress: 24.9% Elapsed: 6 days, 18:38:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.622113 Generator_loss: 0.713169 [INFO] 2021-06-29 01:12:01 > Step: 49900 Progress: 24.9% Elapsed: 6 days, 18:58:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.597803 Generator_loss: 0.797853 [INFO] 2021-06-29 01:31:18 > Step: 50000 Progress: 25.0% Elapsed: 6 days, 19:17:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.579147 Generator_loss: 0.786047 [INFO] 2021-06-29 01:31:18 > Start Evaluation (50000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-29 01:31:18 > Calculating FID Score.... [INFO] 2021-06-29 01:32:23 > Calculating Inception Score.... [INFO] 2021-06-29 01:33:17 > Calculate F_beta Score.... [INFO] 2021-06-29 01:35:45 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-29 01:35:45 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-29 01:35:49 > Calculate Accuracies.... [INFO] 2021-06-29 01:36:38 > Calculate Accuracies.... [INFO] 2021-06-29 01:37:29 > F_8 score (Step: 50000, Using valid images): 0.9400125529651424 [INFO] 2021-06-29 01:37:29 > F_1/8 score (Step: 50000, Using valid images): 0.9673452040434974 [INFO] 2021-06-29 01:37:29 > FID score (Step: 50000, Using valid moments): 16.962154305351874 [INFO] 2021-06-29 01:37:29 > Inception score (Step: 50000, 50000 generated images): 42.18688201904297 [INFO] 2021-06-29 01:37:29 > Best FID score (Step: 50000, Using valid moments): 16.962154305351874 [INFO] 2021-06-29 01:37:44 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-29 01:57:09 > Step: 50100 Progress: 25.1% Elapsed: 6 days, 19:43:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.57324 Generator_loss: 0.736299 [INFO] 2021-06-29 02:16:28 > Step: 50200 Progress: 25.1% Elapsed: 6 days, 20:02:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.612527 Generator_loss: 0.740135 [INFO] 2021-06-29 02:35:45 > Step: 50300 Progress: 25.1% Elapsed: 6 days, 20:21:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.609916 Generator_loss: 0.768223 [INFO] 2021-06-29 02:55:08 > Step: 50400 Progress: 25.2% Elapsed: 6 days, 20:41:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.603909 Generator_loss: 0.743836 [INFO] 2021-06-29 03:14:26 > Step: 50500 Progress: 25.2% Elapsed: 6 days, 21:00:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.625902 Generator_loss: 0.689521 [INFO] 2021-06-29 03:33:44 > Step: 50600 Progress: 25.3% Elapsed: 6 days, 21:19:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.603028 Generator_loss: 0.777949 [INFO] 2021-06-29 03:53:08 > Step: 50700 Progress: 25.4% Elapsed: 6 days, 21:39:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.567993 Generator_loss: 0.788106 [INFO] 2021-06-29 04:12:26 > Step: 50800 Progress: 25.4% Elapsed: 6 days, 21:58:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.621226 Generator_loss: 0.764692 [INFO] 2021-06-29 04:31:42 > Step: 50900 Progress: 25.4% Elapsed: 6 days, 22:17:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.625515 Generator_loss: 0.737365 [INFO] 2021-06-29 04:51:05 > Step: 51000 Progress: 25.5% Elapsed: 6 days, 22:37:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.60532 Generator_loss: 0.774039 [INFO] 2021-06-29 05:10:25 > Step: 51100 Progress: 25.6% Elapsed: 6 days, 22:56:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.575553 Generator_loss: 0.777004 [INFO] 2021-06-29 05:29:42 > Step: 51200 Progress: 25.6% Elapsed: 6 days, 23:15:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.589012 Generator_loss: 0.741495 [INFO] 2021-06-29 05:49:03 > Step: 51300 Progress: 25.7% Elapsed: 6 days, 23:35:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.58614 Generator_loss: 0.779884 [INFO] 2021-06-29 06:08:21 > Step: 51400 Progress: 25.7% Elapsed: 6 days, 23:54:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.582846 Generator_loss: 0.748877 [INFO] 2021-06-29 06:27:40 > Step: 51500 Progress: 25.8% Elapsed: 7 days, 0:13:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.633622 Generator_loss: 0.750905 [INFO] 2021-06-29 06:46:57 > Step: 51600 Progress: 25.8% Elapsed: 7 days, 0:33:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.646723 Generator_loss: 0.684953 [INFO] 2021-06-29 07:06:23 > Step: 51700 Progress: 25.9% Elapsed: 7 days, 0:52:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.61543 Generator_loss: 0.703478 [INFO] 2021-06-29 07:25:39 > Step: 51800 Progress: 25.9% Elapsed: 7 days, 1:11:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.659511 Generator_loss: 0.767005 [INFO] 2021-06-29 07:44:56 > Step: 51900 Progress: 25.9% Elapsed: 7 days, 1:31:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.601358 Generator_loss: 0.74618 [INFO] 2021-06-29 08:04:18 > Step: 52000 Progress: 26.0% Elapsed: 7 days, 1:50:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.577515 Generator_loss: 0.816332 [INFO] 2021-06-29 08:04:18 > Start Evaluation (52000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-29 08:04:18 > Calculating FID Score.... [INFO] 2021-06-29 08:05:23 > Calculating Inception Score.... [INFO] 2021-06-29 08:06:17 > Calculate F_beta Score.... [INFO] 2021-06-29 08:08:37 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-29 08:08:38 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-29 08:08:41 > Calculate Accuracies.... [INFO] 2021-06-29 08:09:32 > Calculate Accuracies.... [INFO] 2021-06-29 08:10:23 > F_8 score (Step: 52000, Using valid images): 0.9571564036780078 [INFO] 2021-06-29 08:10:23 > F_1/8 score (Step: 52000, Using valid images): 0.965462357233051 [INFO] 2021-06-29 08:10:23 > FID score (Step: 52000, Using valid moments): 16.358789727164037 [INFO] 2021-06-29 08:10:23 > Inception score (Step: 52000, 50000 generated images): 43.64131546020508 [INFO] 2021-06-29 08:10:23 > Best FID score (Step: 52000, Using valid moments): 16.358789727164037 [INFO] 2021-06-29 08:10:37 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-29 08:29:55 > Step: 52100 Progress: 26.1% Elapsed: 7 days, 2:15:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.639957 Generator_loss: 0.738792 [INFO] 2021-06-29 08:49:13 > Step: 52200 Progress: 26.1% Elapsed: 7 days, 2:35:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.58338 Generator_loss: 0.779894 [INFO] 2021-06-29 09:08:36 > Step: 52300 Progress: 26.2% Elapsed: 7 days, 2:54:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.583139 Generator_loss: 0.830758 [INFO] 2021-06-29 09:27:53 > Step: 52400 Progress: 26.2% Elapsed: 7 days, 3:13:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.640052 Generator_loss: 0.761337 [INFO] 2021-06-29 09:47:10 > Step: 52500 Progress: 26.2% Elapsed: 7 days, 3:33:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.619914 Generator_loss: 0.741474 [INFO] 2021-06-29 10:06:34 > Step: 52600 Progress: 26.3% Elapsed: 7 days, 3:52:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.601355 Generator_loss: 0.82176 [INFO] 2021-06-29 10:25:52 > Step: 52700 Progress: 26.4% Elapsed: 7 days, 4:11:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.659161 Generator_loss: 0.751933 [INFO] 2021-06-29 10:45:07 > Step: 52800 Progress: 26.4% Elapsed: 7 days, 4:31:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.588686 Generator_loss: 0.771517 [INFO] 2021-06-29 11:04:27 > Step: 52900 Progress: 26.5% Elapsed: 7 days, 4:50:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.606458 Generator_loss: 0.802696 [INFO] 2021-06-29 11:23:46 > Step: 53000 Progress: 26.5% Elapsed: 7 days, 5:09:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.80145 Generator_loss: 0.775182 [INFO] 2021-06-29 11:43:02 > Step: 53100 Progress: 26.6% Elapsed: 7 days, 5:29:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.58401 Generator_loss: 0.75445 [INFO] 2021-06-29 12:02:25 > Step: 53200 Progress: 26.6% Elapsed: 7 days, 5:48:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.574943 Generator_loss: 0.874973 [INFO] 2021-06-29 12:21:42 > Step: 53300 Progress: 26.7% Elapsed: 7 days, 6:07:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.573136 Generator_loss: 0.747887 [INFO] 2021-06-29 12:41:00 > Step: 53400 Progress: 26.7% Elapsed: 7 days, 6:27:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.569787 Generator_loss: 0.836315 [INFO] 2021-06-29 13:00:24 > Step: 53500 Progress: 26.8% Elapsed: 7 days, 6:46:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.596054 Generator_loss: 0.770474 [INFO] 2021-06-29 13:19:41 > Step: 53600 Progress: 26.8% Elapsed: 7 days, 7:05:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.573175 Generator_loss: 0.747979 [INFO] 2021-06-29 13:39:00 > Step: 53700 Progress: 26.9% Elapsed: 7 days, 7:25:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.60832 Generator_loss: 0.763277 [INFO] 2021-06-29 13:58:20 > Step: 53800 Progress: 26.9% Elapsed: 7 days, 7:44:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.558948 Generator_loss: 0.787397 [INFO] 2021-06-29 14:17:37 > Step: 53900 Progress: 27.0% Elapsed: 7 days, 8:03:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.611141 Generator_loss: 0.743947 [INFO] 2021-06-29 14:36:52 > Step: 54000 Progress: 27.0% Elapsed: 7 days, 8:22:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.59418 Generator_loss: 0.75486 [INFO] 2021-06-29 14:36:52 > Start Evaluation (54000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-29 14:36:52 > Calculating FID Score.... [INFO] 2021-06-29 14:37:57 > Calculating Inception Score.... [INFO] 2021-06-29 14:38:51 > Calculate F_beta Score.... [INFO] 2021-06-29 14:41:21 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-29 14:41:21 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-29 14:41:25 > Calculate Accuracies.... [INFO] 2021-06-29 14:42:15 > Calculate Accuracies.... [INFO] 2021-06-29 14:43:06 > F_8 score (Step: 54000, Using valid images): 0.9432704143961704 [INFO] 2021-06-29 14:43:06 > F_1/8 score (Step: 54000, Using valid images): 0.9681022518847265 [INFO] 2021-06-29 14:43:06 > FID score (Step: 54000, Using valid moments): 15.923212605349363 [INFO] 2021-06-29 14:43:06 > Inception score (Step: 54000, 50000 generated images): 45.175418853759766 [INFO] 2021-06-29 14:43:06 > Best FID score (Step: 54000, Using valid moments): 15.923212605349363 [INFO] 2021-06-29 14:43:21 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-29 15:02:37 > Step: 54100 Progress: 27.1% Elapsed: 7 days, 8:48:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.549525 Generator_loss: 0.794374 [INFO] 2021-06-29 15:21:55 > Step: 54200 Progress: 27.1% Elapsed: 7 days, 9:08:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.778079 Generator_loss: 0.671499 [INFO] 2021-06-29 15:41:08 > Step: 54300 Progress: 27.2% Elapsed: 7 days, 9:27:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.61256 Generator_loss: 0.70922 [INFO] 2021-06-29 16:00:25 > Step: 54400 Progress: 27.2% Elapsed: 7 days, 9:46:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.550404 Generator_loss: 0.808882 [INFO] 2021-06-29 16:19:47 > Step: 54500 Progress: 27.3% Elapsed: 7 days, 10:05:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.56061 Generator_loss: 0.758916 [INFO] 2021-06-29 16:39:03 > Step: 54600 Progress: 27.3% Elapsed: 7 days, 10:25:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.596353 Generator_loss: 0.822204 [INFO] 2021-06-29 16:58:18 > Step: 54700 Progress: 27.4% Elapsed: 7 days, 10:44:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.601166 Generator_loss: 0.718292 [INFO] 2021-06-29 17:17:41 > Step: 54800 Progress: 27.4% Elapsed: 7 days, 11:03:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.598078 Generator_loss: 0.758573 [INFO] 2021-06-29 17:36:54 > Step: 54900 Progress: 27.5% Elapsed: 7 days, 11:22:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.559035 Generator_loss: 0.801113 [INFO] 2021-06-29 17:56:12 > Step: 55000 Progress: 27.5% Elapsed: 7 days, 11:42:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.599685 Generator_loss: 0.771254 [INFO] 2021-06-29 18:15:35 > Step: 55100 Progress: 27.6% Elapsed: 7 days, 12:01:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.595198 Generator_loss: 0.771104 [INFO] 2021-06-29 18:34:53 > Step: 55200 Progress: 27.6% Elapsed: 7 days, 12:20:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.601875 Generator_loss: 0.748689 [INFO] 2021-06-29 18:54:09 > Step: 55300 Progress: 27.7% Elapsed: 7 days, 12:40:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.593213 Generator_loss: 0.771653 [INFO] 2021-06-29 19:13:30 > Step: 55400 Progress: 27.7% Elapsed: 7 days, 12:59:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.590599 Generator_loss: 0.76947 [INFO] 2021-06-29 19:32:45 > Step: 55500 Progress: 27.8% Elapsed: 7 days, 13:18:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.597245 Generator_loss: 0.758133 [INFO] 2021-06-29 19:52:01 > Step: 55600 Progress: 27.8% Elapsed: 7 days, 13:38:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.553477 Generator_loss: 0.81865 [INFO] 2021-06-29 20:11:20 > Step: 55700 Progress: 27.9% Elapsed: 7 days, 13:57:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.562254 Generator_loss: 0.781326 [INFO] 2021-06-29 20:30:37 > Step: 55800 Progress: 27.9% Elapsed: 7 days, 14:16:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.629433 Generator_loss: 0.751197 [INFO] 2021-06-29 20:49:53 > Step: 55900 Progress: 28.0% Elapsed: 7 days, 14:35:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.586043 Generator_loss: 0.804504 [INFO] 2021-06-29 21:09:13 > Step: 56000 Progress: 28.0% Elapsed: 7 days, 14:55:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.618437 Generator_loss: 0.724592 [INFO] 2021-06-29 21:09:13 > Start Evaluation (56000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-29 21:09:13 > Calculating FID Score.... [INFO] 2021-06-29 21:10:19 > Calculating Inception Score.... [INFO] 2021-06-29 21:11:14 > Calculate F_beta Score.... [INFO] 2021-06-29 21:13:41 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-29 21:13:41 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-29 21:13:44 > Calculate Accuracies.... [INFO] 2021-06-29 21:14:35 > Calculate Accuracies.... [INFO] 2021-06-29 21:15:25 > F_8 score (Step: 56000, Using valid images): 0.9503459251429063 [INFO] 2021-06-29 21:15:25 > F_1/8 score (Step: 56000, Using valid images): 0.9686859206577904 [INFO] 2021-06-29 21:15:25 > FID score (Step: 56000, Using valid moments): 15.587504865781682 [INFO] 2021-06-29 21:15:25 > Inception score (Step: 56000, 50000 generated images): 45.84307861328125 [INFO] 2021-06-29 21:15:25 > Best FID score (Step: 56000, Using valid moments): 15.587504865781682 [INFO] 2021-06-29 21:15:40 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-29 21:34:58 > Step: 56100 Progress: 28.1% Elapsed: 7 days, 15:21:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.585948 Generator_loss: 0.80335 [INFO] 2021-06-29 21:54:14 > Step: 56200 Progress: 28.1% Elapsed: 7 days, 15:40:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.647292 Generator_loss: 0.718284 [INFO] 2021-06-29 22:13:33 > Step: 56300 Progress: 28.1% Elapsed: 7 days, 15:59:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.657978 Generator_loss: 0.851201 [INFO] 2021-06-29 22:32:46 > Step: 56400 Progress: 28.2% Elapsed: 7 days, 16:18:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.583469 Generator_loss: 0.798223 [INFO] 2021-06-29 22:52:02 > Step: 56500 Progress: 28.2% Elapsed: 7 days, 16:38:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.583357 Generator_loss: 0.796791 [INFO] 2021-06-29 23:11:18 > Step: 56600 Progress: 28.3% Elapsed: 7 days, 16:57:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.590931 Generator_loss: 0.753421 [INFO] 2021-06-29 23:30:43 > Step: 56700 Progress: 28.3% Elapsed: 7 days, 17:16:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.554261 Generator_loss: 0.764216 [INFO] 2021-06-29 23:49:58 > Step: 56800 Progress: 28.4% Elapsed: 7 days, 17:36:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.574481 Generator_loss: 0.795592 [INFO] 2021-06-30 00:09:12 > Step: 56900 Progress: 28.4% Elapsed: 7 days, 17:55:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.602095 Generator_loss: 0.749757 [INFO] 2021-06-30 00:28:31 > Step: 57000 Progress: 28.5% Elapsed: 7 days, 18:14:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.58932 Generator_loss: 0.758881 [INFO] 2021-06-30 00:47:46 > Step: 57100 Progress: 28.5% Elapsed: 7 days, 18:33:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.583487 Generator_loss: 0.760329 [INFO] 2021-06-30 01:07:00 > Step: 57200 Progress: 28.6% Elapsed: 7 days, 18:53:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.624195 Generator_loss: 0.754286 [INFO] 2021-06-30 01:26:20 > Step: 57300 Progress: 28.6% Elapsed: 7 days, 19:12:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.58388 Generator_loss: 0.75543 [INFO] 2021-06-30 01:45:36 > Step: 57400 Progress: 28.7% Elapsed: 7 days, 19:31:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.604138 Generator_loss: 0.742537 [INFO] 2021-06-30 02:04:50 > Step: 57500 Progress: 28.7% Elapsed: 7 days, 19:50:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.609316 Generator_loss: 0.770337 [INFO] 2021-06-30 02:24:11 > Step: 57600 Progress: 28.8% Elapsed: 7 days, 20:10:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.569128 Generator_loss: 0.75636 [INFO] 2021-06-30 02:43:26 > Step: 57700 Progress: 28.8% Elapsed: 7 days, 20:29:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.578007 Generator_loss: 0.789139 [INFO] 2021-06-30 03:02:41 > Step: 57800 Progress: 28.9% Elapsed: 7 days, 20:48:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.606317 Generator_loss: 0.758874 [INFO] 2021-06-30 03:22:03 > Step: 57900 Progress: 28.9% Elapsed: 7 days, 21:08:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.624281 Generator_loss: 0.731411 [INFO] 2021-06-30 03:41:22 > Step: 58000 Progress: 29.0% Elapsed: 7 days, 21:27:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.569398 Generator_loss: 0.76757 [INFO] 2021-06-30 03:41:22 > Start Evaluation (58000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-30 03:41:22 > Calculating FID Score.... [INFO] 2021-06-30 03:42:27 > Calculating Inception Score.... [INFO] 2021-06-30 03:43:21 > Calculate F_beta Score.... [INFO] 2021-06-30 03:45:51 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-30 03:45:51 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-30 03:45:55 > Calculate Accuracies.... [INFO] 2021-06-30 03:46:45 > Calculate Accuracies.... [INFO] 2021-06-30 03:47:35 > F_8 score (Step: 58000, Using valid images): 0.9467464545660061 [INFO] 2021-06-30 03:47:35 > F_1/8 score (Step: 58000, Using valid images): 0.9714525459981274 [INFO] 2021-06-30 03:47:35 > FID score (Step: 58000, Using valid moments): 15.21484372368792 [INFO] 2021-06-30 03:47:35 > Inception score (Step: 58000, 50000 generated images): 47.56911087036133 [INFO] 2021-06-30 03:47:35 > Best FID score (Step: 58000, Using valid moments): 15.21484372368792 [INFO] 2021-06-30 03:47:50 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-30 04:07:07 > Step: 58100 Progress: 29.0% Elapsed: 7 days, 21:53:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.54956 Generator_loss: 0.902864 [INFO] 2021-06-30 04:26:28 > Step: 58200 Progress: 29.1% Elapsed: 7 days, 22:12:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.625346 Generator_loss: 0.751283 [INFO] 2021-06-30 04:45:44 > Step: 58300 Progress: 29.1% Elapsed: 7 days, 22:31:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.565482 Generator_loss: 0.771791 [INFO] 2021-06-30 05:05:00 > Step: 58400 Progress: 29.2% Elapsed: 7 days, 22:51:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.601031 Generator_loss: 0.752409 [INFO] 2021-06-30 05:24:17 > Step: 58500 Progress: 29.2% Elapsed: 7 days, 23:10:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.633817 Generator_loss: 0.768017 [INFO] 2021-06-30 05:43:34 > Step: 58600 Progress: 29.3% Elapsed: 7 days, 23:29:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.725635 Generator_loss: 0.690796 [INFO] 2021-06-30 06:02:48 > Step: 58700 Progress: 29.3% Elapsed: 7 days, 23:48:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.624028 Generator_loss: 0.73941 [INFO] 2021-06-30 06:22:06 > Step: 58800 Progress: 29.4% Elapsed: 8 days, 0:08:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.548075 Generator_loss: 0.785363 [INFO] 2021-06-30 06:41:18 > Step: 58900 Progress: 29.4% Elapsed: 8 days, 0:27:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.552108 Generator_loss: 0.822842 [INFO] 2021-06-30 07:00:31 > Step: 59000 Progress: 29.5% Elapsed: 8 days, 0:46:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.581767 Generator_loss: 0.791583 [INFO] 2021-06-30 07:19:46 > Step: 59100 Progress: 29.5% Elapsed: 8 days, 1:05:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.577402 Generator_loss: 0.779452 [INFO] 2021-06-30 07:39:08 > Step: 59200 Progress: 29.6% Elapsed: 8 days, 1:25:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.597128 Generator_loss: 0.807442 [INFO] 2021-06-30 07:58:22 > Step: 59300 Progress: 29.6% Elapsed: 8 days, 1:44:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.579793 Generator_loss: 0.823036 [INFO] 2021-06-30 08:17:37 > Step: 59400 Progress: 29.7% Elapsed: 8 days, 2:03:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.61617 Generator_loss: 0.754537 [INFO] 2021-06-30 08:36:59 > Step: 59500 Progress: 29.8% Elapsed: 8 days, 2:23:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.534183 Generator_loss: 0.847689 [INFO] 2021-06-30 08:56:14 > Step: 59600 Progress: 29.8% Elapsed: 8 days, 2:42:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.551786 Generator_loss: 0.808784 [INFO] 2021-06-30 09:15:27 > Step: 59700 Progress: 29.8% Elapsed: 8 days, 3:01:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.68847 Generator_loss: 0.702607 [INFO] 2021-06-30 09:34:47 > Step: 59800 Progress: 29.9% Elapsed: 8 days, 3:20:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.570251 Generator_loss: 0.971902 [INFO] 2021-06-30 09:54:02 > Step: 59900 Progress: 29.9% Elapsed: 8 days, 3:40:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.575299 Generator_loss: 0.771173 [INFO] 2021-06-30 10:13:17 > Step: 60000 Progress: 30.0% Elapsed: 8 days, 3:59:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.564363 Generator_loss: 0.811031 [INFO] 2021-06-30 10:13:17 > Start Evaluation (60000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-30 10:13:17 > Calculating FID Score.... [INFO] 2021-06-30 10:14:22 > Calculating Inception Score.... [INFO] 2021-06-30 10:15:17 > Calculate F_beta Score.... [INFO] 2021-06-30 10:17:43 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-30 10:17:43 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-30 10:17:47 > Calculate Accuracies.... [INFO] 2021-06-30 10:18:37 > Calculate Accuracies.... [INFO] 2021-06-30 10:19:28 > F_8 score (Step: 60000, Using valid images): 0.9629957605391939 [INFO] 2021-06-30 10:19:28 > F_1/8 score (Step: 60000, Using valid images): 0.9683557881883421 [INFO] 2021-06-30 10:19:28 > FID score (Step: 60000, Using valid moments): 14.711493630446796 [INFO] 2021-06-30 10:19:28 > Inception score (Step: 60000, 50000 generated images): 48.79393005371094 [INFO] 2021-06-30 10:19:28 > Best FID score (Step: 60000, Using valid moments): 14.711493630446796 [INFO] 2021-06-30 10:19:43 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-30 10:39:07 > Step: 60100 Progress: 30.0% Elapsed: 8 days, 4:25:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.604168 Generator_loss: 0.804435 [INFO] 2021-06-30 10:58:23 > Step: 60200 Progress: 30.1% Elapsed: 8 days, 4:44:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.566889 Generator_loss: 0.822777 [INFO] 2021-06-30 11:17:38 > Step: 60300 Progress: 30.1% Elapsed: 8 days, 5:03:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.544305 Generator_loss: 0.805593 [INFO] 2021-06-30 11:37:01 > Step: 60400 Progress: 30.2% Elapsed: 8 days, 5:23:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.566244 Generator_loss: 0.779121 [INFO] 2021-06-30 11:56:17 > Step: 60500 Progress: 30.2% Elapsed: 8 days, 5:42:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.548743 Generator_loss: 0.795296 [INFO] 2021-06-30 12:15:32 > Step: 60600 Progress: 30.3% Elapsed: 8 days, 6:01:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.573284 Generator_loss: 0.792391 [INFO] 2021-06-30 12:34:57 > Step: 60700 Progress: 30.3% Elapsed: 8 days, 6:21:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.586936 Generator_loss: 0.769166 [INFO] 2021-06-30 12:54:15 > Step: 60800 Progress: 30.4% Elapsed: 8 days, 6:40:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.587356 Generator_loss: 0.766665 [INFO] 2021-06-30 13:13:34 > Step: 60900 Progress: 30.4% Elapsed: 8 days, 6:59:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.5526 Generator_loss: 0.829891 [INFO] 2021-06-30 13:32:54 > Step: 61000 Progress: 30.5% Elapsed: 8 days, 7:18:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.562782 Generator_loss: 0.792793 [INFO] 2021-06-30 13:52:09 > Step: 61100 Progress: 30.6% Elapsed: 8 days, 7:38:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.567339 Generator_loss: 0.792833 [INFO] 2021-06-30 14:11:25 > Step: 61200 Progress: 30.6% Elapsed: 8 days, 7:57:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.580682 Generator_loss: 0.798023 [INFO] 2021-06-30 14:30:45 > Step: 61300 Progress: 30.6% Elapsed: 8 days, 8:16:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.598691 Generator_loss: 0.814619 [INFO] 2021-06-30 14:50:02 > Step: 61400 Progress: 30.7% Elapsed: 8 days, 8:36:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.569316 Generator_loss: 0.741706 [INFO] 2021-06-30 15:09:18 > Step: 61500 Progress: 30.8% Elapsed: 8 days, 8:55:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.608653 Generator_loss: 0.718696 [INFO] 2021-06-30 15:28:34 > Step: 61600 Progress: 30.8% Elapsed: 8 days, 9:14:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.580656 Generator_loss: 0.780582 [INFO] 2021-06-30 15:47:54 > Step: 61700 Progress: 30.9% Elapsed: 8 days, 9:33:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.558249 Generator_loss: 0.800471 [INFO] 2021-06-30 16:07:09 > Step: 61800 Progress: 30.9% Elapsed: 8 days, 9:53:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.554123 Generator_loss: 0.777111 [INFO] 2021-06-30 16:26:23 > Step: 61900 Progress: 30.9% Elapsed: 8 days, 10:12:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.556848 Generator_loss: 0.786283 [INFO] 2021-06-30 16:45:46 > Step: 62000 Progress: 31.0% Elapsed: 8 days, 10:31:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.58848 Generator_loss: 0.783531 [INFO] 2021-06-30 16:45:46 > Start Evaluation (62000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-30 16:45:46 > Calculating FID Score.... [INFO] 2021-06-30 16:46:51 > Calculating Inception Score.... [INFO] 2021-06-30 16:47:46 > Calculate F_beta Score.... [INFO] 2021-06-30 16:50:17 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-30 16:50:17 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-30 16:50:20 > Calculate Accuracies.... [INFO] 2021-06-30 16:51:11 > Calculate Accuracies.... [INFO] 2021-06-30 16:52:01 > F_8 score (Step: 62000, Using valid images): 0.9505787929343857 [INFO] 2021-06-30 16:52:01 > F_1/8 score (Step: 62000, Using valid images): 0.9717580646003561 [INFO] 2021-06-30 16:52:01 > FID score (Step: 62000, Using valid moments): 14.450982202130945 [INFO] 2021-06-30 16:52:01 > Inception score (Step: 62000, 50000 generated images): 49.44697189331055 [INFO] 2021-06-30 16:52:01 > Best FID score (Step: 62000, Using valid moments): 14.450982202130945 [INFO] 2021-06-30 16:52:16 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-30 17:11:32 > Step: 62100 Progress: 31.1% Elapsed: 8 days, 10:57:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.609479 Generator_loss: 0.775024 [INFO] 2021-06-30 17:30:47 > Step: 62200 Progress: 31.1% Elapsed: 8 days, 11:16:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.615909 Generator_loss: 0.723372 [INFO] 2021-06-30 17:50:07 > Step: 62300 Progress: 31.1% Elapsed: 8 days, 11:36:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.569861 Generator_loss: 0.836964 [INFO] 2021-06-30 18:09:23 > Step: 62400 Progress: 31.2% Elapsed: 8 days, 11:55:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.604506 Generator_loss: 0.764629 [INFO] 2021-06-30 18:28:38 > Step: 62500 Progress: 31.2% Elapsed: 8 days, 12:14:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.574387 Generator_loss: 0.806052 [INFO] 2021-06-30 18:48:01 > Step: 62600 Progress: 31.3% Elapsed: 8 days, 12:34:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.577028 Generator_loss: 0.782131 [INFO] 2021-06-30 19:07:15 > Step: 62700 Progress: 31.4% Elapsed: 8 days, 12:53:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.556794 Generator_loss: 0.8027 [INFO] 2021-06-30 19:26:28 > Step: 62800 Progress: 31.4% Elapsed: 8 days, 13:12:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.61848 Generator_loss: 0.778962 [INFO] 2021-06-30 19:45:48 > Step: 62900 Progress: 31.4% Elapsed: 8 days, 13:31:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.557689 Generator_loss: 0.894434 [INFO] 2021-06-30 20:05:05 > Step: 63000 Progress: 31.5% Elapsed: 8 days, 13:51:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.603365 Generator_loss: 0.79563 [INFO] 2021-06-30 20:24:22 > Step: 63100 Progress: 31.6% Elapsed: 8 days, 14:10:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.556658 Generator_loss: 0.812689 [INFO] 2021-06-30 20:43:43 > Step: 63200 Progress: 31.6% Elapsed: 8 days, 14:29:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.603128 Generator_loss: 0.787457 [INFO] 2021-06-30 21:02:58 > Step: 63300 Progress: 31.6% Elapsed: 8 days, 14:49:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.546808 Generator_loss: 0.816795 [INFO] 2021-06-30 21:22:12 > Step: 63400 Progress: 31.7% Elapsed: 8 days, 15:08:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.640251 Generator_loss: 0.759015 [INFO] 2021-06-30 21:41:35 > Step: 63500 Progress: 31.8% Elapsed: 8 days, 15:27:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.556225 Generator_loss: 0.782984 [INFO] 2021-06-30 22:00:51 > Step: 63600 Progress: 31.8% Elapsed: 8 days, 15:46:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.575701 Generator_loss: 0.723195 [INFO] 2021-06-30 22:20:07 > Step: 63700 Progress: 31.9% Elapsed: 8 days, 16:06:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.578865 Generator_loss: 0.791302 [INFO] 2021-06-30 22:39:21 > Step: 63800 Progress: 31.9% Elapsed: 8 days, 16:25:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.577109 Generator_loss: 0.796723 [INFO] 2021-06-30 22:58:46 > Step: 63900 Progress: 31.9% Elapsed: 8 days, 16:44:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.564589 Generator_loss: 0.858417 [INFO] 2021-06-30 23:18:03 > Step: 64000 Progress: 32.0% Elapsed: 8 days, 17:04:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.539504 Generator_loss: 0.846795 [INFO] 2021-06-30 23:18:03 > Start Evaluation (64000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-30 23:18:03 > Calculating FID Score.... [INFO] 2021-06-30 23:19:08 > Calculating Inception Score.... [INFO] 2021-06-30 23:20:02 > Calculate F_beta Score.... [INFO] 2021-06-30 23:22:28 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-06-30 23:22:29 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-06-30 23:22:32 > Calculate Accuracies.... [INFO] 2021-06-30 23:23:23 > Calculate Accuracies.... [INFO] 2021-06-30 23:24:13 > F_8 score (Step: 64000, Using valid images): 0.9614500426714192 [INFO] 2021-06-30 23:24:13 > F_1/8 score (Step: 64000, Using valid images): 0.9709470225628153 [INFO] 2021-06-30 23:24:13 > FID score (Step: 64000, Using valid moments): 14.264668848674603 [INFO] 2021-06-30 23:24:13 > Inception score (Step: 64000, 50000 generated images): 51.37336349487305 [INFO] 2021-06-30 23:24:13 > Best FID score (Step: 64000, Using valid moments): 14.264668848674603 [INFO] 2021-06-30 23:24:28 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-06-30 23:43:45 > Step: 64100 Progress: 32.0% Elapsed: 8 days, 17:29:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.566331 Generator_loss: 0.790447 [INFO] 2021-07-01 00:03:07 > Step: 64200 Progress: 32.1% Elapsed: 8 days, 17:49:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.576423 Generator_loss: 0.757927 [INFO] 2021-07-01 00:22:24 > Step: 64300 Progress: 32.1% Elapsed: 8 days, 18:08:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.563183 Generator_loss: 0.801783 [INFO] 2021-07-01 00:41:38 > Step: 64400 Progress: 32.2% Elapsed: 8 days, 18:27:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.585271 Generator_loss: 0.783264 [INFO] 2021-07-01 01:01:01 > Step: 64500 Progress: 32.2% Elapsed: 8 days, 18:47:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.577845 Generator_loss: 0.809416 [INFO] 2021-07-01 01:20:18 > Step: 64600 Progress: 32.3% Elapsed: 8 days, 19:06:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.583555 Generator_loss: 0.795947 [INFO] 2021-07-01 01:39:34 > Step: 64700 Progress: 32.4% Elapsed: 8 days, 19:25:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.554562 Generator_loss: 0.813979 [INFO] 2021-07-01 01:58:54 > Step: 64800 Progress: 32.4% Elapsed: 8 days, 19:44:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.587236 Generator_loss: 0.761661 [INFO] 2021-07-01 02:18:09 > Step: 64900 Progress: 32.5% Elapsed: 8 days, 20:04:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.604825 Generator_loss: 0.737911 [INFO] 2021-07-01 02:37:25 > Step: 65000 Progress: 32.5% Elapsed: 8 days, 20:23:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.544229 Generator_loss: 0.832878 [INFO] 2021-07-01 02:56:47 > Step: 65100 Progress: 32.6% Elapsed: 8 days, 20:42:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.623072 Generator_loss: 0.764594 [INFO] 2021-07-01 03:16:04 > Step: 65200 Progress: 32.6% Elapsed: 8 days, 21:02:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.614441 Generator_loss: 0.752601 [INFO] 2021-07-01 03:35:17 > Step: 65300 Progress: 32.6% Elapsed: 8 days, 21:21:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.548253 Generator_loss: 0.836549 [INFO] 2021-07-01 03:54:37 > Step: 65400 Progress: 32.7% Elapsed: 8 days, 21:40:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.58836 Generator_loss: 0.783411 [INFO] 2021-07-01 04:13:54 > Step: 65500 Progress: 32.8% Elapsed: 8 days, 21:59:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.591354 Generator_loss: 0.865444 [INFO] 2021-07-01 04:33:09 > Step: 65600 Progress: 32.8% Elapsed: 8 days, 22:19:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.532369 Generator_loss: 0.797109 [INFO] 2021-07-01 04:52:29 > Step: 65700 Progress: 32.9% Elapsed: 8 days, 22:38:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.559644 Generator_loss: 0.842203 [INFO] 2021-07-01 05:11:49 > Step: 65800 Progress: 32.9% Elapsed: 8 days, 22:57:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.566366 Generator_loss: 0.826317 [INFO] 2021-07-01 05:31:07 > Step: 65900 Progress: 33.0% Elapsed: 8 days, 23:17:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.592384 Generator_loss: 0.79763 [INFO] 2021-07-01 05:50:29 > Step: 66000 Progress: 33.0% Elapsed: 8 days, 23:36:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.545155 Generator_loss: 0.793865 [INFO] 2021-07-01 05:50:29 > Start Evaluation (66000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-01 05:50:29 > Calculating FID Score.... [INFO] 2021-07-01 05:51:34 > Calculating Inception Score.... [INFO] 2021-07-01 05:52:29 > Calculate F_beta Score.... [INFO] 2021-07-01 05:54:54 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-01 05:54:54 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-01 05:54:58 > Calculate Accuracies.... [INFO] 2021-07-01 05:55:48 > Calculate Accuracies.... [INFO] 2021-07-01 05:56:39 > F_8 score (Step: 66000, Using valid images): 0.9624918665185662 [INFO] 2021-07-01 05:56:39 > F_1/8 score (Step: 66000, Using valid images): 0.9735129153512119 [INFO] 2021-07-01 05:56:39 > FID score (Step: 66000, Using valid moments): 13.780860891675218 [INFO] 2021-07-01 05:56:39 > Inception score (Step: 66000, 50000 generated images): 51.99471664428711 [INFO] 2021-07-01 05:56:39 > Best FID score (Step: 66000, Using valid moments): 13.780860891675218 [INFO] 2021-07-01 05:56:53 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-01 06:16:15 > Step: 66100 Progress: 33.1% Elapsed: 9 days, 0:02:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.616549 Generator_loss: 0.760795 [INFO] 2021-07-01 06:35:32 > Step: 66200 Progress: 33.1% Elapsed: 9 days, 0:21:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.558407 Generator_loss: 0.794632 [INFO] 2021-07-01 06:54:49 > Step: 66300 Progress: 33.1% Elapsed: 9 days, 0:40:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.539861 Generator_loss: 0.825153 [INFO] 2021-07-01 07:14:10 > Step: 66400 Progress: 33.2% Elapsed: 9 days, 1:00:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.566838 Generator_loss: 0.817623 [INFO] 2021-07-01 07:33:26 > Step: 66500 Progress: 33.2% Elapsed: 9 days, 1:19:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.557553 Generator_loss: 0.806568 [INFO] 2021-07-01 07:52:42 > Step: 66600 Progress: 33.3% Elapsed: 9 days, 1:38:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.573731 Generator_loss: 0.774032 [INFO] 2021-07-01 08:12:06 > Step: 66700 Progress: 33.4% Elapsed: 9 days, 1:58:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.564188 Generator_loss: 0.820944 [INFO] 2021-07-01 08:31:23 > Step: 66800 Progress: 33.4% Elapsed: 9 days, 2:17:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.573447 Generator_loss: 0.815938 [INFO] 2021-07-01 08:50:38 > Step: 66900 Progress: 33.5% Elapsed: 9 days, 2:36:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.567183 Generator_loss: 0.78228 [INFO] 2021-07-01 09:10:01 > Step: 67000 Progress: 33.5% Elapsed: 9 days, 2:56:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.549337 Generator_loss: 0.806598 [INFO] 2021-07-01 09:29:16 > Step: 67100 Progress: 33.6% Elapsed: 9 days, 3:15:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.553126 Generator_loss: 0.814002 [INFO] 2021-07-01 09:48:32 > Step: 67200 Progress: 33.6% Elapsed: 9 days, 3:34:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.595144 Generator_loss: 0.832739 [INFO] 2021-07-01 10:07:55 > Step: 67300 Progress: 33.7% Elapsed: 9 days, 3:54:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.645927 Generator_loss: 0.784876 [INFO] 2021-07-01 10:27:14 > Step: 67400 Progress: 33.7% Elapsed: 9 days, 4:13:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.562506 Generator_loss: 0.805858 [INFO] 2021-07-01 10:46:29 > Step: 67500 Progress: 33.8% Elapsed: 9 days, 4:32:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.579873 Generator_loss: 0.761695 [INFO] 2021-07-01 11:05:54 > Step: 67600 Progress: 33.8% Elapsed: 9 days, 4:51:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.549967 Generator_loss: 0.785937 [INFO] 2021-07-01 11:25:14 > Step: 67700 Progress: 33.9% Elapsed: 9 days, 5:11:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.54391 Generator_loss: 0.795606 [INFO] 2021-07-01 11:44:32 > Step: 67800 Progress: 33.9% Elapsed: 9 days, 5:30:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.563754 Generator_loss: 0.83456 [INFO] 2021-07-01 12:03:56 > Step: 67900 Progress: 34.0% Elapsed: 9 days, 5:50:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.58244 Generator_loss: 0.840125 [INFO] 2021-07-01 12:23:15 > Step: 68000 Progress: 34.0% Elapsed: 9 days, 6:09:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.541111 Generator_loss: 0.882187 [INFO] 2021-07-01 12:23:15 > Start Evaluation (68000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-01 12:23:15 > Calculating FID Score.... [INFO] 2021-07-01 12:24:20 > Calculating Inception Score.... [INFO] 2021-07-01 12:25:15 > Calculate F_beta Score.... [INFO] 2021-07-01 12:27:48 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-01 12:27:48 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-01 12:27:52 > Calculate Accuracies.... [INFO] 2021-07-01 12:28:43 > Calculate Accuracies.... [INFO] 2021-07-01 12:29:33 > F_8 score (Step: 68000, Using valid images): 0.9678870853647478 [INFO] 2021-07-01 12:29:33 > F_1/8 score (Step: 68000, Using valid images): 0.9729245529786764 [INFO] 2021-07-01 12:29:33 > FID score (Step: 68000, Using valid moments): 13.55430584508548 [INFO] 2021-07-01 12:29:33 > Inception score (Step: 68000, 50000 generated images): 53.29833984375 [INFO] 2021-07-01 12:29:33 > Best FID score (Step: 68000, Using valid moments): 13.55430584508548 [INFO] 2021-07-01 12:29:48 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-01 12:49:07 > Step: 68100 Progress: 34.1% Elapsed: 9 days, 6:35:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.578392 Generator_loss: 0.817176 [INFO] 2021-07-01 13:08:30 > Step: 68200 Progress: 34.1% Elapsed: 9 days, 6:54:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.557725 Generator_loss: 0.771417 [INFO] 2021-07-01 13:27:48 > Step: 68300 Progress: 34.2% Elapsed: 9 days, 7:13:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.550074 Generator_loss: 0.797966 [INFO] 2021-07-01 13:47:02 > Step: 68400 Progress: 34.2% Elapsed: 9 days, 7:33:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.566521 Generator_loss: 0.821702 [INFO] 2021-07-01 14:06:25 > Step: 68500 Progress: 34.2% Elapsed: 9 days, 7:52:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.586564 Generator_loss: 0.811956 [INFO] 2021-07-01 14:25:44 > Step: 68600 Progress: 34.3% Elapsed: 9 days, 8:11:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.585788 Generator_loss: 0.79205 [INFO] 2021-07-01 14:45:00 > Step: 68700 Progress: 34.4% Elapsed: 9 days, 8:31:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.534624 Generator_loss: 0.859258 [INFO] 2021-07-01 15:04:16 > Step: 68800 Progress: 34.4% Elapsed: 9 days, 8:50:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.569256 Generator_loss: 0.809782 [INFO] 2021-07-01 15:23:42 > Step: 68900 Progress: 34.4% Elapsed: 9 days, 9:09:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.555411 Generator_loss: 0.817082 [INFO] 2021-07-01 15:43:01 > Step: 69000 Progress: 34.5% Elapsed: 9 days, 9:29:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.541683 Generator_loss: 0.847567 [INFO] 2021-07-01 16:02:18 > Step: 69100 Progress: 34.5% Elapsed: 9 days, 9:48:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.542267 Generator_loss: 0.838339 [INFO] 2021-07-01 16:21:43 > Step: 69200 Progress: 34.6% Elapsed: 9 days, 10:07:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.568717 Generator_loss: 0.824446 [INFO] 2021-07-01 16:41:01 > Step: 69300 Progress: 34.6% Elapsed: 9 days, 10:27:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.540022 Generator_loss: 0.837425 [INFO] 2021-07-01 17:00:18 > Step: 69400 Progress: 34.7% Elapsed: 9 days, 10:46:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.56188 Generator_loss: 0.970228 [INFO] 2021-07-01 17:19:40 > Step: 69500 Progress: 34.8% Elapsed: 9 days, 11:05:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.561102 Generator_loss: 0.80826 [INFO] 2021-07-01 17:38:57 > Step: 69600 Progress: 34.8% Elapsed: 9 days, 11:25:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.560742 Generator_loss: 0.798177 [INFO] 2021-07-01 17:58:11 > Step: 69700 Progress: 34.8% Elapsed: 9 days, 11:44:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.533702 Generator_loss: 0.800491 [INFO] 2021-07-01 18:17:35 > Step: 69800 Progress: 34.9% Elapsed: 9 days, 12:03:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.620264 Generator_loss: 0.870147 [INFO] 2021-07-01 18:36:54 > Step: 69900 Progress: 34.9% Elapsed: 9 days, 12:22:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.559713 Generator_loss: 0.798208 [INFO] 2021-07-01 18:56:12 > Step: 70000 Progress: 35.0% Elapsed: 9 days, 12:42:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.522351 Generator_loss: 0.831144 [INFO] 2021-07-01 18:56:12 > Start Evaluation (70000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-01 18:56:12 > Calculating FID Score.... [INFO] 2021-07-01 18:57:17 > Calculating Inception Score.... [INFO] 2021-07-01 18:58:12 > Calculate F_beta Score.... [INFO] 2021-07-01 19:00:41 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-01 19:00:42 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-01 19:00:45 > Calculate Accuracies.... [INFO] 2021-07-01 19:01:35 > Calculate Accuracies.... [INFO] 2021-07-01 19:02:26 > F_8 score (Step: 70000, Using valid images): 0.9635150394458641 [INFO] 2021-07-01 19:02:26 > F_1/8 score (Step: 70000, Using valid images): 0.9779274511311772 [INFO] 2021-07-01 19:02:26 > FID score (Step: 70000, Using valid moments): 13.259591691171465 [INFO] 2021-07-01 19:02:26 > Inception score (Step: 70000, 50000 generated images): 54.890933990478516 [INFO] 2021-07-01 19:02:26 > Best FID score (Step: 70000, Using valid moments): 13.259591691171465 [INFO] 2021-07-01 19:02:41 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-01 19:22:07 > Step: 70100 Progress: 35.0% Elapsed: 9 days, 13:08:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.519183 Generator_loss: 0.818569 [INFO] 2021-07-01 19:41:26 > Step: 70200 Progress: 35.1% Elapsed: 9 days, 13:27:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.542971 Generator_loss: 0.823979 [INFO] 2021-07-01 20:00:42 > Step: 70300 Progress: 35.1% Elapsed: 9 days, 13:46:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.542613 Generator_loss: 0.82106 [INFO] 2021-07-01 20:20:03 > Step: 70400 Progress: 35.2% Elapsed: 9 days, 14:06:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.558017 Generator_loss: 0.803839 [INFO] 2021-07-01 20:39:22 > Step: 70500 Progress: 35.2% Elapsed: 9 days, 14:25:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.537946 Generator_loss: 0.79241 [INFO] 2021-07-01 20:58:42 > Step: 70600 Progress: 35.3% Elapsed: 9 days, 14:44:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.521986 Generator_loss: 0.828936 [INFO] 2021-07-01 21:18:07 > Step: 70700 Progress: 35.4% Elapsed: 9 days, 15:04:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.548973 Generator_loss: 0.821738 [INFO] 2021-07-01 21:37:26 > Step: 70800 Progress: 35.4% Elapsed: 9 days, 15:23:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.571572 Generator_loss: 0.822479 [INFO] 2021-07-01 21:56:43 > Step: 70900 Progress: 35.4% Elapsed: 9 days, 15:42:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.531791 Generator_loss: 0.881156 [INFO] 2021-07-01 22:16:04 > Step: 71000 Progress: 35.5% Elapsed: 9 days, 16:02:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.533224 Generator_loss: 0.860889 [INFO] 2021-07-01 22:35:20 > Step: 71100 Progress: 35.5% Elapsed: 9 days, 16:21:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.563995 Generator_loss: 0.806782 [INFO] 2021-07-01 22:54:37 > Step: 71200 Progress: 35.6% Elapsed: 9 days, 16:40:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.531624 Generator_loss: 0.835081 [INFO] 2021-07-01 23:13:51 > Step: 71300 Progress: 35.6% Elapsed: 9 days, 16:59:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.597037 Generator_loss: 0.767495 [INFO] 2021-07-01 23:33:17 > Step: 71400 Progress: 35.7% Elapsed: 9 days, 17:19:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.533484 Generator_loss: 0.865077 [INFO] 2021-07-01 23:52:33 > Step: 71500 Progress: 35.8% Elapsed: 9 days, 17:38:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.555082 Generator_loss: 0.886172 [INFO] 2021-07-02 00:11:47 > Step: 71600 Progress: 35.8% Elapsed: 9 days, 17:57:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.545001 Generator_loss: 0.818534 [INFO] 2021-07-02 00:31:09 > Step: 71700 Progress: 35.9% Elapsed: 9 days, 18:17:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.545022 Generator_loss: 0.819398 [INFO] 2021-07-02 00:50:27 > Step: 71800 Progress: 35.9% Elapsed: 9 days, 18:36:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.577435 Generator_loss: 0.814251 [INFO] 2021-07-02 01:09:45 > Step: 71900 Progress: 35.9% Elapsed: 9 days, 18:55:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.576444 Generator_loss: 0.802456 [INFO] 2021-07-02 01:29:10 > Step: 72000 Progress: 36.0% Elapsed: 9 days, 19:15:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.562628 Generator_loss: 0.948744 [INFO] 2021-07-02 01:29:10 > Start Evaluation (72000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-02 01:29:10 > Calculating FID Score.... [INFO] 2021-07-02 01:30:14 > Calculating Inception Score.... [INFO] 2021-07-02 01:31:09 > Calculate F_beta Score.... [INFO] 2021-07-02 01:33:42 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-02 01:33:42 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-02 01:33:46 > Calculate Accuracies.... [INFO] 2021-07-02 01:34:36 > Calculate Accuracies.... [INFO] 2021-07-02 01:35:27 > F_8 score (Step: 72000, Using valid images): 0.9691985835292652 [INFO] 2021-07-02 01:35:27 > F_1/8 score (Step: 72000, Using valid images): 0.9745476584932621 [INFO] 2021-07-02 01:35:27 > FID score (Step: 72000, Using valid moments): 13.042833648728106 [INFO] 2021-07-02 01:35:27 > Inception score (Step: 72000, 50000 generated images): 55.658599853515625 [INFO] 2021-07-02 01:35:27 > Best FID score (Step: 72000, Using valid moments): 13.042833648728106 [INFO] 2021-07-02 01:35:42 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-02 01:54:59 > Step: 72100 Progress: 36.0% Elapsed: 9 days, 19:41:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.556789 Generator_loss: 0.768637 [INFO] 2021-07-02 02:14:17 > Step: 72200 Progress: 36.1% Elapsed: 9 days, 20:00:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.657413 Generator_loss: 0.767039 [INFO] 2021-07-02 02:33:39 > Step: 72300 Progress: 36.1% Elapsed: 9 days, 20:19:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.544885 Generator_loss: 0.808996 [INFO] 2021-07-02 02:52:55 > Step: 72400 Progress: 36.2% Elapsed: 9 days, 20:38:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.596184 Generator_loss: 0.784624 [INFO] 2021-07-02 03:12:13 > Step: 72500 Progress: 36.2% Elapsed: 9 days, 20:58:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.610751 Generator_loss: 0.711819 [INFO] 2021-07-02 03:31:36 > Step: 72600 Progress: 36.3% Elapsed: 9 days, 21:17:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.542466 Generator_loss: 0.83101 [INFO] 2021-07-02 03:50:51 > Step: 72700 Progress: 36.4% Elapsed: 9 days, 21:36:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.545538 Generator_loss: 0.798108 [INFO] 2021-07-02 04:10:07 > Step: 72800 Progress: 36.4% Elapsed: 9 days, 21:56:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.553311 Generator_loss: 0.85559 [INFO] 2021-07-02 04:29:27 > Step: 72900 Progress: 36.4% Elapsed: 9 days, 22:15:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.569434 Generator_loss: 0.793725 [INFO] 2021-07-02 04:48:45 > Step: 73000 Progress: 36.5% Elapsed: 9 days, 22:34:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.558693 Generator_loss: 0.806371 [INFO] 2021-07-02 05:08:01 > Step: 73100 Progress: 36.5% Elapsed: 9 days, 22:54:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.581835 Generator_loss: 0.834401 [INFO] 2021-07-02 05:27:23 > Step: 73200 Progress: 36.6% Elapsed: 9 days, 23:13:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.545849 Generator_loss: 0.819369 [INFO] 2021-07-02 05:46:43 > Step: 73300 Progress: 36.6% Elapsed: 9 days, 23:32:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.544654 Generator_loss: 0.793921 [INFO] 2021-07-02 06:05:57 > Step: 73400 Progress: 36.7% Elapsed: 9 days, 23:52:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.62761 Generator_loss: 0.793694 [INFO] 2021-07-02 06:25:18 > Step: 73500 Progress: 36.8% Elapsed: 10 days, 0:11:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.553376 Generator_loss: 0.758024 [INFO] 2021-07-02 06:44:33 > Step: 73600 Progress: 36.8% Elapsed: 10 days, 0:30:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.542762 Generator_loss: 0.80864 [INFO] 2021-07-02 07:03:49 > Step: 73700 Progress: 36.9% Elapsed: 10 days, 0:49:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.726354 Generator_loss: 0.777428 [INFO] 2021-07-02 07:23:04 > Step: 73800 Progress: 36.9% Elapsed: 10 days, 1:09:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.538502 Generator_loss: 0.832096 [INFO] 2021-07-02 07:42:31 > Step: 73900 Progress: 37.0% Elapsed: 10 days, 1:28:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.557722 Generator_loss: 0.849079 [INFO] 2021-07-02 08:01:49 > Step: 74000 Progress: 37.0% Elapsed: 10 days, 1:47:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.534722 Generator_loss: 0.855072 [INFO] 2021-07-02 08:01:49 > Start Evaluation (74000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-02 08:01:49 > Calculating FID Score.... [INFO] 2021-07-02 08:02:54 > Calculating Inception Score.... [INFO] 2021-07-02 08:03:48 > Calculate F_beta Score.... [INFO] 2021-07-02 08:06:10 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-02 08:06:11 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-02 08:06:14 > Calculate Accuracies.... [INFO] 2021-07-02 08:07:05 > Calculate Accuracies.... [INFO] 2021-07-02 08:07:55 > F_8 score (Step: 74000, Using valid images): 0.9685413154457277 [INFO] 2021-07-02 08:07:55 > F_1/8 score (Step: 74000, Using valid images): 0.9740806407999273 [INFO] 2021-07-02 08:07:55 > FID score (Step: 74000, Using valid moments): 12.792910386391952 [INFO] 2021-07-02 08:07:55 > Inception score (Step: 74000, 50000 generated images): 56.3109245300293 [INFO] 2021-07-02 08:07:55 > Best FID score (Step: 74000, Using valid moments): 12.792910386391952 [INFO] 2021-07-02 08:08:10 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-02 08:27:29 > Step: 74100 Progress: 37.0% Elapsed: 10 days, 2:13:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.52686 Generator_loss: 0.846676 [INFO] 2021-07-02 08:46:55 > Step: 74200 Progress: 37.1% Elapsed: 10 days, 2:32:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.607158 Generator_loss: 0.763917 [INFO] 2021-07-02 09:06:12 > Step: 74300 Progress: 37.1% Elapsed: 10 days, 2:52:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.556882 Generator_loss: 0.872097 [INFO] 2021-07-02 09:25:31 > Step: 74400 Progress: 37.2% Elapsed: 10 days, 3:11:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.541746 Generator_loss: 0.814893 [INFO] 2021-07-02 09:44:54 > Step: 74500 Progress: 37.2% Elapsed: 10 days, 3:30:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.528969 Generator_loss: 0.830323 [INFO] 2021-07-02 10:04:12 > Step: 74600 Progress: 37.3% Elapsed: 10 days, 3:50:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.547197 Generator_loss: 0.75015 [INFO] 2021-07-02 10:23:28 > Step: 74700 Progress: 37.4% Elapsed: 10 days, 4:09:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.557426 Generator_loss: 0.798778 [INFO] 2021-07-02 10:42:52 > Step: 74800 Progress: 37.4% Elapsed: 10 days, 4:28:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.509416 Generator_loss: 0.883445 [INFO] 2021-07-02 11:02:10 > Step: 74900 Progress: 37.5% Elapsed: 10 days, 4:48:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.567378 Generator_loss: 0.829192 [INFO] 2021-07-02 11:21:26 > Step: 75000 Progress: 37.5% Elapsed: 10 days, 5:07:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.580636 Generator_loss: 0.844131 [INFO] 2021-07-02 11:40:52 > Step: 75100 Progress: 37.5% Elapsed: 10 days, 5:26:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.542616 Generator_loss: 0.945474 [INFO] 2021-07-02 12:00:10 > Step: 75200 Progress: 37.6% Elapsed: 10 days, 5:46:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.536234 Generator_loss: 0.856395 [INFO] 2021-07-02 12:19:26 > Step: 75300 Progress: 37.6% Elapsed: 10 days, 6:05:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.519778 Generator_loss: 0.992372 [INFO] 2021-07-02 12:38:52 > Step: 75400 Progress: 37.7% Elapsed: 10 days, 6:24:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.546997 Generator_loss: 0.79469 [INFO] 2021-07-02 12:58:11 > Step: 75500 Progress: 37.8% Elapsed: 10 days, 6:44:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.563523 Generator_loss: 0.808213 [INFO] 2021-07-02 13:17:29 > Step: 75600 Progress: 37.8% Elapsed: 10 days, 7:03:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.531393 Generator_loss: 0.836171 [INFO] 2021-07-02 13:36:54 > Step: 75700 Progress: 37.9% Elapsed: 10 days, 7:22:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.53783 Generator_loss: 0.846975 [INFO] 2021-07-02 13:56:10 > Step: 75800 Progress: 37.9% Elapsed: 10 days, 7:42:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.538351 Generator_loss: 0.878968 [INFO] 2021-07-02 14:15:29 > Step: 75900 Progress: 38.0% Elapsed: 10 days, 8:01:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.518632 Generator_loss: 0.920449 [INFO] 2021-07-02 14:34:54 > Step: 76000 Progress: 38.0% Elapsed: 10 days, 8:20:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.552462 Generator_loss: 0.815074 [INFO] 2021-07-02 14:34:54 > Start Evaluation (76000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-02 14:34:54 > Calculating FID Score.... [INFO] 2021-07-02 14:36:00 > Calculating Inception Score.... [INFO] 2021-07-02 14:36:56 > Calculate F_beta Score.... [INFO] 2021-07-02 14:39:24 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-02 14:39:25 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-02 14:39:28 > Calculate Accuracies.... [INFO] 2021-07-02 14:40:19 > Calculate Accuracies.... [INFO] 2021-07-02 14:41:09 > F_8 score (Step: 76000, Using valid images): 0.9700446721997349 [INFO] 2021-07-02 14:41:09 > F_1/8 score (Step: 76000, Using valid images): 0.9739146461907494 [INFO] 2021-07-02 14:41:09 > FID score (Step: 76000, Using valid moments): 12.64217849854981 [INFO] 2021-07-02 14:41:09 > Inception score (Step: 76000, 50000 generated images): 57.37497329711914 [INFO] 2021-07-02 14:41:09 > Best FID score (Step: 76000, Using valid moments): 12.64217849854981 [INFO] 2021-07-02 14:41:24 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-02 15:00:44 > Step: 76100 Progress: 38.0% Elapsed: 10 days, 8:46:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.517925 Generator_loss: 0.83417 [INFO] 2021-07-02 15:20:02 > Step: 76200 Progress: 38.1% Elapsed: 10 days, 9:06:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.582479 Generator_loss: 0.863567 [INFO] 2021-07-02 15:39:20 > Step: 76300 Progress: 38.1% Elapsed: 10 days, 9:25:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.547831 Generator_loss: 0.801102 [INFO] 2021-07-02 15:58:46 > Step: 76400 Progress: 38.2% Elapsed: 10 days, 9:44:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.580339 Generator_loss: 0.808151 [INFO] 2021-07-02 16:18:04 > Step: 76500 Progress: 38.2% Elapsed: 10 days, 10:04:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.559852 Generator_loss: 0.844997 [INFO] 2021-07-02 16:37:23 > Step: 76600 Progress: 38.3% Elapsed: 10 days, 10:23:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.536682 Generator_loss: 0.798041 [INFO] 2021-07-02 16:56:45 > Step: 76700 Progress: 38.4% Elapsed: 10 days, 10:42:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.52404 Generator_loss: 0.900791 [INFO] 2021-07-02 17:16:00 > Step: 76800 Progress: 38.4% Elapsed: 10 days, 11:02:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.542745 Generator_loss: 0.860878 [INFO] 2021-07-02 17:35:17 > Step: 76900 Progress: 38.5% Elapsed: 10 days, 11:21:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.542525 Generator_loss: 0.801222 [INFO] 2021-07-02 17:54:43 > Step: 77000 Progress: 38.5% Elapsed: 10 days, 11:40:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.520206 Generator_loss: 0.827641 [INFO] 2021-07-02 18:14:00 > Step: 77100 Progress: 38.6% Elapsed: 10 days, 12:00:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.523127 Generator_loss: 0.815452 [INFO] 2021-07-02 18:33:16 > Step: 77200 Progress: 38.6% Elapsed: 10 days, 12:19:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.562858 Generator_loss: 0.744964 [INFO] 2021-07-02 18:52:40 > Step: 77300 Progress: 38.6% Elapsed: 10 days, 12:38:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.581137 Generator_loss: 0.829183 [INFO] 2021-07-02 19:11:58 > Step: 77400 Progress: 38.7% Elapsed: 10 days, 12:58:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.544653 Generator_loss: 0.786025 [INFO] 2021-07-02 19:31:14 > Step: 77500 Progress: 38.8% Elapsed: 10 days, 13:17:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.555991 Generator_loss: 0.807106 [INFO] 2021-07-02 19:50:40 > Step: 77600 Progress: 38.8% Elapsed: 10 days, 13:36:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.547948 Generator_loss: 0.819466 [INFO] 2021-07-02 20:09:58 > Step: 77700 Progress: 38.9% Elapsed: 10 days, 13:56:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.538349 Generator_loss: 0.839181 [INFO] 2021-07-02 20:29:16 > Step: 77800 Progress: 38.9% Elapsed: 10 days, 14:15:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.585233 Generator_loss: 0.821135 [INFO] 2021-07-02 20:48:38 > Step: 77900 Progress: 39.0% Elapsed: 10 days, 14:34:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.525189 Generator_loss: 0.862487 [INFO] 2021-07-02 21:07:55 > Step: 78000 Progress: 39.0% Elapsed: 10 days, 14:54:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.547126 Generator_loss: 0.842469 [INFO] 2021-07-02 21:07:55 > Start Evaluation (78000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-02 21:07:55 > Calculating FID Score.... [INFO] 2021-07-02 21:09:01 > Calculating Inception Score.... [INFO] 2021-07-02 21:09:56 > Calculate F_beta Score.... [INFO] 2021-07-02 21:12:22 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-02 21:12:23 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-02 21:12:26 > Calculate Accuracies.... [INFO] 2021-07-02 21:13:17 > Calculate Accuracies.... [INFO] 2021-07-02 21:14:08 > F_8 score (Step: 78000, Using valid images): 0.9657864710918137 [INFO] 2021-07-02 21:14:08 > F_1/8 score (Step: 78000, Using valid images): 0.9786863897591523 [INFO] 2021-07-02 21:14:08 > FID score (Step: 78000, Using valid moments): 12.388009110048927 [INFO] 2021-07-02 21:14:08 > Inception score (Step: 78000, 50000 generated images): 58.693199157714844 [INFO] 2021-07-02 21:14:08 > Best FID score (Step: 78000, Using valid moments): 12.388009110048927 [INFO] 2021-07-02 21:14:23 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-02 21:33:44 > Step: 78100 Progress: 39.1% Elapsed: 10 days, 15:19:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.536464 Generator_loss: 0.832781 [INFO] 2021-07-02 21:53:10 > Step: 78200 Progress: 39.1% Elapsed: 10 days, 15:39:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.604663 Generator_loss: 0.811941 [INFO] 2021-07-02 22:12:28 > Step: 78300 Progress: 39.1% Elapsed: 10 days, 15:58:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.535742 Generator_loss: 0.79965 [INFO] 2021-07-02 22:31:45 > Step: 78400 Progress: 39.2% Elapsed: 10 days, 16:17:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.554211 Generator_loss: 0.847801 [INFO] 2021-07-02 22:51:00 > Step: 78500 Progress: 39.2% Elapsed: 10 days, 16:37:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.533074 Generator_loss: 0.952018 [INFO] 2021-07-02 23:10:23 > Step: 78600 Progress: 39.3% Elapsed: 10 days, 16:56:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.531849 Generator_loss: 0.823782 [INFO] 2021-07-02 23:29:39 > Step: 78700 Progress: 39.4% Elapsed: 10 days, 17:15:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.543734 Generator_loss: 0.793589 [INFO] 2021-07-02 23:48:58 > Step: 78800 Progress: 39.4% Elapsed: 10 days, 17:35:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.537193 Generator_loss: 0.86178 [INFO] 2021-07-03 00:08:28 > Step: 78900 Progress: 39.5% Elapsed: 10 days, 17:54:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.604563 Generator_loss: 0.843183 [INFO] 2021-07-03 00:27:47 > Step: 79000 Progress: 39.5% Elapsed: 10 days, 18:13:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.547761 Generator_loss: 0.813497 [INFO] 2021-07-03 00:47:07 > Step: 79100 Progress: 39.6% Elapsed: 10 days, 18:33:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.542927 Generator_loss: 0.839059 [INFO] 2021-07-03 01:06:32 > Step: 79200 Progress: 39.6% Elapsed: 10 days, 18:52:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.522429 Generator_loss: 0.786876 [INFO] 2021-07-03 01:25:48 > Step: 79300 Progress: 39.6% Elapsed: 10 days, 19:11:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.538011 Generator_loss: 0.823589 [INFO] 2021-07-03 01:45:12 > Step: 79400 Progress: 39.7% Elapsed: 10 days, 19:31:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.552407 Generator_loss: 0.786761 [INFO] 2021-07-03 02:04:37 > Step: 79500 Progress: 39.8% Elapsed: 10 days, 19:50:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.536425 Generator_loss: 0.797506 [INFO] 2021-07-03 02:23:53 > Step: 79600 Progress: 39.8% Elapsed: 10 days, 20:09:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.51687 Generator_loss: 0.845106 [INFO] 2021-07-03 02:43:09 > Step: 79700 Progress: 39.9% Elapsed: 10 days, 20:29:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.539719 Generator_loss: 0.890679 [INFO] 2021-07-03 03:02:31 > Step: 79800 Progress: 39.9% Elapsed: 10 days, 20:48:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.574395 Generator_loss: 0.838906 [INFO] 2021-07-03 03:21:48 > Step: 79900 Progress: 40.0% Elapsed: 10 days, 21:07:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.548776 Generator_loss: 0.826076 [INFO] 2021-07-03 03:41:07 > Step: 80000 Progress: 40.0% Elapsed: 10 days, 21:27:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.653491 Generator_loss: 0.819866 [INFO] 2021-07-03 03:41:07 > Start Evaluation (80000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-03 03:41:07 > Calculating FID Score.... [INFO] 2021-07-03 03:42:12 > Calculating Inception Score.... [INFO] 2021-07-03 03:43:06 > Calculate F_beta Score.... [INFO] 2021-07-03 03:45:31 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-03 03:45:31 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-03 03:45:35 > Calculate Accuracies.... [INFO] 2021-07-03 03:46:25 > Calculate Accuracies.... [INFO] 2021-07-03 03:47:16 > F_8 score (Step: 80000, Using valid images): 0.9718953607835794 [INFO] 2021-07-03 03:47:16 > F_1/8 score (Step: 80000, Using valid images): 0.9775838971065861 [INFO] 2021-07-03 03:47:16 > FID score (Step: 80000, Using valid moments): 12.140070954607324 [INFO] 2021-07-03 03:47:16 > Inception score (Step: 80000, 50000 generated images): 60.177879333496094 [INFO] 2021-07-03 03:47:16 > Best FID score (Step: 80000, Using valid moments): 12.140070954607324 [INFO] 2021-07-03 03:47:31 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-03 04:06:57 > Step: 80100 Progress: 40.1% Elapsed: 10 days, 21:53:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.56685 Generator_loss: 0.828637 [INFO] 2021-07-03 04:26:15 > Step: 80200 Progress: 40.1% Elapsed: 10 days, 22:12:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.530632 Generator_loss: 0.849639 [INFO] 2021-07-03 04:45:32 > Step: 80300 Progress: 40.2% Elapsed: 10 days, 22:31:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.527406 Generator_loss: 0.853202 [INFO] 2021-07-03 05:04:58 > Step: 80400 Progress: 40.2% Elapsed: 10 days, 22:51:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.549507 Generator_loss: 0.833599 [INFO] 2021-07-03 05:24:18 > Step: 80500 Progress: 40.2% Elapsed: 10 days, 23:10:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.671562 Generator_loss: 0.902217 [INFO] 2021-07-03 05:43:35 > Step: 80600 Progress: 40.3% Elapsed: 10 days, 23:29:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.534 Generator_loss: 0.827792 [INFO] 2021-07-03 06:03:01 > Step: 80700 Progress: 40.4% Elapsed: 10 days, 23:49:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.522279 Generator_loss: 0.889181 [INFO] 2021-07-03 06:22:19 > Step: 80800 Progress: 40.4% Elapsed: 11 days, 0:08:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.557503 Generator_loss: 0.803678 [INFO] 2021-07-03 06:41:37 > Step: 80900 Progress: 40.5% Elapsed: 11 days, 0:27:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.52828 Generator_loss: 0.886297 [INFO] 2021-07-03 07:00:54 > Step: 81000 Progress: 40.5% Elapsed: 11 days, 0:46:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.526702 Generator_loss: 0.868355 [INFO] 2021-07-03 07:20:18 > Step: 81100 Progress: 40.6% Elapsed: 11 days, 1:06:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.517802 Generator_loss: 0.829382 [INFO] 2021-07-03 07:39:33 > Step: 81200 Progress: 40.6% Elapsed: 11 days, 1:25:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.569791 Generator_loss: 0.784843 [INFO] 2021-07-03 07:58:49 > Step: 81300 Progress: 40.6% Elapsed: 11 days, 1:44:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.590068 Generator_loss: 0.843531 [INFO] 2021-07-03 08:18:15 > Step: 81400 Progress: 40.7% Elapsed: 11 days, 2:04:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.520124 Generator_loss: 0.869025 [INFO] 2021-07-03 08:37:32 > Step: 81500 Progress: 40.8% Elapsed: 11 days, 2:23:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.618588 Generator_loss: 0.88692 [INFO] 2021-07-03 08:56:50 > Step: 81600 Progress: 40.8% Elapsed: 11 days, 2:42:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.556529 Generator_loss: 0.870511 [INFO] 2021-07-03 09:16:16 > Step: 81700 Progress: 40.8% Elapsed: 11 days, 3:02:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.532907 Generator_loss: 0.820883 [INFO] 2021-07-03 09:35:36 > Step: 81800 Progress: 40.9% Elapsed: 11 days, 3:21:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.529133 Generator_loss: 0.814472 [INFO] 2021-07-03 09:54:53 > Step: 81900 Progress: 40.9% Elapsed: 11 days, 3:40:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.598287 Generator_loss: 0.771251 [INFO] 2021-07-03 10:14:18 > Step: 82000 Progress: 41.0% Elapsed: 11 days, 4:00:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.505997 Generator_loss: 0.934914 [INFO] 2021-07-03 10:14:18 > Start Evaluation (82000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-03 10:14:18 > Calculating FID Score.... [INFO] 2021-07-03 10:15:25 > Calculating Inception Score.... [INFO] 2021-07-03 10:16:20 > Calculate F_beta Score.... [INFO] 2021-07-03 10:18:44 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-03 10:18:44 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-03 10:18:47 > Calculate Accuracies.... [INFO] 2021-07-03 10:19:37 > Calculate Accuracies.... [INFO] 2021-07-03 10:20:28 > F_8 score (Step: 82000, Using valid images): 0.970522058689578 [INFO] 2021-07-03 10:20:28 > F_1/8 score (Step: 82000, Using valid images): 0.9776248544107733 [INFO] 2021-07-03 10:20:28 > FID score (Step: 82000, Using valid moments): 12.052574022668296 [INFO] 2021-07-03 10:20:28 > Inception score (Step: 82000, 50000 generated images): 61.08469009399414 [INFO] 2021-07-03 10:20:28 > Best FID score (Step: 82000, Using valid moments): 12.052574022668296 [INFO] 2021-07-03 10:20:43 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-03 10:40:06 > Step: 82100 Progress: 41.0% Elapsed: 11 days, 4:26:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.529434 Generator_loss: 0.791398 [INFO] 2021-07-03 10:59:26 > Step: 82200 Progress: 41.1% Elapsed: 11 days, 4:45:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.520204 Generator_loss: 0.893385 [INFO] 2021-07-03 11:18:52 > Step: 82300 Progress: 41.1% Elapsed: 11 days, 5:04:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.678402 Generator_loss: 0.831425 [INFO] 2021-07-03 11:38:11 > Step: 82400 Progress: 41.2% Elapsed: 11 days, 5:24:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.531454 Generator_loss: 0.848982 [INFO] 2021-07-03 11:57:28 > Step: 82500 Progress: 41.2% Elapsed: 11 days, 5:43:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.556526 Generator_loss: 0.756625 [INFO] 2021-07-03 12:16:54 > Step: 82600 Progress: 41.3% Elapsed: 11 days, 6:02:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.550373 Generator_loss: 0.84664 [INFO] 2021-07-03 12:36:12 > Step: 82700 Progress: 41.3% Elapsed: 11 days, 6:22:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.512105 Generator_loss: 0.844601 [INFO] 2021-07-03 12:55:33 > Step: 82800 Progress: 41.4% Elapsed: 11 days, 6:41:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.557774 Generator_loss: 0.852271 [INFO] 2021-07-03 13:14:56 > Step: 82900 Progress: 41.4% Elapsed: 11 days, 7:01:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.528184 Generator_loss: 0.819522 [INFO] 2021-07-03 13:34:13 > Step: 83000 Progress: 41.5% Elapsed: 11 days, 7:20:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.542335 Generator_loss: 0.914581 [INFO] 2021-07-03 13:53:31 > Step: 83100 Progress: 41.5% Elapsed: 11 days, 7:39:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.539411 Generator_loss: 0.79226 [INFO] 2021-07-03 14:12:55 > Step: 83200 Progress: 41.6% Elapsed: 11 days, 7:59:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.517224 Generator_loss: 0.899161 [INFO] 2021-07-03 14:32:15 > Step: 83300 Progress: 41.6% Elapsed: 11 days, 8:18:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.567664 Generator_loss: 0.872631 [INFO] 2021-07-03 14:51:36 > Step: 83400 Progress: 41.7% Elapsed: 11 days, 8:37:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.522669 Generator_loss: 0.860998 [INFO] 2021-07-03 15:10:55 > Step: 83500 Progress: 41.8% Elapsed: 11 days, 8:56:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.53365 Generator_loss: 0.773913 [INFO] 2021-07-03 15:30:21 > Step: 83600 Progress: 41.8% Elapsed: 11 days, 9:16:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.522575 Generator_loss: 0.850711 [INFO] 2021-07-03 15:49:41 > Step: 83700 Progress: 41.9% Elapsed: 11 days, 9:35:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.515619 Generator_loss: 0.895006 [INFO] 2021-07-03 16:08:58 > Step: 83800 Progress: 41.9% Elapsed: 11 days, 9:55:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.539779 Generator_loss: 0.836464 [INFO] 2021-07-03 16:28:24 > Step: 83900 Progress: 41.9% Elapsed: 11 days, 10:14:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.630451 Generator_loss: 0.88513 [INFO] 2021-07-03 16:47:43 > Step: 84000 Progress: 42.0% Elapsed: 11 days, 10:33:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.55905 Generator_loss: 0.890285 [INFO] 2021-07-03 16:47:43 > Start Evaluation (84000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-03 16:47:43 > Calculating FID Score.... [INFO] 2021-07-03 16:48:49 > Calculating Inception Score.... [INFO] 2021-07-03 16:49:43 > Calculate F_beta Score.... [INFO] 2021-07-03 16:52:21 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-03 16:52:21 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-03 16:52:25 > Calculate Accuracies.... [INFO] 2021-07-03 16:53:15 > Calculate Accuracies.... [INFO] 2021-07-03 16:54:07 > F_8 score (Step: 84000, Using valid images): 0.9752265876963713 [INFO] 2021-07-03 16:54:07 > F_1/8 score (Step: 84000, Using valid images): 0.9793093335575452 [INFO] 2021-07-03 16:54:07 > FID score (Step: 84000, Using valid moments): 11.707100693924758 [INFO] 2021-07-03 16:54:07 > Inception score (Step: 84000, 50000 generated images): 61.74370574951172 [INFO] 2021-07-03 16:54:07 > Best FID score (Step: 84000, Using valid moments): 11.707100693924758 [INFO] 2021-07-03 16:54:22 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-03 17:13:43 > Step: 84100 Progress: 42.0% Elapsed: 11 days, 10:59:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.52343 Generator_loss: 0.849943 [INFO] 2021-07-03 17:33:07 > Step: 84200 Progress: 42.1% Elapsed: 11 days, 11:19:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.54692 Generator_loss: 0.819558 [INFO] 2021-07-03 17:52:27 > Step: 84300 Progress: 42.1% Elapsed: 11 days, 11:38:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.540718 Generator_loss: 0.820908 [INFO] 2021-07-03 18:11:45 > Step: 84400 Progress: 42.2% Elapsed: 11 days, 11:57:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.519318 Generator_loss: 0.862965 [INFO] 2021-07-03 18:31:10 > Step: 84500 Progress: 42.2% Elapsed: 11 days, 12:17:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.55476 Generator_loss: 0.819165 [INFO] 2021-07-03 18:50:27 > Step: 84600 Progress: 42.3% Elapsed: 11 days, 12:36:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.526543 Generator_loss: 0.836696 [INFO] 2021-07-03 19:09:45 > Step: 84700 Progress: 42.4% Elapsed: 11 days, 12:55:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.585062 Generator_loss: 0.824861 [INFO] 2021-07-03 19:29:13 > Step: 84800 Progress: 42.4% Elapsed: 11 days, 13:15:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.702085 Generator_loss: 0.739368 [INFO] 2021-07-03 19:48:35 > Step: 84900 Progress: 42.4% Elapsed: 11 days, 13:34:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.517019 Generator_loss: 0.848874 [INFO] 2021-07-03 20:07:54 > Step: 85000 Progress: 42.5% Elapsed: 11 days, 13:53:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.540624 Generator_loss: 0.813154 [INFO] 2021-07-03 20:27:19 > Step: 85100 Progress: 42.5% Elapsed: 11 days, 14:13:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.601838 Generator_loss: 0.771437 [INFO] 2021-07-03 20:46:39 > Step: 85200 Progress: 42.6% Elapsed: 11 days, 14:32:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.526352 Generator_loss: 0.815419 [INFO] 2021-07-03 21:05:55 > Step: 85300 Progress: 42.6% Elapsed: 11 days, 14:51:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.534611 Generator_loss: 0.835442 [INFO] 2021-07-03 21:25:18 > Step: 85400 Progress: 42.7% Elapsed: 11 days, 15:11:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.504968 Generator_loss: 0.970683 [INFO] 2021-07-03 21:44:38 > Step: 85500 Progress: 42.8% Elapsed: 11 days, 15:30:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.520307 Generator_loss: 0.817376 [INFO] 2021-07-03 22:03:54 > Step: 85600 Progress: 42.8% Elapsed: 11 days, 15:49:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.529272 Generator_loss: 0.800255 [INFO] 2021-07-03 22:23:19 > Step: 85700 Progress: 42.9% Elapsed: 11 days, 16:09:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.518277 Generator_loss: 0.837339 [INFO] 2021-07-03 22:42:41 > Step: 85800 Progress: 42.9% Elapsed: 11 days, 16:28:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.494453 Generator_loss: 1.0455 [INFO] 2021-07-03 23:01:58 > Step: 85900 Progress: 43.0% Elapsed: 11 days, 16:48:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.537924 Generator_loss: 0.842435 [INFO] 2021-07-03 23:21:15 > Step: 86000 Progress: 43.0% Elapsed: 11 days, 17:07:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.543534 Generator_loss: 0.87594 [INFO] 2021-07-03 23:21:15 > Start Evaluation (86000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-03 23:21:15 > Calculating FID Score.... [INFO] 2021-07-03 23:22:20 > Calculating Inception Score.... [INFO] 2021-07-03 23:23:15 > Calculate F_beta Score.... [INFO] 2021-07-03 23:25:57 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-03 23:25:58 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-03 23:26:01 > Calculate Accuracies.... [INFO] 2021-07-03 23:26:51 > Calculate Accuracies.... [INFO] 2021-07-03 23:27:41 > F_8 score (Step: 86000, Using valid images): 0.9711631482973849 [INFO] 2021-07-03 23:27:41 > F_1/8 score (Step: 86000, Using valid images): 0.9792884523851118 [INFO] 2021-07-03 23:27:41 > FID score (Step: 86000, Using valid moments): 11.721896565283032 [INFO] 2021-07-03 23:27:41 > Inception score (Step: 86000, 50000 generated images): 62.77888870239258 [INFO] 2021-07-03 23:27:41 > Best FID score (Step: 84000, Using valid moments): 11.707100693924758 [INFO] 2021-07-03 23:27:49 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-03 23:47:12 > Step: 86100 Progress: 43.0% Elapsed: 11 days, 17:33:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.541343 Generator_loss: 0.810655 [INFO] 2021-07-04 00:06:31 > Step: 86200 Progress: 43.1% Elapsed: 11 days, 17:52:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.551185 Generator_loss: 0.744552 [INFO] 2021-07-04 00:25:49 > Step: 86300 Progress: 43.1% Elapsed: 11 days, 18:11:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.534805 Generator_loss: 0.822361 [INFO] 2021-07-04 00:45:16 > Step: 86400 Progress: 43.2% Elapsed: 11 days, 18:31:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.541538 Generator_loss: 0.825031 [INFO] 2021-07-04 01:04:35 > Step: 86500 Progress: 43.2% Elapsed: 11 days, 18:50:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.516097 Generator_loss: 0.896594 [INFO] 2021-07-04 01:23:53 > Step: 86600 Progress: 43.3% Elapsed: 11 days, 19:09:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.508095 Generator_loss: 0.877506 [INFO] 2021-07-04 01:43:16 > Step: 86700 Progress: 43.4% Elapsed: 11 days, 19:29:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.516238 Generator_loss: 0.832615 [INFO] 2021-07-04 02:02:35 > Step: 86800 Progress: 43.4% Elapsed: 11 days, 19:48:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.508305 Generator_loss: 0.921165 [INFO] 2021-07-04 02:21:53 > Step: 86900 Progress: 43.5% Elapsed: 11 days, 20:07:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.539816 Generator_loss: 0.868654 [INFO] 2021-07-04 02:41:20 > Step: 87000 Progress: 43.5% Elapsed: 11 days, 20:27:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.522181 Generator_loss: 0.887174 [INFO] 2021-07-04 03:00:43 > Step: 87100 Progress: 43.5% Elapsed: 11 days, 20:46:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.543427 Generator_loss: 0.82377 [INFO] 2021-07-04 03:20:02 > Step: 87200 Progress: 43.6% Elapsed: 11 days, 21:06:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.498496 Generator_loss: 0.925198 [INFO] 2021-07-04 03:39:32 > Step: 87300 Progress: 43.6% Elapsed: 11 days, 21:25:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.522524 Generator_loss: 0.803216 [INFO] 2021-07-04 03:58:53 > Step: 87400 Progress: 43.7% Elapsed: 11 days, 21:44:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.506622 Generator_loss: 0.921412 [INFO] 2021-07-04 04:18:14 > Step: 87500 Progress: 43.8% Elapsed: 11 days, 22:04:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.553343 Generator_loss: 0.799161 [INFO] 2021-07-04 04:37:43 > Step: 87600 Progress: 43.8% Elapsed: 11 days, 22:23:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.546686 Generator_loss: 0.876276 [INFO] 2021-07-04 04:57:02 > Step: 87700 Progress: 43.9% Elapsed: 11 days, 22:43:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.619608 Generator_loss: 0.780472 [INFO] 2021-07-04 05:16:21 > Step: 87800 Progress: 43.9% Elapsed: 11 days, 23:02:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.547969 Generator_loss: 0.814467 [INFO] 2021-07-04 05:35:48 > Step: 87900 Progress: 44.0% Elapsed: 11 days, 23:21:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.496402 Generator_loss: 0.927523 [INFO] 2021-07-04 05:55:11 > Step: 88000 Progress: 44.0% Elapsed: 11 days, 23:41:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.51222 Generator_loss: 0.85686 [INFO] 2021-07-04 05:55:11 > Start Evaluation (88000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-04 05:55:12 > Calculating FID Score.... [INFO] 2021-07-04 05:56:18 > Calculating Inception Score.... [INFO] 2021-07-04 05:57:13 > Calculate F_beta Score.... [INFO] 2021-07-04 05:59:54 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-04 05:59:55 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-04 05:59:58 > Calculate Accuracies.... [INFO] 2021-07-04 06:00:48 > Calculate Accuracies.... [INFO] 2021-07-04 06:01:39 > F_8 score (Step: 88000, Using valid images): 0.9739746197681369 [INFO] 2021-07-04 06:01:39 > F_1/8 score (Step: 88000, Using valid images): 0.9787790840897159 [INFO] 2021-07-04 06:01:39 > FID score (Step: 88000, Using valid moments): 11.519669682418623 [INFO] 2021-07-04 06:01:39 > Inception score (Step: 88000, 50000 generated images): 64.17039489746094 [INFO] 2021-07-04 06:01:39 > Best FID score (Step: 88000, Using valid moments): 11.519669682418623 [INFO] 2021-07-04 06:01:54 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-04 06:21:18 > Step: 88100 Progress: 44.0% Elapsed: 12 days, 0:07:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.594355 Generator_loss: 0.827374 [INFO] 2021-07-04 06:40:47 > Step: 88200 Progress: 44.1% Elapsed: 12 days, 0:26:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.515391 Generator_loss: 0.808588 [INFO] 2021-07-04 07:00:11 > Step: 88300 Progress: 44.1% Elapsed: 12 days, 0:46:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.515909 Generator_loss: 0.837057 [INFO] 2021-07-04 07:19:34 > Step: 88400 Progress: 44.2% Elapsed: 12 days, 1:05:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.549447 Generator_loss: 0.801586 [INFO] 2021-07-04 07:38:54 > Step: 88500 Progress: 44.2% Elapsed: 12 days, 1:24:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.603452 Generator_loss: 0.770166 [INFO] 2021-07-04 07:58:20 > Step: 88600 Progress: 44.3% Elapsed: 12 days, 1:44:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.512278 Generator_loss: 0.912495 [INFO] 2021-07-04 08:17:39 > Step: 88700 Progress: 44.4% Elapsed: 12 days, 2:03:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.529189 Generator_loss: 0.870317 [INFO] 2021-07-04 08:37:00 > Step: 88800 Progress: 44.4% Elapsed: 12 days, 2:23:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.629794 Generator_loss: 0.874018 [INFO] 2021-07-04 08:56:27 > Step: 88900 Progress: 44.5% Elapsed: 12 days, 2:42:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.584916 Generator_loss: 0.826349 [INFO] 2021-07-04 09:15:48 > Step: 89000 Progress: 44.5% Elapsed: 12 days, 3:01:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.525805 Generator_loss: 0.865809 [INFO] 2021-07-04 09:35:09 > Step: 89100 Progress: 44.5% Elapsed: 12 days, 3:21:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.499029 Generator_loss: 0.917697 [INFO] 2021-07-04 09:54:40 > Step: 89200 Progress: 44.6% Elapsed: 12 days, 3:40:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.515566 Generator_loss: 0.941384 [INFO] 2021-07-04 10:14:03 > Step: 89300 Progress: 44.6% Elapsed: 12 days, 4:00:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.51002 Generator_loss: 0.879407 [INFO] 2021-07-04 10:33:26 > Step: 89400 Progress: 44.7% Elapsed: 12 days, 4:19:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.511276 Generator_loss: 0.885011 [INFO] 2021-07-04 10:52:57 > Step: 89500 Progress: 44.8% Elapsed: 12 days, 4:39:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.659996 Generator_loss: 0.840236 [INFO] 2021-07-04 11:12:17 > Step: 89600 Progress: 44.8% Elapsed: 12 days, 4:58:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.501383 Generator_loss: 0.897469 [INFO] 2021-07-04 11:31:41 > Step: 89700 Progress: 44.9% Elapsed: 12 days, 5:17:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.509676 Generator_loss: 0.881505 [INFO] 2021-07-04 11:51:11 > Step: 89800 Progress: 44.9% Elapsed: 12 days, 5:37:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.529701 Generator_loss: 0.830662 [INFO] 2021-07-04 12:10:33 > Step: 89900 Progress: 45.0% Elapsed: 12 days, 5:56:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.532845 Generator_loss: 0.854946 [INFO] 2021-07-04 12:29:55 > Step: 90000 Progress: 45.0% Elapsed: 12 days, 6:16:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.524934 Generator_loss: 0.851636 [INFO] 2021-07-04 12:29:55 > Start Evaluation (90000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-04 12:29:55 > Calculating FID Score.... [INFO] 2021-07-04 12:31:01 > Calculating Inception Score.... [INFO] 2021-07-04 12:31:56 > Calculate F_beta Score.... [INFO] 2021-07-04 12:34:38 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-04 12:34:39 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-04 12:34:42 > Calculate Accuracies.... [INFO] 2021-07-04 12:35:31 > Calculate Accuracies.... [INFO] 2021-07-04 12:36:22 > F_8 score (Step: 90000, Using valid images): 0.9749946476316158 [INFO] 2021-07-04 12:36:22 > F_1/8 score (Step: 90000, Using valid images): 0.9814636666573975 [INFO] 2021-07-04 12:36:22 > FID score (Step: 90000, Using valid moments): 11.311430518808379 [INFO] 2021-07-04 12:36:22 > Inception score (Step: 90000, 50000 generated images): 65.00286102294922 [INFO] 2021-07-04 12:36:22 > Best FID score (Step: 90000, Using valid moments): 11.311430518808379 [INFO] 2021-07-04 12:36:37 > Save model to checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-08 08:06:45 > Generator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=G-current-weights-step=90000.pth [INFO] 2021-07-08 08:06:45 > Discriminator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=D-current-weights-step=90000.pth [INFO] 2021-07-08 08:06:48 > Start training.... [INFO] 2021-07-08 08:26:40 > Step: 90100 Progress: 45.1% Elapsed: 0:19:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.532005 Generator_loss: 0.845859 [INFO] 2021-07-08 08:45:50 > Step: 90200 Progress: 45.1% Elapsed: 0:39:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.591782 Generator_loss: 0.802328 [INFO] 2021-07-08 09:04:58 > Step: 90300 Progress: 45.1% Elapsed: 0:58:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.543241 Generator_loss: 0.840681 [INFO] 2021-07-08 09:24:06 > Step: 90400 Progress: 45.2% Elapsed: 1:17:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.506869 Generator_loss: 0.894721 [INFO] 2021-07-08 09:43:08 > Step: 90500 Progress: 45.2% Elapsed: 1:36:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.518491 Generator_loss: 0.834793 [INFO] 2021-07-08 10:02:06 > Step: 90600 Progress: 45.3% Elapsed: 1:55:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.533416 Generator_loss: 0.828192 [INFO] 2021-07-08 10:21:09 > Step: 90700 Progress: 45.4% Elapsed: 2:14:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.503356 Generator_loss: 0.841099 [INFO] 2021-07-08 10:40:12 > Step: 90800 Progress: 45.4% Elapsed: 2:33:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.512663 Generator_loss: 0.889314 [INFO] 2021-07-08 10:59:15 > Step: 90900 Progress: 45.5% Elapsed: 2:52:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.542305 Generator_loss: 0.809844 [INFO] 2021-07-08 11:18:23 > Step: 91000 Progress: 45.5% Elapsed: 3:11:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.518766 Generator_loss: 0.846024 [INFO] 2021-07-08 11:37:26 > Step: 91100 Progress: 45.6% Elapsed: 3:30:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.519762 Generator_loss: 0.854629 [INFO] 2021-07-08 11:56:28 > Step: 91200 Progress: 45.6% Elapsed: 3:49:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.546387 Generator_loss: 0.861594 [INFO] 2021-07-08 12:15:34 > Step: 91300 Progress: 45.6% Elapsed: 4:08:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.549588 Generator_loss: 0.834552 [INFO] 2021-07-08 12:34:36 > Step: 91400 Progress: 45.7% Elapsed: 4:27:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.548293 Generator_loss: 0.884197 [INFO] 2021-07-08 12:53:38 > Step: 91500 Progress: 45.8% Elapsed: 4:46:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.507548 Generator_loss: 0.918301 [INFO] 2021-07-08 13:12:43 > Step: 91600 Progress: 45.8% Elapsed: 5:05:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.516426 Generator_loss: 0.861697 [INFO] 2021-07-08 13:31:44 > Step: 91700 Progress: 45.9% Elapsed: 5:24:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.541879 Generator_loss: 0.823783 [INFO] 2021-07-08 13:50:48 > Step: 91800 Progress: 45.9% Elapsed: 5:43:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.567377 Generator_loss: 0.790335 [INFO] 2021-07-08 14:09:52 > Step: 91900 Progress: 46.0% Elapsed: 6:03:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.564126 Generator_loss: 0.81718 [INFO] 2021-07-08 14:28:51 > Step: 92000 Progress: 46.0% Elapsed: 6:22:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.515972 Generator_loss: 0.877361 [INFO] 2021-07-08 14:28:51 > Start Evaluation (92000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-08 14:28:51 > Calculating FID Score.... [INFO] 2021-07-08 14:29:59 > Calculating Inception Score.... [INFO] 2021-07-08 14:30:55 > Calculate F_beta Score.... [INFO] 2021-07-08 14:33:18 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-08 14:33:18 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-08 14:33:19 > Calculate Accuracies.... [INFO] 2021-07-08 14:34:05 > Calculate Accuracies.... [INFO] 2021-07-08 14:34:55 > F_8 score (Step: 92000, Using valid images): 0.9754270318486924 [INFO] 2021-07-08 14:34:55 > F_1/8 score (Step: 92000, Using valid images): 0.9815141265481464 [INFO] 2021-07-08 14:34:55 > FID score (Step: 92000, Using valid moments): 11.138773097844705 [INFO] 2021-07-08 14:34:55 > Inception score (Step: 92000, 50000 generated images): 65.86644744873047 [INFO] 2021-07-08 14:34:55 > Best FID score (Step: 92000, Using valid moments): 11.138773097844705 [INFO] 2021-07-08 14:35:09 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-08 14:54:10 > Step: 92100 Progress: 46.1% Elapsed: 6:47:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.547287 Generator_loss: 0.864011 [INFO] 2021-07-08 15:13:14 > Step: 92200 Progress: 46.1% Elapsed: 7:06:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.517183 Generator_loss: 0.875636 [INFO] 2021-07-08 15:32:15 > Step: 92300 Progress: 46.2% Elapsed: 7:25:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.525143 Generator_loss: 0.901967 [INFO] 2021-07-08 15:51:17 > Step: 92400 Progress: 46.2% Elapsed: 7:44:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.513595 Generator_loss: 0.870058 [INFO] 2021-07-08 16:10:22 > Step: 92500 Progress: 46.2% Elapsed: 8:03:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.497011 Generator_loss: 0.905114 [INFO] 2021-07-08 16:29:28 > Step: 92600 Progress: 46.3% Elapsed: 8:22:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.516476 Generator_loss: 0.972585 [INFO] 2021-07-08 16:48:31 > Step: 92700 Progress: 46.4% Elapsed: 8:41:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.513657 Generator_loss: 0.836344 [INFO] 2021-07-08 17:07:34 > Step: 92800 Progress: 46.4% Elapsed: 9:00:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.543895 Generator_loss: 0.825771 [INFO] 2021-07-08 17:26:40 > Step: 92900 Progress: 46.5% Elapsed: 9:19:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.505416 Generator_loss: 0.889559 [INFO] 2021-07-08 17:45:44 > Step: 93000 Progress: 46.5% Elapsed: 9:38:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.534635 Generator_loss: 0.87764 [INFO] 2021-07-08 18:04:47 > Step: 93100 Progress: 46.6% Elapsed: 9:57:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.544963 Generator_loss: 0.850406 [INFO] 2021-07-08 18:23:54 > Step: 93200 Progress: 46.6% Elapsed: 10:17:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.499396 Generator_loss: 0.915013 [INFO] 2021-07-08 18:42:58 > Step: 93300 Progress: 46.7% Elapsed: 10:36:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.496412 Generator_loss: 0.941964 [INFO] 2021-07-08 19:02:05 > Step: 93400 Progress: 46.7% Elapsed: 10:55:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.527253 Generator_loss: 0.892261 [INFO] 2021-07-08 19:21:11 > Step: 93500 Progress: 46.8% Elapsed: 11:14:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.514034 Generator_loss: 0.834996 [INFO] 2021-07-08 19:40:14 > Step: 93600 Progress: 46.8% Elapsed: 11:33:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.594432 Generator_loss: 0.861317 [INFO] 2021-07-08 19:59:17 > Step: 93700 Progress: 46.9% Elapsed: 11:52:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.514147 Generator_loss: 0.844442 [INFO] 2021-07-08 20:18:24 > Step: 93800 Progress: 46.9% Elapsed: 12:11:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.508339 Generator_loss: 0.864969 [INFO] 2021-07-08 20:37:28 > Step: 93900 Progress: 46.9% Elapsed: 12:30:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.535127 Generator_loss: 0.865617 [INFO] 2021-07-08 20:56:31 > Step: 94000 Progress: 47.0% Elapsed: 12:49:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.552074 Generator_loss: 0.811139 [INFO] 2021-07-08 20:56:31 > Start Evaluation (94000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-08 20:56:31 > Calculating FID Score.... [INFO] 2021-07-08 20:57:37 > Calculating Inception Score.... [INFO] 2021-07-08 20:58:32 > Calculate F_beta Score.... [INFO] 2021-07-08 21:00:53 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-08 21:00:53 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-08 21:00:54 > Calculate Accuracies.... [INFO] 2021-07-08 21:01:41 > Calculate Accuracies.... [INFO] 2021-07-08 21:02:30 > F_8 score (Step: 94000, Using valid images): 0.9748965377058916 [INFO] 2021-07-08 21:02:30 > F_1/8 score (Step: 94000, Using valid images): 0.9830123546023247 [INFO] 2021-07-08 21:02:30 > FID score (Step: 94000, Using valid moments): 10.925998443744902 [INFO] 2021-07-08 21:02:30 > Inception score (Step: 94000, 50000 generated images): 67.62565612792969 [INFO] 2021-07-08 21:02:30 > Best FID score (Step: 94000, Using valid moments): 10.925998443744902 [INFO] 2021-07-08 21:02:44 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-08 21:21:50 > Step: 94100 Progress: 47.0% Elapsed: 13:15:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.569803 Generator_loss: 0.84509 [INFO] 2021-07-08 21:40:54 > Step: 94200 Progress: 47.1% Elapsed: 13:34:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.505365 Generator_loss: 0.864832 [INFO] 2021-07-08 21:59:57 > Step: 94300 Progress: 47.1% Elapsed: 13:53:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.543491 Generator_loss: 0.889036 [INFO] 2021-07-08 22:19:04 > Step: 94400 Progress: 47.2% Elapsed: 14:12:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.509451 Generator_loss: 0.863369 [INFO] 2021-07-08 22:38:10 > Step: 94500 Progress: 47.2% Elapsed: 14:31:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.53209 Generator_loss: 0.808318 [INFO] 2021-07-08 22:57:13 > Step: 94600 Progress: 47.3% Elapsed: 14:50:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.51822 Generator_loss: 0.907394 [INFO] 2021-07-08 23:16:19 > Step: 94700 Progress: 47.3% Elapsed: 15:09:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.619569 Generator_loss: 0.821922 [INFO] 2021-07-08 23:35:23 > Step: 94800 Progress: 47.4% Elapsed: 15:28:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.506125 Generator_loss: 0.879036 [INFO] 2021-07-08 23:54:29 > Step: 94900 Progress: 47.4% Elapsed: 15:47:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.504209 Generator_loss: 0.924592 [INFO] 2021-07-09 00:13:33 > Step: 95000 Progress: 47.5% Elapsed: 16:06:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.542858 Generator_loss: 0.818369 [INFO] 2021-07-09 00:32:39 > Step: 95100 Progress: 47.5% Elapsed: 16:25:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.544829 Generator_loss: 0.904873 [INFO] 2021-07-09 00:51:39 > Step: 95200 Progress: 47.6% Elapsed: 16:44:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.519286 Generator_loss: 0.916034 [INFO] 2021-07-09 01:10:37 > Step: 95300 Progress: 47.6% Elapsed: 17:03:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.528078 Generator_loss: 0.891303 [INFO] 2021-07-09 01:29:43 > Step: 95400 Progress: 47.7% Elapsed: 17:22:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.48576 Generator_loss: 1.03413 [INFO] 2021-07-09 01:48:47 > Step: 95500 Progress: 47.8% Elapsed: 17:41:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.548199 Generator_loss: 0.835832 [INFO] 2021-07-09 02:07:52 > Step: 95600 Progress: 47.8% Elapsed: 18:01:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.536992 Generator_loss: 0.889845 [INFO] 2021-07-09 02:26:58 > Step: 95700 Progress: 47.9% Elapsed: 18:20:10 temperature: 0.25 ada_p: No Discriminator_loss: 1.32136 Generator_loss: 0.854867 [INFO] 2021-07-09 02:46:00 > Step: 95800 Progress: 47.9% Elapsed: 18:39:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.592273 Generator_loss: 0.784711 [INFO] 2021-07-09 03:05:03 > Step: 95900 Progress: 47.9% Elapsed: 18:58:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.516931 Generator_loss: 0.872781 [INFO] 2021-07-09 03:24:10 > Step: 96000 Progress: 48.0% Elapsed: 19:17:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.519185 Generator_loss: 0.856665 [INFO] 2021-07-09 03:24:10 > Start Evaluation (96000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-09 03:24:10 > Calculating FID Score.... [INFO] 2021-07-09 03:25:16 > Calculating Inception Score.... [INFO] 2021-07-09 03:26:12 > Calculate F_beta Score.... [INFO] 2021-07-09 03:28:33 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-09 03:28:33 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-09 03:28:34 > Calculate Accuracies.... [INFO] 2021-07-09 03:29:21 > Calculate Accuracies.... [INFO] 2021-07-09 03:30:11 > F_8 score (Step: 96000, Using valid images): 0.9760782442939571 [INFO] 2021-07-09 03:30:11 > F_1/8 score (Step: 96000, Using valid images): 0.9805408875123252 [INFO] 2021-07-09 03:30:11 > FID score (Step: 96000, Using valid moments): 10.837651974914365 [INFO] 2021-07-09 03:30:11 > Inception score (Step: 96000, 50000 generated images): 67.25634765625 [INFO] 2021-07-09 03:30:11 > Best FID score (Step: 96000, Using valid moments): 10.837651974914365 [INFO] 2021-07-09 03:30:25 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-09 03:49:30 > Step: 96100 Progress: 48.0% Elapsed: 19:42:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.51329 Generator_loss: 0.84296 [INFO] 2021-07-09 04:08:35 > Step: 96200 Progress: 48.1% Elapsed: 20:01:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.504018 Generator_loss: 0.908009 [INFO] 2021-07-09 04:27:42 > Step: 96300 Progress: 48.1% Elapsed: 20:20:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.52021 Generator_loss: 0.903168 [INFO] 2021-07-09 04:46:44 > Step: 96400 Progress: 48.2% Elapsed: 20:39:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.517034 Generator_loss: 0.849034 [INFO] 2021-07-09 05:05:48 > Step: 96500 Progress: 48.2% Elapsed: 20:59:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.52154 Generator_loss: 0.883357 [INFO] 2021-07-09 05:24:55 > Step: 96600 Progress: 48.3% Elapsed: 21:18:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.504245 Generator_loss: 0.921709 [INFO] 2021-07-09 05:44:00 > Step: 96700 Progress: 48.4% Elapsed: 21:37:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.502921 Generator_loss: 0.889792 [INFO] 2021-07-09 06:03:05 > Step: 96800 Progress: 48.4% Elapsed: 21:56:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.536309 Generator_loss: 0.814072 [INFO] 2021-07-09 06:22:14 > Step: 96900 Progress: 48.4% Elapsed: 22:15:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.554918 Generator_loss: 0.897993 [INFO] 2021-07-09 06:41:20 > Step: 97000 Progress: 48.5% Elapsed: 22:34:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.618058 Generator_loss: 0.852644 [INFO] 2021-07-09 07:00:24 > Step: 97100 Progress: 48.5% Elapsed: 22:53:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.586662 Generator_loss: 0.830346 [INFO] 2021-07-09 07:19:30 > Step: 97200 Progress: 48.6% Elapsed: 23:12:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.505699 Generator_loss: 0.906712 [INFO] 2021-07-09 07:38:34 > Step: 97300 Progress: 48.6% Elapsed: 23:31:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.514387 Generator_loss: 0.894461 [INFO] 2021-07-09 07:57:34 > Step: 97400 Progress: 48.7% Elapsed: 23:50:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.491158 Generator_loss: 0.921722 [INFO] 2021-07-09 08:16:35 > Step: 97500 Progress: 48.8% Elapsed: 1 day, 0:09:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.516285 Generator_loss: 0.889423 [INFO] 2021-07-09 08:35:43 > Step: 97600 Progress: 48.8% Elapsed: 1 day, 0:28:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.62565 Generator_loss: 0.961522 [INFO] 2021-07-09 08:54:48 > Step: 97700 Progress: 48.9% Elapsed: 1 day, 0:47:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.584011 Generator_loss: 0.902412 [INFO] 2021-07-09 09:13:52 > Step: 97800 Progress: 48.9% Elapsed: 1 day, 1:07:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.589776 Generator_loss: 0.833839 [INFO] 2021-07-09 09:32:58 > Step: 97900 Progress: 48.9% Elapsed: 1 day, 1:26:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.519121 Generator_loss: 0.874058 [INFO] 2021-07-09 09:51:59 > Step: 98000 Progress: 49.0% Elapsed: 1 day, 1:45:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.582755 Generator_loss: 0.832966 [INFO] 2021-07-09 09:51:59 > Start Evaluation (98000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-09 09:51:59 > Calculating FID Score.... [INFO] 2021-07-09 09:53:06 > Calculating Inception Score.... [INFO] 2021-07-09 09:54:01 > Calculate F_beta Score.... [INFO] 2021-07-09 09:56:18 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-09 09:56:19 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-09 09:56:20 > Calculate Accuracies.... [INFO] 2021-07-09 09:57:06 > Calculate Accuracies.... [INFO] 2021-07-09 09:57:55 > F_8 score (Step: 98000, Using valid images): 0.9776113108472643 [INFO] 2021-07-09 09:57:55 > F_1/8 score (Step: 98000, Using valid images): 0.9809354291802556 [INFO] 2021-07-09 09:57:55 > FID score (Step: 98000, Using valid moments): 10.732240715113335 [INFO] 2021-07-09 09:57:55 > Inception score (Step: 98000, 50000 generated images): 68.74588012695312 [INFO] 2021-07-09 09:57:55 > Best FID score (Step: 98000, Using valid moments): 10.732240715113335 [INFO] 2021-07-09 09:58:10 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-09 10:17:15 > Step: 98100 Progress: 49.0% Elapsed: 1 day, 2:10:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.519388 Generator_loss: 0.848538 [INFO] 2021-07-09 10:36:21 > Step: 98200 Progress: 49.1% Elapsed: 1 day, 2:29:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.515345 Generator_loss: 0.865704 [INFO] 2021-07-09 10:55:25 > Step: 98300 Progress: 49.1% Elapsed: 1 day, 2:48:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.504043 Generator_loss: 0.891598 [INFO] 2021-07-09 11:14:28 > Step: 98400 Progress: 49.2% Elapsed: 1 day, 3:07:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.513831 Generator_loss: 0.892346 [INFO] 2021-07-09 11:33:35 > Step: 98500 Progress: 49.2% Elapsed: 1 day, 3:26:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.50233 Generator_loss: 0.919892 [INFO] 2021-07-09 11:52:39 > Step: 98600 Progress: 49.3% Elapsed: 1 day, 3:45:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.511495 Generator_loss: 1.01612 [INFO] 2021-07-09 12:11:44 > Step: 98700 Progress: 49.4% Elapsed: 1 day, 4:04:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.611357 Generator_loss: 0.787141 [INFO] 2021-07-09 12:30:53 > Step: 98800 Progress: 49.4% Elapsed: 1 day, 4:24:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.523911 Generator_loss: 0.855263 [INFO] 2021-07-09 12:49:57 > Step: 98900 Progress: 49.5% Elapsed: 1 day, 4:43:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.512893 Generator_loss: 0.888453 [INFO] 2021-07-09 13:09:02 > Step: 99000 Progress: 49.5% Elapsed: 1 day, 5:02:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.508791 Generator_loss: 0.857604 [INFO] 2021-07-09 13:28:07 > Step: 99100 Progress: 49.5% Elapsed: 1 day, 5:21:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.564351 Generator_loss: 0.788384 [INFO] 2021-07-09 13:47:07 > Step: 99200 Progress: 49.6% Elapsed: 1 day, 5:40:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.493595 Generator_loss: 1.01238 [INFO] 2021-07-09 14:06:12 > Step: 99300 Progress: 49.6% Elapsed: 1 day, 5:59:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.541832 Generator_loss: 0.871774 [INFO] 2021-07-09 14:25:21 > Step: 99400 Progress: 49.7% Elapsed: 1 day, 6:18:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.587959 Generator_loss: 0.835744 [INFO] 2021-07-09 14:44:24 > Step: 99500 Progress: 49.8% Elapsed: 1 day, 6:37:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.531456 Generator_loss: 0.873517 [INFO] 2021-07-09 15:03:29 > Step: 99600 Progress: 49.8% Elapsed: 1 day, 6:56:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.528352 Generator_loss: 0.876327 [INFO] 2021-07-09 15:22:38 > Step: 99700 Progress: 49.9% Elapsed: 1 day, 7:15:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.517633 Generator_loss: 0.905505 [INFO] 2021-07-09 15:41:41 > Step: 99800 Progress: 49.9% Elapsed: 1 day, 7:34:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.541278 Generator_loss: 0.83686 [INFO] 2021-07-09 16:00:47 > Step: 99900 Progress: 50.0% Elapsed: 1 day, 7:53:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.506812 Generator_loss: 0.922292 [INFO] 2021-07-09 16:19:53 > Step: 100000 Progress: 50.0% Elapsed: 1 day, 8:13:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.505041 Generator_loss: 0.970723 [INFO] 2021-07-09 16:19:53 > Start Evaluation (100000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-09 16:19:53 > Calculating FID Score.... [INFO] 2021-07-09 16:20:59 > Calculating Inception Score.... [INFO] 2021-07-09 16:21:55 > Calculate F_beta Score.... [INFO] 2021-07-09 16:24:22 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-09 16:24:22 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-09 16:24:24 > Calculate Accuracies.... [INFO] 2021-07-09 16:25:10 > Calculate Accuracies.... [INFO] 2021-07-09 16:26:00 > F_8 score (Step: 100000, Using valid images): 0.9768636704504107 [INFO] 2021-07-09 16:26:00 > F_1/8 score (Step: 100000, Using valid images): 0.9807298890896525 [INFO] 2021-07-09 16:26:00 > FID score (Step: 100000, Using valid moments): 10.616102536348933 [INFO] 2021-07-09 16:26:00 > Inception score (Step: 100000, 50000 generated images): 69.58582305908203 [INFO] 2021-07-09 16:26:00 > Best FID score (Step: 100000, Using valid moments): 10.616102536348933 [INFO] 2021-07-09 16:26:14 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-09 16:45:23 > Step: 100100 Progress: 50.0% Elapsed: 1 day, 8:38:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.529423 Generator_loss: 0.825843 [INFO] 2021-07-09 17:04:28 > Step: 100200 Progress: 50.1% Elapsed: 1 day, 8:57:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.521876 Generator_loss: 0.857053 [INFO] 2021-07-09 17:23:31 > Step: 100300 Progress: 50.1% Elapsed: 1 day, 9:16:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.506342 Generator_loss: 0.881829 [INFO] 2021-07-09 17:42:39 > Step: 100400 Progress: 50.2% Elapsed: 1 day, 9:35:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.498054 Generator_loss: 0.877934 [INFO] 2021-07-09 18:01:44 > Step: 100500 Progress: 50.2% Elapsed: 1 day, 9:54:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.498536 Generator_loss: 0.897691 [INFO] 2021-07-09 18:20:47 > Step: 100600 Progress: 50.3% Elapsed: 1 day, 10:13:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.517794 Generator_loss: 0.889689 [INFO] 2021-07-09 18:39:58 > Step: 100700 Progress: 50.3% Elapsed: 1 day, 10:33:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.505458 Generator_loss: 0.922022 [INFO] 2021-07-09 18:59:02 > Step: 100800 Progress: 50.4% Elapsed: 1 day, 10:52:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.540303 Generator_loss: 0.877039 [INFO] 2021-07-09 19:18:08 > Step: 100900 Progress: 50.4% Elapsed: 1 day, 11:11:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.501879 Generator_loss: 0.846807 [INFO] 2021-07-09 19:37:17 > Step: 101000 Progress: 50.5% Elapsed: 1 day, 11:30:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.530737 Generator_loss: 0.839484 [INFO] 2021-07-09 19:56:22 > Step: 101100 Progress: 50.5% Elapsed: 1 day, 11:49:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.517221 Generator_loss: 0.880692 [INFO] 2021-07-09 20:15:26 > Step: 101200 Progress: 50.6% Elapsed: 1 day, 12:08:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.634266 Generator_loss: 1.01255 [INFO] 2021-07-09 20:34:34 > Step: 101300 Progress: 50.6% Elapsed: 1 day, 12:27:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.521503 Generator_loss: 0.846603 [INFO] 2021-07-09 20:53:37 > Step: 101400 Progress: 50.7% Elapsed: 1 day, 12:46:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.501728 Generator_loss: 0.927483 [INFO] 2021-07-09 21:12:42 > Step: 101500 Progress: 50.7% Elapsed: 1 day, 13:05:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.56843 Generator_loss: 0.879703 [INFO] 2021-07-09 21:31:47 > Step: 101600 Progress: 50.8% Elapsed: 1 day, 13:24:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.508884 Generator_loss: 0.928054 [INFO] 2021-07-09 21:50:52 > Step: 101700 Progress: 50.8% Elapsed: 1 day, 13:44:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.486893 Generator_loss: 0.925565 [INFO] 2021-07-09 22:09:58 > Step: 101800 Progress: 50.9% Elapsed: 1 day, 14:03:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.489207 Generator_loss: 0.895782 [INFO] 2021-07-09 22:29:06 > Step: 101900 Progress: 50.9% Elapsed: 1 day, 14:22:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.48316 Generator_loss: 0.944623 [INFO] 2021-07-09 22:48:12 > Step: 102000 Progress: 51.0% Elapsed: 1 day, 14:41:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.49078 Generator_loss: 0.936465 [INFO] 2021-07-09 22:48:12 > Start Evaluation (102000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-09 22:48:12 > Calculating FID Score.... [INFO] 2021-07-09 22:49:18 > Calculating Inception Score.... [INFO] 2021-07-09 22:50:14 > Calculate F_beta Score.... [INFO] 2021-07-09 22:52:38 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-09 22:52:38 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-09 22:52:40 > Calculate Accuracies.... [INFO] 2021-07-09 22:53:26 > Calculate Accuracies.... [INFO] 2021-07-09 22:54:16 > F_8 score (Step: 102000, Using valid images): 0.9749469887763658 [INFO] 2021-07-09 22:54:16 > F_1/8 score (Step: 102000, Using valid images): 0.9785248369190244 [INFO] 2021-07-09 22:54:16 > FID score (Step: 102000, Using valid moments): 10.622358923807269 [INFO] 2021-07-09 22:54:16 > Inception score (Step: 102000, 50000 generated images): 69.93843078613281 [INFO] 2021-07-09 22:54:16 > Best FID score (Step: 100000, Using valid moments): 10.616102536348933 [INFO] 2021-07-09 22:54:23 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-09 23:13:31 > Step: 102100 Progress: 51.0% Elapsed: 1 day, 15:06:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.518095 Generator_loss: 0.840376 [INFO] 2021-07-09 23:32:41 > Step: 102200 Progress: 51.1% Elapsed: 1 day, 15:25:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.503755 Generator_loss: 0.853233 [INFO] 2021-07-09 23:51:47 > Step: 102300 Progress: 51.1% Elapsed: 1 day, 15:44:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.508998 Generator_loss: 0.900222 [INFO] 2021-07-10 00:10:53 > Step: 102400 Progress: 51.2% Elapsed: 1 day, 16:04:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.549636 Generator_loss: 0.866662 [INFO] 2021-07-10 00:30:01 > Step: 102500 Progress: 51.2% Elapsed: 1 day, 16:23:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.511412 Generator_loss: 0.860192 [INFO] 2021-07-10 00:49:09 > Step: 102600 Progress: 51.3% Elapsed: 1 day, 16:42:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.541581 Generator_loss: 0.870138 [INFO] 2021-07-10 01:08:12 > Step: 102700 Progress: 51.3% Elapsed: 1 day, 17:01:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.520706 Generator_loss: 0.884194 [INFO] 2021-07-10 01:27:16 > Step: 102800 Progress: 51.4% Elapsed: 1 day, 17:20:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.523789 Generator_loss: 0.847139 [INFO] 2021-07-10 01:46:23 > Step: 102900 Progress: 51.4% Elapsed: 1 day, 17:39:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.533478 Generator_loss: 0.837192 [INFO] 2021-07-10 02:05:28 > Step: 103000 Progress: 51.5% Elapsed: 1 day, 17:58:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.523831 Generator_loss: 0.904885 [INFO] 2021-07-10 02:24:33 > Step: 103100 Progress: 51.5% Elapsed: 1 day, 18:17:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.512233 Generator_loss: 0.996377 [INFO] 2021-07-10 02:43:41 > Step: 103200 Progress: 51.6% Elapsed: 1 day, 18:36:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.483457 Generator_loss: 0.96769 [INFO] 2021-07-10 03:02:45 > Step: 103300 Progress: 51.6% Elapsed: 1 day, 18:55:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.520944 Generator_loss: 0.860089 [INFO] 2021-07-10 03:21:54 > Step: 103400 Progress: 51.7% Elapsed: 1 day, 19:15:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.595397 Generator_loss: 0.850863 [INFO] 2021-07-10 03:41:03 > Step: 103500 Progress: 51.7% Elapsed: 1 day, 19:34:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.500357 Generator_loss: 0.92006 [INFO] 2021-07-10 04:00:08 > Step: 103600 Progress: 51.8% Elapsed: 1 day, 19:53:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.516973 Generator_loss: 0.866904 [INFO] 2021-07-10 04:19:15 > Step: 103700 Progress: 51.8% Elapsed: 1 day, 20:12:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.483195 Generator_loss: 0.904047 [INFO] 2021-07-10 04:38:26 > Step: 103800 Progress: 51.9% Elapsed: 1 day, 20:31:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.4954 Generator_loss: 0.869296 [INFO] 2021-07-10 04:57:30 > Step: 103900 Progress: 51.9% Elapsed: 1 day, 20:50:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.55736 Generator_loss: 0.860588 [INFO] 2021-07-10 05:16:36 > Step: 104000 Progress: 52.0% Elapsed: 1 day, 21:09:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.504825 Generator_loss: 0.888339 [INFO] 2021-07-10 05:16:36 > Start Evaluation (104000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-10 05:16:36 > Calculating FID Score.... [INFO] 2021-07-10 05:17:43 > Calculating Inception Score.... [INFO] 2021-07-10 05:18:39 > Calculate F_beta Score.... [INFO] 2021-07-10 05:21:00 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-10 05:21:00 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-10 05:21:01 > Calculate Accuracies.... [INFO] 2021-07-10 05:21:48 > Calculate Accuracies.... [INFO] 2021-07-10 05:22:38 > F_8 score (Step: 104000, Using valid images): 0.9758907283414305 [INFO] 2021-07-10 05:22:38 > F_1/8 score (Step: 104000, Using valid images): 0.9822281814511651 [INFO] 2021-07-10 05:22:38 > FID score (Step: 104000, Using valid moments): 10.445207105469478 [INFO] 2021-07-10 05:22:38 > Inception score (Step: 104000, 50000 generated images): 71.3439712524414 [INFO] 2021-07-10 05:22:38 > Best FID score (Step: 104000, Using valid moments): 10.445207105469478 [INFO] 2021-07-10 05:22:52 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-10 05:42:02 > Step: 104100 Progress: 52.0% Elapsed: 1 day, 21:35:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.513033 Generator_loss: 0.87645 [INFO] 2021-07-10 06:01:08 > Step: 104200 Progress: 52.1% Elapsed: 1 day, 21:54:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.526879 Generator_loss: 0.866304 [INFO] 2021-07-10 06:20:14 > Step: 104300 Progress: 52.1% Elapsed: 1 day, 22:13:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.497373 Generator_loss: 0.940982 [INFO] 2021-07-10 06:39:22 > Step: 104400 Progress: 52.2% Elapsed: 1 day, 22:32:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.505326 Generator_loss: 0.922637 [INFO] 2021-07-10 06:58:29 > Step: 104500 Progress: 52.2% Elapsed: 1 day, 22:51:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.50128 Generator_loss: 0.920753 [INFO] 2021-07-10 07:17:35 > Step: 104600 Progress: 52.3% Elapsed: 1 day, 23:10:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.532376 Generator_loss: 0.858778 [INFO] 2021-07-10 07:36:44 > Step: 104700 Progress: 52.3% Elapsed: 1 day, 23:29:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.521318 Generator_loss: 0.879717 [INFO] 2021-07-10 07:55:49 > Step: 104800 Progress: 52.4% Elapsed: 1 day, 23:49:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.480361 Generator_loss: 0.995421 [INFO] 2021-07-10 08:14:52 > Step: 104900 Progress: 52.4% Elapsed: 2 days, 0:08:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.513534 Generator_loss: 0.910464 [INFO] 2021-07-10 08:33:55 > Step: 105000 Progress: 52.5% Elapsed: 2 days, 0:27:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.497677 Generator_loss: 0.896108 [INFO] 2021-07-10 08:53:04 > Step: 105100 Progress: 52.5% Elapsed: 2 days, 0:46:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.705199 Generator_loss: 1.04706 [INFO] 2021-07-10 09:12:09 > Step: 105200 Progress: 52.6% Elapsed: 2 days, 1:05:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.515401 Generator_loss: 0.943822 [INFO] 2021-07-10 09:31:16 > Step: 105300 Progress: 52.6% Elapsed: 2 days, 1:24:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.486163 Generator_loss: 1.02364 [INFO] 2021-07-10 09:50:26 > Step: 105400 Progress: 52.7% Elapsed: 2 days, 1:43:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.496536 Generator_loss: 0.938423 [INFO] 2021-07-10 10:09:30 > Step: 105500 Progress: 52.8% Elapsed: 2 days, 2:02:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.496015 Generator_loss: 1.03637 [INFO] 2021-07-10 10:28:35 > Step: 105600 Progress: 52.8% Elapsed: 2 days, 2:21:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.512605 Generator_loss: 0.893498 [INFO] 2021-07-10 10:47:40 > Step: 105700 Progress: 52.8% Elapsed: 2 days, 2:40:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.523303 Generator_loss: 0.854704 [INFO] 2021-07-10 11:06:42 > Step: 105800 Progress: 52.9% Elapsed: 2 days, 2:59:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.501993 Generator_loss: 0.921698 [INFO] 2021-07-10 11:25:42 > Step: 105900 Progress: 52.9% Elapsed: 2 days, 3:18:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.488149 Generator_loss: 0.898198 [INFO] 2021-07-10 11:44:51 > Step: 106000 Progress: 53.0% Elapsed: 2 days, 3:38:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.537815 Generator_loss: 0.874385 [INFO] 2021-07-10 11:44:51 > Start Evaluation (106000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-10 11:44:51 > Calculating FID Score.... [INFO] 2021-07-10 11:45:56 > Calculating Inception Score.... [INFO] 2021-07-10 11:46:52 > Calculate F_beta Score.... [INFO] 2021-07-10 11:49:16 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-10 11:49:17 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-10 11:49:18 > Calculate Accuracies.... [INFO] 2021-07-10 11:50:04 > Calculate Accuracies.... [INFO] 2021-07-10 11:50:54 > F_8 score (Step: 106000, Using valid images): 0.9769086797584255 [INFO] 2021-07-10 11:50:54 > F_1/8 score (Step: 106000, Using valid images): 0.981457114246236 [INFO] 2021-07-10 11:50:54 > FID score (Step: 106000, Using valid moments): 10.245987068456202 [INFO] 2021-07-10 11:50:54 > Inception score (Step: 106000, 50000 generated images): 71.81549835205078 [INFO] 2021-07-10 11:50:54 > Best FID score (Step: 106000, Using valid moments): 10.245987068456202 [INFO] 2021-07-10 11:51:08 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-10 12:10:14 > Step: 106100 Progress: 53.0% Elapsed: 2 days, 4:03:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.508363 Generator_loss: 0.887816 [INFO] 2021-07-10 12:29:20 > Step: 106200 Progress: 53.1% Elapsed: 2 days, 4:22:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.479149 Generator_loss: 0.970629 [INFO] 2021-07-10 12:48:29 > Step: 106300 Progress: 53.1% Elapsed: 2 days, 4:41:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.513616 Generator_loss: 0.990333 [INFO] 2021-07-10 13:07:34 > Step: 106400 Progress: 53.2% Elapsed: 2 days, 5:00:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.539194 Generator_loss: 0.857139 [INFO] 2021-07-10 13:26:37 > Step: 106500 Progress: 53.2% Elapsed: 2 days, 5:19:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.505379 Generator_loss: 0.891051 [INFO] 2021-07-10 13:45:48 > Step: 106600 Progress: 53.3% Elapsed: 2 days, 5:39:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.499469 Generator_loss: 0.907569 [INFO] 2021-07-10 14:04:52 > Step: 106700 Progress: 53.3% Elapsed: 2 days, 5:58:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.504961 Generator_loss: 0.910139 [INFO] 2021-07-10 14:23:57 > Step: 106800 Progress: 53.4% Elapsed: 2 days, 6:17:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.509755 Generator_loss: 0.932931 [INFO] 2021-07-10 14:43:06 > Step: 106900 Progress: 53.4% Elapsed: 2 days, 6:36:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.504397 Generator_loss: 0.865121 [INFO] 2021-07-10 15:02:12 > Step: 107000 Progress: 53.5% Elapsed: 2 days, 6:55:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.567051 Generator_loss: 0.891442 [INFO] 2021-07-10 15:21:15 > Step: 107100 Progress: 53.5% Elapsed: 2 days, 7:14:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.484443 Generator_loss: 0.93652 [INFO] 2021-07-10 15:40:20 > Step: 107200 Progress: 53.6% Elapsed: 2 days, 7:33:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.53609 Generator_loss: 0.94205 [INFO] 2021-07-10 15:59:28 > Step: 107300 Progress: 53.6% Elapsed: 2 days, 7:52:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.535791 Generator_loss: 0.854973 [INFO] 2021-07-10 16:18:32 > Step: 107400 Progress: 53.7% Elapsed: 2 days, 8:11:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.49551 Generator_loss: 0.914135 [INFO] 2021-07-10 16:37:37 > Step: 107500 Progress: 53.8% Elapsed: 2 days, 8:30:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.521478 Generator_loss: 0.879267 [INFO] 2021-07-10 16:56:46 > Step: 107600 Progress: 53.8% Elapsed: 2 days, 8:49:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.529065 Generator_loss: 0.851259 [INFO] 2021-07-10 17:15:52 > Step: 107700 Progress: 53.8% Elapsed: 2 days, 9:09:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.487092 Generator_loss: 0.917662 [INFO] 2021-07-10 17:34:59 > Step: 107800 Progress: 53.9% Elapsed: 2 days, 9:28:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.528437 Generator_loss: 0.854339 [INFO] 2021-07-10 17:54:07 > Step: 107900 Progress: 53.9% Elapsed: 2 days, 9:47:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.559682 Generator_loss: 0.862584 [INFO] 2021-07-10 18:13:11 > Step: 108000 Progress: 54.0% Elapsed: 2 days, 10:06:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.49399 Generator_loss: 0.926887 [INFO] 2021-07-10 18:13:11 > Start Evaluation (108000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-10 18:13:11 > Calculating FID Score.... [INFO] 2021-07-10 18:14:18 > Calculating Inception Score.... [INFO] 2021-07-10 18:15:14 > Calculate F_beta Score.... [INFO] 2021-07-10 18:17:34 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-10 18:17:35 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-10 18:17:36 > Calculate Accuracies.... [INFO] 2021-07-10 18:18:23 > Calculate Accuracies.... [INFO] 2021-07-10 18:19:12 > F_8 score (Step: 108000, Using valid images): 0.9797984226859746 [INFO] 2021-07-10 18:19:12 > F_1/8 score (Step: 108000, Using valid images): 0.9825397681810537 [INFO] 2021-07-10 18:19:12 > FID score (Step: 108000, Using valid moments): 10.219546145023514 [INFO] 2021-07-10 18:19:12 > Inception score (Step: 108000, 50000 generated images): 72.22919464111328 [INFO] 2021-07-10 18:19:12 > Best FID score (Step: 108000, Using valid moments): 10.219546145023514 [INFO] 2021-07-10 18:19:27 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-10 18:38:33 > Step: 108100 Progress: 54.0% Elapsed: 2 days, 10:31:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.476966 Generator_loss: 1.04354 [INFO] 2021-07-10 18:57:43 > Step: 108200 Progress: 54.1% Elapsed: 2 days, 10:50:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.500336 Generator_loss: 0.859586 [INFO] 2021-07-10 19:16:49 > Step: 108300 Progress: 54.1% Elapsed: 2 days, 11:10:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.487259 Generator_loss: 0.93626 [INFO] 2021-07-10 19:35:54 > Step: 108400 Progress: 54.2% Elapsed: 2 days, 11:29:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.556942 Generator_loss: 0.854626 [INFO] 2021-07-10 19:55:05 > Step: 108500 Progress: 54.2% Elapsed: 2 days, 11:48:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.51328 Generator_loss: 0.877107 [INFO] 2021-07-10 20:14:11 > Step: 108600 Progress: 54.3% Elapsed: 2 days, 12:07:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.481629 Generator_loss: 0.963476 [INFO] 2021-07-10 20:33:17 > Step: 108700 Progress: 54.4% Elapsed: 2 days, 12:26:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.522411 Generator_loss: 0.904521 [INFO] 2021-07-10 20:52:25 > Step: 108800 Progress: 54.4% Elapsed: 2 days, 12:45:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.51531 Generator_loss: 0.895624 [INFO] 2021-07-10 21:11:30 > Step: 108900 Progress: 54.4% Elapsed: 2 days, 13:04:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.533499 Generator_loss: 0.866131 [INFO] 2021-07-10 21:30:36 > Step: 109000 Progress: 54.5% Elapsed: 2 days, 13:23:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.523143 Generator_loss: 0.888009 [INFO] 2021-07-10 21:49:46 > Step: 109100 Progress: 54.5% Elapsed: 2 days, 13:42:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.510164 Generator_loss: 0.911556 [INFO] 2021-07-10 22:08:54 > Step: 109200 Progress: 54.6% Elapsed: 2 days, 14:02:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.489108 Generator_loss: 1.02161 [INFO] 2021-07-10 22:28:00 > Step: 109300 Progress: 54.6% Elapsed: 2 days, 14:21:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.538239 Generator_loss: 0.953782 [INFO] 2021-07-10 22:47:07 > Step: 109400 Progress: 54.7% Elapsed: 2 days, 14:40:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.488858 Generator_loss: 1.03638 [INFO] 2021-07-10 23:06:13 > Step: 109500 Progress: 54.8% Elapsed: 2 days, 14:59:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.507465 Generator_loss: 0.886347 [INFO] 2021-07-10 23:25:15 > Step: 109600 Progress: 54.8% Elapsed: 2 days, 15:18:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.489566 Generator_loss: 0.894653 [INFO] 2021-07-10 23:44:25 > Step: 109700 Progress: 54.9% Elapsed: 2 days, 15:37:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.487788 Generator_loss: 1.0432 [INFO] 2021-07-11 00:03:35 > Step: 109800 Progress: 54.9% Elapsed: 2 days, 15:56:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.504012 Generator_loss: 0.917982 [INFO] 2021-07-11 00:22:40 > Step: 109900 Progress: 54.9% Elapsed: 2 days, 16:15:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.610298 Generator_loss: 0.854194 [INFO] 2021-07-11 00:41:46 > Step: 110000 Progress: 55.0% Elapsed: 2 days, 16:34:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.506149 Generator_loss: 0.878317 [INFO] 2021-07-11 00:41:46 > Start Evaluation (110000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-11 00:41:46 > Calculating FID Score.... [INFO] 2021-07-11 00:42:53 > Calculating Inception Score.... [INFO] 2021-07-11 00:43:49 > Calculate F_beta Score.... [INFO] 2021-07-11 00:46:08 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-11 00:46:09 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-11 00:46:10 > Calculate Accuracies.... [INFO] 2021-07-11 00:46:56 > Calculate Accuracies.... [INFO] 2021-07-11 00:47:46 > F_8 score (Step: 110000, Using valid images): 0.9798851497067261 [INFO] 2021-07-11 00:47:46 > F_1/8 score (Step: 110000, Using valid images): 0.9805474909033279 [INFO] 2021-07-11 00:47:46 > FID score (Step: 110000, Using valid moments): 10.085223299956454 [INFO] 2021-07-11 00:47:46 > Inception score (Step: 110000, 50000 generated images): 73.52679443359375 [INFO] 2021-07-11 00:47:46 > Best FID score (Step: 110000, Using valid moments): 10.085223299956454 [INFO] 2021-07-11 00:48:00 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-11 01:07:11 > Step: 110100 Progress: 55.0% Elapsed: 2 days, 17:00:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.497405 Generator_loss: 0.89007 [INFO] 2021-07-11 01:26:15 > Step: 110200 Progress: 55.1% Elapsed: 2 days, 17:19:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.539315 Generator_loss: 0.902484 [INFO] 2021-07-11 01:45:21 > Step: 110300 Progress: 55.1% Elapsed: 2 days, 17:38:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.519996 Generator_loss: 0.911924 [INFO] 2021-07-11 02:04:32 > Step: 110400 Progress: 55.2% Elapsed: 2 days, 17:57:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.51449 Generator_loss: 0.872801 [INFO] 2021-07-11 02:23:38 > Step: 110500 Progress: 55.2% Elapsed: 2 days, 18:16:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.510537 Generator_loss: 0.90086 [INFO] 2021-07-11 02:42:44 > Step: 110600 Progress: 55.3% Elapsed: 2 days, 18:35:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.504062 Generator_loss: 0.910457 [INFO] 2021-07-11 03:01:54 > Step: 110700 Progress: 55.4% Elapsed: 2 days, 18:55:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.496491 Generator_loss: 0.901096 [INFO] 2021-07-11 03:21:02 > Step: 110800 Progress: 55.4% Elapsed: 2 days, 19:14:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.471909 Generator_loss: 0.952207 [INFO] 2021-07-11 03:40:09 > Step: 110900 Progress: 55.5% Elapsed: 2 days, 19:33:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.588024 Generator_loss: 0.865526 [INFO] 2021-07-11 03:59:17 > Step: 111000 Progress: 55.5% Elapsed: 2 days, 19:52:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.485147 Generator_loss: 0.981569 [INFO] 2021-07-11 04:18:22 > Step: 111100 Progress: 55.5% Elapsed: 2 days, 20:11:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.499404 Generator_loss: 0.914435 [INFO] 2021-07-11 04:37:29 > Step: 111200 Progress: 55.6% Elapsed: 2 days, 20:30:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.481523 Generator_loss: 0.962844 [INFO] 2021-07-11 04:56:36 > Step: 111300 Progress: 55.6% Elapsed: 2 days, 20:49:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.497472 Generator_loss: 0.979749 [INFO] 2021-07-11 05:15:41 > Step: 111400 Progress: 55.7% Elapsed: 2 days, 21:08:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.475719 Generator_loss: 1.0259 [INFO] 2021-07-11 05:34:45 > Step: 111500 Progress: 55.8% Elapsed: 2 days, 21:27:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.505329 Generator_loss: 0.929681 [INFO] 2021-07-11 05:53:55 > Step: 111600 Progress: 55.8% Elapsed: 2 days, 21:47:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.483436 Generator_loss: 0.954754 [INFO] 2021-07-11 06:13:02 > Step: 111700 Progress: 55.9% Elapsed: 2 days, 22:06:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.508064 Generator_loss: 0.89543 [INFO] 2021-07-11 06:32:10 > Step: 111800 Progress: 55.9% Elapsed: 2 days, 22:25:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.614993 Generator_loss: 0.803514 [INFO] 2021-07-11 06:51:21 > Step: 111900 Progress: 56.0% Elapsed: 2 days, 22:44:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.478916 Generator_loss: 0.872305 [INFO] 2021-07-11 07:10:27 > Step: 112000 Progress: 56.0% Elapsed: 2 days, 23:03:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.490732 Generator_loss: 0.925038 [INFO] 2021-07-11 07:10:27 > Start Evaluation (112000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-11 07:10:27 > Calculating FID Score.... [INFO] 2021-07-11 07:11:33 > Calculating Inception Score.... [INFO] 2021-07-11 07:12:29 > Calculate F_beta Score.... [INFO] 2021-07-11 07:14:52 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-11 07:14:52 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-11 07:14:54 > Calculate Accuracies.... [INFO] 2021-07-11 07:15:40 > Calculate Accuracies.... [INFO] 2021-07-11 07:16:30 > F_8 score (Step: 112000, Using valid images): 0.9784246302928121 [INFO] 2021-07-11 07:16:30 > F_1/8 score (Step: 112000, Using valid images): 0.9822695615468687 [INFO] 2021-07-11 07:16:30 > FID score (Step: 112000, Using valid moments): 10.091427553047083 [INFO] 2021-07-11 07:16:30 > Inception score (Step: 112000, 50000 generated images): 74.72677612304688 [INFO] 2021-07-11 07:16:30 > Best FID score (Step: 110000, Using valid moments): 10.085223299956454 [INFO] 2021-07-11 07:16:37 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-11 07:35:43 > Step: 112100 Progress: 56.0% Elapsed: 2 days, 23:28:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.474913 Generator_loss: 0.956653 [INFO] 2021-07-11 07:54:47 > Step: 112200 Progress: 56.1% Elapsed: 2 days, 23:47:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.504364 Generator_loss: 0.863187 [INFO] 2021-07-11 08:13:55 > Step: 112300 Progress: 56.1% Elapsed: 3 days, 0:07:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.501352 Generator_loss: 0.869367 [INFO] 2021-07-11 08:33:00 > Step: 112400 Progress: 56.2% Elapsed: 3 days, 0:26:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.517582 Generator_loss: 0.900069 [INFO] 2021-07-11 08:52:06 > Step: 112500 Progress: 56.2% Elapsed: 3 days, 0:45:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.715928 Generator_loss: 0.746451 [INFO] 2021-07-11 09:11:16 > Step: 112600 Progress: 56.3% Elapsed: 3 days, 1:04:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.484117 Generator_loss: 0.902897 [INFO] 2021-07-11 09:30:25 > Step: 112700 Progress: 56.4% Elapsed: 3 days, 1:23:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.491288 Generator_loss: 0.929654 [INFO] 2021-07-11 09:49:31 > Step: 112800 Progress: 56.4% Elapsed: 3 days, 1:42:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.494595 Generator_loss: 0.896491 [INFO] 2021-07-11 10:08:42 > Step: 112900 Progress: 56.5% Elapsed: 3 days, 2:01:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.496398 Generator_loss: 0.906436 [INFO] 2021-07-11 10:27:50 > Step: 113000 Progress: 56.5% Elapsed: 3 days, 2:21:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.515445 Generator_loss: 0.873149 [INFO] 2021-07-11 10:46:56 > Step: 113100 Progress: 56.5% Elapsed: 3 days, 2:40:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.488892 Generator_loss: 0.995859 [INFO] 2021-07-11 11:06:06 > Step: 113200 Progress: 56.6% Elapsed: 3 days, 2:59:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.581731 Generator_loss: 0.820714 [INFO] 2021-07-11 11:25:12 > Step: 113300 Progress: 56.6% Elapsed: 3 days, 3:18:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.529581 Generator_loss: 0.876297 [INFO] 2021-07-11 11:44:19 > Step: 113400 Progress: 56.7% Elapsed: 3 days, 3:37:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.49099 Generator_loss: 0.96914 [INFO] 2021-07-11 12:03:31 > Step: 113500 Progress: 56.8% Elapsed: 3 days, 3:56:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.501321 Generator_loss: 0.872851 [INFO] 2021-07-11 12:22:37 > Step: 113600 Progress: 56.8% Elapsed: 3 days, 4:15:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.516143 Generator_loss: 0.906575 [INFO] 2021-07-11 12:41:44 > Step: 113700 Progress: 56.9% Elapsed: 3 days, 4:34:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.485534 Generator_loss: 0.907505 [INFO] 2021-07-11 13:00:54 > Step: 113800 Progress: 56.9% Elapsed: 3 days, 4:54:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.484044 Generator_loss: 0.968742 [INFO] 2021-07-11 13:20:02 > Step: 113900 Progress: 57.0% Elapsed: 3 days, 5:13:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.489914 Generator_loss: 0.957652 [INFO] 2021-07-11 13:39:08 > Step: 114000 Progress: 57.0% Elapsed: 3 days, 5:32:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.537858 Generator_loss: 0.861506 [INFO] 2021-07-11 13:39:08 > Start Evaluation (114000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-11 13:39:08 > Calculating FID Score.... [INFO] 2021-07-11 13:40:15 > Calculating Inception Score.... [INFO] 2021-07-11 13:41:10 > Calculate F_beta Score.... [INFO] 2021-07-11 13:43:27 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-11 13:43:28 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-11 13:43:29 > Calculate Accuracies.... [INFO] 2021-07-11 13:44:16 > Calculate Accuracies.... [INFO] 2021-07-11 13:45:06 > F_8 score (Step: 114000, Using valid images): 0.9808350378111527 [INFO] 2021-07-11 13:45:06 > F_1/8 score (Step: 114000, Using valid images): 0.9821827394215764 [INFO] 2021-07-11 13:45:06 > FID score (Step: 114000, Using valid moments): 10.011736408632828 [INFO] 2021-07-11 13:45:06 > Inception score (Step: 114000, 50000 generated images): 74.53571319580078 [INFO] 2021-07-11 13:45:06 > Best FID score (Step: 114000, Using valid moments): 10.011736408632828 [INFO] 2021-07-11 13:45:20 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-11 14:04:29 > Step: 114100 Progress: 57.0% Elapsed: 3 days, 5:57:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.495871 Generator_loss: 0.924714 [INFO] 2021-07-11 14:23:35 > Step: 114200 Progress: 57.1% Elapsed: 3 days, 6:16:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.497412 Generator_loss: 0.912619 [INFO] 2021-07-11 14:42:42 > Step: 114300 Progress: 57.1% Elapsed: 3 days, 6:35:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.57031 Generator_loss: 0.861556 [INFO] 2021-07-11 15:01:52 > Step: 114400 Progress: 57.2% Elapsed: 3 days, 6:55:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.513019 Generator_loss: 0.943694 [INFO] 2021-07-11 15:21:01 > Step: 114500 Progress: 57.2% Elapsed: 3 days, 7:14:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.589781 Generator_loss: 1.06561 [INFO] 2021-07-11 15:40:10 > Step: 114600 Progress: 57.3% Elapsed: 3 days, 7:33:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.492969 Generator_loss: 0.899504 [INFO] 2021-07-11 15:59:15 > Step: 114700 Progress: 57.4% Elapsed: 3 days, 7:52:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.496312 Generator_loss: 0.945041 [INFO] 2021-07-11 16:18:26 > Step: 114800 Progress: 57.4% Elapsed: 3 days, 8:11:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.501897 Generator_loss: 0.956466 [INFO] 2021-07-11 16:37:30 > Step: 114900 Progress: 57.5% Elapsed: 3 days, 8:30:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.469241 Generator_loss: 1.02113 [INFO] 2021-07-11 16:56:36 > Step: 115000 Progress: 57.5% Elapsed: 3 days, 8:49:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.473805 Generator_loss: 0.963425 [INFO] 2021-07-11 17:15:44 > Step: 115100 Progress: 57.6% Elapsed: 3 days, 9:08:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.497463 Generator_loss: 0.948464 [INFO] 2021-07-11 17:34:50 > Step: 115200 Progress: 57.6% Elapsed: 3 days, 9:28:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.492813 Generator_loss: 0.985324 [INFO] 2021-07-11 17:53:55 > Step: 115300 Progress: 57.6% Elapsed: 3 days, 9:47:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.485184 Generator_loss: 0.926297 [INFO] 2021-07-11 18:13:01 > Step: 115400 Progress: 57.7% Elapsed: 3 days, 10:06:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.49812 Generator_loss: 1.17874 [INFO] 2021-07-11 18:32:04 > Step: 115500 Progress: 57.8% Elapsed: 3 days, 10:25:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.484573 Generator_loss: 0.946123 [INFO] 2021-07-11 18:51:11 > Step: 115600 Progress: 57.8% Elapsed: 3 days, 10:44:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.492396 Generator_loss: 0.982578 [INFO] 2021-07-11 19:10:24 > Step: 115700 Progress: 57.9% Elapsed: 3 days, 11:03:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.481845 Generator_loss: 0.981878 [INFO] 2021-07-11 19:29:29 > Step: 115800 Progress: 57.9% Elapsed: 3 days, 11:22:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.497059 Generator_loss: 0.978771 [INFO] 2021-07-11 19:48:33 > Step: 115900 Progress: 58.0% Elapsed: 3 days, 11:41:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.514629 Generator_loss: 0.876704 [INFO] 2021-07-11 20:07:39 > Step: 116000 Progress: 58.0% Elapsed: 3 days, 12:00:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.485593 Generator_loss: 0.957256 [INFO] 2021-07-11 20:07:39 > Start Evaluation (116000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-11 20:07:39 > Calculating FID Score.... [INFO] 2021-07-11 20:08:46 > Calculating Inception Score.... [INFO] 2021-07-11 20:09:41 > Calculate F_beta Score.... [INFO] 2021-07-11 20:12:02 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-11 20:12:02 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-11 20:12:03 > Calculate Accuracies.... [INFO] 2021-07-11 20:12:50 > Calculate Accuracies.... [INFO] 2021-07-11 20:13:41 > F_8 score (Step: 116000, Using valid images): 0.9818431617691495 [INFO] 2021-07-11 20:13:41 > F_1/8 score (Step: 116000, Using valid images): 0.9821576945570233 [INFO] 2021-07-11 20:13:41 > FID score (Step: 116000, Using valid moments): 9.886957913658591 [INFO] 2021-07-11 20:13:41 > Inception score (Step: 116000, 50000 generated images): 76.12019348144531 [INFO] 2021-07-11 20:13:41 > Best FID score (Step: 116000, Using valid moments): 9.886957913658591 [INFO] 2021-07-11 20:13:55 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-11 20:33:00 > Step: 116100 Progress: 58.1% Elapsed: 3 days, 12:26:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.500288 Generator_loss: 0.873587 [INFO] 2021-07-11 20:52:04 > Step: 116200 Progress: 58.1% Elapsed: 3 days, 12:45:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.502496 Generator_loss: 0.938407 [INFO] 2021-07-11 21:11:12 > Step: 116300 Progress: 58.1% Elapsed: 3 days, 13:04:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.557537 Generator_loss: 0.868227 [INFO] 2021-07-11 21:30:17 > Step: 116400 Progress: 58.2% Elapsed: 3 days, 13:23:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.501207 Generator_loss: 0.933983 [INFO] 2021-07-11 21:49:23 > Step: 116500 Progress: 58.2% Elapsed: 3 days, 13:42:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.513801 Generator_loss: 0.899935 [INFO] 2021-07-11 22:08:33 > Step: 116600 Progress: 58.3% Elapsed: 3 days, 14:01:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.487694 Generator_loss: 0.882951 [INFO] 2021-07-11 22:27:41 > Step: 116700 Progress: 58.4% Elapsed: 3 days, 14:20:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.460335 Generator_loss: 0.986567 [INFO] 2021-07-11 22:46:50 > Step: 116800 Progress: 58.4% Elapsed: 3 days, 14:40:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.496998 Generator_loss: 0.882339 [INFO] 2021-07-11 23:05:59 > Step: 116900 Progress: 58.5% Elapsed: 3 days, 14:59:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.483129 Generator_loss: 0.874163 [INFO] 2021-07-11 23:25:06 > Step: 117000 Progress: 58.5% Elapsed: 3 days, 15:18:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.486168 Generator_loss: 0.947541 [INFO] 2021-07-11 23:44:12 > Step: 117100 Progress: 58.6% Elapsed: 3 days, 15:37:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.501192 Generator_loss: 0.892388 [INFO] 2021-07-12 00:03:17 > Step: 117200 Progress: 58.6% Elapsed: 3 days, 15:56:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.48835 Generator_loss: 0.911561 [INFO] 2021-07-12 00:22:28 > Step: 117300 Progress: 58.7% Elapsed: 3 days, 16:15:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.498475 Generator_loss: 0.98181 [INFO] 2021-07-12 00:41:35 > Step: 117400 Progress: 58.7% Elapsed: 3 days, 16:34:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.518029 Generator_loss: 0.840973 [INFO] 2021-07-12 01:00:41 > Step: 117500 Progress: 58.8% Elapsed: 3 days, 16:53:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.526986 Generator_loss: 0.847672 [INFO] 2021-07-12 01:19:51 > Step: 117600 Progress: 58.8% Elapsed: 3 days, 17:13:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.549607 Generator_loss: 0.919642 [INFO] 2021-07-12 01:38:58 > Step: 117700 Progress: 58.9% Elapsed: 3 days, 17:32:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.504859 Generator_loss: 0.909306 [INFO] 2021-07-12 01:58:05 > Step: 117800 Progress: 58.9% Elapsed: 3 days, 17:51:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.492423 Generator_loss: 0.945034 [INFO] 2021-07-12 02:17:17 > Step: 117900 Progress: 59.0% Elapsed: 3 days, 18:10:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.497391 Generator_loss: 0.960338 [INFO] 2021-07-12 02:36:23 > Step: 118000 Progress: 59.0% Elapsed: 3 days, 18:29:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.533821 Generator_loss: 0.910021 [INFO] 2021-07-12 02:36:23 > Start Evaluation (118000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-12 02:36:23 > Calculating FID Score.... [INFO] 2021-07-12 02:37:29 > Calculating Inception Score.... [INFO] 2021-07-12 02:38:25 > Calculate F_beta Score.... [INFO] 2021-07-12 02:40:48 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-12 02:40:48 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-12 02:40:50 > Calculate Accuracies.... [INFO] 2021-07-12 02:41:37 > Calculate Accuracies.... [INFO] 2021-07-12 02:42:26 > F_8 score (Step: 118000, Using valid images): 0.9830751876295662 [INFO] 2021-07-12 02:42:26 > F_1/8 score (Step: 118000, Using valid images): 0.9820799477255338 [INFO] 2021-07-12 02:42:26 > FID score (Step: 118000, Using valid moments): 9.91145704503657 [INFO] 2021-07-12 02:42:26 > Inception score (Step: 118000, 50000 generated images): 77.46297454833984 [INFO] 2021-07-12 02:42:26 > Best FID score (Step: 116000, Using valid moments): 9.886957913658591 [INFO] 2021-07-12 02:42:34 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-12 03:01:39 > Step: 118100 Progress: 59.1% Elapsed: 3 days, 18:54:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.491758 Generator_loss: 0.928162 [INFO] 2021-07-12 03:20:49 > Step: 118200 Progress: 59.1% Elapsed: 3 days, 19:14:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.486742 Generator_loss: 0.968347 [INFO] 2021-07-12 03:39:58 > Step: 118300 Progress: 59.2% Elapsed: 3 days, 19:33:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.494511 Generator_loss: 0.931934 [INFO] 2021-07-12 03:59:06 > Step: 118400 Progress: 59.2% Elapsed: 3 days, 19:52:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.509362 Generator_loss: 0.897444 [INFO] 2021-07-12 04:18:17 > Step: 118500 Progress: 59.2% Elapsed: 3 days, 20:11:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.482702 Generator_loss: 1.0028 [INFO] 2021-07-12 04:37:26 > Step: 118600 Progress: 59.3% Elapsed: 3 days, 20:30:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.474882 Generator_loss: 0.964782 [INFO] 2021-07-12 04:56:34 > Step: 118700 Progress: 59.4% Elapsed: 3 days, 20:49:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.519017 Generator_loss: 0.918416 [INFO] 2021-07-12 05:15:45 > Step: 118800 Progress: 59.4% Elapsed: 3 days, 21:08:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.492754 Generator_loss: 0.933285 [INFO] 2021-07-12 05:34:52 > Step: 118900 Progress: 59.5% Elapsed: 3 days, 21:28:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.508301 Generator_loss: 0.915511 [INFO] 2021-07-12 05:53:59 > Step: 119000 Progress: 59.5% Elapsed: 3 days, 21:47:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.500937 Generator_loss: 0.921558 [INFO] 2021-07-12 06:13:09 > Step: 119100 Progress: 59.6% Elapsed: 3 days, 22:06:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.523037 Generator_loss: 0.824896 [INFO] 2021-07-12 06:32:15 > Step: 119200 Progress: 59.6% Elapsed: 3 days, 22:25:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.541233 Generator_loss: 0.859666 [INFO] 2021-07-12 06:51:21 > Step: 119300 Progress: 59.7% Elapsed: 3 days, 22:44:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.555759 Generator_loss: 0.810021 [INFO] 2021-07-12 07:10:31 > Step: 119400 Progress: 59.7% Elapsed: 3 days, 23:03:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.492304 Generator_loss: 0.902082 [INFO] 2021-07-12 07:29:37 > Step: 119500 Progress: 59.8% Elapsed: 3 days, 23:22:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.469452 Generator_loss: 1.10932 [INFO] 2021-07-12 07:48:45 > Step: 119600 Progress: 59.8% Elapsed: 3 days, 23:41:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.498439 Generator_loss: 0.866051 [INFO] 2021-07-12 08:07:50 > Step: 119700 Progress: 59.9% Elapsed: 4 days, 0:01:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.567253 Generator_loss: 0.837569 [INFO] 2021-07-12 08:27:03 > Step: 119800 Progress: 59.9% Elapsed: 4 days, 0:20:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.502978 Generator_loss: 0.911767 [INFO] 2021-07-12 08:46:11 > Step: 119900 Progress: 60.0% Elapsed: 4 days, 0:39:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.512788 Generator_loss: 0.963933 [INFO] 2021-07-12 09:05:16 > Step: 120000 Progress: 60.0% Elapsed: 4 days, 0:58:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.503916 Generator_loss: 0.885118 [INFO] 2021-07-12 09:05:16 > Start Evaluation (120000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-12 09:05:16 > Calculating FID Score.... [INFO] 2021-07-12 09:06:23 > Calculating Inception Score.... [INFO] 2021-07-12 09:07:19 > Calculate F_beta Score.... [INFO] 2021-07-12 09:09:39 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-12 09:09:40 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-12 09:09:41 > Calculate Accuracies.... [INFO] 2021-07-12 09:10:27 > Calculate Accuracies.... [INFO] 2021-07-12 09:11:17 > F_8 score (Step: 120000, Using valid images): 0.9830785049840061 [INFO] 2021-07-12 09:11:17 > F_1/8 score (Step: 120000, Using valid images): 0.9833692327933486 [INFO] 2021-07-12 09:11:17 > FID score (Step: 120000, Using valid moments): 9.786524220124363 [INFO] 2021-07-12 09:11:17 > Inception score (Step: 120000, 50000 generated images): 76.78092193603516 [INFO] 2021-07-12 09:11:17 > Best FID score (Step: 120000, Using valid moments): 9.786524220124363 [INFO] 2021-07-12 09:11:32 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-12 09:30:43 > Step: 120100 Progress: 60.1% Elapsed: 4 days, 1:23:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.472064 Generator_loss: 0.969013 [INFO] 2021-07-12 09:49:50 > Step: 120200 Progress: 60.1% Elapsed: 4 days, 1:43:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.497062 Generator_loss: 0.934354 [INFO] 2021-07-12 10:08:56 > Step: 120300 Progress: 60.2% Elapsed: 4 days, 2:02:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.504226 Generator_loss: 0.888167 [INFO] 2021-07-12 10:28:09 > Step: 120400 Progress: 60.2% Elapsed: 4 days, 2:21:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.510905 Generator_loss: 0.883864 [INFO] 2021-07-12 10:47:17 > Step: 120500 Progress: 60.2% Elapsed: 4 days, 2:40:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.499064 Generator_loss: 0.881114 [INFO] 2021-07-12 11:06:24 > Step: 120600 Progress: 60.3% Elapsed: 4 days, 2:59:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.489538 Generator_loss: 0.945632 [INFO] 2021-07-12 11:25:34 > Step: 120700 Progress: 60.4% Elapsed: 4 days, 3:18:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.479351 Generator_loss: 0.957531 [INFO] 2021-07-12 11:44:42 > Step: 120800 Progress: 60.4% Elapsed: 4 days, 3:37:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.504838 Generator_loss: 0.884438 [INFO] 2021-07-12 12:03:47 > Step: 120900 Progress: 60.5% Elapsed: 4 days, 3:56:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.512469 Generator_loss: 0.84689 [INFO] 2021-07-12 12:22:56 > Step: 121000 Progress: 60.5% Elapsed: 4 days, 4:16:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.513756 Generator_loss: 0.927822 [INFO] 2021-07-12 12:42:03 > Step: 121100 Progress: 60.6% Elapsed: 4 days, 4:35:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.529487 Generator_loss: 0.87322 [INFO] 2021-07-12 13:01:09 > Step: 121200 Progress: 60.6% Elapsed: 4 days, 4:54:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.478714 Generator_loss: 0.968783 [INFO] 2021-07-12 13:20:20 > Step: 121300 Progress: 60.7% Elapsed: 4 days, 5:13:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.492635 Generator_loss: 0.970007 [INFO] 2021-07-12 13:39:26 > Step: 121400 Progress: 60.7% Elapsed: 4 days, 5:32:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.481745 Generator_loss: 0.952347 [INFO] 2021-07-12 13:58:31 > Step: 121500 Progress: 60.8% Elapsed: 4 days, 5:51:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.502933 Generator_loss: 0.94707 [INFO] 2021-07-12 14:17:40 > Step: 121600 Progress: 60.8% Elapsed: 4 days, 6:10:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.510784 Generator_loss: 0.910467 [INFO] 2021-07-12 14:36:49 > Step: 121700 Progress: 60.9% Elapsed: 4 days, 6:30:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.508887 Generator_loss: 0.929384 [INFO] 2021-07-12 14:55:57 > Step: 121800 Progress: 60.9% Elapsed: 4 days, 6:49:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.489631 Generator_loss: 0.903784 [INFO] 2021-07-12 15:15:04 > Step: 121900 Progress: 61.0% Elapsed: 4 days, 7:08:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.487476 Generator_loss: 0.908212 [INFO] 2021-07-12 15:34:17 > Step: 122000 Progress: 61.0% Elapsed: 4 days, 7:27:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.476378 Generator_loss: 0.938404 [INFO] 2021-07-12 15:34:17 > Start Evaluation (122000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-12 15:34:17 > Calculating FID Score.... [INFO] 2021-07-12 15:35:23 > Calculating Inception Score.... [INFO] 2021-07-12 15:36:19 > Calculate F_beta Score.... [INFO] 2021-07-12 15:38:44 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-12 15:38:44 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-12 15:38:46 > Calculate Accuracies.... [INFO] 2021-07-12 15:39:32 > Calculate Accuracies.... [INFO] 2021-07-12 15:40:22 > F_8 score (Step: 122000, Using valid images): 0.9826054051744534 [INFO] 2021-07-12 15:40:22 > F_1/8 score (Step: 122000, Using valid images): 0.9831479237645823 [INFO] 2021-07-12 15:40:22 > FID score (Step: 122000, Using valid moments): 9.737043001300208 [INFO] 2021-07-12 15:40:22 > Inception score (Step: 122000, 50000 generated images): 76.5002212524414 [INFO] 2021-07-12 15:40:22 > Best FID score (Step: 122000, Using valid moments): 9.737043001300208 [INFO] 2021-07-12 15:40:37 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-12 15:59:43 > Step: 122100 Progress: 61.1% Elapsed: 4 days, 7:52:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.493218 Generator_loss: 0.962117 [INFO] 2021-07-12 16:18:47 > Step: 122200 Progress: 61.1% Elapsed: 4 days, 8:11:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.480547 Generator_loss: 0.983659 [INFO] 2021-07-12 16:37:59 > Step: 122300 Progress: 61.2% Elapsed: 4 days, 8:31:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.496703 Generator_loss: 0.921679 [INFO] 2021-07-12 16:57:06 > Step: 122400 Progress: 61.2% Elapsed: 4 days, 8:50:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.470078 Generator_loss: 1.02927 [INFO] 2021-07-12 17:16:14 > Step: 122500 Progress: 61.3% Elapsed: 4 days, 9:09:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.496231 Generator_loss: 0.970189 [INFO] 2021-07-12 17:35:26 > Step: 122600 Progress: 61.3% Elapsed: 4 days, 9:28:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.513917 Generator_loss: 0.950341 [INFO] 2021-07-12 17:54:31 > Step: 122700 Progress: 61.4% Elapsed: 4 days, 9:47:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.536657 Generator_loss: 0.914599 [INFO] 2021-07-12 18:13:39 > Step: 122800 Progress: 61.4% Elapsed: 4 days, 10:06:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.500883 Generator_loss: 0.929693 [INFO] 2021-07-12 18:32:50 > Step: 122900 Progress: 61.5% Elapsed: 4 days, 10:26:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.495148 Generator_loss: 0.898899 [INFO] 2021-07-12 18:51:59 > Step: 123000 Progress: 61.5% Elapsed: 4 days, 10:45:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.5341 Generator_loss: 0.934888 [INFO] 2021-07-12 19:11:07 > Step: 123100 Progress: 61.6% Elapsed: 4 days, 11:04:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.487129 Generator_loss: 0.942776 [INFO] 2021-07-12 19:30:19 > Step: 123200 Progress: 61.6% Elapsed: 4 days, 11:23:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.484998 Generator_loss: 0.967279 [INFO] 2021-07-12 19:49:27 > Step: 123300 Progress: 61.7% Elapsed: 4 days, 11:42:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.482982 Generator_loss: 0.962745 [INFO] 2021-07-12 20:08:36 > Step: 123400 Progress: 61.7% Elapsed: 4 days, 12:01:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.565255 Generator_loss: 0.78688 [INFO] 2021-07-12 20:27:48 > Step: 123500 Progress: 61.8% Elapsed: 4 days, 12:21:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.486852 Generator_loss: 0.935304 [INFO] 2021-07-12 20:46:54 > Step: 123600 Progress: 61.8% Elapsed: 4 days, 12:40:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.496969 Generator_loss: 0.939102 [INFO] 2021-07-12 21:06:00 > Step: 123700 Progress: 61.9% Elapsed: 4 days, 12:59:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.568206 Generator_loss: 0.860439 [INFO] 2021-07-12 21:25:11 > Step: 123800 Progress: 61.9% Elapsed: 4 days, 13:18:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.475788 Generator_loss: 1.00997 [INFO] 2021-07-12 21:44:18 > Step: 123900 Progress: 62.0% Elapsed: 4 days, 13:37:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.48668 Generator_loss: 0.924101 [INFO] 2021-07-12 22:03:23 > Step: 124000 Progress: 62.0% Elapsed: 4 days, 13:56:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.498484 Generator_loss: 0.979271 [INFO] 2021-07-12 22:03:23 > Start Evaluation (124000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-12 22:03:23 > Calculating FID Score.... [INFO] 2021-07-12 22:04:29 > Calculating Inception Score.... [INFO] 2021-07-12 22:05:24 > Calculate F_beta Score.... [INFO] 2021-07-12 22:07:47 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-12 22:07:47 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-12 22:07:49 > Calculate Accuracies.... [INFO] 2021-07-12 22:08:35 > Calculate Accuracies.... [INFO] 2021-07-12 22:09:25 > F_8 score (Step: 124000, Using valid images): 0.9837726119790686 [INFO] 2021-07-12 22:09:25 > F_1/8 score (Step: 124000, Using valid images): 0.9824180812081793 [INFO] 2021-07-12 22:09:25 > FID score (Step: 124000, Using valid moments): 9.630354667678944 [INFO] 2021-07-12 22:09:25 > Inception score (Step: 124000, 50000 generated images): 77.34195709228516 [INFO] 2021-07-12 22:09:25 > Best FID score (Step: 124000, Using valid moments): 9.630354667678944 [INFO] 2021-07-12 22:09:40 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-12 22:28:52 > Step: 124100 Progress: 62.1% Elapsed: 4 days, 14:22:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.492887 Generator_loss: 0.926087 [INFO] 2021-07-12 22:47:59 > Step: 124200 Progress: 62.1% Elapsed: 4 days, 14:41:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.514502 Generator_loss: 0.887204 [INFO] 2021-07-12 23:07:06 > Step: 124300 Progress: 62.2% Elapsed: 4 days, 15:00:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.487028 Generator_loss: 0.93221 [INFO] 2021-07-12 23:26:10 > Step: 124400 Progress: 62.2% Elapsed: 4 days, 15:19:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.518947 Generator_loss: 0.928422 [INFO] 2021-07-12 23:45:19 > Step: 124500 Progress: 62.3% Elapsed: 4 days, 15:38:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.472221 Generator_loss: 0.971943 [INFO] 2021-07-13 00:04:28 > Step: 124600 Progress: 62.3% Elapsed: 4 days, 15:57:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.482764 Generator_loss: 0.938644 [INFO] 2021-07-13 00:23:37 > Step: 124700 Progress: 62.4% Elapsed: 4 days, 16:16:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.48685 Generator_loss: 1.0036 [INFO] 2021-07-13 00:42:50 > Step: 124800 Progress: 62.4% Elapsed: 4 days, 16:36:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.49232 Generator_loss: 0.914812 [INFO] 2021-07-13 01:01:59 > Step: 124900 Progress: 62.5% Elapsed: 4 days, 16:55:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.491355 Generator_loss: 1.02472 [INFO] 2021-07-13 01:21:08 > Step: 125000 Progress: 62.5% Elapsed: 4 days, 17:14:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.469571 Generator_loss: 1.01191 [INFO] 2021-07-13 01:40:21 > Step: 125100 Progress: 62.5% Elapsed: 4 days, 17:33:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.466902 Generator_loss: 1.03495 [INFO] 2021-07-13 01:59:27 > Step: 125200 Progress: 62.6% Elapsed: 4 days, 17:52:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.481563 Generator_loss: 0.957194 [INFO] 2021-07-13 02:18:36 > Step: 125300 Progress: 62.6% Elapsed: 4 days, 18:11:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.488366 Generator_loss: 0.989734 [INFO] 2021-07-13 02:37:47 > Step: 125400 Progress: 62.7% Elapsed: 4 days, 18:30:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.491066 Generator_loss: 0.960127 [INFO] 2021-07-13 02:56:53 > Step: 125500 Progress: 62.7% Elapsed: 4 days, 18:50:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.49564 Generator_loss: 0.972969 [INFO] 2021-07-13 03:15:59 > Step: 125600 Progress: 62.8% Elapsed: 4 days, 19:09:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.466992 Generator_loss: 1.01109 [INFO] 2021-07-13 03:35:11 > Step: 125700 Progress: 62.8% Elapsed: 4 days, 19:28:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.472066 Generator_loss: 0.976928 [INFO] 2021-07-13 03:54:19 > Step: 125800 Progress: 62.9% Elapsed: 4 days, 19:47:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.490152 Generator_loss: 1.00656 [INFO] 2021-07-13 04:13:28 > Step: 125900 Progress: 62.9% Elapsed: 4 days, 20:06:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.482944 Generator_loss: 0.908907 [INFO] 2021-07-13 04:32:38 > Step: 126000 Progress: 63.0% Elapsed: 4 days, 20:25:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.567736 Generator_loss: 0.971995 [INFO] 2021-07-13 04:32:38 > Start Evaluation (126000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-13 04:32:38 > Calculating FID Score.... [INFO] 2021-07-13 04:33:44 > Calculating Inception Score.... [INFO] 2021-07-13 04:34:41 > Calculate F_beta Score.... [INFO] 2021-07-13 04:37:03 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-13 04:37:03 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-13 04:37:05 > Calculate Accuracies.... [INFO] 2021-07-13 04:37:51 > Calculate Accuracies.... [INFO] 2021-07-13 04:38:41 > F_8 score (Step: 126000, Using valid images): 0.9814553541892804 [INFO] 2021-07-13 04:38:41 > F_1/8 score (Step: 126000, Using valid images): 0.9848249889880849 [INFO] 2021-07-13 04:38:41 > FID score (Step: 126000, Using valid moments): 9.75537534492986 [INFO] 2021-07-13 04:38:41 > Inception score (Step: 126000, 50000 generated images): 77.760009765625 [INFO] 2021-07-13 04:38:41 > Best FID score (Step: 124000, Using valid moments): 9.630354667678944 [INFO] 2021-07-13 04:38:49 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-13 04:57:55 > Step: 126100 Progress: 63.0% Elapsed: 4 days, 20:51:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.49668 Generator_loss: 0.995403 [INFO] 2021-07-13 05:17:02 > Step: 126200 Progress: 63.1% Elapsed: 4 days, 21:10:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.500294 Generator_loss: 0.944288 [INFO] 2021-07-13 05:36:13 > Step: 126300 Progress: 63.1% Elapsed: 4 days, 21:29:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.519833 Generator_loss: 0.836262 [INFO] 2021-07-13 05:55:20 > Step: 126400 Progress: 63.2% Elapsed: 4 days, 21:48:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.527165 Generator_loss: 0.949158 [INFO] 2021-07-13 06:14:27 > Step: 126500 Progress: 63.2% Elapsed: 4 days, 22:07:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.534085 Generator_loss: 0.845978 [INFO] 2021-07-13 06:33:38 > Step: 126600 Progress: 63.3% Elapsed: 4 days, 22:26:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.486086 Generator_loss: 0.927979 [INFO] 2021-07-13 06:52:45 > Step: 126700 Progress: 63.3% Elapsed: 4 days, 22:45:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.515486 Generator_loss: 0.940803 [INFO] 2021-07-13 07:11:53 > Step: 126800 Progress: 63.4% Elapsed: 4 days, 23:05:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.495588 Generator_loss: 0.997805 [INFO] 2021-07-13 07:31:01 > Step: 126900 Progress: 63.4% Elapsed: 4 days, 23:24:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.485334 Generator_loss: 0.939672 [INFO] 2021-07-13 07:50:10 > Step: 127000 Progress: 63.5% Elapsed: 4 days, 23:43:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.493908 Generator_loss: 0.902936 [INFO] 2021-07-13 08:09:15 > Step: 127100 Progress: 63.5% Elapsed: 5 days, 0:02:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.487796 Generator_loss: 0.912412 [INFO] 2021-07-13 08:28:23 > Step: 127200 Progress: 63.6% Elapsed: 5 days, 0:21:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.50704 Generator_loss: 0.89332 [INFO] 2021-07-13 08:47:32 > Step: 127300 Progress: 63.6% Elapsed: 5 days, 0:40:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.523446 Generator_loss: 0.842097 [INFO] 2021-07-13 09:06:37 > Step: 127400 Progress: 63.7% Elapsed: 5 days, 0:59:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.483891 Generator_loss: 1.01559 [INFO] 2021-07-13 09:25:41 > Step: 127500 Progress: 63.7% Elapsed: 5 days, 1:18:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.500028 Generator_loss: 0.938803 [INFO] 2021-07-13 09:44:51 > Step: 127600 Progress: 63.8% Elapsed: 5 days, 1:38:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.513393 Generator_loss: 0.910967 [INFO] 2021-07-13 10:03:57 > Step: 127700 Progress: 63.8% Elapsed: 5 days, 1:57:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.513272 Generator_loss: 0.911155 [INFO] 2021-07-13 10:23:01 > Step: 127800 Progress: 63.9% Elapsed: 5 days, 2:16:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.471973 Generator_loss: 1.04891 [INFO] 2021-07-13 10:42:13 > Step: 127900 Progress: 63.9% Elapsed: 5 days, 2:35:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.530984 Generator_loss: 0.920422 [INFO] 2021-07-13 11:01:21 > Step: 128000 Progress: 64.0% Elapsed: 5 days, 2:54:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.539347 Generator_loss: 0.962932 [INFO] 2021-07-13 11:01:21 > Start Evaluation (128000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-13 11:01:21 > Calculating FID Score.... [INFO] 2021-07-13 11:02:28 > Calculating Inception Score.... [INFO] 2021-07-13 11:03:23 > Calculate F_beta Score.... [INFO] 2021-07-13 11:05:42 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-13 11:05:43 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-13 11:05:44 > Calculate Accuracies.... [INFO] 2021-07-13 11:06:31 > Calculate Accuracies.... [INFO] 2021-07-13 11:07:21 > F_8 score (Step: 128000, Using valid images): 0.9820196322213127 [INFO] 2021-07-13 11:07:21 > F_1/8 score (Step: 128000, Using valid images): 0.9846222665542304 [INFO] 2021-07-13 11:07:21 > FID score (Step: 128000, Using valid moments): 9.63420073792264 [INFO] 2021-07-13 11:07:21 > Inception score (Step: 128000, 50000 generated images): 77.58470153808594 [INFO] 2021-07-13 11:07:21 > Best FID score (Step: 124000, Using valid moments): 9.630354667678944 [INFO] 2021-07-13 11:07:29 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-13 11:26:38 > Step: 128100 Progress: 64.0% Elapsed: 5 days, 3:19:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.485051 Generator_loss: 0.974381 [INFO] 2021-07-13 11:45:49 > Step: 128200 Progress: 64.1% Elapsed: 5 days, 3:39:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.562968 Generator_loss: 0.806935 [INFO] 2021-07-13 12:04:56 > Step: 128300 Progress: 64.1% Elapsed: 5 days, 3:58:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.525298 Generator_loss: 0.877923 [INFO] 2021-07-13 12:24:03 > Step: 128400 Progress: 64.2% Elapsed: 5 days, 4:17:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.480046 Generator_loss: 0.99824 [INFO] 2021-07-13 12:43:12 > Step: 128500 Progress: 64.2% Elapsed: 5 days, 4:36:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.485371 Generator_loss: 0.91194 [INFO] 2021-07-13 13:02:19 > Step: 128600 Progress: 64.3% Elapsed: 5 days, 4:55:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.476148 Generator_loss: 0.916024 [INFO] 2021-07-13 13:21:29 > Step: 128700 Progress: 64.3% Elapsed: 5 days, 5:14:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.47165 Generator_loss: 0.935532 [INFO] 2021-07-13 13:40:39 > Step: 128800 Progress: 64.4% Elapsed: 5 days, 5:33:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.481229 Generator_loss: 0.925534 [INFO] 2021-07-13 13:59:47 > Step: 128900 Progress: 64.5% Elapsed: 5 days, 5:52:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.520381 Generator_loss: 0.948337 [INFO] 2021-07-13 14:18:52 > Step: 129000 Progress: 64.5% Elapsed: 5 days, 6:12:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.531052 Generator_loss: 1.00344 [INFO] 2021-07-13 14:38:01 > Step: 129100 Progress: 64.5% Elapsed: 5 days, 6:31:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.471907 Generator_loss: 0.983976 [INFO] 2021-07-13 14:57:09 > Step: 129200 Progress: 64.6% Elapsed: 5 days, 6:50:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.478421 Generator_loss: 0.970237 [INFO] 2021-07-13 15:16:14 > Step: 129300 Progress: 64.6% Elapsed: 5 days, 7:09:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.468891 Generator_loss: 0.956092 [INFO] 2021-07-13 15:35:19 > Step: 129400 Progress: 64.7% Elapsed: 5 days, 7:28:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.503263 Generator_loss: 0.914364 [INFO] 2021-07-13 15:54:30 > Step: 129500 Progress: 64.8% Elapsed: 5 days, 7:47:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.484239 Generator_loss: 0.984387 [INFO] 2021-07-13 16:13:38 > Step: 129600 Progress: 64.8% Elapsed: 5 days, 8:06:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.500993 Generator_loss: 0.943237 [INFO] 2021-07-13 16:32:44 > Step: 129700 Progress: 64.8% Elapsed: 5 days, 8:25:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.506162 Generator_loss: 0.948633 [INFO] 2021-07-13 16:51:55 > Step: 129800 Progress: 64.9% Elapsed: 5 days, 8:45:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.473456 Generator_loss: 1.01569 [INFO] 2021-07-13 17:11:00 > Step: 129900 Progress: 65.0% Elapsed: 5 days, 9:04:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.478417 Generator_loss: 1.04462 [INFO] 2021-07-13 17:30:06 > Step: 130000 Progress: 65.0% Elapsed: 5 days, 9:23:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.500642 Generator_loss: 0.912356 [INFO] 2021-07-13 17:30:06 > Start Evaluation (130000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-13 17:30:06 > Calculating FID Score.... [INFO] 2021-07-13 17:31:13 > Calculating Inception Score.... [INFO] 2021-07-13 17:32:08 > Calculate F_beta Score.... [INFO] 2021-07-13 17:34:30 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-13 17:34:30 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-13 17:34:31 > Calculate Accuracies.... [INFO] 2021-07-13 17:35:18 > Calculate Accuracies.... [INFO] 2021-07-13 17:36:08 > F_8 score (Step: 130000, Using valid images): 0.9827843374519118 [INFO] 2021-07-13 17:36:08 > F_1/8 score (Step: 130000, Using valid images): 0.9832332266123711 [INFO] 2021-07-13 17:36:08 > FID score (Step: 130000, Using valid moments): 9.44861629449224 [INFO] 2021-07-13 17:36:08 > Inception score (Step: 130000, 50000 generated images): 79.22754669189453 [INFO] 2021-07-13 17:36:08 > Best FID score (Step: 130000, Using valid moments): 9.44861629449224 [INFO] 2021-07-13 17:36:23 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-13 17:55:35 > Step: 130100 Progress: 65.0% Elapsed: 5 days, 9:48:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.471708 Generator_loss: 1.01932 [INFO] 2021-07-13 18:14:44 > Step: 130200 Progress: 65.1% Elapsed: 5 days, 10:07:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.514158 Generator_loss: 0.896057 [INFO] 2021-07-13 18:33:50 > Step: 130300 Progress: 65.1% Elapsed: 5 days, 10:27:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.492727 Generator_loss: 0.928291 [INFO] 2021-07-13 18:53:02 > Step: 130400 Progress: 65.2% Elapsed: 5 days, 10:46:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.479662 Generator_loss: 0.937762 [INFO] 2021-07-13 19:12:08 > Step: 130500 Progress: 65.2% Elapsed: 5 days, 11:05:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.53263 Generator_loss: 0.893658 [INFO] 2021-07-13 19:31:11 > Step: 130600 Progress: 65.3% Elapsed: 5 days, 11:24:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.474365 Generator_loss: 1.07389 [INFO] 2021-07-13 19:50:21 > Step: 130700 Progress: 65.3% Elapsed: 5 days, 11:43:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.482204 Generator_loss: 1.00453 [INFO] 2021-07-13 20:09:27 > Step: 130800 Progress: 65.4% Elapsed: 5 days, 12:02:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.476542 Generator_loss: 0.954472 [INFO] 2021-07-13 20:28:32 > Step: 130900 Progress: 65.5% Elapsed: 5 days, 12:21:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.497506 Generator_loss: 0.928923 [INFO] 2021-07-13 20:47:43 > Step: 131000 Progress: 65.5% Elapsed: 5 days, 12:40:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.466522 Generator_loss: 0.99291 [INFO] 2021-07-13 21:06:50 > Step: 131100 Progress: 65.5% Elapsed: 5 days, 13:00:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.464597 Generator_loss: 1.03522 [INFO] 2021-07-13 21:25:58 > Step: 131200 Progress: 65.6% Elapsed: 5 days, 13:19:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.474423 Generator_loss: 0.96543 [INFO] 2021-07-13 21:45:11 > Step: 131300 Progress: 65.6% Elapsed: 5 days, 13:38:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.467193 Generator_loss: 1.03939 [INFO] 2021-07-13 22:04:17 > Step: 131400 Progress: 65.7% Elapsed: 5 days, 13:57:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.474345 Generator_loss: 1.07402 [INFO] 2021-07-13 22:23:24 > Step: 131500 Progress: 65.8% Elapsed: 5 days, 14:16:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.467906 Generator_loss: 1.03284 [INFO] 2021-07-13 22:42:31 > Step: 131600 Progress: 65.8% Elapsed: 5 days, 14:35:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.503285 Generator_loss: 0.91634 [INFO] 2021-07-13 23:01:40 > Step: 131700 Progress: 65.8% Elapsed: 5 days, 14:54:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.514197 Generator_loss: 0.9116 [INFO] 2021-07-13 23:20:47 > Step: 131800 Progress: 65.9% Elapsed: 5 days, 15:13:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.469379 Generator_loss: 1.05325 [INFO] 2021-07-13 23:39:51 > Step: 131900 Progress: 66.0% Elapsed: 5 days, 15:33:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.498111 Generator_loss: 0.943357 [INFO] 2021-07-13 23:59:04 > Step: 132000 Progress: 66.0% Elapsed: 5 days, 15:52:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.521652 Generator_loss: 0.958514 [INFO] 2021-07-13 23:59:04 > Start Evaluation (132000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-13 23:59:04 > Calculating FID Score.... [INFO] 2021-07-14 00:00:11 > Calculating Inception Score.... [INFO] 2021-07-14 00:01:06 > Calculate F_beta Score.... [INFO] 2021-07-14 00:03:30 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-14 00:03:31 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-14 00:03:32 > Calculate Accuracies.... [INFO] 2021-07-14 00:04:19 > Calculate Accuracies.... [INFO] 2021-07-14 00:05:08 > F_8 score (Step: 132000, Using valid images): 0.9833696614732781 [INFO] 2021-07-14 00:05:08 > F_1/8 score (Step: 132000, Using valid images): 0.9839402262898693 [INFO] 2021-07-14 00:05:08 > FID score (Step: 132000, Using valid moments): 9.476753844361724 [INFO] 2021-07-14 00:05:08 > Inception score (Step: 132000, 50000 generated images): 80.1781234741211 [INFO] 2021-07-14 00:05:08 > Best FID score (Step: 130000, Using valid moments): 9.44861629449224 [INFO] 2021-07-14 00:05:16 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-14 00:24:26 > Step: 132100 Progress: 66.0% Elapsed: 5 days, 16:17:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.59958 Generator_loss: 0.941158 [INFO] 2021-07-14 00:43:33 > Step: 132200 Progress: 66.1% Elapsed: 5 days, 16:36:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.484583 Generator_loss: 0.938263 [INFO] 2021-07-14 01:02:44 > Step: 132300 Progress: 66.1% Elapsed: 5 days, 16:55:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.479057 Generator_loss: 0.958024 [INFO] 2021-07-14 01:21:52 > Step: 132400 Progress: 66.2% Elapsed: 5 days, 17:15:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.47813 Generator_loss: 0.960839 [INFO] 2021-07-14 01:40:59 > Step: 132500 Progress: 66.2% Elapsed: 5 days, 17:34:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.474047 Generator_loss: 0.982217 [INFO] 2021-07-14 02:00:09 > Step: 132600 Progress: 66.3% Elapsed: 5 days, 17:53:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.469518 Generator_loss: 0.983948 [INFO] 2021-07-14 02:19:15 > Step: 132700 Progress: 66.3% Elapsed: 5 days, 18:12:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.496908 Generator_loss: 0.938763 [INFO] 2021-07-14 02:38:22 > Step: 132800 Progress: 66.4% Elapsed: 5 days, 18:31:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.480039 Generator_loss: 0.979779 [INFO] 2021-07-14 02:57:32 > Step: 132900 Progress: 66.5% Elapsed: 5 days, 18:50:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.488693 Generator_loss: 0.94381 [INFO] 2021-07-14 03:16:38 > Step: 133000 Progress: 66.5% Elapsed: 5 days, 19:09:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.471831 Generator_loss: 1.00869 [INFO] 2021-07-14 03:35:45 > Step: 133100 Progress: 66.5% Elapsed: 5 days, 19:28:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.617717 Generator_loss: 1.05617 [INFO] 2021-07-14 03:54:58 > Step: 133200 Progress: 66.6% Elapsed: 5 days, 19:48:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.49908 Generator_loss: 0.916477 [INFO] 2021-07-14 04:14:06 > Step: 133300 Progress: 66.6% Elapsed: 5 days, 20:07:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.476839 Generator_loss: 0.971435 [INFO] 2021-07-14 04:33:13 > Step: 133400 Progress: 66.7% Elapsed: 5 days, 20:26:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.479394 Generator_loss: 0.950127 [INFO] 2021-07-14 04:52:24 > Step: 133500 Progress: 66.8% Elapsed: 5 days, 20:45:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.544037 Generator_loss: 0.863764 [INFO] 2021-07-14 05:11:33 > Step: 133600 Progress: 66.8% Elapsed: 5 days, 21:04:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.503269 Generator_loss: 0.857117 [INFO] 2021-07-14 05:30:40 > Step: 133700 Progress: 66.8% Elapsed: 5 days, 21:23:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.487257 Generator_loss: 0.998634 [INFO] 2021-07-14 05:49:52 > Step: 133800 Progress: 66.9% Elapsed: 5 days, 21:43:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.467964 Generator_loss: 1.04695 [INFO] 2021-07-14 06:08:58 > Step: 133900 Progress: 67.0% Elapsed: 5 days, 22:02:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.481171 Generator_loss: 0.972529 [INFO] 2021-07-14 06:28:05 > Step: 134000 Progress: 67.0% Elapsed: 5 days, 22:21:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.502576 Generator_loss: 0.953983 [INFO] 2021-07-14 06:28:06 > Start Evaluation (134000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-14 06:28:06 > Calculating FID Score.... [INFO] 2021-07-14 06:29:12 > Calculating Inception Score.... [INFO] 2021-07-14 06:30:08 > Calculate F_beta Score.... [INFO] 2021-07-14 06:32:33 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-14 06:32:33 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-14 06:32:35 > Calculate Accuracies.... [INFO] 2021-07-14 06:33:21 > Calculate Accuracies.... [INFO] 2021-07-14 06:34:11 > F_8 score (Step: 134000, Using valid images): 0.9833236568211784 [INFO] 2021-07-14 06:34:11 > F_1/8 score (Step: 134000, Using valid images): 0.9842809127168577 [INFO] 2021-07-14 06:34:11 > FID score (Step: 134000, Using valid moments): 9.409102067123115 [INFO] 2021-07-14 06:34:11 > Inception score (Step: 134000, 50000 generated images): 80.20745086669922 [INFO] 2021-07-14 06:34:11 > Best FID score (Step: 134000, Using valid moments): 9.409102067123115 [INFO] 2021-07-14 06:34:26 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-14 06:53:39 > Step: 134100 Progress: 67.0% Elapsed: 5 days, 22:46:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.477668 Generator_loss: 0.953551 [INFO] 2021-07-14 07:12:49 > Step: 134200 Progress: 67.1% Elapsed: 5 days, 23:06:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.549642 Generator_loss: 1.07394 [INFO] 2021-07-14 07:31:57 > Step: 134300 Progress: 67.2% Elapsed: 5 days, 23:25:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.467404 Generator_loss: 1.00228 [INFO] 2021-07-14 07:51:04 > Step: 134400 Progress: 67.2% Elapsed: 5 days, 23:44:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.506556 Generator_loss: 0.90845 [INFO] 2021-07-14 08:10:17 > Step: 134500 Progress: 67.2% Elapsed: 6 days, 0:03:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.498445 Generator_loss: 0.925174 [INFO] 2021-07-14 08:29:23 > Step: 134600 Progress: 67.3% Elapsed: 6 days, 0:22:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.482671 Generator_loss: 0.931569 [INFO] 2021-07-14 08:48:29 > Step: 134700 Progress: 67.3% Elapsed: 6 days, 0:41:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.485977 Generator_loss: 0.970029 [INFO] 2021-07-14 09:07:40 > Step: 134800 Progress: 67.4% Elapsed: 6 days, 1:00:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.482229 Generator_loss: 0.976526 [INFO] 2021-07-14 09:26:49 > Step: 134900 Progress: 67.5% Elapsed: 6 days, 1:20:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.507459 Generator_loss: 0.973622 [INFO] 2021-07-14 09:45:56 > Step: 135000 Progress: 67.5% Elapsed: 6 days, 1:39:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.468872 Generator_loss: 1.01615 [INFO] 2021-07-14 10:05:10 > Step: 135100 Progress: 67.5% Elapsed: 6 days, 1:58:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.463898 Generator_loss: 1.03879 [INFO] 2021-07-14 10:24:19 > Step: 135200 Progress: 67.6% Elapsed: 6 days, 2:17:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.467856 Generator_loss: 1.02922 [INFO] 2021-07-14 10:43:26 > Step: 135300 Progress: 67.7% Elapsed: 6 days, 2:36:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.496308 Generator_loss: 0.878423 [INFO] 2021-07-14 11:02:37 > Step: 135400 Progress: 67.7% Elapsed: 6 days, 2:55:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.489983 Generator_loss: 0.944151 [INFO] 2021-07-14 11:21:44 > Step: 135500 Progress: 67.8% Elapsed: 6 days, 3:14:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.535482 Generator_loss: 0.924856 [INFO] 2021-07-14 11:40:52 > Step: 135600 Progress: 67.8% Elapsed: 6 days, 3:34:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.479307 Generator_loss: 1.00385 [INFO] 2021-07-14 12:00:04 > Step: 135700 Progress: 67.8% Elapsed: 6 days, 3:53:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.468008 Generator_loss: 1.09179 [INFO] 2021-07-14 12:19:15 > Step: 135800 Progress: 67.9% Elapsed: 6 days, 4:12:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.498035 Generator_loss: 0.955796 [INFO] 2021-07-14 12:38:21 > Step: 135900 Progress: 68.0% Elapsed: 6 days, 4:31:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.578265 Generator_loss: 0.863852 [INFO] 2021-07-14 12:57:32 > Step: 136000 Progress: 68.0% Elapsed: 6 days, 4:50:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.474055 Generator_loss: 0.950116 [INFO] 2021-07-14 12:57:32 > Start Evaluation (136000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-14 12:57:32 > Calculating FID Score.... [INFO] 2021-07-14 12:58:38 > Calculating Inception Score.... [INFO] 2021-07-14 12:59:34 > Calculate F_beta Score.... [INFO] 2021-07-14 13:01:57 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-14 13:01:58 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-14 13:01:59 > Calculate Accuracies.... [INFO] 2021-07-14 13:02:46 > Calculate Accuracies.... [INFO] 2021-07-14 13:03:35 > F_8 score (Step: 136000, Using valid images): 0.9849685561642421 [INFO] 2021-07-14 13:03:35 > F_1/8 score (Step: 136000, Using valid images): 0.9877969488963294 [INFO] 2021-07-14 13:03:35 > FID score (Step: 136000, Using valid moments): 9.351508963507285 [INFO] 2021-07-14 13:03:35 > Inception score (Step: 136000, 50000 generated images): 80.76636505126953 [INFO] 2021-07-14 13:03:35 > Best FID score (Step: 136000, Using valid moments): 9.351508963507285 [INFO] 2021-07-14 13:03:50 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-14 13:22:58 > Step: 136100 Progress: 68.0% Elapsed: 6 days, 5:16:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.490716 Generator_loss: 0.988117 [INFO] 2021-07-14 13:42:07 > Step: 136200 Progress: 68.1% Elapsed: 6 days, 5:35:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.487458 Generator_loss: 0.994345 [INFO] 2021-07-14 14:01:18 > Step: 136300 Progress: 68.2% Elapsed: 6 days, 5:54:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.510148 Generator_loss: 0.95334 [INFO] 2021-07-14 14:20:26 > Step: 136400 Progress: 68.2% Elapsed: 6 days, 6:13:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.500579 Generator_loss: 0.92545 [INFO] 2021-07-14 14:39:34 > Step: 136500 Progress: 68.2% Elapsed: 6 days, 6:32:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.4801 Generator_loss: 0.96623 [INFO] 2021-07-14 14:58:45 > Step: 136600 Progress: 68.3% Elapsed: 6 days, 6:51:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.46628 Generator_loss: 1.05316 [INFO] 2021-07-14 15:17:54 > Step: 136700 Progress: 68.3% Elapsed: 6 days, 7:11:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.491217 Generator_loss: 0.945876 [INFO] 2021-07-14 15:37:02 > Step: 136800 Progress: 68.4% Elapsed: 6 days, 7:30:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.475352 Generator_loss: 0.981302 [INFO] 2021-07-14 15:56:12 > Step: 136900 Progress: 68.5% Elapsed: 6 days, 7:49:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.465868 Generator_loss: 1.17379 [INFO] 2021-07-14 16:15:23 > Step: 137000 Progress: 68.5% Elapsed: 6 days, 8:08:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.495051 Generator_loss: 0.942474 [INFO] 2021-07-14 16:34:29 > Step: 137100 Progress: 68.5% Elapsed: 6 days, 8:27:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.474025 Generator_loss: 0.972511 [INFO] 2021-07-14 16:53:36 > Step: 137200 Progress: 68.6% Elapsed: 6 days, 8:46:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.508516 Generator_loss: 0.901093 [INFO] 2021-07-14 17:12:48 > Step: 137300 Progress: 68.7% Elapsed: 6 days, 9:05:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.481385 Generator_loss: 0.922511 [INFO] 2021-07-14 17:31:55 > Step: 137400 Progress: 68.7% Elapsed: 6 days, 9:25:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.499474 Generator_loss: 0.976242 [INFO] 2021-07-14 17:51:01 > Step: 137500 Progress: 68.8% Elapsed: 6 days, 9:44:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.521846 Generator_loss: 0.901663 [INFO] 2021-07-14 18:10:11 > Step: 137600 Progress: 68.8% Elapsed: 6 days, 10:03:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.522103 Generator_loss: 0.908087 [INFO] 2021-07-14 18:29:17 > Step: 137700 Progress: 68.8% Elapsed: 6 days, 10:22:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.494002 Generator_loss: 0.93463 [INFO] 2021-07-14 18:48:25 > Step: 137800 Progress: 68.9% Elapsed: 6 days, 10:41:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.584078 Generator_loss: 0.899375 [INFO] 2021-07-14 19:07:38 > Step: 137900 Progress: 69.0% Elapsed: 6 days, 11:00:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.516981 Generator_loss: 0.914354 [INFO] 2021-07-14 19:26:44 > Step: 138000 Progress: 69.0% Elapsed: 6 days, 11:19:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.47396 Generator_loss: 1.01425 [INFO] 2021-07-14 19:26:44 > Start Evaluation (138000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-14 19:26:44 > Calculating FID Score.... [INFO] 2021-07-14 19:27:51 > Calculating Inception Score.... [INFO] 2021-07-14 19:28:47 > Calculate F_beta Score.... [INFO] 2021-07-14 19:31:09 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-14 19:31:09 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-14 19:31:11 > Calculate Accuracies.... [INFO] 2021-07-14 19:31:57 > Calculate Accuracies.... [INFO] 2021-07-14 19:32:47 > F_8 score (Step: 138000, Using valid images): 0.9833490655076502 [INFO] 2021-07-14 19:32:47 > F_1/8 score (Step: 138000, Using valid images): 0.9861339343389878 [INFO] 2021-07-14 19:32:47 > FID score (Step: 138000, Using valid moments): 9.348085243288097 [INFO] 2021-07-14 19:32:47 > Inception score (Step: 138000, 50000 generated images): 81.3119888305664 [INFO] 2021-07-14 19:32:47 > Best FID score (Step: 138000, Using valid moments): 9.348085243288097 [INFO] 2021-07-14 19:33:02 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-14 19:52:11 > Step: 138100 Progress: 69.0% Elapsed: 6 days, 11:45:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.4788 Generator_loss: 1.08113 [INFO] 2021-07-14 20:11:24 > Step: 138200 Progress: 69.1% Elapsed: 6 days, 12:04:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.480045 Generator_loss: 1.03286 [INFO] 2021-07-14 20:30:31 > Step: 138300 Progress: 69.2% Elapsed: 6 days, 12:23:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.599703 Generator_loss: 0.983394 [INFO] 2021-07-14 20:49:42 > Step: 138400 Progress: 69.2% Elapsed: 6 days, 12:42:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.477947 Generator_loss: 0.977547 [INFO] 2021-07-14 21:08:55 > Step: 138500 Progress: 69.2% Elapsed: 6 days, 13:02:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.492791 Generator_loss: 0.951811 [INFO] 2021-07-14 21:28:03 > Step: 138600 Progress: 69.3% Elapsed: 6 days, 13:21:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.532602 Generator_loss: 0.935109 [INFO] 2021-07-14 21:47:11 > Step: 138700 Progress: 69.3% Elapsed: 6 days, 13:40:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.474153 Generator_loss: 1.0127 [INFO] 2021-07-14 22:06:21 > Step: 138800 Progress: 69.4% Elapsed: 6 days, 13:59:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.486325 Generator_loss: 0.947932 [INFO] 2021-07-14 22:25:29 > Step: 138900 Progress: 69.5% Elapsed: 6 days, 14:18:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.466373 Generator_loss: 1.05444 [INFO] 2021-07-14 22:44:35 > Step: 139000 Progress: 69.5% Elapsed: 6 days, 14:37:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.478032 Generator_loss: 0.989165 [INFO] 2021-07-14 23:03:40 > Step: 139100 Progress: 69.5% Elapsed: 6 days, 14:56:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.506939 Generator_loss: 1.00672 [INFO] 2021-07-14 23:22:51 > Step: 139200 Progress: 69.6% Elapsed: 6 days, 15:16:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.498857 Generator_loss: 0.943601 [INFO] 2021-07-14 23:42:00 > Step: 139300 Progress: 69.7% Elapsed: 6 days, 15:35:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.461352 Generator_loss: 1.07997 [INFO] 2021-07-15 00:01:10 > Step: 139400 Progress: 69.7% Elapsed: 6 days, 15:54:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.475981 Generator_loss: 1.00796 [INFO] 2021-07-15 00:20:22 > Step: 139500 Progress: 69.8% Elapsed: 6 days, 16:13:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.468026 Generator_loss: 0.990565 [INFO] 2021-07-15 00:39:33 > Step: 139600 Progress: 69.8% Elapsed: 6 days, 16:32:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.485134 Generator_loss: 0.987714 [INFO] 2021-07-15 00:58:38 > Step: 139700 Progress: 69.8% Elapsed: 6 days, 16:51:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.849846 Generator_loss: 0.887815 [INFO] 2021-07-15 01:17:50 > Step: 139800 Progress: 69.9% Elapsed: 6 days, 17:11:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.476949 Generator_loss: 1.01508 [INFO] 2021-07-15 01:36:58 > Step: 139900 Progress: 70.0% Elapsed: 6 days, 17:30:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.473644 Generator_loss: 0.996079 [INFO] 2021-07-15 01:56:04 > Step: 140000 Progress: 70.0% Elapsed: 6 days, 17:49:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.505068 Generator_loss: 0.939907 [INFO] 2021-07-15 01:56:04 > Start Evaluation (140000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-15 01:56:04 > Calculating FID Score.... [INFO] 2021-07-15 01:57:11 > Calculating Inception Score.... [INFO] 2021-07-15 01:58:07 > Calculate F_beta Score.... [INFO] 2021-07-15 02:00:32 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-15 02:00:33 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-15 02:00:34 > Calculate Accuracies.... [INFO] 2021-07-15 02:01:21 > Calculate Accuracies.... [INFO] 2021-07-15 02:02:11 > F_8 score (Step: 140000, Using valid images): 0.9823932223830111 [INFO] 2021-07-15 02:02:11 > F_1/8 score (Step: 140000, Using valid images): 0.9855571123380007 [INFO] 2021-07-15 02:02:11 > FID score (Step: 140000, Using valid moments): 9.271928412899456 [INFO] 2021-07-15 02:02:11 > Inception score (Step: 140000, 50000 generated images): 81.67046356201172 [INFO] 2021-07-15 02:02:11 > Best FID score (Step: 140000, Using valid moments): 9.271928412899456 [INFO] 2021-07-15 02:02:25 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-15 02:21:37 > Step: 140100 Progress: 70.0% Elapsed: 6 days, 18:14:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.491637 Generator_loss: 0.922684 [INFO] 2021-07-15 02:40:44 > Step: 140200 Progress: 70.1% Elapsed: 6 days, 18:33:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.483215 Generator_loss: 0.972935 [INFO] 2021-07-15 02:59:50 > Step: 140300 Progress: 70.2% Elapsed: 6 days, 18:53:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.517152 Generator_loss: 0.909633 [INFO] 2021-07-15 03:19:01 > Step: 140400 Progress: 70.2% Elapsed: 6 days, 19:12:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.472664 Generator_loss: 1.06074 [INFO] 2021-07-15 03:38:06 > Step: 140500 Progress: 70.2% Elapsed: 6 days, 19:31:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.459975 Generator_loss: 1.05808 [INFO] 2021-07-15 03:57:12 > Step: 140600 Progress: 70.3% Elapsed: 6 days, 19:50:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.499539 Generator_loss: 0.974135 [INFO] 2021-07-15 04:16:23 > Step: 140700 Progress: 70.3% Elapsed: 6 days, 20:09:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.512159 Generator_loss: 0.863338 [INFO] 2021-07-15 04:35:32 > Step: 140800 Progress: 70.4% Elapsed: 6 days, 20:28:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.476203 Generator_loss: 1.01695 [INFO] 2021-07-15 04:54:39 > Step: 140900 Progress: 70.5% Elapsed: 6 days, 20:47:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.50458 Generator_loss: 0.902637 [INFO] 2021-07-15 05:13:52 > Step: 141000 Progress: 70.5% Elapsed: 6 days, 21:07:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.466866 Generator_loss: 1.03137 [INFO] 2021-07-15 05:33:00 > Step: 141100 Progress: 70.5% Elapsed: 6 days, 21:26:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.502705 Generator_loss: 0.914029 [INFO] 2021-07-15 05:52:05 > Step: 141200 Progress: 70.6% Elapsed: 6 days, 21:45:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.604516 Generator_loss: 0.727667 [INFO] 2021-07-15 06:11:13 > Step: 141300 Progress: 70.7% Elapsed: 6 days, 22:04:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.465446 Generator_loss: 1.0624 [INFO] 2021-07-15 06:30:20 > Step: 141400 Progress: 70.7% Elapsed: 6 days, 22:23:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.482981 Generator_loss: 0.930488 [INFO] 2021-07-15 06:49:27 > Step: 141500 Progress: 70.8% Elapsed: 6 days, 22:42:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.475362 Generator_loss: 0.974243 [INFO] 2021-07-15 07:08:32 > Step: 141600 Progress: 70.8% Elapsed: 6 days, 23:01:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.466989 Generator_loss: 1.06832 [INFO] 2021-07-15 07:27:45 > Step: 141700 Progress: 70.9% Elapsed: 6 days, 23:20:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.52683 Generator_loss: 0.888894 [INFO] 2021-07-15 07:46:49 > Step: 141800 Progress: 70.9% Elapsed: 6 days, 23:40:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.467668 Generator_loss: 1.00622 [INFO] 2021-07-15 08:05:55 > Step: 141900 Progress: 71.0% Elapsed: 6 days, 23:59:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.480694 Generator_loss: 0.958967 [INFO] 2021-07-15 08:25:08 > Step: 142000 Progress: 71.0% Elapsed: 7 days, 0:18:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.497855 Generator_loss: 0.887778 [INFO] 2021-07-15 08:25:08 > Start Evaluation (142000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-15 08:25:08 > Calculating FID Score.... [INFO] 2021-07-15 08:26:15 > Calculating Inception Score.... [INFO] 2021-07-15 08:27:11 > Calculate F_beta Score.... [INFO] 2021-07-15 08:29:33 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-15 08:29:33 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-15 08:29:34 > Calculate Accuracies.... [INFO] 2021-07-15 08:30:21 > Calculate Accuracies.... [INFO] 2021-07-15 08:31:12 > F_8 score (Step: 142000, Using valid images): 0.9844261620655099 [INFO] 2021-07-15 08:31:12 > F_1/8 score (Step: 142000, Using valid images): 0.984985489177109 [INFO] 2021-07-15 08:31:12 > FID score (Step: 142000, Using valid moments): 9.275866173264944 [INFO] 2021-07-15 08:31:12 > Inception score (Step: 142000, 50000 generated images): 82.50457763671875 [INFO] 2021-07-15 08:31:12 > Best FID score (Step: 140000, Using valid moments): 9.271928412899456 [INFO] 2021-07-15 08:31:19 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-15 08:50:30 > Step: 142100 Progress: 71.0% Elapsed: 7 days, 0:43:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.490768 Generator_loss: 0.924417 [INFO] 2021-07-15 09:09:39 > Step: 142200 Progress: 71.1% Elapsed: 7 days, 1:02:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.53757 Generator_loss: 0.965266 [INFO] 2021-07-15 09:28:52 > Step: 142300 Progress: 71.2% Elapsed: 7 days, 1:22:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.478326 Generator_loss: 1.01719 [INFO] 2021-07-15 09:47:59 > Step: 142400 Progress: 71.2% Elapsed: 7 days, 1:41:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.487715 Generator_loss: 0.96209 [INFO] 2021-07-15 10:07:09 > Step: 142500 Progress: 71.2% Elapsed: 7 days, 2:00:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.487824 Generator_loss: 0.984082 [INFO] 2021-07-15 10:26:22 > Step: 142600 Progress: 71.3% Elapsed: 7 days, 2:19:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.589019 Generator_loss: 0.941402 [INFO] 2021-07-15 10:45:31 > Step: 142700 Progress: 71.4% Elapsed: 7 days, 2:38:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.478505 Generator_loss: 0.994381 [INFO] 2021-07-15 11:04:40 > Step: 142800 Progress: 71.4% Elapsed: 7 days, 2:57:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.517009 Generator_loss: 0.868507 [INFO] 2021-07-15 11:23:54 > Step: 142900 Progress: 71.5% Elapsed: 7 days, 3:17:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.470955 Generator_loss: 1.02109 [INFO] 2021-07-15 11:43:04 > Step: 143000 Progress: 71.5% Elapsed: 7 days, 3:36:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.486589 Generator_loss: 0.992237 [INFO] 2021-07-15 12:02:15 > Step: 143100 Progress: 71.5% Elapsed: 7 days, 3:55:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.488704 Generator_loss: 1.00668 [INFO] 2021-07-15 12:21:29 > Step: 143200 Progress: 71.6% Elapsed: 7 days, 4:14:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.531103 Generator_loss: 0.834299 [INFO] 2021-07-15 12:40:36 > Step: 143300 Progress: 71.7% Elapsed: 7 days, 4:33:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.487418 Generator_loss: 0.952918 [INFO] 2021-07-15 12:59:44 > Step: 143400 Progress: 71.7% Elapsed: 7 days, 4:52:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.463657 Generator_loss: 1.05805 [INFO] 2021-07-15 13:18:58 > Step: 143500 Progress: 71.8% Elapsed: 7 days, 5:12:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.488949 Generator_loss: 0.951452 [INFO] 2021-07-15 13:38:06 > Step: 143600 Progress: 71.8% Elapsed: 7 days, 5:31:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.479855 Generator_loss: 0.993096 [INFO] 2021-07-15 13:57:13 > Step: 143700 Progress: 71.9% Elapsed: 7 days, 5:50:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.46458 Generator_loss: 1.04549 [INFO] 2021-07-15 14:16:25 > Step: 143800 Progress: 71.9% Elapsed: 7 days, 6:09:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.477407 Generator_loss: 1.02203 [INFO] 2021-07-15 14:35:33 > Step: 143900 Progress: 72.0% Elapsed: 7 days, 6:28:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.490721 Generator_loss: 1.02815 [INFO] 2021-07-15 14:54:40 > Step: 144000 Progress: 72.0% Elapsed: 7 days, 6:47:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.514217 Generator_loss: 0.898366 [INFO] 2021-07-15 14:54:40 > Start Evaluation (144000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-15 14:54:40 > Calculating FID Score.... [INFO] 2021-07-15 14:55:47 > Calculating Inception Score.... [INFO] 2021-07-15 14:56:42 > Calculate F_beta Score.... [INFO] 2021-07-15 14:59:03 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-15 14:59:03 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-15 14:59:05 > Calculate Accuracies.... [INFO] 2021-07-15 14:59:52 > Calculate Accuracies.... [INFO] 2021-07-15 15:00:42 > F_8 score (Step: 144000, Using valid images): 0.9844592856548076 [INFO] 2021-07-15 15:00:42 > F_1/8 score (Step: 144000, Using valid images): 0.9866491917418312 [INFO] 2021-07-15 15:00:42 > FID score (Step: 144000, Using valid moments): 9.281435840551865 [INFO] 2021-07-15 15:00:42 > Inception score (Step: 144000, 50000 generated images): 82.869873046875 [INFO] 2021-07-15 15:00:42 > Best FID score (Step: 140000, Using valid moments): 9.271928412899456 [INFO] 2021-07-15 15:00:49 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-15 15:19:56 > Step: 144100 Progress: 72.0% Elapsed: 7 days, 7:13:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.482773 Generator_loss: 0.977142 [INFO] 2021-07-15 15:39:11 > Step: 144200 Progress: 72.1% Elapsed: 7 days, 7:32:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.502249 Generator_loss: 0.96035 [INFO] 2021-07-15 15:58:17 > Step: 144300 Progress: 72.2% Elapsed: 7 days, 7:51:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.51149 Generator_loss: 0.930812 [INFO] 2021-07-15 16:17:25 > Step: 144400 Progress: 72.2% Elapsed: 7 days, 8:10:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.487079 Generator_loss: 0.968886 [INFO] 2021-07-15 16:36:39 > Step: 144500 Progress: 72.2% Elapsed: 7 days, 8:29:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.467925 Generator_loss: 1.02095 [INFO] 2021-07-15 16:55:48 > Step: 144600 Progress: 72.3% Elapsed: 7 days, 8:49:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.489363 Generator_loss: 0.929981 [INFO] 2021-07-15 17:14:57 > Step: 144700 Progress: 72.4% Elapsed: 7 days, 9:08:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.495017 Generator_loss: 0.915638 [INFO] 2021-07-15 17:34:12 > Step: 144800 Progress: 72.4% Elapsed: 7 days, 9:27:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.48818 Generator_loss: 0.948095 [INFO] 2021-07-15 17:53:20 > Step: 144900 Progress: 72.5% Elapsed: 7 days, 9:46:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.48111 Generator_loss: 1.00075 [INFO] 2021-07-15 18:12:29 > Step: 145000 Progress: 72.5% Elapsed: 7 days, 10:05:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.474581 Generator_loss: 1.11438 [INFO] 2021-07-15 18:31:40 > Step: 145100 Progress: 72.5% Elapsed: 7 days, 10:24:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.500925 Generator_loss: 0.9114 [INFO] 2021-07-15 18:50:44 > Step: 145200 Progress: 72.6% Elapsed: 7 days, 10:43:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.461618 Generator_loss: 1.08484 [INFO] 2021-07-15 19:09:50 > Step: 145300 Progress: 72.7% Elapsed: 7 days, 11:03:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.500956 Generator_loss: 0.918513 [INFO] 2021-07-15 19:29:04 > Step: 145400 Progress: 72.7% Elapsed: 7 days, 11:22:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.496059 Generator_loss: 0.967005 [INFO] 2021-07-15 19:48:13 > Step: 145500 Progress: 72.8% Elapsed: 7 days, 11:41:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.478783 Generator_loss: 0.985636 [INFO] 2021-07-15 20:07:23 > Step: 145600 Progress: 72.8% Elapsed: 7 days, 12:00:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.463843 Generator_loss: 1.02648 [INFO] 2021-07-15 20:26:37 > Step: 145700 Progress: 72.9% Elapsed: 7 days, 12:19:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.46312 Generator_loss: 0.998438 [INFO] 2021-07-15 20:45:50 > Step: 145800 Progress: 72.9% Elapsed: 7 days, 12:39:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.488035 Generator_loss: 0.974102 [INFO] 2021-07-15 21:04:55 > Step: 145900 Progress: 73.0% Elapsed: 7 days, 12:58:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.493524 Generator_loss: 0.969922 [INFO] 2021-07-15 21:24:06 > Step: 146000 Progress: 73.0% Elapsed: 7 days, 13:17:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.493677 Generator_loss: 0.993819 [INFO] 2021-07-15 21:24:06 > Start Evaluation (146000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-15 21:24:06 > Calculating FID Score.... [INFO] 2021-07-15 21:25:12 > Calculating Inception Score.... [INFO] 2021-07-15 21:26:08 > Calculate F_beta Score.... [INFO] 2021-07-15 21:28:32 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-15 21:28:33 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-15 21:28:34 > Calculate Accuracies.... [INFO] 2021-07-15 21:29:22 > Calculate Accuracies.... [INFO] 2021-07-15 21:30:12 > F_8 score (Step: 146000, Using valid images): 0.9846355256885958 [INFO] 2021-07-15 21:30:12 > F_1/8 score (Step: 146000, Using valid images): 0.9845364574416222 [INFO] 2021-07-15 21:30:12 > FID score (Step: 146000, Using valid moments): 9.187716222280244 [INFO] 2021-07-15 21:30:12 > Inception score (Step: 146000, 50000 generated images): 84.19973754882812 [INFO] 2021-07-15 21:30:12 > Best FID score (Step: 146000, Using valid moments): 9.187716222280244 [INFO] 2021-07-15 21:30:27 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-15 21:49:38 > Step: 146100 Progress: 73.0% Elapsed: 7 days, 13:42:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.467553 Generator_loss: 0.974787 [INFO] 2021-07-15 22:08:48 > Step: 146200 Progress: 73.1% Elapsed: 7 days, 14:02:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.492916 Generator_loss: 0.930859 [INFO] 2021-07-15 22:28:03 > Step: 146300 Progress: 73.2% Elapsed: 7 days, 14:21:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.466398 Generator_loss: 0.989324 [INFO] 2021-07-15 22:47:12 > Step: 146400 Progress: 73.2% Elapsed: 7 days, 14:40:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.512859 Generator_loss: 0.936632 [INFO] 2021-07-15 23:06:20 > Step: 146500 Progress: 73.2% Elapsed: 7 days, 14:59:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.468731 Generator_loss: 1.01951 [INFO] 2021-07-15 23:25:29 > Step: 146600 Progress: 73.3% Elapsed: 7 days, 15:18:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.483245 Generator_loss: 0.957356 [INFO] 2021-07-15 23:44:45 > Step: 146700 Progress: 73.4% Elapsed: 7 days, 15:37:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.491637 Generator_loss: 0.964783 [INFO] 2021-07-16 00:03:56 > Step: 146800 Progress: 73.4% Elapsed: 7 days, 15:57:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.480659 Generator_loss: 1.04899 [INFO] 2021-07-16 00:23:06 > Step: 146900 Progress: 73.5% Elapsed: 7 days, 16:16:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.488924 Generator_loss: 0.973786 [INFO] 2021-07-16 00:42:17 > Step: 147000 Progress: 73.5% Elapsed: 7 days, 16:35:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.47154 Generator_loss: 0.990435 [INFO] 2021-07-16 01:01:25 > Step: 147100 Progress: 73.6% Elapsed: 7 days, 16:54:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.534389 Generator_loss: 1.03812 [INFO] 2021-07-16 01:20:31 > Step: 147200 Progress: 73.6% Elapsed: 7 days, 17:13:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.479146 Generator_loss: 0.999077 [INFO] 2021-07-16 01:39:44 > Step: 147300 Progress: 73.7% Elapsed: 7 days, 17:32:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.490311 Generator_loss: 0.969214 [INFO] 2021-07-16 01:58:52 > Step: 147400 Progress: 73.7% Elapsed: 7 days, 17:52:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.589277 Generator_loss: 0.846212 [INFO] 2021-07-16 02:17:57 > Step: 147500 Progress: 73.8% Elapsed: 7 days, 18:11:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.493681 Generator_loss: 0.965943 [INFO] 2021-07-16 02:37:10 > Step: 147600 Progress: 73.8% Elapsed: 7 days, 18:30:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.485487 Generator_loss: 1.25152 [INFO] 2021-07-16 02:56:17 > Step: 147700 Progress: 73.9% Elapsed: 7 days, 18:49:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.469142 Generator_loss: 1.02825 [INFO] 2021-07-16 03:15:24 > Step: 147800 Progress: 73.9% Elapsed: 7 days, 19:08:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.474942 Generator_loss: 0.977492 [INFO] 2021-07-16 03:34:37 > Step: 147900 Progress: 74.0% Elapsed: 7 days, 19:27:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.505877 Generator_loss: 1.01072 [INFO] 2021-07-16 03:53:46 > Step: 148000 Progress: 74.0% Elapsed: 7 days, 19:46:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.464901 Generator_loss: 0.976217 [INFO] 2021-07-16 03:53:46 > Start Evaluation (148000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-16 03:53:46 > Calculating FID Score.... [INFO] 2021-07-16 03:54:52 > Calculating Inception Score.... [INFO] 2021-07-16 03:55:48 > Calculate F_beta Score.... [INFO] 2021-07-16 03:58:12 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-16 03:58:13 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-16 03:58:14 > Calculate Accuracies.... [INFO] 2021-07-16 03:59:02 > Calculate Accuracies.... [INFO] 2021-07-16 03:59:52 > F_8 score (Step: 148000, Using valid images): 0.9843759086812575 [INFO] 2021-07-16 03:59:52 > F_1/8 score (Step: 148000, Using valid images): 0.9842207260829561 [INFO] 2021-07-16 03:59:52 > FID score (Step: 148000, Using valid moments): 9.220212683210548 [INFO] 2021-07-16 03:59:52 > Inception score (Step: 148000, 50000 generated images): 85.20403289794922 [INFO] 2021-07-16 03:59:52 > Best FID score (Step: 146000, Using valid moments): 9.187716222280244 [INFO] 2021-07-16 03:59:59 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-16 04:19:09 > Step: 148100 Progress: 74.1% Elapsed: 7 days, 20:12:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.494341 Generator_loss: 1.00455 [INFO] 2021-07-16 04:38:24 > Step: 148200 Progress: 74.1% Elapsed: 7 days, 20:31:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.469675 Generator_loss: 0.995185 [INFO] 2021-07-16 04:57:32 > Step: 148300 Progress: 74.2% Elapsed: 7 days, 20:50:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.487196 Generator_loss: 0.968644 [INFO] 2021-07-16 05:16:39 > Step: 148400 Progress: 74.2% Elapsed: 7 days, 21:09:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.499133 Generator_loss: 1.0256 [INFO] 2021-07-16 05:35:50 > Step: 148500 Progress: 74.2% Elapsed: 7 days, 21:29:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.469075 Generator_loss: 0.964521 [INFO] 2021-07-16 05:54:58 > Step: 148600 Progress: 74.3% Elapsed: 7 days, 21:48:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.476709 Generator_loss: 0.984448 [INFO] 2021-07-16 06:14:04 > Step: 148700 Progress: 74.4% Elapsed: 7 days, 22:07:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.483143 Generator_loss: 1.01312 [INFO] 2021-07-16 06:33:16 > Step: 148800 Progress: 74.4% Elapsed: 7 days, 22:26:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.457961 Generator_loss: 1.00098 [INFO] 2021-07-16 06:52:23 > Step: 148900 Progress: 74.5% Elapsed: 7 days, 22:45:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.470165 Generator_loss: 1.10688 [INFO] 2021-07-16 07:11:31 > Step: 149000 Progress: 74.5% Elapsed: 7 days, 23:04:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.453833 Generator_loss: 1.05805 [INFO] 2021-07-16 07:30:41 > Step: 149100 Progress: 74.6% Elapsed: 7 days, 23:23:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.483738 Generator_loss: 0.957584 [INFO] 2021-07-16 07:49:53 > Step: 149200 Progress: 74.6% Elapsed: 7 days, 23:43:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.492121 Generator_loss: 0.98533 [INFO] 2021-07-16 08:09:02 > Step: 149300 Progress: 74.7% Elapsed: 8 days, 0:02:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.474584 Generator_loss: 1.03238 [INFO] 2021-07-16 08:28:11 > Step: 149400 Progress: 74.7% Elapsed: 8 days, 0:21:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.487105 Generator_loss: 0.895128 [INFO] 2021-07-16 08:47:25 > Step: 149500 Progress: 74.8% Elapsed: 8 days, 0:40:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.577048 Generator_loss: 0.827389 [INFO] 2021-07-16 09:06:34 > Step: 149600 Progress: 74.8% Elapsed: 8 days, 0:59:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.481456 Generator_loss: 1.02673 [INFO] 2021-07-16 09:25:42 > Step: 149700 Progress: 74.9% Elapsed: 8 days, 1:18:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.483274 Generator_loss: 1.00759 [INFO] 2021-07-16 09:44:54 > Step: 149800 Progress: 74.9% Elapsed: 8 days, 1:38:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.485477 Generator_loss: 0.965669 [INFO] 2021-07-16 10:04:00 > Step: 149900 Progress: 75.0% Elapsed: 8 days, 1:57:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.472503 Generator_loss: 0.956178 [INFO] 2021-07-16 10:23:07 > Step: 150000 Progress: 75.0% Elapsed: 8 days, 2:16:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.504648 Generator_loss: 0.903886 [INFO] 2021-07-16 10:23:07 > Start Evaluation (150000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-16 10:23:07 > Calculating FID Score.... [INFO] 2021-07-16 10:24:13 > Calculating Inception Score.... [INFO] 2021-07-16 10:25:09 > Calculate F_beta Score.... [INFO] 2021-07-16 10:27:28 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-16 10:27:28 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-16 10:27:30 > Calculate Accuracies.... [INFO] 2021-07-16 10:28:17 > Calculate Accuracies.... [INFO] 2021-07-16 10:29:08 > F_8 score (Step: 150000, Using valid images): 0.9872328673064422 [INFO] 2021-07-16 10:29:08 > F_1/8 score (Step: 150000, Using valid images): 0.984638050680866 [INFO] 2021-07-16 10:29:08 > FID score (Step: 150000, Using valid moments): 9.057791057288227 [INFO] 2021-07-16 10:29:08 > Inception score (Step: 150000, 50000 generated images): 84.83191680908203 [INFO] 2021-07-16 10:29:08 > Best FID score (Step: 150000, Using valid moments): 9.057791057288227 [INFO] 2021-07-16 10:29:22 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-16 10:48:35 > Step: 150100 Progress: 75.0% Elapsed: 8 days, 2:41:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.480471 Generator_loss: 0.999258 [INFO] 2021-07-16 11:07:41 > Step: 150200 Progress: 75.1% Elapsed: 8 days, 3:00:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.490603 Generator_loss: 0.929505 [INFO] 2021-07-16 11:26:47 > Step: 150300 Progress: 75.1% Elapsed: 8 days, 3:19:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.466733 Generator_loss: 1.07306 [INFO] 2021-07-16 11:45:59 > Step: 150400 Progress: 75.2% Elapsed: 8 days, 3:39:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.491324 Generator_loss: 1.00398 [INFO] 2021-07-16 12:05:08 > Step: 150500 Progress: 75.2% Elapsed: 8 days, 3:58:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.478757 Generator_loss: 0.933367 [INFO] 2021-07-16 12:24:16 > Step: 150600 Progress: 75.3% Elapsed: 8 days, 4:17:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.495798 Generator_loss: 1.06391 [INFO] 2021-07-16 12:43:31 > Step: 150700 Progress: 75.3% Elapsed: 8 days, 4:36:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.481613 Generator_loss: 1.00198 [INFO] 2021-07-16 13:02:37 > Step: 150800 Progress: 75.4% Elapsed: 8 days, 4:55:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.483526 Generator_loss: 0.97833 [INFO] 2021-07-16 13:21:46 > Step: 150900 Progress: 75.4% Elapsed: 8 days, 5:14:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.496147 Generator_loss: 0.969868 [INFO] 2021-07-16 13:41:01 > Step: 151000 Progress: 75.5% Elapsed: 8 days, 5:34:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.468352 Generator_loss: 0.951764 [INFO] 2021-07-16 14:00:12 > Step: 151100 Progress: 75.5% Elapsed: 8 days, 5:53:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.468756 Generator_loss: 0.971112 [INFO] 2021-07-16 14:19:17 > Step: 151200 Progress: 75.6% Elapsed: 8 days, 6:12:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.467906 Generator_loss: 1.01691 [INFO] 2021-07-16 14:38:30 > Step: 151300 Progress: 75.6% Elapsed: 8 days, 6:31:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.457696 Generator_loss: 1.02369 [INFO] 2021-07-16 14:57:41 > Step: 151400 Progress: 75.7% Elapsed: 8 days, 6:50:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.479342 Generator_loss: 0.962098 [INFO] 2021-07-16 15:16:52 > Step: 151500 Progress: 75.8% Elapsed: 8 days, 7:10:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.504754 Generator_loss: 0.859338 [INFO] 2021-07-16 15:36:02 > Step: 151600 Progress: 75.8% Elapsed: 8 days, 7:29:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.484371 Generator_loss: 0.945401 [INFO] 2021-07-16 15:55:19 > Step: 151700 Progress: 75.8% Elapsed: 8 days, 7:48:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.468279 Generator_loss: 1.01161 [INFO] 2021-07-16 16:14:27 > Step: 151800 Progress: 75.9% Elapsed: 8 days, 8:07:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.475522 Generator_loss: 1.00868 [INFO] 2021-07-16 16:33:38 > Step: 151900 Progress: 75.9% Elapsed: 8 days, 8:26:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.50553 Generator_loss: 0.893932 [INFO] 2021-07-16 16:52:54 > Step: 152000 Progress: 76.0% Elapsed: 8 days, 8:46:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.536999 Generator_loss: 0.908882 [INFO] 2021-07-16 16:52:54 > Start Evaluation (152000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-16 16:52:54 > Calculating FID Score.... [INFO] 2021-07-16 16:54:01 > Calculating Inception Score.... [INFO] 2021-07-16 16:54:56 > Calculate F_beta Score.... [INFO] 2021-07-16 16:57:23 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-16 16:57:23 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-16 16:57:25 > Calculate Accuracies.... [INFO] 2021-07-16 16:58:12 > Calculate Accuracies.... [INFO] 2021-07-16 16:59:02 > F_8 score (Step: 152000, Using valid images): 0.9863245749445139 [INFO] 2021-07-16 16:59:02 > F_1/8 score (Step: 152000, Using valid images): 0.9874199683156124 [INFO] 2021-07-16 16:59:02 > FID score (Step: 152000, Using valid moments): 9.002103752315065 [INFO] 2021-07-16 16:59:02 > Inception score (Step: 152000, 50000 generated images): 84.86760711669922 [INFO] 2021-07-16 16:59:02 > Best FID score (Step: 152000, Using valid moments): 9.002103752315065 [INFO] 2021-07-16 16:59:16 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-16 17:18:28 > Step: 152100 Progress: 76.0% Elapsed: 8 days, 9:11:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.45987 Generator_loss: 1.01411 [INFO] 2021-07-16 17:37:38 > Step: 152200 Progress: 76.1% Elapsed: 8 days, 9:30:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.492335 Generator_loss: 0.950447 [INFO] 2021-07-16 17:56:54 > Step: 152300 Progress: 76.1% Elapsed: 8 days, 9:50:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.503178 Generator_loss: 0.944369 [INFO] 2021-07-16 18:16:03 > Step: 152400 Progress: 76.2% Elapsed: 8 days, 10:09:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.506303 Generator_loss: 0.964615 [INFO] 2021-07-16 18:35:11 > Step: 152500 Progress: 76.2% Elapsed: 8 days, 10:28:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.552752 Generator_loss: 0.943366 [INFO] 2021-07-16 18:54:29 > Step: 152600 Progress: 76.3% Elapsed: 8 days, 10:47:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.465457 Generator_loss: 1.15574 [INFO] 2021-07-16 19:13:36 > Step: 152700 Progress: 76.3% Elapsed: 8 days, 11:06:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.527219 Generator_loss: 0.831883 [INFO] 2021-07-16 19:32:46 > Step: 152800 Progress: 76.4% Elapsed: 8 days, 11:25:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.491639 Generator_loss: 0.935933 [INFO] 2021-07-16 19:52:01 > Step: 152900 Progress: 76.4% Elapsed: 8 days, 11:45:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.506132 Generator_loss: 0.908684 [INFO] 2021-07-16 20:11:10 > Step: 153000 Progress: 76.5% Elapsed: 8 days, 12:04:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.504324 Generator_loss: 0.931089 [INFO] 2021-07-16 20:30:19 > Step: 153100 Progress: 76.5% Elapsed: 8 days, 12:23:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.474588 Generator_loss: 0.985805 [INFO] 2021-07-16 20:49:33 > Step: 153200 Progress: 76.6% Elapsed: 8 days, 12:42:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.463197 Generator_loss: 1.05672 [INFO] 2021-07-16 21:08:45 > Step: 153300 Progress: 76.6% Elapsed: 8 days, 13:01:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.505487 Generator_loss: 0.996107 [INFO] 2021-07-16 21:27:54 > Step: 153400 Progress: 76.7% Elapsed: 8 days, 13:21:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.474967 Generator_loss: 0.970472 [INFO] 2021-07-16 21:47:09 > Step: 153500 Progress: 76.8% Elapsed: 8 days, 13:40:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.502481 Generator_loss: 0.959549 [INFO] 2021-07-16 22:06:21 > Step: 153600 Progress: 76.8% Elapsed: 8 days, 13:59:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.534079 Generator_loss: 0.956742 [INFO] 2021-07-16 22:25:31 > Step: 153700 Progress: 76.8% Elapsed: 8 days, 14:18:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.456183 Generator_loss: 1.05138 [INFO] 2021-07-16 22:44:39 > Step: 153800 Progress: 76.9% Elapsed: 8 days, 14:37:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.470922 Generator_loss: 1.02209 [INFO] 2021-07-16 23:03:54 > Step: 153900 Progress: 77.0% Elapsed: 8 days, 14:57:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.497894 Generator_loss: 0.912487 [INFO] 2021-07-16 23:23:03 > Step: 154000 Progress: 77.0% Elapsed: 8 days, 15:16:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.484888 Generator_loss: 1.00976 [INFO] 2021-07-16 23:23:03 > Start Evaluation (154000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-16 23:23:03 > Calculating FID Score.... [INFO] 2021-07-16 23:24:09 > Calculating Inception Score.... [INFO] 2021-07-16 23:25:05 > Calculate F_beta Score.... [INFO] 2021-07-16 23:27:25 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-16 23:27:25 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-16 23:27:27 > Calculate Accuracies.... [INFO] 2021-07-16 23:28:14 > Calculate Accuracies.... [INFO] 2021-07-16 23:29:04 > F_8 score (Step: 154000, Using valid images): 0.9848825672786916 [INFO] 2021-07-16 23:29:04 > F_1/8 score (Step: 154000, Using valid images): 0.9848326930349685 [INFO] 2021-07-16 23:29:04 > FID score (Step: 154000, Using valid moments): 8.992030173744183 [INFO] 2021-07-16 23:29:04 > Inception score (Step: 154000, 50000 generated images): 85.7206802368164 [INFO] 2021-07-16 23:29:04 > Best FID score (Step: 154000, Using valid moments): 8.992030173744183 [INFO] 2021-07-16 23:29:19 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-16 23:48:29 > Step: 154100 Progress: 77.0% Elapsed: 8 days, 15:41:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.518966 Generator_loss: 0.892698 [INFO] 2021-07-17 00:07:45 > Step: 154200 Progress: 77.1% Elapsed: 8 days, 16:00:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.472697 Generator_loss: 0.972094 [INFO] 2021-07-17 00:26:53 > Step: 154300 Progress: 77.1% Elapsed: 8 days, 16:20:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.501926 Generator_loss: 0.930037 [INFO] 2021-07-17 00:46:05 > Step: 154400 Progress: 77.2% Elapsed: 8 days, 16:39:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.485008 Generator_loss: 1.01658 [INFO] 2021-07-17 01:05:20 > Step: 154500 Progress: 77.2% Elapsed: 8 days, 16:58:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.472892 Generator_loss: 1.03638 [INFO] 2021-07-17 01:24:28 > Step: 154600 Progress: 77.3% Elapsed: 8 days, 17:17:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.466139 Generator_loss: 1.01215 [INFO] 2021-07-17 01:43:37 > Step: 154700 Progress: 77.3% Elapsed: 8 days, 17:36:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.513918 Generator_loss: 0.973119 [INFO] 2021-07-17 02:02:51 > Step: 154800 Progress: 77.4% Elapsed: 8 days, 17:56:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.462522 Generator_loss: 1.0158 [INFO] 2021-07-17 02:22:02 > Step: 154900 Progress: 77.5% Elapsed: 8 days, 18:15:13 temperature: 0.25 ada_p: No Discriminator_loss: 1.39331 Generator_loss: 0.597617 [INFO] 2021-07-17 02:41:12 > Step: 155000 Progress: 77.5% Elapsed: 8 days, 18:34:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.513685 Generator_loss: 0.865694 [INFO] 2021-07-17 03:00:29 > Step: 155100 Progress: 77.5% Elapsed: 8 days, 18:53:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.472471 Generator_loss: 1.00848 [INFO] 2021-07-17 03:19:39 > Step: 155200 Progress: 77.6% Elapsed: 8 days, 19:12:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.478793 Generator_loss: 0.921038 [INFO] 2021-07-17 03:38:50 > Step: 155300 Progress: 77.6% Elapsed: 8 days, 19:32:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.497683 Generator_loss: 1.00743 [INFO] 2021-07-17 03:58:05 > Step: 155400 Progress: 77.7% Elapsed: 8 days, 19:51:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.511295 Generator_loss: 0.880887 [INFO] 2021-07-17 04:17:17 > Step: 155500 Progress: 77.8% Elapsed: 8 days, 20:10:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.470091 Generator_loss: 1.00949 [INFO] 2021-07-17 04:36:28 > Step: 155600 Progress: 77.8% Elapsed: 8 days, 20:29:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.499461 Generator_loss: 0.968727 [INFO] 2021-07-17 04:55:43 > Step: 155700 Progress: 77.8% Elapsed: 8 days, 20:48:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.459192 Generator_loss: 1.10615 [INFO] 2021-07-17 05:14:52 > Step: 155800 Progress: 77.9% Elapsed: 8 days, 21:08:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.48962 Generator_loss: 0.986838 [INFO] 2021-07-17 05:34:02 > Step: 155900 Progress: 78.0% Elapsed: 8 days, 21:27:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.506587 Generator_loss: 1.02088 [INFO] 2021-07-17 05:53:16 > Step: 156000 Progress: 78.0% Elapsed: 8 days, 21:46:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.483077 Generator_loss: 0.952118 [INFO] 2021-07-17 05:53:16 > Start Evaluation (156000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-17 05:53:16 > Calculating FID Score.... [INFO] 2021-07-17 05:54:23 > Calculating Inception Score.... [INFO] 2021-07-17 05:55:19 > Calculate F_beta Score.... [INFO] 2021-07-17 05:57:41 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-17 05:57:41 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-17 05:57:43 > Calculate Accuracies.... [INFO] 2021-07-17 05:58:30 > Calculate Accuracies.... [INFO] 2021-07-17 05:59:20 > F_8 score (Step: 156000, Using valid images): 0.9851069642071472 [INFO] 2021-07-17 05:59:20 > F_1/8 score (Step: 156000, Using valid images): 0.9869341314163601 [INFO] 2021-07-17 05:59:20 > FID score (Step: 156000, Using valid moments): 8.94299023275289 [INFO] 2021-07-17 05:59:20 > Inception score (Step: 156000, 50000 generated images): 86.75259399414062 [INFO] 2021-07-17 05:59:20 > Best FID score (Step: 156000, Using valid moments): 8.94299023275289 [INFO] 2021-07-17 05:59:35 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-17 06:18:47 > Step: 156100 Progress: 78.0% Elapsed: 8 days, 22:11:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.520859 Generator_loss: 0.907596 [INFO] 2021-07-17 06:37:57 > Step: 156200 Progress: 78.1% Elapsed: 8 days, 22:31:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.483934 Generator_loss: 1.00635 [INFO] 2021-07-17 06:57:07 > Step: 156300 Progress: 78.1% Elapsed: 8 days, 22:50:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.481408 Generator_loss: 0.939412 [INFO] 2021-07-17 07:16:24 > Step: 156400 Progress: 78.2% Elapsed: 8 days, 23:09:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.48651 Generator_loss: 0.96794 [INFO] 2021-07-17 07:35:36 > Step: 156500 Progress: 78.2% Elapsed: 8 days, 23:28:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.482698 Generator_loss: 0.955995 [INFO] 2021-07-17 07:54:43 > Step: 156600 Progress: 78.3% Elapsed: 8 days, 23:47:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.473281 Generator_loss: 1.002 [INFO] 2021-07-17 08:13:59 > Step: 156700 Progress: 78.3% Elapsed: 9 days, 0:07:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.47579 Generator_loss: 0.975447 [INFO] 2021-07-17 08:33:09 > Step: 156800 Progress: 78.4% Elapsed: 9 days, 0:26:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.461018 Generator_loss: 1.10151 [INFO] 2021-07-17 08:52:21 > Step: 156900 Progress: 78.5% Elapsed: 9 days, 0:45:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.462663 Generator_loss: 1.08032 [INFO] 2021-07-17 09:11:36 > Step: 157000 Progress: 78.5% Elapsed: 9 days, 1:04:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.463213 Generator_loss: 1.08332 [INFO] 2021-07-17 09:30:46 > Step: 157100 Progress: 78.5% Elapsed: 9 days, 1:23:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.476488 Generator_loss: 1.08728 [INFO] 2021-07-17 09:49:55 > Step: 157200 Progress: 78.6% Elapsed: 9 days, 1:43:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.464119 Generator_loss: 1.01876 [INFO] 2021-07-17 10:09:10 > Step: 157300 Progress: 78.6% Elapsed: 9 days, 2:02:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.468885 Generator_loss: 0.98292 [INFO] 2021-07-17 10:28:20 > Step: 157400 Progress: 78.7% Elapsed: 9 days, 2:21:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.463979 Generator_loss: 0.985981 [INFO] 2021-07-17 10:47:32 > Step: 157500 Progress: 78.8% Elapsed: 9 days, 2:40:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.472463 Generator_loss: 1.00275 [INFO] 2021-07-17 11:06:49 > Step: 157600 Progress: 78.8% Elapsed: 9 days, 3:00:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.481338 Generator_loss: 1.00307 [INFO] 2021-07-17 11:25:57 > Step: 157700 Progress: 78.8% Elapsed: 9 days, 3:19:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.489483 Generator_loss: 0.982913 [INFO] 2021-07-17 11:45:04 > Step: 157800 Progress: 78.9% Elapsed: 9 days, 3:38:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.488706 Generator_loss: 0.918635 [INFO] 2021-07-17 12:04:17 > Step: 157900 Progress: 79.0% Elapsed: 9 days, 3:57:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.509735 Generator_loss: 0.947071 [INFO] 2021-07-17 12:23:26 > Step: 158000 Progress: 79.0% Elapsed: 9 days, 4:16:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.466809 Generator_loss: 0.991377 [INFO] 2021-07-17 12:23:26 > Start Evaluation (158000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-17 12:23:26 > Calculating FID Score.... [INFO] 2021-07-17 12:24:32 > Calculating Inception Score.... [INFO] 2021-07-17 12:25:28 > Calculate F_beta Score.... [INFO] 2021-07-17 12:27:51 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-17 12:27:52 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-17 12:27:53 > Calculate Accuracies.... [INFO] 2021-07-17 12:28:40 > Calculate Accuracies.... [INFO] 2021-07-17 12:29:30 > F_8 score (Step: 158000, Using valid images): 0.9873876171684242 [INFO] 2021-07-17 12:29:30 > F_1/8 score (Step: 158000, Using valid images): 0.9866660942876158 [INFO] 2021-07-17 12:29:30 > FID score (Step: 158000, Using valid moments): 8.937010824366894 [INFO] 2021-07-17 12:29:30 > Inception score (Step: 158000, 50000 generated images): 86.97440338134766 [INFO] 2021-07-17 12:29:30 > Best FID score (Step: 158000, Using valid moments): 8.937010824366894 [INFO] 2021-07-17 12:29:45 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-17 12:48:57 > Step: 158100 Progress: 79.0% Elapsed: 9 days, 4:42:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.478983 Generator_loss: 0.963823 [INFO] 2021-07-17 13:08:11 > Step: 158200 Progress: 79.1% Elapsed: 9 days, 5:01:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.476596 Generator_loss: 1.00615 [INFO] 2021-07-17 13:27:24 > Step: 158300 Progress: 79.1% Elapsed: 9 days, 5:20:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.46814 Generator_loss: 0.99597 [INFO] 2021-07-17 13:46:35 > Step: 158400 Progress: 79.2% Elapsed: 9 days, 5:39:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.509771 Generator_loss: 0.892981 [INFO] 2021-07-17 14:05:50 > Step: 158500 Progress: 79.2% Elapsed: 9 days, 5:59:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.460304 Generator_loss: 1.03779 [INFO] 2021-07-17 14:25:01 > Step: 158600 Progress: 79.3% Elapsed: 9 days, 6:18:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.489254 Generator_loss: 0.952037 [INFO] 2021-07-17 14:44:10 > Step: 158700 Progress: 79.3% Elapsed: 9 days, 6:37:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.48514 Generator_loss: 1.01015 [INFO] 2021-07-17 15:03:21 > Step: 158800 Progress: 79.4% Elapsed: 9 days, 6:56:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.482251 Generator_loss: 1.01968 [INFO] 2021-07-17 15:22:37 > Step: 158900 Progress: 79.5% Elapsed: 9 days, 7:15:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.489366 Generator_loss: 1.02821 [INFO] 2021-07-17 15:41:48 > Step: 159000 Progress: 79.5% Elapsed: 9 days, 7:35:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.48915 Generator_loss: 1.02246 [INFO] 2021-07-17 16:00:58 > Step: 159100 Progress: 79.5% Elapsed: 9 days, 7:54:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.470002 Generator_loss: 0.953454 [INFO] 2021-07-17 16:20:14 > Step: 159200 Progress: 79.6% Elapsed: 9 days, 8:13:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.463918 Generator_loss: 1.06557 [INFO] 2021-07-17 16:39:24 > Step: 159300 Progress: 79.7% Elapsed: 9 days, 8:32:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.47044 Generator_loss: 1.03046 [INFO] 2021-07-17 16:58:33 > Step: 159400 Progress: 79.7% Elapsed: 9 days, 8:51:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.484371 Generator_loss: 1.0235 [INFO] 2021-07-17 17:17:48 > Step: 159500 Progress: 79.8% Elapsed: 9 days, 9:11:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.473914 Generator_loss: 1.03029 [INFO] 2021-07-17 17:36:58 > Step: 159600 Progress: 79.8% Elapsed: 9 days, 9:30:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.477751 Generator_loss: 1.01432 [INFO] 2021-07-17 17:56:08 > Step: 159700 Progress: 79.8% Elapsed: 9 days, 9:49:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.464721 Generator_loss: 1.02931 [INFO] 2021-07-17 18:15:24 > Step: 159800 Progress: 79.9% Elapsed: 9 days, 10:08:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.491386 Generator_loss: 0.946774 [INFO] 2021-07-17 18:34:34 > Step: 159900 Progress: 80.0% Elapsed: 9 days, 10:27:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.455266 Generator_loss: 1.04162 [INFO] 2021-07-17 18:53:43 > Step: 160000 Progress: 80.0% Elapsed: 9 days, 10:46:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.471066 Generator_loss: 1.04467 [INFO] 2021-07-17 18:53:43 > Start Evaluation (160000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-17 18:53:43 > Calculating FID Score.... [INFO] 2021-07-17 18:54:49 > Calculating Inception Score.... [INFO] 2021-07-17 18:55:45 > Calculate F_beta Score.... [INFO] 2021-07-17 18:58:04 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-17 18:58:05 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-17 18:58:07 > Calculate Accuracies.... [INFO] 2021-07-17 18:58:54 > Calculate Accuracies.... [INFO] 2021-07-17 18:59:44 > F_8 score (Step: 160000, Using valid images): 0.9859698227876372 [INFO] 2021-07-17 18:59:44 > F_1/8 score (Step: 160000, Using valid images): 0.9865790389657486 [INFO] 2021-07-17 18:59:44 > FID score (Step: 160000, Using valid moments): 8.96465663929132 [INFO] 2021-07-17 18:59:44 > Inception score (Step: 160000, 50000 generated images): 87.84828186035156 [INFO] 2021-07-17 18:59:44 > Best FID score (Step: 158000, Using valid moments): 8.937010824366894 [INFO] 2021-07-17 18:59:51 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-17 19:19:09 > Step: 160100 Progress: 80.0% Elapsed: 9 days, 11:12:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.472444 Generator_loss: 1.05831 [INFO] 2021-07-17 19:38:20 > Step: 160200 Progress: 80.1% Elapsed: 9 days, 11:31:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.464552 Generator_loss: 1.05768 [INFO] 2021-07-17 19:57:30 > Step: 160300 Progress: 80.2% Elapsed: 9 days, 11:50:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.494941 Generator_loss: 0.975786 [INFO] 2021-07-17 20:16:47 > Step: 160400 Progress: 80.2% Elapsed: 9 days, 12:09:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.482928 Generator_loss: 0.938535 [INFO] 2021-07-17 20:35:59 > Step: 160500 Progress: 80.2% Elapsed: 9 days, 12:29:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.478195 Generator_loss: 1.02611 [INFO] 2021-07-17 20:55:10 > Step: 160600 Progress: 80.3% Elapsed: 9 days, 12:48:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.543227 Generator_loss: 0.959573 [INFO] 2021-07-17 21:14:27 > Step: 160700 Progress: 80.3% Elapsed: 9 days, 13:07:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.471165 Generator_loss: 1.03583 [INFO] 2021-07-17 21:33:36 > Step: 160800 Progress: 80.4% Elapsed: 9 days, 13:26:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.500406 Generator_loss: 0.948393 [INFO] 2021-07-17 21:52:47 > Step: 160900 Progress: 80.5% Elapsed: 9 days, 13:45:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.486599 Generator_loss: 0.975169 [INFO] 2021-07-17 22:12:01 > Step: 161000 Progress: 80.5% Elapsed: 9 days, 14:05:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.465689 Generator_loss: 0.972275 [INFO] 2021-07-17 22:31:13 > Step: 161100 Progress: 80.5% Elapsed: 9 days, 14:24:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.509127 Generator_loss: 1.01023 [INFO] 2021-07-17 22:50:21 > Step: 161200 Progress: 80.6% Elapsed: 9 days, 14:43:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.468873 Generator_loss: 1.04365 [INFO] 2021-07-17 23:09:29 > Step: 161300 Progress: 80.7% Elapsed: 9 days, 15:02:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.492023 Generator_loss: 0.984247 [INFO] 2021-07-17 23:28:46 > Step: 161400 Progress: 80.7% Elapsed: 9 days, 15:21:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.478162 Generator_loss: 1.0195 [INFO] 2021-07-17 23:47:55 > Step: 161500 Progress: 80.8% Elapsed: 9 days, 15:41:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.466106 Generator_loss: 1.00465 [INFO] 2021-07-18 00:07:06 > Step: 161600 Progress: 80.8% Elapsed: 9 days, 16:00:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.481818 Generator_loss: 0.954818 [INFO] 2021-07-18 00:26:21 > Step: 161700 Progress: 80.8% Elapsed: 9 days, 16:19:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.482667 Generator_loss: 0.961481 [INFO] 2021-07-18 00:45:31 > Step: 161800 Progress: 80.9% Elapsed: 9 days, 16:38:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.51679 Generator_loss: 0.964263 [INFO] 2021-07-18 01:04:40 > Step: 161900 Progress: 81.0% Elapsed: 9 days, 16:57:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.470388 Generator_loss: 0.966024 [INFO] 2021-07-18 01:23:57 > Step: 162000 Progress: 81.0% Elapsed: 9 days, 17:17:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.474762 Generator_loss: 1.04844 [INFO] 2021-07-18 01:23:57 > Start Evaluation (162000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-18 01:23:57 > Calculating FID Score.... [INFO] 2021-07-18 01:25:04 > Calculating Inception Score.... [INFO] 2021-07-18 01:26:00 > Calculate F_beta Score.... [INFO] 2021-07-18 01:28:24 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-18 01:28:25 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-18 01:28:26 > Calculate Accuracies.... [INFO] 2021-07-18 01:29:14 > Calculate Accuracies.... [INFO] 2021-07-18 01:30:04 > F_8 score (Step: 162000, Using valid images): 0.9864011714881962 [INFO] 2021-07-18 01:30:04 > F_1/8 score (Step: 162000, Using valid images): 0.9874452917304007 [INFO] 2021-07-18 01:30:04 > FID score (Step: 162000, Using valid moments): 8.892661535508466 [INFO] 2021-07-18 01:30:04 > Inception score (Step: 162000, 50000 generated images): 87.73382568359375 [INFO] 2021-07-18 01:30:04 > Best FID score (Step: 162000, Using valid moments): 8.892661535508466 [INFO] 2021-07-18 01:30:18 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-18 01:49:30 > Step: 162100 Progress: 81.0% Elapsed: 9 days, 17:42:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.548417 Generator_loss: 0.996297 [INFO] 2021-07-18 02:08:41 > Step: 162200 Progress: 81.1% Elapsed: 9 days, 18:01:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.48022 Generator_loss: 0.963374 [INFO] 2021-07-18 02:27:58 > Step: 162300 Progress: 81.2% Elapsed: 9 days, 18:21:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.46084 Generator_loss: 1.15345 [INFO] 2021-07-18 02:47:05 > Step: 162400 Progress: 81.2% Elapsed: 9 days, 18:40:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.498549 Generator_loss: 1.00983 [INFO] 2021-07-18 03:06:15 > Step: 162500 Progress: 81.2% Elapsed: 9 days, 18:59:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.472003 Generator_loss: 1.00293 [INFO] 2021-07-18 03:25:30 > Step: 162600 Progress: 81.3% Elapsed: 9 days, 19:18:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.495431 Generator_loss: 0.908468 [INFO] 2021-07-18 03:44:41 > Step: 162700 Progress: 81.3% Elapsed: 9 days, 19:37:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.481518 Generator_loss: 1.03675 [INFO] 2021-07-18 04:03:51 > Step: 162800 Progress: 81.4% Elapsed: 9 days, 19:57:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.465162 Generator_loss: 1.10566 [INFO] 2021-07-18 04:23:06 > Step: 162900 Progress: 81.5% Elapsed: 9 days, 20:16:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.470347 Generator_loss: 1.04584 [INFO] 2021-07-18 04:42:17 > Step: 163000 Progress: 81.5% Elapsed: 9 days, 20:35:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.464803 Generator_loss: 0.986379 [INFO] 2021-07-18 05:01:28 > Step: 163100 Progress: 81.5% Elapsed: 9 days, 20:54:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.477995 Generator_loss: 1.01707 [INFO] 2021-07-18 05:20:44 > Step: 163200 Progress: 81.6% Elapsed: 9 days, 21:13:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.465011 Generator_loss: 1.05723 [INFO] 2021-07-18 05:39:54 > Step: 163300 Progress: 81.7% Elapsed: 9 days, 21:33:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.501922 Generator_loss: 0.936401 [INFO] 2021-07-18 05:59:04 > Step: 163400 Progress: 81.7% Elapsed: 9 days, 21:52:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.484517 Generator_loss: 1.0327 [INFO] 2021-07-18 06:18:18 > Step: 163500 Progress: 81.8% Elapsed: 9 days, 22:11:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.463759 Generator_loss: 1.00074 [INFO] 2021-07-18 06:37:29 > Step: 163600 Progress: 81.8% Elapsed: 9 days, 22:30:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.479853 Generator_loss: 1.03763 [INFO] 2021-07-18 06:56:43 > Step: 163700 Progress: 81.8% Elapsed: 9 days, 22:49:55 temperature: 0.25 ada_p: No Discriminator_loss: 1.08115 Generator_loss: 0.921354 [INFO] 2021-07-18 07:15:53 > Step: 163800 Progress: 81.9% Elapsed: 9 days, 23:09:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.476305 Generator_loss: 1.0392 [INFO] 2021-07-18 07:35:08 > Step: 163900 Progress: 82.0% Elapsed: 9 days, 23:28:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.470264 Generator_loss: 1.02887 [INFO] 2021-07-18 07:54:16 > Step: 164000 Progress: 82.0% Elapsed: 9 days, 23:47:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.47094 Generator_loss: 1.0313 [INFO] 2021-07-18 07:54:16 > Start Evaluation (164000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-18 07:54:16 > Calculating FID Score.... [INFO] 2021-07-18 07:55:22 > Calculating Inception Score.... [INFO] 2021-07-18 07:56:18 > Calculate F_beta Score.... [INFO] 2021-07-18 07:58:46 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-18 07:58:46 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-18 07:58:48 > Calculate Accuracies.... [INFO] 2021-07-18 07:59:35 > Calculate Accuracies.... [INFO] 2021-07-18 08:00:25 > F_8 score (Step: 164000, Using valid images): 0.9867737056821895 [INFO] 2021-07-18 08:00:25 > F_1/8 score (Step: 164000, Using valid images): 0.9887339630963824 [INFO] 2021-07-18 08:00:26 > FID score (Step: 164000, Using valid moments): 8.91069408521787 [INFO] 2021-07-18 08:00:26 > Inception score (Step: 164000, 50000 generated images): 88.21949005126953 [INFO] 2021-07-18 08:00:26 > Best FID score (Step: 162000, Using valid moments): 8.892661535508466 [INFO] 2021-07-18 08:00:33 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-18 08:19:45 > Step: 164100 Progress: 82.0% Elapsed: 10 days, 0:12:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.480172 Generator_loss: 1.04147 [INFO] 2021-07-18 08:38:59 > Step: 164200 Progress: 82.1% Elapsed: 10 days, 0:32:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.481194 Generator_loss: 0.945143 [INFO] 2021-07-18 08:58:09 > Step: 164300 Progress: 82.2% Elapsed: 10 days, 0:51:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.487456 Generator_loss: 0.986703 [INFO] 2021-07-18 09:17:18 > Step: 164400 Progress: 82.2% Elapsed: 10 days, 1:10:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.492589 Generator_loss: 0.963362 [INFO] 2021-07-18 09:36:35 > Step: 164500 Progress: 82.2% Elapsed: 10 days, 1:29:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.696355 Generator_loss: 0.777754 [INFO] 2021-07-18 09:55:46 > Step: 164600 Progress: 82.3% Elapsed: 10 days, 1:48:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.479421 Generator_loss: 0.994861 [INFO] 2021-07-18 10:14:56 > Step: 164700 Progress: 82.3% Elapsed: 10 days, 2:08:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.468148 Generator_loss: 0.956647 [INFO] 2021-07-18 10:34:13 > Step: 164800 Progress: 82.4% Elapsed: 10 days, 2:27:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.517388 Generator_loss: 0.957724 [INFO] 2021-07-18 10:53:24 > Step: 164900 Progress: 82.5% Elapsed: 10 days, 2:46:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.461735 Generator_loss: 1.03025 [INFO] 2021-07-18 11:12:36 > Step: 165000 Progress: 82.5% Elapsed: 10 days, 3:05:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.478321 Generator_loss: 1.00494 [INFO] 2021-07-18 11:31:51 > Step: 165100 Progress: 82.5% Elapsed: 10 days, 3:25:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.496977 Generator_loss: 0.97931 [INFO] 2021-07-18 11:51:02 > Step: 165200 Progress: 82.6% Elapsed: 10 days, 3:44:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.560293 Generator_loss: 0.939478 [INFO] 2021-07-18 12:10:11 > Step: 165300 Progress: 82.7% Elapsed: 10 days, 4:03:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.497898 Generator_loss: 0.996738 [INFO] 2021-07-18 12:29:25 > Step: 165400 Progress: 82.7% Elapsed: 10 days, 4:22:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.473936 Generator_loss: 1.00429 [INFO] 2021-07-18 12:48:36 > Step: 165500 Progress: 82.8% Elapsed: 10 days, 4:41:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.473783 Generator_loss: 1.02407 [INFO] 2021-07-18 13:07:45 > Step: 165600 Progress: 82.8% Elapsed: 10 days, 5:00:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.479553 Generator_loss: 0.996841 [INFO] 2021-07-18 13:26:59 > Step: 165700 Progress: 82.8% Elapsed: 10 days, 5:20:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.466771 Generator_loss: 1.04115 [INFO] 2021-07-18 13:46:10 > Step: 165800 Progress: 82.9% Elapsed: 10 days, 5:39:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.463704 Generator_loss: 1.02686 [INFO] 2021-07-18 14:05:18 > Step: 165900 Progress: 83.0% Elapsed: 10 days, 5:58:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.463257 Generator_loss: 1.00922 [INFO] 2021-07-18 14:24:31 > Step: 166000 Progress: 83.0% Elapsed: 10 days, 6:17:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.474475 Generator_loss: 1.01568 [INFO] 2021-07-18 14:24:31 > Start Evaluation (166000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-18 14:24:31 > Calculating FID Score.... [INFO] 2021-07-18 14:25:39 > Calculating Inception Score.... [INFO] 2021-07-18 14:26:35 > Calculate F_beta Score.... [INFO] 2021-07-18 14:28:57 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-18 14:28:58 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-18 14:28:59 > Calculate Accuracies.... [INFO] 2021-07-18 14:29:47 > Calculate Accuracies.... [INFO] 2021-07-18 14:30:37 > F_8 score (Step: 166000, Using valid images): 0.9882594668046186 [INFO] 2021-07-18 14:30:37 > F_1/8 score (Step: 166000, Using valid images): 0.9881268049979945 [INFO] 2021-07-18 14:30:37 > FID score (Step: 166000, Using valid moments): 8.88042629383591 [INFO] 2021-07-18 14:30:37 > Inception score (Step: 166000, 50000 generated images): 88.83321380615234 [INFO] 2021-07-18 14:30:37 > Best FID score (Step: 166000, Using valid moments): 8.88042629383591 [INFO] 2021-07-18 14:30:52 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-18 14:50:01 > Step: 166100 Progress: 83.0% Elapsed: 10 days, 6:43:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.501349 Generator_loss: 0.974427 [INFO] 2021-07-18 15:09:11 > Step: 166200 Progress: 83.1% Elapsed: 10 days, 7:02:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.477168 Generator_loss: 0.980653 [INFO] 2021-07-18 15:28:19 > Step: 166300 Progress: 83.2% Elapsed: 10 days, 7:21:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.489634 Generator_loss: 0.962543 [INFO] 2021-07-18 15:47:34 > Step: 166400 Progress: 83.2% Elapsed: 10 days, 7:40:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.488434 Generator_loss: 1.01909 [INFO] 2021-07-18 16:06:44 > Step: 166500 Progress: 83.2% Elapsed: 10 days, 7:59:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.462461 Generator_loss: 1.04195 [INFO] 2021-07-18 16:25:56 > Step: 166600 Progress: 83.3% Elapsed: 10 days, 8:19:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.488497 Generator_loss: 0.959464 [INFO] 2021-07-18 16:45:12 > Step: 166700 Progress: 83.4% Elapsed: 10 days, 8:38:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.489939 Generator_loss: 1.01071 [INFO] 2021-07-18 17:04:23 > Step: 166800 Progress: 83.4% Elapsed: 10 days, 8:57:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.473074 Generator_loss: 0.991517 [INFO] 2021-07-18 17:23:32 > Step: 166900 Progress: 83.5% Elapsed: 10 days, 9:16:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.463843 Generator_loss: 1.02724 [INFO] 2021-07-18 17:42:47 > Step: 167000 Progress: 83.5% Elapsed: 10 days, 9:35:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.471722 Generator_loss: 1.05218 [INFO] 2021-07-18 18:01:56 > Step: 167100 Progress: 83.5% Elapsed: 10 days, 9:55:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.470302 Generator_loss: 0.988553 [INFO] 2021-07-18 18:21:05 > Step: 167200 Progress: 83.6% Elapsed: 10 days, 10:14:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.498259 Generator_loss: 0.910298 [INFO] 2021-07-18 18:40:20 > Step: 167300 Progress: 83.7% Elapsed: 10 days, 10:33:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.469188 Generator_loss: 1.01689 [INFO] 2021-07-18 18:59:29 > Step: 167400 Progress: 83.7% Elapsed: 10 days, 10:52:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.471757 Generator_loss: 1.05082 [INFO] 2021-07-18 19:18:38 > Step: 167500 Progress: 83.8% Elapsed: 10 days, 11:11:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.464004 Generator_loss: 1.0762 [INFO] 2021-07-18 19:37:52 > Step: 167600 Progress: 83.8% Elapsed: 10 days, 11:31:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.472834 Generator_loss: 0.96993 [INFO] 2021-07-18 19:57:00 > Step: 167700 Progress: 83.9% Elapsed: 10 days, 11:50:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.472802 Generator_loss: 1.03364 [INFO] 2021-07-18 20:16:14 > Step: 167800 Progress: 83.9% Elapsed: 10 days, 12:09:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.522239 Generator_loss: 0.925637 [INFO] 2021-07-18 20:35:32 > Step: 167900 Progress: 84.0% Elapsed: 10 days, 12:28:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.455738 Generator_loss: 1.05472 [INFO] 2021-07-18 20:54:43 > Step: 168000 Progress: 84.0% Elapsed: 10 days, 12:47:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.482846 Generator_loss: 1.00677 [INFO] 2021-07-18 20:54:43 > Start Evaluation (168000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-18 20:54:43 > Calculating FID Score.... [INFO] 2021-07-18 20:55:49 > Calculating Inception Score.... [INFO] 2021-07-18 20:56:44 > Calculate F_beta Score.... [INFO] 2021-07-18 20:59:10 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-18 20:59:11 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-18 20:59:12 > Calculate Accuracies.... [INFO] 2021-07-18 21:00:00 > Calculate Accuracies.... [INFO] 2021-07-18 21:00:50 > F_8 score (Step: 168000, Using valid images): 0.9876008356646864 [INFO] 2021-07-18 21:00:50 > F_1/8 score (Step: 168000, Using valid images): 0.9875677635764287 [INFO] 2021-07-18 21:00:50 > FID score (Step: 168000, Using valid moments): 8.804948374539322 [INFO] 2021-07-18 21:00:50 > Inception score (Step: 168000, 50000 generated images): 89.50932312011719 [INFO] 2021-07-18 21:00:50 > Best FID score (Step: 168000, Using valid moments): 8.804948374539322 [INFO] 2021-07-18 21:01:04 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-18 21:20:17 > Step: 168100 Progress: 84.0% Elapsed: 10 days, 13:13:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.464664 Generator_loss: 1.08042 [INFO] 2021-07-18 21:39:31 > Step: 168200 Progress: 84.1% Elapsed: 10 days, 13:32:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.492277 Generator_loss: 0.979122 [INFO] 2021-07-18 21:58:39 > Step: 168300 Progress: 84.2% Elapsed: 10 days, 13:51:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.472877 Generator_loss: 1.05312 [INFO] 2021-07-18 22:17:46 > Step: 168400 Progress: 84.2% Elapsed: 10 days, 14:10:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.485472 Generator_loss: 1.06132 [INFO] 2021-07-18 22:36:51 > Step: 168500 Progress: 84.2% Elapsed: 10 days, 14:30:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.480341 Generator_loss: 0.980098 [INFO] 2021-07-18 22:56:03 > Step: 168600 Progress: 84.3% Elapsed: 10 days, 14:49:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.49022 Generator_loss: 0.923859 [INFO] 2021-07-18 23:15:11 > Step: 168700 Progress: 84.4% Elapsed: 10 days, 15:08:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.460808 Generator_loss: 1.00558 [INFO] 2021-07-18 23:34:18 > Step: 168800 Progress: 84.4% Elapsed: 10 days, 15:27:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.472729 Generator_loss: 0.944074 [INFO] 2021-07-18 23:53:31 > Step: 168900 Progress: 84.5% Elapsed: 10 days, 15:46:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.498186 Generator_loss: 0.937529 [INFO] 2021-07-19 00:12:39 > Step: 169000 Progress: 84.5% Elapsed: 10 days, 16:05:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.480916 Generator_loss: 1.03534 [INFO] 2021-07-19 00:31:46 > Step: 169100 Progress: 84.5% Elapsed: 10 days, 16:24:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.471023 Generator_loss: 1.02658 [INFO] 2021-07-19 00:51:01 > Step: 169200 Progress: 84.6% Elapsed: 10 days, 16:44:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.457144 Generator_loss: 1.0072 [INFO] 2021-07-19 01:10:10 > Step: 169300 Progress: 84.7% Elapsed: 10 days, 17:03:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.46584 Generator_loss: 1.01532 [INFO] 2021-07-19 01:29:19 > Step: 169400 Progress: 84.7% Elapsed: 10 days, 17:22:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.469342 Generator_loss: 0.971697 [INFO] 2021-07-19 01:48:34 > Step: 169500 Progress: 84.8% Elapsed: 10 days, 17:41:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.46384 Generator_loss: 0.995529 [INFO] 2021-07-19 02:07:44 > Step: 169600 Progress: 84.8% Elapsed: 10 days, 18:00:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.462594 Generator_loss: 1.04996 [INFO] 2021-07-19 02:26:55 > Step: 169700 Progress: 84.9% Elapsed: 10 days, 18:20:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.501174 Generator_loss: 0.997866 [INFO] 2021-07-19 02:46:12 > Step: 169800 Progress: 84.9% Elapsed: 10 days, 18:39:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.494959 Generator_loss: 0.971625 [INFO] 2021-07-19 03:05:20 > Step: 169900 Progress: 85.0% Elapsed: 10 days, 18:58:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.507977 Generator_loss: 0.97136 [INFO] 2021-07-19 03:24:30 > Step: 170000 Progress: 85.0% Elapsed: 10 days, 19:17:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.495033 Generator_loss: 0.955023 [INFO] 2021-07-19 03:24:30 > Start Evaluation (170000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-19 03:24:30 > Calculating FID Score.... [INFO] 2021-07-19 03:25:36 > Calculating Inception Score.... [INFO] 2021-07-19 03:26:32 > Calculate F_beta Score.... [INFO] 2021-07-19 03:28:54 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-19 03:28:54 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-19 03:28:56 > Calculate Accuracies.... [INFO] 2021-07-19 03:29:43 > Calculate Accuracies.... [INFO] 2021-07-19 03:30:34 > F_8 score (Step: 170000, Using valid images): 0.985796033601614 [INFO] 2021-07-19 03:30:34 > F_1/8 score (Step: 170000, Using valid images): 0.9859676843060035 [INFO] 2021-07-19 03:30:34 > FID score (Step: 170000, Using valid moments): 8.800033997771152 [INFO] 2021-07-19 03:30:34 > Inception score (Step: 170000, 50000 generated images): 89.22224426269531 [INFO] 2021-07-19 03:30:34 > Best FID score (Step: 170000, Using valid moments): 8.800033997771152 [INFO] 2021-07-19 03:30:49 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-19 03:50:07 > Step: 170100 Progress: 85.0% Elapsed: 10 days, 19:43:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.471446 Generator_loss: 1.01133 [INFO] 2021-07-19 04:09:19 > Step: 170200 Progress: 85.1% Elapsed: 10 days, 20:02:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.484061 Generator_loss: 0.94369 [INFO] 2021-07-19 04:28:30 > Step: 170300 Progress: 85.2% Elapsed: 10 days, 20:21:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.450402 Generator_loss: 1.05456 [INFO] 2021-07-19 04:47:44 > Step: 170400 Progress: 85.2% Elapsed: 10 days, 20:40:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.4828 Generator_loss: 1.00823 [INFO] 2021-07-19 05:06:53 > Step: 170500 Progress: 85.2% Elapsed: 10 days, 21:00:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.509336 Generator_loss: 0.990758 [INFO] 2021-07-19 05:26:07 > Step: 170600 Progress: 85.3% Elapsed: 10 days, 21:19:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.99528 Generator_loss: 1.10263 [INFO] 2021-07-19 05:45:24 > Step: 170700 Progress: 85.4% Elapsed: 10 days, 21:38:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.44927 Generator_loss: 1.08808 [INFO] 2021-07-19 06:04:39 > Step: 170800 Progress: 85.4% Elapsed: 10 days, 21:57:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.468481 Generator_loss: 1.06025 [INFO] 2021-07-19 06:23:50 > Step: 170900 Progress: 85.5% Elapsed: 10 days, 22:17:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.484572 Generator_loss: 0.98602 [INFO] 2021-07-19 06:43:02 > Step: 171000 Progress: 85.5% Elapsed: 10 days, 22:36:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.506683 Generator_loss: 1.07708 [INFO] 2021-07-19 07:02:20 > Step: 171100 Progress: 85.5% Elapsed: 10 days, 22:55:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.471493 Generator_loss: 0.986364 [INFO] 2021-07-19 07:21:33 > Step: 171200 Progress: 85.6% Elapsed: 10 days, 23:14:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.457506 Generator_loss: 1.10773 [INFO] 2021-07-19 07:40:44 > Step: 171300 Progress: 85.7% Elapsed: 10 days, 23:33:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.463438 Generator_loss: 1.02099 [INFO] 2021-07-19 08:00:00 > Step: 171400 Progress: 85.7% Elapsed: 10 days, 23:53:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.471251 Generator_loss: 1.05495 [INFO] 2021-07-19 08:19:17 > Step: 171500 Progress: 85.8% Elapsed: 11 days, 0:12:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.463427 Generator_loss: 1.2277 [INFO] 2021-07-19 08:38:21 > Step: 171600 Progress: 85.8% Elapsed: 11 days, 0:31:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.47906 Generator_loss: 1.00369 [INFO] 2021-07-19 08:57:32 > Step: 171700 Progress: 85.9% Elapsed: 11 days, 0:50:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.51203 Generator_loss: 0.954283 [INFO] 2021-07-19 09:16:39 > Step: 171800 Progress: 85.9% Elapsed: 11 days, 1:09:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.470128 Generator_loss: 0.998479 [INFO] 2021-07-19 09:35:48 > Step: 171900 Progress: 86.0% Elapsed: 11 days, 1:29:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.464666 Generator_loss: 1.02206 [INFO] 2021-07-19 09:55:01 > Step: 172000 Progress: 86.0% Elapsed: 11 days, 1:48:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.467524 Generator_loss: 0.999053 [INFO] 2021-07-19 09:55:01 > Start Evaluation (172000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-19 09:55:01 > Calculating FID Score.... [INFO] 2021-07-19 09:56:08 > Calculating Inception Score.... [INFO] 2021-07-19 09:57:04 > Calculate F_beta Score.... [INFO] 2021-07-19 09:59:45 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-19 09:59:45 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-19 09:59:47 > Calculate Accuracies.... [INFO] 2021-07-19 10:00:34 > Calculate Accuracies.... [INFO] 2021-07-19 10:01:25 > F_8 score (Step: 172000, Using valid images): 0.9875870399441415 [INFO] 2021-07-19 10:01:25 > F_1/8 score (Step: 172000, Using valid images): 0.9868179621961383 [INFO] 2021-07-19 10:01:25 > FID score (Step: 172000, Using valid moments): 8.85199984578378 [INFO] 2021-07-19 10:01:25 > Inception score (Step: 172000, 50000 generated images): 89.91262817382812 [INFO] 2021-07-19 10:01:25 > Best FID score (Step: 170000, Using valid moments): 8.800033997771152 [INFO] 2021-07-19 10:01:32 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-19 10:20:42 > Step: 172100 Progress: 86.1% Elapsed: 11 days, 2:13:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.457391 Generator_loss: 1.07947 [INFO] 2021-07-19 10:39:50 > Step: 172200 Progress: 86.1% Elapsed: 11 days, 2:33:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.486062 Generator_loss: 0.950668 [INFO] 2021-07-19 10:59:05 > Step: 172300 Progress: 86.2% Elapsed: 11 days, 2:52:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.500091 Generator_loss: 0.98318 [INFO] 2021-07-19 11:18:12 > Step: 172400 Progress: 86.2% Elapsed: 11 days, 3:11:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.476719 Generator_loss: 0.987003 [INFO] 2021-07-19 11:37:23 > Step: 172500 Progress: 86.2% Elapsed: 11 days, 3:30:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.510147 Generator_loss: 0.865012 [INFO] 2021-07-19 11:56:37 > Step: 172600 Progress: 86.3% Elapsed: 11 days, 3:49:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.472054 Generator_loss: 0.978634 [INFO] 2021-07-19 12:15:45 > Step: 172700 Progress: 86.4% Elapsed: 11 days, 4:08:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.455595 Generator_loss: 1.12767 [INFO] 2021-07-19 12:34:50 > Step: 172800 Progress: 86.4% Elapsed: 11 days, 4:28:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.482104 Generator_loss: 0.972127 [INFO] 2021-07-19 12:54:03 > Step: 172900 Progress: 86.5% Elapsed: 11 days, 4:47:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.480806 Generator_loss: 1.01307 [INFO] 2021-07-19 13:13:12 > Step: 173000 Progress: 86.5% Elapsed: 11 days, 5:06:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.474794 Generator_loss: 0.992975 [INFO] 2021-07-19 13:32:22 > Step: 173100 Progress: 86.6% Elapsed: 11 days, 5:25:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.493774 Generator_loss: 1.04595 [INFO] 2021-07-19 13:51:35 > Step: 173200 Progress: 86.6% Elapsed: 11 days, 5:44:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.482925 Generator_loss: 1.07503 [INFO] 2021-07-19 14:10:46 > Step: 173300 Progress: 86.7% Elapsed: 11 days, 6:03:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.46243 Generator_loss: 1.03047 [INFO] 2021-07-19 14:29:55 > Step: 173400 Progress: 86.7% Elapsed: 11 days, 6:23:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.470801 Generator_loss: 1.29502 [INFO] 2021-07-19 14:49:04 > Step: 173500 Progress: 86.8% Elapsed: 11 days, 6:42:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.489872 Generator_loss: 1.0073 [INFO] 2021-07-19 15:08:19 > Step: 173600 Progress: 86.8% Elapsed: 11 days, 7:01:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.470098 Generator_loss: 0.993111 [INFO] 2021-07-19 15:27:29 > Step: 173700 Progress: 86.9% Elapsed: 11 days, 7:20:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.496704 Generator_loss: 0.947146 [INFO] 2021-07-19 15:46:34 > Step: 173800 Progress: 86.9% Elapsed: 11 days, 7:39:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.493278 Generator_loss: 0.973999 [INFO] 2021-07-19 16:05:50 > Step: 173900 Progress: 87.0% Elapsed: 11 days, 7:59:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.468334 Generator_loss: 1.0932 [INFO] 2021-07-19 16:25:01 > Step: 174000 Progress: 87.0% Elapsed: 11 days, 8:18:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.475877 Generator_loss: 1.0327 [INFO] 2021-07-19 16:25:01 > Start Evaluation (174000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-19 16:25:01 > Calculating FID Score.... [INFO] 2021-07-19 16:26:07 > Calculating Inception Score.... [INFO] 2021-07-19 16:27:03 > Calculate F_beta Score.... [INFO] 2021-07-19 16:29:30 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-19 16:29:30 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-19 16:29:32 > Calculate Accuracies.... [INFO] 2021-07-19 16:30:19 > Calculate Accuracies.... [INFO] 2021-07-19 16:31:10 > F_8 score (Step: 174000, Using valid images): 0.98784716175891 [INFO] 2021-07-19 16:31:10 > F_1/8 score (Step: 174000, Using valid images): 0.987577797652852 [INFO] 2021-07-19 16:31:10 > FID score (Step: 174000, Using valid moments): 8.75032100773268 [INFO] 2021-07-19 16:31:10 > Inception score (Step: 174000, 50000 generated images): 89.37958526611328 [INFO] 2021-07-19 16:31:10 > Best FID score (Step: 174000, Using valid moments): 8.75032100773268 [INFO] 2021-07-19 16:31:25 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-19 16:50:34 > Step: 174100 Progress: 87.1% Elapsed: 11 days, 8:43:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.467936 Generator_loss: 1.07226 [INFO] 2021-07-19 17:09:50 > Step: 174200 Progress: 87.1% Elapsed: 11 days, 9:03:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.464134 Generator_loss: 1.03204 [INFO] 2021-07-19 17:28:58 > Step: 174300 Progress: 87.2% Elapsed: 11 days, 9:22:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.46729 Generator_loss: 1.08352 [INFO] 2021-07-19 17:48:08 > Step: 174400 Progress: 87.2% Elapsed: 11 days, 9:41:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.478972 Generator_loss: 1.03003 [INFO] 2021-07-19 18:07:26 > Step: 174500 Progress: 87.2% Elapsed: 11 days, 10:00:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.460486 Generator_loss: 1.08102 [INFO] 2021-07-19 18:26:35 > Step: 174600 Progress: 87.3% Elapsed: 11 days, 10:19:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.465732 Generator_loss: 1.08945 [INFO] 2021-07-19 18:45:43 > Step: 174700 Progress: 87.4% Elapsed: 11 days, 10:38:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.519176 Generator_loss: 0.957423 [INFO] 2021-07-19 19:05:01 > Step: 174800 Progress: 87.4% Elapsed: 11 days, 10:58:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.466682 Generator_loss: 1.07841 [INFO] 2021-07-19 19:24:12 > Step: 174900 Progress: 87.5% Elapsed: 11 days, 11:17:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.500842 Generator_loss: 0.988571 [INFO] 2021-07-19 19:43:22 > Step: 175000 Progress: 87.5% Elapsed: 11 days, 11:36:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.458289 Generator_loss: 1.14054 [INFO] 2021-07-19 20:02:38 > Step: 175100 Progress: 87.5% Elapsed: 11 days, 11:55:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.460559 Generator_loss: 1.1109 [INFO] 2021-07-19 20:21:43 > Step: 175200 Progress: 87.6% Elapsed: 11 days, 12:14:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.471038 Generator_loss: 1.03236 [INFO] 2021-07-19 20:40:50 > Step: 175300 Progress: 87.6% Elapsed: 11 days, 12:34:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.47489 Generator_loss: 1.04958 [INFO] 2021-07-19 21:00:01 > Step: 175400 Progress: 87.7% Elapsed: 11 days, 12:53:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.466653 Generator_loss: 1.01747 [INFO] 2021-07-19 21:19:06 > Step: 175500 Progress: 87.8% Elapsed: 11 days, 13:12:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.473208 Generator_loss: 0.993767 [INFO] 2021-07-19 21:38:13 > Step: 175600 Progress: 87.8% Elapsed: 11 days, 13:31:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.478809 Generator_loss: 0.983998 [INFO] 2021-07-19 21:57:24 > Step: 175700 Progress: 87.8% Elapsed: 11 days, 13:50:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.455415 Generator_loss: 1.12678 [INFO] 2021-07-19 22:16:29 > Step: 175800 Progress: 87.9% Elapsed: 11 days, 14:09:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.53958 Generator_loss: 0.98058 [INFO] 2021-07-19 22:35:35 > Step: 175900 Progress: 87.9% Elapsed: 11 days, 14:28:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.472256 Generator_loss: 0.95416 [INFO] 2021-07-19 22:54:40 > Step: 176000 Progress: 88.0% Elapsed: 11 days, 14:47:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.459643 Generator_loss: 1.1665 [INFO] 2021-07-19 22:54:40 > Start Evaluation (176000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-19 22:54:40 > Calculating FID Score.... [INFO] 2021-07-19 22:55:46 > Calculating Inception Score.... [INFO] 2021-07-19 22:56:42 > Calculate F_beta Score.... [INFO] 2021-07-19 22:59:01 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-19 22:59:01 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-19 22:59:03 > Calculate Accuracies.... [INFO] 2021-07-19 22:59:51 > Calculate Accuracies.... [INFO] 2021-07-19 23:00:41 > F_8 score (Step: 176000, Using valid images): 0.9895193316575266 [INFO] 2021-07-19 23:00:41 > F_1/8 score (Step: 176000, Using valid images): 0.9866197905684327 [INFO] 2021-07-19 23:00:41 > FID score (Step: 176000, Using valid moments): 8.897156248032388 [INFO] 2021-07-19 23:00:41 > Inception score (Step: 176000, 50000 generated images): 89.93325805664062 [INFO] 2021-07-19 23:00:41 > Best FID score (Step: 174000, Using valid moments): 8.75032100773268 [INFO] 2021-07-19 23:00:49 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-19 23:20:03 > Step: 176100 Progress: 88.0% Elapsed: 11 days, 15:13:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.473116 Generator_loss: 1.00926 [INFO] 2021-07-19 23:39:10 > Step: 176200 Progress: 88.1% Elapsed: 11 days, 15:32:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.485907 Generator_loss: 1.18774 [INFO] 2021-07-19 23:58:16 > Step: 176300 Progress: 88.1% Elapsed: 11 days, 15:51:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.494553 Generator_loss: 0.934119 [INFO] 2021-07-20 00:17:29 > Step: 176400 Progress: 88.2% Elapsed: 11 days, 16:10:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.499463 Generator_loss: 0.878438 [INFO] 2021-07-20 00:36:36 > Step: 176500 Progress: 88.2% Elapsed: 11 days, 16:29:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.483725 Generator_loss: 1.08247 [INFO] 2021-07-20 00:55:43 > Step: 176600 Progress: 88.3% Elapsed: 11 days, 16:48:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.649442 Generator_loss: 0.885286 [INFO] 2021-07-20 01:14:54 > Step: 176700 Progress: 88.3% Elapsed: 11 days, 17:08:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.467156 Generator_loss: 1.00233 [INFO] 2021-07-20 01:34:01 > Step: 176800 Progress: 88.4% Elapsed: 11 days, 17:27:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.510744 Generator_loss: 0.959335 [INFO] 2021-07-20 01:53:07 > Step: 176900 Progress: 88.4% Elapsed: 11 days, 17:46:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.464129 Generator_loss: 1.01681 [INFO] 2021-07-20 02:12:17 > Step: 177000 Progress: 88.5% Elapsed: 11 days, 18:05:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.466965 Generator_loss: 1.06095 [INFO] 2021-07-20 02:31:24 > Step: 177100 Progress: 88.5% Elapsed: 11 days, 18:24:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.476965 Generator_loss: 0.979029 [INFO] 2021-07-20 02:50:31 > Step: 177200 Progress: 88.6% Elapsed: 11 days, 18:43:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.46402 Generator_loss: 1.03754 [INFO] 2021-07-20 03:09:46 > Step: 177300 Progress: 88.6% Elapsed: 11 days, 19:02:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.489454 Generator_loss: 0.954476 [INFO] 2021-07-20 03:28:52 > Step: 177400 Progress: 88.7% Elapsed: 11 days, 19:22:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.482639 Generator_loss: 0.970849 [INFO] 2021-07-20 03:48:01 > Step: 177500 Progress: 88.8% Elapsed: 11 days, 19:41:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.472726 Generator_loss: 1.02045 [INFO] 2021-07-20 04:07:15 > Step: 177600 Progress: 88.8% Elapsed: 11 days, 20:00:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.450731 Generator_loss: 1.19461 [INFO] 2021-07-20 04:26:25 > Step: 177700 Progress: 88.8% Elapsed: 11 days, 20:19:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.463987 Generator_loss: 1.05683 [INFO] 2021-07-20 04:45:34 > Step: 177800 Progress: 88.9% Elapsed: 11 days, 20:38:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.467122 Generator_loss: 1.06538 [INFO] 2021-07-20 05:04:47 > Step: 177900 Progress: 88.9% Elapsed: 11 days, 20:57:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.479456 Generator_loss: 1.01798 [INFO] 2021-07-20 05:23:52 > Step: 178000 Progress: 89.0% Elapsed: 11 days, 21:17:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.472981 Generator_loss: 1.0836 [INFO] 2021-07-20 05:23:52 > Start Evaluation (178000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-20 05:23:52 > Calculating FID Score.... [INFO] 2021-07-20 05:24:59 > Calculating Inception Score.... [INFO] 2021-07-20 05:25:55 > Calculate F_beta Score.... [INFO] 2021-07-20 05:28:25 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-20 05:28:25 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-20 05:28:27 > Calculate Accuracies.... [INFO] 2021-07-20 05:29:15 > Calculate Accuracies.... [INFO] 2021-07-20 05:30:05 > F_8 score (Step: 178000, Using valid images): 0.9871654961825601 [INFO] 2021-07-20 05:30:05 > F_1/8 score (Step: 178000, Using valid images): 0.9873427377569696 [INFO] 2021-07-20 05:30:05 > FID score (Step: 178000, Using valid moments): 8.80359317813003 [INFO] 2021-07-20 05:30:05 > Inception score (Step: 178000, 50000 generated images): 90.6899642944336 [INFO] 2021-07-20 05:30:05 > Best FID score (Step: 174000, Using valid moments): 8.75032100773268 [INFO] 2021-07-20 05:30:13 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-20 05:49:21 > Step: 178100 Progress: 89.0% Elapsed: 11 days, 21:42:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.467351 Generator_loss: 1.03921 [INFO] 2021-07-20 06:08:33 > Step: 178200 Progress: 89.1% Elapsed: 11 days, 22:01:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.444065 Generator_loss: 1.11766 [INFO] 2021-07-20 06:27:41 > Step: 178300 Progress: 89.1% Elapsed: 11 days, 22:20:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.56524 Generator_loss: 0.865801 [INFO] 2021-07-20 06:46:47 > Step: 178400 Progress: 89.2% Elapsed: 11 days, 22:39:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.4969 Generator_loss: 0.946002 [INFO] 2021-07-20 07:05:53 > Step: 178500 Progress: 89.2% Elapsed: 11 days, 22:59:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.465795 Generator_loss: 1.05068 [INFO] 2021-07-20 07:25:08 > Step: 178600 Progress: 89.3% Elapsed: 11 days, 23:18:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.466111 Generator_loss: 1.15284 [INFO] 2021-07-20 07:44:16 > Step: 178700 Progress: 89.3% Elapsed: 11 days, 23:37:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.464459 Generator_loss: 1.04488 [INFO] 2021-07-20 08:03:25 > Step: 178800 Progress: 89.4% Elapsed: 11 days, 23:56:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.470055 Generator_loss: 1.02027 [INFO] 2021-07-20 08:22:41 > Step: 178900 Progress: 89.5% Elapsed: 12 days, 0:15:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.459737 Generator_loss: 1.05197 [INFO] 2021-07-20 08:41:48 > Step: 179000 Progress: 89.5% Elapsed: 12 days, 0:35:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.463354 Generator_loss: 1.05143 [INFO] 2021-07-20 09:00:55 > Step: 179100 Progress: 89.5% Elapsed: 12 days, 0:54:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.536363 Generator_loss: 0.981807 [INFO] 2021-07-20 09:20:08 > Step: 179200 Progress: 89.6% Elapsed: 12 days, 1:13:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.466917 Generator_loss: 1.00142 [INFO] 2021-07-20 09:39:16 > Step: 179300 Progress: 89.6% Elapsed: 12 days, 1:32:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.467776 Generator_loss: 1.01201 [INFO] 2021-07-20 09:58:24 > Step: 179400 Progress: 89.7% Elapsed: 12 days, 1:51:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.464775 Generator_loss: 1.08465 [INFO] 2021-07-20 10:17:37 > Step: 179500 Progress: 89.8% Elapsed: 12 days, 2:10:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.471848 Generator_loss: 0.968114 [INFO] 2021-07-20 10:36:43 > Step: 179600 Progress: 89.8% Elapsed: 12 days, 2:29:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.46634 Generator_loss: 1.05178 [INFO] 2021-07-20 10:55:50 > Step: 179700 Progress: 89.8% Elapsed: 12 days, 2:49:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.499081 Generator_loss: 1.02337 [INFO] 2021-07-20 11:15:02 > Step: 179800 Progress: 89.9% Elapsed: 12 days, 3:08:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.469793 Generator_loss: 1.09657 [INFO] 2021-07-20 11:34:08 > Step: 179900 Progress: 90.0% Elapsed: 12 days, 3:27:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.468865 Generator_loss: 1.05421 [INFO] 2021-07-20 11:53:16 > Step: 180000 Progress: 90.0% Elapsed: 12 days, 3:46:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.476521 Generator_loss: 0.951921 [INFO] 2021-07-20 11:53:16 > Start Evaluation (180000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-20 11:53:16 > Calculating FID Score.... [INFO] 2021-07-20 11:54:23 > Calculating Inception Score.... [INFO] 2021-07-20 11:55:19 > Calculate F_beta Score.... [INFO] 2021-07-20 11:57:56 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-20 11:57:57 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-20 11:57:59 > Calculate Accuracies.... [INFO] 2021-07-20 11:58:46 > Calculate Accuracies.... [INFO] 2021-07-20 11:59:37 > F_8 score (Step: 180000, Using valid images): 0.9876638386077272 [INFO] 2021-07-20 11:59:37 > F_1/8 score (Step: 180000, Using valid images): 0.9878178268029486 [INFO] 2021-07-20 11:59:37 > FID score (Step: 180000, Using valid moments): 8.88519336030123 [INFO] 2021-07-20 11:59:37 > Inception score (Step: 180000, 50000 generated images): 91.1284408569336 [INFO] 2021-07-20 11:59:37 > Best FID score (Step: 174000, Using valid moments): 8.75032100773268 [INFO] 2021-07-20 11:59:45 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-20 12:19:02 > Step: 180100 Progress: 90.0% Elapsed: 12 days, 4:12:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.460764 Generator_loss: 1.0844 [INFO] 2021-07-20 12:38:11 > Step: 180200 Progress: 90.1% Elapsed: 12 days, 4:31:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.480926 Generator_loss: 0.943243 [INFO] 2021-07-20 12:57:19 > Step: 180300 Progress: 90.1% Elapsed: 12 days, 4:50:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.480629 Generator_loss: 1.00382 [INFO] 2021-07-20 13:16:34 > Step: 180400 Progress: 90.2% Elapsed: 12 days, 5:09:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.472871 Generator_loss: 0.978637 [INFO] 2021-07-20 13:35:42 > Step: 180500 Progress: 90.2% Elapsed: 12 days, 5:28:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.453024 Generator_loss: 1.12938 [INFO] 2021-07-20 13:54:50 > Step: 180600 Progress: 90.3% Elapsed: 12 days, 5:48:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.464275 Generator_loss: 1.01484 [INFO] 2021-07-20 14:14:02 > Step: 180700 Progress: 90.3% Elapsed: 12 days, 6:07:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.482548 Generator_loss: 1.00109 [INFO] 2021-07-20 14:33:12 > Step: 180800 Progress: 90.4% Elapsed: 12 days, 6:26:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.5354 Generator_loss: 0.814961 [INFO] 2021-07-20 14:52:19 > Step: 180900 Progress: 90.5% Elapsed: 12 days, 6:45:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.463362 Generator_loss: 1.05089 [INFO] 2021-07-20 15:11:29 > Step: 181000 Progress: 90.5% Elapsed: 12 days, 7:04:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.479671 Generator_loss: 0.983426 [INFO] 2021-07-20 15:30:45 > Step: 181100 Progress: 90.5% Elapsed: 12 days, 7:23:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.464555 Generator_loss: 1.06583 [INFO] 2021-07-20 15:49:55 > Step: 181200 Progress: 90.6% Elapsed: 12 days, 7:43:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.473829 Generator_loss: 1.21676 [INFO] 2021-07-20 16:09:03 > Step: 181300 Progress: 90.6% Elapsed: 12 days, 8:02:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.463741 Generator_loss: 1.06111 [INFO] 2021-07-20 16:28:18 > Step: 181400 Progress: 90.7% Elapsed: 12 days, 8:21:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.453163 Generator_loss: 1.11124 [INFO] 2021-07-20 16:47:26 > Step: 181500 Progress: 90.8% Elapsed: 12 days, 8:40:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.45955 Generator_loss: 1.06749 [INFO] 2021-07-20 17:06:35 > Step: 181600 Progress: 90.8% Elapsed: 12 days, 8:59:47 temperature: 0.25 ada_p: No Discriminator_loss: 0.47223 Generator_loss: 1.03707 [INFO] 2021-07-20 17:25:49 > Step: 181700 Progress: 90.8% Elapsed: 12 days, 9:19:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.450578 Generator_loss: 1.07826 [INFO] 2021-07-20 17:44:55 > Step: 181800 Progress: 90.9% Elapsed: 12 days, 9:38:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.45978 Generator_loss: 1.07655 [INFO] 2021-07-20 18:04:04 > Step: 181900 Progress: 91.0% Elapsed: 12 days, 9:57:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.47111 Generator_loss: 0.999355 [INFO] 2021-07-20 18:23:19 > Step: 182000 Progress: 91.0% Elapsed: 12 days, 10:16:31 temperature: 0.25 ada_p: No Discriminator_loss: 0.465085 Generator_loss: 1.0438 [INFO] 2021-07-20 18:23:19 > Start Evaluation (182000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-20 18:23:19 > Calculating FID Score.... [INFO] 2021-07-20 18:24:26 > Calculating Inception Score.... [INFO] 2021-07-20 18:25:22 > Calculate F_beta Score.... [INFO] 2021-07-20 18:27:44 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-20 18:27:45 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-20 18:27:47 > Calculate Accuracies.... [INFO] 2021-07-20 18:28:34 > Calculate Accuracies.... [INFO] 2021-07-20 18:29:24 > F_8 score (Step: 182000, Using valid images): 0.989059880443905 [INFO] 2021-07-20 18:29:24 > F_1/8 score (Step: 182000, Using valid images): 0.9907775600477844 [INFO] 2021-07-20 18:29:24 > FID score (Step: 182000, Using valid moments): 8.723129042952678 [INFO] 2021-07-20 18:29:24 > Inception score (Step: 182000, 50000 generated images): 91.44615936279297 [INFO] 2021-07-20 18:29:24 > Best FID score (Step: 182000, Using valid moments): 8.723129042952678 [INFO] 2021-07-20 18:29:39 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-20 18:48:49 > Step: 182100 Progress: 91.0% Elapsed: 12 days, 10:42:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.461899 Generator_loss: 1.05978 [INFO] 2021-07-20 19:07:58 > Step: 182200 Progress: 91.1% Elapsed: 12 days, 11:01:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.461387 Generator_loss: 1.07452 [INFO] 2021-07-20 19:27:11 > Step: 182300 Progress: 91.1% Elapsed: 12 days, 11:20:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.528899 Generator_loss: 1.15183 [INFO] 2021-07-20 19:46:24 > Step: 182400 Progress: 91.2% Elapsed: 12 days, 11:39:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.459108 Generator_loss: 1.05522 [INFO] 2021-07-20 20:05:34 > Step: 182500 Progress: 91.2% Elapsed: 12 days, 11:58:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.477872 Generator_loss: 0.966624 [INFO] 2021-07-20 20:24:51 > Step: 182600 Progress: 91.3% Elapsed: 12 days, 12:18:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.460209 Generator_loss: 1.03757 [INFO] 2021-07-20 20:43:59 > Step: 182700 Progress: 91.3% Elapsed: 12 days, 12:37:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.455883 Generator_loss: 1.10943 [INFO] 2021-07-20 21:03:07 > Step: 182800 Progress: 91.4% Elapsed: 12 days, 12:56:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.466918 Generator_loss: 0.991204 [INFO] 2021-07-20 21:22:17 > Step: 182900 Progress: 91.5% Elapsed: 12 days, 13:15:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.488384 Generator_loss: 0.971627 [INFO] 2021-07-20 21:41:28 > Step: 183000 Progress: 91.5% Elapsed: 12 days, 13:34:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.450319 Generator_loss: 1.04478 [INFO] 2021-07-20 22:00:37 > Step: 183100 Progress: 91.5% Elapsed: 12 days, 13:53:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.502027 Generator_loss: 0.93012 [INFO] 2021-07-20 22:19:50 > Step: 183200 Progress: 91.6% Elapsed: 12 days, 14:13:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.462204 Generator_loss: 1.05712 [INFO] 2021-07-20 22:39:01 > Step: 183300 Progress: 91.6% Elapsed: 12 days, 14:32:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.467662 Generator_loss: 1.02016 [INFO] 2021-07-20 22:58:09 > Step: 183400 Progress: 91.7% Elapsed: 12 days, 14:51:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.475012 Generator_loss: 0.998411 [INFO] 2021-07-20 23:17:18 > Step: 183500 Progress: 91.8% Elapsed: 12 days, 15:10:30 temperature: 0.25 ada_p: No Discriminator_loss: 0.465771 Generator_loss: 1.0457 [INFO] 2021-07-20 23:36:31 > Step: 183600 Progress: 91.8% Elapsed: 12 days, 15:29:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.460746 Generator_loss: 1.10703 [INFO] 2021-07-20 23:55:39 > Step: 183700 Progress: 91.8% Elapsed: 12 days, 15:48:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.460604 Generator_loss: 1.13029 [INFO] 2021-07-21 00:14:47 > Step: 183800 Progress: 91.9% Elapsed: 12 days, 16:07:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.478265 Generator_loss: 0.99819 [INFO] 2021-07-21 00:33:59 > Step: 183900 Progress: 92.0% Elapsed: 12 days, 16:27:11 temperature: 0.25 ada_p: No Discriminator_loss: 0.476677 Generator_loss: 1.0005 [INFO] 2021-07-21 00:53:06 > Step: 184000 Progress: 92.0% Elapsed: 12 days, 16:46:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.456335 Generator_loss: 1.10804 [INFO] 2021-07-21 00:53:06 > Start Evaluation (184000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-21 00:53:06 > Calculating FID Score.... [INFO] 2021-07-21 00:54:12 > Calculating Inception Score.... [INFO] 2021-07-21 00:55:08 > Calculate F_beta Score.... [INFO] 2021-07-21 00:57:45 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-21 00:57:46 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-21 00:57:48 > Calculate Accuracies.... [INFO] 2021-07-21 00:58:35 > Calculate Accuracies.... [INFO] 2021-07-21 00:59:26 > F_8 score (Step: 184000, Using valid images): 0.9889794155874229 [INFO] 2021-07-21 00:59:26 > F_1/8 score (Step: 184000, Using valid images): 0.9890836398113416 [INFO] 2021-07-21 00:59:26 > FID score (Step: 184000, Using valid moments): 8.767959928617302 [INFO] 2021-07-21 00:59:26 > Inception score (Step: 184000, 50000 generated images): 90.74520874023438 [INFO] 2021-07-21 00:59:26 > Best FID score (Step: 182000, Using valid moments): 8.723129042952678 [INFO] 2021-07-21 00:59:34 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-21 01:18:42 > Step: 184100 Progress: 92.0% Elapsed: 12 days, 17:11:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.578185 Generator_loss: 0.788061 [INFO] 2021-07-21 01:37:54 > Step: 184200 Progress: 92.1% Elapsed: 12 days, 17:31:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.448054 Generator_loss: 1.14253 [INFO] 2021-07-21 01:57:02 > Step: 184300 Progress: 92.2% Elapsed: 12 days, 17:50:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.471707 Generator_loss: 1.0357 [INFO] 2021-07-21 02:16:10 > Step: 184400 Progress: 92.2% Elapsed: 12 days, 18:09:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.527222 Generator_loss: 0.878541 [INFO] 2021-07-21 02:35:27 > Step: 184500 Progress: 92.2% Elapsed: 12 days, 18:28:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.461788 Generator_loss: 1.06572 [INFO] 2021-07-21 02:54:37 > Step: 184600 Progress: 92.3% Elapsed: 12 days, 18:47:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.464043 Generator_loss: 1.19348 [INFO] 2021-07-21 03:13:45 > Step: 184700 Progress: 92.3% Elapsed: 12 days, 19:06:57 temperature: 0.25 ada_p: No Discriminator_loss: 0.621556 Generator_loss: 1.02769 [INFO] 2021-07-21 03:33:02 > Step: 184800 Progress: 92.4% Elapsed: 12 days, 19:26:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.461502 Generator_loss: 1.01563 [INFO] 2021-07-21 03:52:08 > Step: 184900 Progress: 92.5% Elapsed: 12 days, 19:45:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.460079 Generator_loss: 1.0518 [INFO] 2021-07-21 04:11:17 > Step: 185000 Progress: 92.5% Elapsed: 12 days, 20:04:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.4664 Generator_loss: 1.03068 [INFO] 2021-07-21 04:30:30 > Step: 185100 Progress: 92.5% Elapsed: 12 days, 20:23:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.453593 Generator_loss: 1.16736 [INFO] 2021-07-21 04:49:40 > Step: 185200 Progress: 92.6% Elapsed: 12 days, 20:42:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.479974 Generator_loss: 1.00594 [INFO] 2021-07-21 05:08:48 > Step: 185300 Progress: 92.7% Elapsed: 12 days, 21:02:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.823791 Generator_loss: 0.886827 [INFO] 2021-07-21 05:28:01 > Step: 185400 Progress: 92.7% Elapsed: 12 days, 21:21:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.45849 Generator_loss: 1.1253 [INFO] 2021-07-21 05:47:11 > Step: 185500 Progress: 92.8% Elapsed: 12 days, 21:40:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.464071 Generator_loss: 1.15513 [INFO] 2021-07-21 06:06:20 > Step: 185600 Progress: 92.8% Elapsed: 12 days, 21:59:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.455104 Generator_loss: 1.06331 [INFO] 2021-07-21 06:25:31 > Step: 185700 Progress: 92.8% Elapsed: 12 days, 22:18:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.471337 Generator_loss: 1.0902 [INFO] 2021-07-21 06:44:47 > Step: 185800 Progress: 92.9% Elapsed: 12 days, 22:37:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.476427 Generator_loss: 1.02428 [INFO] 2021-07-21 07:03:55 > Step: 185900 Progress: 93.0% Elapsed: 12 days, 22:57:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.529654 Generator_loss: 1.05622 [INFO] 2021-07-21 07:23:04 > Step: 186000 Progress: 93.0% Elapsed: 12 days, 23:16:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.47056 Generator_loss: 1.00822 [INFO] 2021-07-21 07:23:04 > Start Evaluation (186000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-21 07:23:04 > Calculating FID Score.... [INFO] 2021-07-21 07:24:11 > Calculating Inception Score.... [INFO] 2021-07-21 07:25:07 > Calculate F_beta Score.... [INFO] 2021-07-21 07:27:35 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-21 07:27:36 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-21 07:27:37 > Calculate Accuracies.... [INFO] 2021-07-21 07:28:25 > Calculate Accuracies.... [INFO] 2021-07-21 07:29:15 > F_8 score (Step: 186000, Using valid images): 0.988432761479709 [INFO] 2021-07-21 07:29:15 > F_1/8 score (Step: 186000, Using valid images): 0.9892976563989471 [INFO] 2021-07-21 07:29:15 > FID score (Step: 186000, Using valid moments): 8.78644802315614 [INFO] 2021-07-21 07:29:15 > Inception score (Step: 186000, 50000 generated images): 91.9386978149414 [INFO] 2021-07-21 07:29:15 > Best FID score (Step: 182000, Using valid moments): 8.723129042952678 [INFO] 2021-07-21 07:29:23 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-21 07:48:39 > Step: 186100 Progress: 93.0% Elapsed: 12 days, 23:41:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.512964 Generator_loss: 1.01868 [INFO] 2021-07-21 08:07:49 > Step: 186200 Progress: 93.1% Elapsed: 13 days, 0:01:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.467086 Generator_loss: 1.10272 [INFO] 2021-07-21 08:26:58 > Step: 186300 Progress: 93.2% Elapsed: 13 days, 0:20:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.453886 Generator_loss: 1.0961 [INFO] 2021-07-21 08:46:15 > Step: 186400 Progress: 93.2% Elapsed: 13 days, 0:39:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.468916 Generator_loss: 1.05594 [INFO] 2021-07-21 09:05:27 > Step: 186500 Progress: 93.2% Elapsed: 13 days, 0:58:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.468925 Generator_loss: 1.04467 [INFO] 2021-07-21 09:24:40 > Step: 186600 Progress: 93.3% Elapsed: 13 days, 1:17:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.460047 Generator_loss: 1.06002 [INFO] 2021-07-21 09:43:57 > Step: 186700 Progress: 93.3% Elapsed: 13 days, 1:37:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.518705 Generator_loss: 0.870098 [INFO] 2021-07-21 10:03:08 > Step: 186800 Progress: 93.4% Elapsed: 13 days, 1:56:20 temperature: 0.25 ada_p: No Discriminator_loss: 0.480547 Generator_loss: 1.09155 [INFO] 2021-07-21 10:22:16 > Step: 186900 Progress: 93.5% Elapsed: 13 days, 2:15:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.482121 Generator_loss: 0.972282 [INFO] 2021-07-21 10:41:33 > Step: 187000 Progress: 93.5% Elapsed: 13 days, 2:34:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.466117 Generator_loss: 1.07251 [INFO] 2021-07-21 11:00:44 > Step: 187100 Progress: 93.5% Elapsed: 13 days, 2:53:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.468512 Generator_loss: 1.06891 [INFO] 2021-07-21 11:19:53 > Step: 187200 Progress: 93.6% Elapsed: 13 days, 3:13:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.481361 Generator_loss: 0.960391 [INFO] 2021-07-21 11:39:06 > Step: 187300 Progress: 93.7% Elapsed: 13 days, 3:32:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.479389 Generator_loss: 0.971488 [INFO] 2021-07-21 11:58:18 > Step: 187400 Progress: 93.7% Elapsed: 13 days, 3:51:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.477246 Generator_loss: 1.06999 [INFO] 2021-07-21 12:17:27 > Step: 187500 Progress: 93.8% Elapsed: 13 days, 4:10:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.463134 Generator_loss: 1.07027 [INFO] 2021-07-21 12:36:43 > Step: 187600 Progress: 93.8% Elapsed: 13 days, 4:29:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.45052 Generator_loss: 1.12096 [INFO] 2021-07-21 12:55:49 > Step: 187700 Progress: 93.8% Elapsed: 13 days, 4:49:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.475441 Generator_loss: 0.983142 [INFO] 2021-07-21 13:14:56 > Step: 187800 Progress: 93.9% Elapsed: 13 days, 5:08:08 temperature: 0.25 ada_p: No Discriminator_loss: 0.472754 Generator_loss: 1.05962 [INFO] 2021-07-21 13:34:10 > Step: 187900 Progress: 94.0% Elapsed: 13 days, 5:27:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.452108 Generator_loss: 1.09996 [INFO] 2021-07-21 13:53:21 > Step: 188000 Progress: 94.0% Elapsed: 13 days, 5:46:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.442338 Generator_loss: 1.14462 [INFO] 2021-07-21 13:53:21 > Start Evaluation (188000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-21 13:53:21 > Calculating FID Score.... [INFO] 2021-07-21 13:54:28 > Calculating Inception Score.... [INFO] 2021-07-21 13:55:23 > Calculate F_beta Score.... [INFO] 2021-07-21 13:58:02 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-21 13:58:03 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-21 13:58:05 > Calculate Accuracies.... [INFO] 2021-07-21 13:58:52 > Calculate Accuracies.... [INFO] 2021-07-21 13:59:42 > F_8 score (Step: 188000, Using valid images): 0.9886943749046969 [INFO] 2021-07-21 13:59:42 > F_1/8 score (Step: 188000, Using valid images): 0.9886807235843135 [INFO] 2021-07-21 13:59:42 > FID score (Step: 188000, Using valid moments): 8.72576677759264 [INFO] 2021-07-21 13:59:42 > Inception score (Step: 188000, 50000 generated images): 93.02119445800781 [INFO] 2021-07-21 13:59:42 > Best FID score (Step: 182000, Using valid moments): 8.723129042952678 [INFO] 2021-07-21 13:59:50 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-21 14:19:01 > Step: 188100 Progress: 94.0% Elapsed: 13 days, 6:12:13 temperature: 0.25 ada_p: No Discriminator_loss: 0.460655 Generator_loss: 1.03725 [INFO] 2021-07-21 14:38:13 > Step: 188200 Progress: 94.1% Elapsed: 13 days, 6:31:25 temperature: 0.25 ada_p: No Discriminator_loss: 0.468554 Generator_loss: 1.04947 [INFO] 2021-07-21 14:57:30 > Step: 188300 Progress: 94.2% Elapsed: 13 days, 6:50:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.459438 Generator_loss: 1.04491 [INFO] 2021-07-21 15:16:41 > Step: 188400 Progress: 94.2% Elapsed: 13 days, 7:09:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.469191 Generator_loss: 0.99937 [INFO] 2021-07-21 15:35:51 > Step: 188500 Progress: 94.2% Elapsed: 13 days, 7:29:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.458827 Generator_loss: 1.11526 [INFO] 2021-07-21 15:55:07 > Step: 188600 Progress: 94.3% Elapsed: 13 days, 7:48:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.460897 Generator_loss: 1.2087 [INFO] 2021-07-21 16:14:17 > Step: 188700 Progress: 94.3% Elapsed: 13 days, 8:07:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.489515 Generator_loss: 0.966502 [INFO] 2021-07-21 16:33:28 > Step: 188800 Progress: 94.4% Elapsed: 13 days, 8:26:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.490231 Generator_loss: 1.02347 [INFO] 2021-07-21 16:52:46 > Step: 188900 Progress: 94.5% Elapsed: 13 days, 8:45:58 temperature: 0.25 ada_p: No Discriminator_loss: 0.456625 Generator_loss: 1.14424 [INFO] 2021-07-21 17:11:54 > Step: 189000 Progress: 94.5% Elapsed: 13 days, 9:05:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.449927 Generator_loss: 1.00952 [INFO] 2021-07-21 17:31:04 > Step: 189100 Progress: 94.5% Elapsed: 13 days, 9:24:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.477359 Generator_loss: 1.02469 [INFO] 2021-07-21 17:50:21 > Step: 189200 Progress: 94.6% Elapsed: 13 days, 9:43:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.46675 Generator_loss: 1.11783 [INFO] 2021-07-21 18:09:29 > Step: 189300 Progress: 94.7% Elapsed: 13 days, 10:02:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.455487 Generator_loss: 1.05673 [INFO] 2021-07-21 18:28:40 > Step: 189400 Progress: 94.7% Elapsed: 13 days, 10:21:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.468768 Generator_loss: 1.05392 [INFO] 2021-07-21 18:47:54 > Step: 189500 Progress: 94.8% Elapsed: 13 days, 10:41:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.453158 Generator_loss: 1.04996 [INFO] 2021-07-21 19:07:03 > Step: 189600 Progress: 94.8% Elapsed: 13 days, 11:00:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.454319 Generator_loss: 1.17182 [INFO] 2021-07-21 19:26:11 > Step: 189700 Progress: 94.8% Elapsed: 13 days, 11:19:22 temperature: 0.25 ada_p: No Discriminator_loss: 0.471196 Generator_loss: 0.994517 [INFO] 2021-07-21 19:45:25 > Step: 189800 Progress: 94.9% Elapsed: 13 days, 11:38:37 temperature: 0.25 ada_p: No Discriminator_loss: 0.509866 Generator_loss: 0.869099 [INFO] 2021-07-21 20:04:34 > Step: 189900 Progress: 95.0% Elapsed: 13 days, 11:57:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.4602 Generator_loss: 1.08662 [INFO] 2021-07-21 20:23:44 > Step: 190000 Progress: 95.0% Elapsed: 13 days, 12:16:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.473918 Generator_loss: 1.03191 [INFO] 2021-07-21 20:23:44 > Start Evaluation (190000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-21 20:23:44 > Calculating FID Score.... [INFO] 2021-07-21 20:24:50 > Calculating Inception Score.... [INFO] 2021-07-21 20:25:46 > Calculate F_beta Score.... [INFO] 2021-07-21 20:28:22 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-21 20:28:23 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-21 20:28:24 > Calculate Accuracies.... [INFO] 2021-07-21 20:29:12 > Calculate Accuracies.... [INFO] 2021-07-21 20:30:03 > F_8 score (Step: 190000, Using valid images): 0.9880048907658611 [INFO] 2021-07-21 20:30:03 > F_1/8 score (Step: 190000, Using valid images): 0.988833411692317 [INFO] 2021-07-21 20:30:03 > FID score (Step: 190000, Using valid moments): 8.642149855140758 [INFO] 2021-07-21 20:30:03 > Inception score (Step: 190000, 50000 generated images): 93.22616577148438 [INFO] 2021-07-21 20:30:03 > Best FID score (Step: 190000, Using valid moments): 8.642149855140758 [INFO] 2021-07-21 20:30:18 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-21 20:49:36 > Step: 190100 Progress: 95.0% Elapsed: 13 days, 12:42:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.476986 Generator_loss: 0.990045 [INFO] 2021-07-21 21:08:48 > Step: 190200 Progress: 95.1% Elapsed: 13 days, 13:02:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.467601 Generator_loss: 1.04712 [INFO] 2021-07-21 21:27:58 > Step: 190300 Progress: 95.2% Elapsed: 13 days, 13:21:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.49385 Generator_loss: 0.960922 [INFO] 2021-07-21 21:47:13 > Step: 190400 Progress: 95.2% Elapsed: 13 days, 13:40:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.464 Generator_loss: 1.04113 [INFO] 2021-07-21 22:06:22 > Step: 190500 Progress: 95.2% Elapsed: 13 days, 13:59:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.463611 Generator_loss: 1.0839 [INFO] 2021-07-21 22:25:31 > Step: 190600 Progress: 95.3% Elapsed: 13 days, 14:18:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.47978 Generator_loss: 0.970677 [INFO] 2021-07-21 22:44:41 > Step: 190700 Progress: 95.3% Elapsed: 13 days, 14:37:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.459526 Generator_loss: 1.05637 [INFO] 2021-07-21 23:03:55 > Step: 190800 Progress: 95.4% Elapsed: 13 days, 14:57:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.456474 Generator_loss: 1.08018 [INFO] 2021-07-21 23:23:06 > Step: 190900 Progress: 95.5% Elapsed: 13 days, 15:16:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.502935 Generator_loss: 0.929101 [INFO] 2021-07-21 23:42:14 > Step: 191000 Progress: 95.5% Elapsed: 13 days, 15:35:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.485639 Generator_loss: 0.946963 [INFO] 2021-07-22 00:01:32 > Step: 191100 Progress: 95.5% Elapsed: 13 days, 15:54:44 temperature: 0.25 ada_p: No Discriminator_loss: 0.482251 Generator_loss: 0.963302 [INFO] 2021-07-22 00:20:40 > Step: 191200 Progress: 95.6% Elapsed: 13 days, 16:13:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.468051 Generator_loss: 1.02426 [INFO] 2021-07-22 00:39:50 > Step: 191300 Progress: 95.7% Elapsed: 13 days, 16:33:02 temperature: 0.25 ada_p: No Discriminator_loss: 0.467524 Generator_loss: 1.0708 [INFO] 2021-07-22 00:59:07 > Step: 191400 Progress: 95.7% Elapsed: 13 days, 16:52:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.487664 Generator_loss: 1.03887 [INFO] 2021-07-22 01:18:17 > Step: 191500 Progress: 95.8% Elapsed: 13 days, 17:11:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.45151 Generator_loss: 1.09166 [INFO] 2021-07-22 01:37:26 > Step: 191600 Progress: 95.8% Elapsed: 13 days, 17:30:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.462591 Generator_loss: 1.08151 [INFO] 2021-07-22 01:56:42 > Step: 191700 Progress: 95.9% Elapsed: 13 days, 17:49:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.458173 Generator_loss: 1.19387 [INFO] 2021-07-22 02:15:54 > Step: 191800 Progress: 95.9% Elapsed: 13 days, 18:09:06 temperature: 0.25 ada_p: No Discriminator_loss: 0.456516 Generator_loss: 1.06446 [INFO] 2021-07-22 02:35:04 > Step: 191900 Progress: 96.0% Elapsed: 13 days, 18:28:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.524925 Generator_loss: 1.07459 [INFO] 2021-07-22 02:54:21 > Step: 192000 Progress: 96.0% Elapsed: 13 days, 18:47:33 temperature: 0.25 ada_p: No Discriminator_loss: 0.458824 Generator_loss: 1.09458 [INFO] 2021-07-22 02:54:21 > Start Evaluation (192000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-22 02:54:21 > Calculating FID Score.... [INFO] 2021-07-22 02:55:28 > Calculating Inception Score.... [INFO] 2021-07-22 02:56:24 > Calculate F_beta Score.... [INFO] 2021-07-22 02:59:10 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-22 02:59:10 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-22 02:59:12 > Calculate Accuracies.... [INFO] 2021-07-22 03:00:00 > Calculate Accuracies.... [INFO] 2021-07-22 03:00:51 > F_8 score (Step: 192000, Using valid images): 0.988642045804403 [INFO] 2021-07-22 03:00:51 > F_1/8 score (Step: 192000, Using valid images): 0.9896234127555735 [INFO] 2021-07-22 03:00:51 > FID score (Step: 192000, Using valid moments): 8.699329972269481 [INFO] 2021-07-22 03:00:51 > Inception score (Step: 192000, 50000 generated images): 94.61144256591797 [INFO] 2021-07-22 03:00:51 > Best FID score (Step: 190000, Using valid moments): 8.642149855140758 [INFO] 2021-07-22 03:00:58 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-22 03:20:08 > Step: 192100 Progress: 96.0% Elapsed: 13 days, 19:13:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.472317 Generator_loss: 1.10655 [INFO] 2021-07-22 03:39:16 > Step: 192200 Progress: 96.1% Elapsed: 13 days, 19:32:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.455262 Generator_loss: 1.13328 [INFO] 2021-07-22 03:58:31 > Step: 192300 Progress: 96.2% Elapsed: 13 days, 19:51:43 temperature: 0.25 ada_p: No Discriminator_loss: 0.453115 Generator_loss: 1.10879 [INFO] 2021-07-22 04:17:41 > Step: 192400 Progress: 96.2% Elapsed: 13 days, 20:10:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.458008 Generator_loss: 1.05077 [INFO] 2021-07-22 04:36:48 > Step: 192500 Progress: 96.2% Elapsed: 13 days, 20:30:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.465029 Generator_loss: 1.1447 [INFO] 2021-07-22 04:56:03 > Step: 192600 Progress: 96.3% Elapsed: 13 days, 20:49:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.45762 Generator_loss: 1.04644 [INFO] 2021-07-22 05:15:12 > Step: 192700 Progress: 96.4% Elapsed: 13 days, 21:08:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.477563 Generator_loss: 1.12491 [INFO] 2021-07-22 05:34:22 > Step: 192800 Progress: 96.4% Elapsed: 13 days, 21:27:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.469784 Generator_loss: 1.04853 [INFO] 2021-07-22 05:53:37 > Step: 192900 Progress: 96.5% Elapsed: 13 days, 21:46:48 temperature: 0.25 ada_p: No Discriminator_loss: 0.47135 Generator_loss: 1.06567 [INFO] 2021-07-22 06:12:48 > Step: 193000 Progress: 96.5% Elapsed: 13 days, 22:06:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.448484 Generator_loss: 1.07834 [INFO] 2021-07-22 06:31:57 > Step: 193100 Progress: 96.5% Elapsed: 13 days, 22:25:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.491883 Generator_loss: 0.970379 [INFO] 2021-07-22 06:51:09 > Step: 193200 Progress: 96.6% Elapsed: 13 days, 22:44:21 temperature: 0.25 ada_p: No Discriminator_loss: 0.474027 Generator_loss: 0.998327 [INFO] 2021-07-22 07:10:24 > Step: 193300 Progress: 96.7% Elapsed: 13 days, 23:03:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.490947 Generator_loss: 1.05603 [INFO] 2021-07-22 07:29:33 > Step: 193400 Progress: 96.7% Elapsed: 13 days, 23:22:45 temperature: 0.25 ada_p: No Discriminator_loss: 0.464629 Generator_loss: 1.10991 [INFO] 2021-07-22 07:48:44 > Step: 193500 Progress: 96.8% Elapsed: 13 days, 23:41:56 temperature: 0.25 ada_p: No Discriminator_loss: 0.452719 Generator_loss: 1.13859 [INFO] 2021-07-22 08:08:00 > Step: 193600 Progress: 96.8% Elapsed: 14 days, 0:01:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.457085 Generator_loss: 1.02152 [INFO] 2021-07-22 08:27:07 > Step: 193700 Progress: 96.9% Elapsed: 14 days, 0:20:19 temperature: 0.25 ada_p: No Discriminator_loss: 0.501322 Generator_loss: 0.940143 [INFO] 2021-07-22 08:46:12 > Step: 193800 Progress: 96.9% Elapsed: 14 days, 0:39:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.457138 Generator_loss: 1.06458 [INFO] 2021-07-22 09:05:27 > Step: 193900 Progress: 97.0% Elapsed: 14 days, 0:58:39 temperature: 0.25 ada_p: No Discriminator_loss: 0.497585 Generator_loss: 1.01999 [INFO] 2021-07-22 09:24:37 > Step: 194000 Progress: 97.0% Elapsed: 14 days, 1:17:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.460648 Generator_loss: 1.05572 [INFO] 2021-07-22 09:24:37 > Start Evaluation (194000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-22 09:24:37 > Calculating FID Score.... [INFO] 2021-07-22 09:25:44 > Calculating Inception Score.... [INFO] 2021-07-22 09:26:40 > Calculate F_beta Score.... [INFO] 2021-07-22 09:29:24 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-22 09:29:24 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-22 09:29:26 > Calculate Accuracies.... [INFO] 2021-07-22 09:30:14 > Calculate Accuracies.... [INFO] 2021-07-22 09:31:04 > F_8 score (Step: 194000, Using valid images): 0.9886929134853982 [INFO] 2021-07-22 09:31:04 > F_1/8 score (Step: 194000, Using valid images): 0.9894006184296436 [INFO] 2021-07-22 09:31:04 > FID score (Step: 194000, Using valid moments): 8.728541667701336 [INFO] 2021-07-22 09:31:04 > Inception score (Step: 194000, 50000 generated images): 94.03524780273438 [INFO] 2021-07-22 09:31:04 > Best FID score (Step: 190000, Using valid moments): 8.642149855140758 [INFO] 2021-07-22 09:31:12 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-22 09:50:21 > Step: 194100 Progress: 97.0% Elapsed: 14 days, 1:43:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.472951 Generator_loss: 1.02746 [INFO] 2021-07-22 10:09:38 > Step: 194200 Progress: 97.1% Elapsed: 14 days, 2:02:50 temperature: 0.25 ada_p: No Discriminator_loss: 0.464295 Generator_loss: 1.01104 [INFO] 2021-07-22 10:28:48 > Step: 194300 Progress: 97.2% Elapsed: 14 days, 2:22:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.477352 Generator_loss: 0.996782 [INFO] 2021-07-22 10:47:57 > Step: 194400 Progress: 97.2% Elapsed: 14 days, 2:41:09 temperature: 0.25 ada_p: No Discriminator_loss: 0.491108 Generator_loss: 0.951962 [INFO] 2021-07-22 11:07:11 > Step: 194500 Progress: 97.2% Elapsed: 14 days, 3:00:23 temperature: 0.25 ada_p: No Discriminator_loss: 0.468199 Generator_loss: 1.04883 [INFO] 2021-07-22 11:26:21 > Step: 194600 Progress: 97.3% Elapsed: 14 days, 3:19:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.482419 Generator_loss: 1.02233 [INFO] 2021-07-22 11:45:29 > Step: 194700 Progress: 97.4% Elapsed: 14 days, 3:38:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.457115 Generator_loss: 1.06988 [INFO] 2021-07-22 12:04:42 > Step: 194800 Progress: 97.4% Elapsed: 14 days, 3:57:54 temperature: 0.25 ada_p: No Discriminator_loss: 0.462015 Generator_loss: 1.17016 [INFO] 2021-07-22 12:23:49 > Step: 194900 Progress: 97.5% Elapsed: 14 days, 4:17:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.483491 Generator_loss: 1.07359 [INFO] 2021-07-22 12:42:58 > Step: 195000 Progress: 97.5% Elapsed: 14 days, 4:36:10 temperature: 0.25 ada_p: No Discriminator_loss: 0.479252 Generator_loss: 1.04731 [INFO] 2021-07-22 13:02:13 > Step: 195100 Progress: 97.5% Elapsed: 14 days, 4:55:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.461627 Generator_loss: 1.01549 [INFO] 2021-07-22 13:21:25 > Step: 195200 Progress: 97.6% Elapsed: 14 days, 5:14:36 temperature: 0.25 ada_p: No Discriminator_loss: 0.466814 Generator_loss: 1.07223 [INFO] 2021-07-22 13:40:34 > Step: 195300 Progress: 97.7% Elapsed: 14 days, 5:33:46 temperature: 0.25 ada_p: No Discriminator_loss: 0.459377 Generator_loss: 1.10034 [INFO] 2021-07-22 13:59:48 > Step: 195400 Progress: 97.7% Elapsed: 14 days, 5:53:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.447757 Generator_loss: 1.08933 [INFO] 2021-07-22 14:19:00 > Step: 195500 Progress: 97.8% Elapsed: 14 days, 6:12:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.448984 Generator_loss: 1.11043 [INFO] 2021-07-22 14:38:12 > Step: 195600 Progress: 97.8% Elapsed: 14 days, 6:31:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.452401 Generator_loss: 1.17037 [INFO] 2021-07-22 14:57:22 > Step: 195700 Progress: 97.9% Elapsed: 14 days, 6:50:34 temperature: 0.25 ada_p: No Discriminator_loss: 0.466606 Generator_loss: 1.06784 [INFO] 2021-07-22 15:16:37 > Step: 195800 Progress: 97.9% Elapsed: 14 days, 7:09:49 temperature: 0.25 ada_p: No Discriminator_loss: 0.479443 Generator_loss: 0.952533 [INFO] 2021-07-22 15:35:47 > Step: 195900 Progress: 98.0% Elapsed: 14 days, 7:28:59 temperature: 0.25 ada_p: No Discriminator_loss: 0.461454 Generator_loss: 1.0819 [INFO] 2021-07-22 15:54:55 > Step: 196000 Progress: 98.0% Elapsed: 14 days, 7:48:07 temperature: 0.25 ada_p: No Discriminator_loss: 0.572926 Generator_loss: 1.02745 [INFO] 2021-07-22 15:54:55 > Start Evaluation (196000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-22 15:54:55 > Calculating FID Score.... [INFO] 2021-07-22 15:56:02 > Calculating Inception Score.... [INFO] 2021-07-22 15:56:58 > Calculate F_beta Score.... [INFO] 2021-07-22 15:59:37 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-22 15:59:37 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-22 15:59:39 > Calculate Accuracies.... [INFO] 2021-07-22 16:00:27 > Calculate Accuracies.... [INFO] 2021-07-22 16:01:18 > F_8 score (Step: 196000, Using valid images): 0.9888130012470244 [INFO] 2021-07-22 16:01:18 > F_1/8 score (Step: 196000, Using valid images): 0.9887135436890361 [INFO] 2021-07-22 16:01:18 > FID score (Step: 196000, Using valid moments): 8.717790537676933 [INFO] 2021-07-22 16:01:18 > Inception score (Step: 196000, 50000 generated images): 94.86791229248047 [INFO] 2021-07-22 16:01:18 > Best FID score (Step: 190000, Using valid moments): 8.642149855140758 [INFO] 2021-07-22 16:01:25 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-22 16:20:43 > Step: 196100 Progress: 98.0% Elapsed: 14 days, 8:13:55 temperature: 0.25 ada_p: No Discriminator_loss: 0.452937 Generator_loss: 1.13575 [INFO] 2021-07-22 16:39:52 > Step: 196200 Progress: 98.1% Elapsed: 14 days, 8:33:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.452164 Generator_loss: 1.11773 [INFO] 2021-07-22 16:59:00 > Step: 196300 Progress: 98.2% Elapsed: 14 days, 8:52:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.450695 Generator_loss: 1.15202 [INFO] 2021-07-22 17:18:16 > Step: 196400 Progress: 98.2% Elapsed: 14 days, 9:11:28 temperature: 0.25 ada_p: No Discriminator_loss: 0.461098 Generator_loss: 1.15046 [INFO] 2021-07-22 17:37:24 > Step: 196500 Progress: 98.2% Elapsed: 14 days, 9:30:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.453265 Generator_loss: 1.09358 [INFO] 2021-07-22 17:56:30 > Step: 196600 Progress: 98.3% Elapsed: 14 days, 9:49:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.518015 Generator_loss: 0.879607 [INFO] 2021-07-22 18:15:49 > Step: 196700 Progress: 98.4% Elapsed: 14 days, 10:09:01 temperature: 0.25 ada_p: No Discriminator_loss: 0.457277 Generator_loss: 1.12383 [INFO] 2021-07-22 18:35:01 > Step: 196800 Progress: 98.4% Elapsed: 14 days, 10:28:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.457373 Generator_loss: 1.0993 [INFO] 2021-07-22 18:54:13 > Step: 196900 Progress: 98.5% Elapsed: 14 days, 10:47:24 temperature: 0.25 ada_p: No Discriminator_loss: 0.490804 Generator_loss: 0.892561 [INFO] 2021-07-22 19:13:29 > Step: 197000 Progress: 98.5% Elapsed: 14 days, 11:06:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.466938 Generator_loss: 1.04496 [INFO] 2021-07-22 19:32:40 > Step: 197100 Progress: 98.6% Elapsed: 14 days, 11:25:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.485525 Generator_loss: 1.01352 [INFO] 2021-07-22 19:51:51 > Step: 197200 Progress: 98.6% Elapsed: 14 days, 11:45:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.495367 Generator_loss: 1.02246 [INFO] 2021-07-22 20:11:06 > Step: 197300 Progress: 98.7% Elapsed: 14 days, 12:04:18 temperature: 0.25 ada_p: No Discriminator_loss: 0.483608 Generator_loss: 1.02283 [INFO] 2021-07-22 20:30:17 > Step: 197400 Progress: 98.7% Elapsed: 14 days, 12:23:29 temperature: 0.25 ada_p: No Discriminator_loss: 0.465996 Generator_loss: 1.11411 [INFO] 2021-07-22 20:49:26 > Step: 197500 Progress: 98.8% Elapsed: 14 days, 12:42:38 temperature: 0.25 ada_p: No Discriminator_loss: 0.457882 Generator_loss: 1.08922 [INFO] 2021-07-22 21:08:42 > Step: 197600 Progress: 98.8% Elapsed: 14 days, 13:01:53 temperature: 0.25 ada_p: No Discriminator_loss: 0.47894 Generator_loss: 1.03413 [INFO] 2021-07-22 21:27:51 > Step: 197700 Progress: 98.9% Elapsed: 14 days, 13:21:03 temperature: 0.25 ada_p: No Discriminator_loss: 0.476218 Generator_loss: 1.00587 [INFO] 2021-07-22 21:47:00 > Step: 197800 Progress: 98.9% Elapsed: 14 days, 13:40:12 temperature: 0.25 ada_p: No Discriminator_loss: 0.497988 Generator_loss: 1.03272 [INFO] 2021-07-22 22:06:15 > Step: 197900 Progress: 99.0% Elapsed: 14 days, 13:59:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.480957 Generator_loss: 0.952069 [INFO] 2021-07-22 22:25:28 > Step: 198000 Progress: 99.0% Elapsed: 14 days, 14:18:40 temperature: 0.25 ada_p: No Discriminator_loss: 0.46341 Generator_loss: 1.0762 [INFO] 2021-07-22 22:25:28 > Start Evaluation (198000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-22 22:25:28 > Calculating FID Score.... [INFO] 2021-07-22 22:26:35 > Calculating Inception Score.... [INFO] 2021-07-22 22:27:31 > Calculate F_beta Score.... [INFO] 2021-07-22 22:30:01 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-22 22:30:02 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-22 22:30:04 > Calculate Accuracies.... [INFO] 2021-07-22 22:30:51 > Calculate Accuracies.... [INFO] 2021-07-22 22:31:41 > F_8 score (Step: 198000, Using valid images): 0.9902733802632535 [INFO] 2021-07-22 22:31:41 > F_1/8 score (Step: 198000, Using valid images): 0.9880454102510091 [INFO] 2021-07-22 22:31:41 > FID score (Step: 198000, Using valid moments): 8.686169490388579 [INFO] 2021-07-22 22:31:41 > Inception score (Step: 198000, 50000 generated images): 95.386962890625 [INFO] 2021-07-22 22:31:41 > Best FID score (Step: 190000, Using valid moments): 8.642149855140758 [INFO] 2021-07-22 22:31:48 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-22 22:51:03 > Step: 198100 Progress: 99.1% Elapsed: 14 days, 14:44:15 temperature: 0.25 ada_p: No Discriminator_loss: 0.471887 Generator_loss: 1.09251 [INFO] 2021-07-22 23:10:15 > Step: 198200 Progress: 99.1% Elapsed: 14 days, 15:03:27 temperature: 0.25 ada_p: No Discriminator_loss: 0.497496 Generator_loss: 0.921759 [INFO] 2021-07-22 23:29:30 > Step: 198300 Progress: 99.2% Elapsed: 14 days, 15:22:42 temperature: 0.25 ada_p: No Discriminator_loss: 0.462942 Generator_loss: 1.06327 [INFO] 2021-07-22 23:48:39 > Step: 198400 Progress: 99.2% Elapsed: 14 days, 15:41:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.460733 Generator_loss: 1.07346 [INFO] 2021-07-23 00:07:49 > Step: 198500 Progress: 99.2% Elapsed: 14 days, 16:01:00 temperature: 0.25 ada_p: No Discriminator_loss: 0.46308 Generator_loss: 1.10284 [INFO] 2021-07-23 00:27:05 > Step: 198600 Progress: 99.3% Elapsed: 14 days, 16:20:17 temperature: 0.25 ada_p: No Discriminator_loss: 0.448796 Generator_loss: 1.14654 [INFO] 2021-07-23 00:46:14 > Step: 198700 Progress: 99.4% Elapsed: 14 days, 16:39:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.476092 Generator_loss: 1.00037 [INFO] 2021-07-23 01:05:23 > Step: 198800 Progress: 99.4% Elapsed: 14 days, 16:58:35 temperature: 0.25 ada_p: No Discriminator_loss: 0.495798 Generator_loss: 0.953949 [INFO] 2021-07-23 01:24:39 > Step: 198900 Progress: 99.5% Elapsed: 14 days, 17:17:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.541566 Generator_loss: 0.906094 [INFO] 2021-07-23 01:43:52 > Step: 199000 Progress: 99.5% Elapsed: 14 days, 17:37:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.450555 Generator_loss: 1.14012 [INFO] 2021-07-23 02:03:03 > Step: 199100 Progress: 99.6% Elapsed: 14 days, 17:56:14 temperature: 0.25 ada_p: No Discriminator_loss: 0.463729 Generator_loss: 1.14105 [INFO] 2021-07-23 02:22:20 > Step: 199200 Progress: 99.6% Elapsed: 14 days, 18:15:32 temperature: 0.25 ada_p: No Discriminator_loss: 0.462954 Generator_loss: 1.04144 [INFO] 2021-07-23 02:41:29 > Step: 199300 Progress: 99.7% Elapsed: 14 days, 18:34:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.460421 Generator_loss: 1.08328 [INFO] 2021-07-23 03:00:39 > Step: 199400 Progress: 99.7% Elapsed: 14 days, 18:53:51 temperature: 0.25 ada_p: No Discriminator_loss: 0.473497 Generator_loss: 1.0279 [INFO] 2021-07-23 03:19:53 > Step: 199500 Progress: 99.8% Elapsed: 14 days, 19:13:05 temperature: 0.25 ada_p: No Discriminator_loss: 0.454096 Generator_loss: 1.08402 [INFO] 2021-07-23 03:39:04 > Step: 199600 Progress: 99.8% Elapsed: 14 days, 19:32:16 temperature: 0.25 ada_p: No Discriminator_loss: 0.502997 Generator_loss: 0.999964 [INFO] 2021-07-23 03:58:15 > Step: 199700 Progress: 99.9% Elapsed: 14 days, 19:51:26 temperature: 0.25 ada_p: No Discriminator_loss: 0.466799 Generator_loss: 0.994969 [INFO] 2021-07-23 04:17:29 > Step: 199800 Progress: 99.9% Elapsed: 14 days, 20:10:41 temperature: 0.25 ada_p: No Discriminator_loss: 0.454511 Generator_loss: 1.14077 [INFO] 2021-07-23 04:36:40 > Step: 199900 Progress: 100.0% Elapsed: 14 days, 20:29:52 temperature: 0.25 ada_p: No Discriminator_loss: 0.446711 Generator_loss: 1.16968 [INFO] 2021-07-23 04:55:52 > Step: 200000 Progress: 100.0% Elapsed: 14 days, 20:49:04 temperature: 0.25 ada_p: No Discriminator_loss: 0.465398 Generator_loss: 1.0088 [INFO] 2021-07-23 04:55:52 > Start Evaluation (200000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-23 04:55:52 > Calculating FID Score.... [INFO] 2021-07-23 04:56:59 > Calculating Inception Score.... [INFO] 2021-07-23 04:57:54 > Calculate F_beta Score.... [INFO] 2021-07-23 05:00:21 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-23 05:00:22 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-23 05:00:24 > Calculate Accuracies.... [INFO] 2021-07-23 05:01:11 > Calculate Accuracies.... [INFO] 2021-07-23 05:02:02 > F_8 score (Step: 200000, Using valid images): 0.989082677803276 [INFO] 2021-07-23 05:02:02 > F_1/8 score (Step: 200000, Using valid images): 0.9888484032274539 [INFO] 2021-07-23 05:02:02 > FID score (Step: 200000, Using valid moments): 8.66259154074794 [INFO] 2021-07-23 05:02:02 > Inception score (Step: 200000, 50000 generated images): 95.94559478759766 [INFO] 2021-07-23 05:02:02 > Best FID score (Step: 190000, Using valid moments): 8.642149855140758 [INFO] 2021-07-23 05:02:09 > Save model to ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-23 05:02:21 > Start Evaluation (200000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-23 05:02:21 > Calculating FID Score.... [INFO] 2021-07-23 05:03:28 > Calculating Inception Score.... [INFO] 2021-07-23 05:04:24 > Calculate F_beta Score.... [INFO] 2021-07-23 05:06:50 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-23 05:06:50 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-23 05:06:52 > Calculate Accuracies.... [INFO] 2021-07-23 05:07:41 > Calculate Accuracies.... [INFO] 2021-07-23 05:08:31 > F_8 score (Step: 200000, Using valid images): 0.990114871732728 [INFO] 2021-07-23 05:08:31 > F_1/8 score (Step: 200000, Using valid images): 0.9875272849339312 [INFO] 2021-07-23 05:08:31 > FID score (Step: 200000, Using valid moments): 8.7913248987374 [INFO] 2021-07-23 05:08:31 > Inception score (Step: 200000, 50000 generated images): 96.33621978759766 [INFO] 2021-07-23 05:08:31 > Best FID score (Step: 190000, Using valid moments): 8.642149855140758 [INFO] 2021-07-23 05:45:30 > Generator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=G-best-weights-step=190000.pth [INFO] 2021-07-23 05:45:30 > Discriminator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=D-best-weights-step=190000.pth [INFO] 2021-07-23 05:45:33 > Start Evaluation (190000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-23 06:30:27 > Generator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=G-best-weights-step=190000.pth [INFO] 2021-07-23 06:30:27 > Discriminator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=D-best-weights-step=190000.pth [INFO] 2021-07-23 06:30:29 > Start Evaluation (190000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-23 06:35:47 > Calculating FID Score.... [INFO] 2021-07-23 06:36:48 > Calculating Inception Score.... [INFO] 2021-07-23 06:37:43 > Calculate F_beta Score.... [INFO] 2021-07-23 06:40:07 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-23 06:40:07 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-23 06:40:09 > Calculate Accuracies.... [INFO] 2021-07-23 06:41:04 > Calculate Accuracies.... [INFO] 2021-07-23 06:41:53 > F_8 score (Step: 190000, Using valid images): 0.9881293253575711 [INFO] 2021-07-23 06:41:53 > F_1/8 score (Step: 190000, Using valid images): 0.9885989059935297 [INFO] 2021-07-23 06:41:53 > FID score (Step: 190000, Using valid moments): 8.239469402078612 [INFO] 2021-07-23 06:41:53 > Inception score (Step: 190000, 50000 generated images): 92.65884399414062 [INFO] 2021-07-23 06:41:53 > Best FID score (Step: 190000, Using valid moments): 8.239469402078612 [INFO] 2021-07-23 07:01:34 > Generator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=G-current-weights-step=200000.pth [INFO] 2021-07-23 07:01:34 > Discriminator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=D-current-weights-step=200000.pth [INFO] 2021-07-23 07:01:37 > Start Evaluation (200000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-23 07:07:38 > Calculating FID Score.... [INFO] 2021-07-23 07:08:38 > Calculating Inception Score.... [INFO] 2021-07-23 07:09:34 > Calculate F_beta Score.... [INFO] 2021-07-23 07:11:57 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-23 07:11:57 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-23 07:11:59 > Calculate Accuracies.... [INFO] 2021-07-23 07:12:56 > Calculate Accuracies.... [INFO] 2021-07-23 07:13:45 > F_8 score (Step: 200000, Using valid images): 0.9904011876750008 [INFO] 2021-07-23 07:13:45 > F_1/8 score (Step: 200000, Using valid images): 0.989323310323937 [INFO] 2021-07-23 07:13:45 > FID score (Step: 200000, Using valid moments): 8.421365239949864 [INFO] 2021-07-23 07:13:45 > Inception score (Step: 200000, 50000 generated images): 95.13998413085938 [INFO] 2021-07-23 07:13:45 > Best FID score (Step: 200000, Using valid moments): 8.421365239949864 [INFO] 2021-07-23 07:14:21 > Generator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=G-current-weights-step=200000.pth [INFO] 2021-07-23 07:14:21 > Discriminator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=D-current-weights-step=200000.pth [INFO] 2021-07-23 07:14:24 > Start Evaluation (200000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-23 07:44:06 > Generator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=G-current-weights-step=200000.pth [INFO] 2021-07-23 07:44:06 > Discriminator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=D-current-weights-step=200000.pth [INFO] 2021-07-23 07:44:08 > Start Evaluation (200000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-23 08:47:09 > Generator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=G-current-weights-step=200000.pth [INFO] 2021-07-23 08:47:09 > Discriminator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=D-current-weights-step=200000.pth [INFO] 2021-07-23 08:47:12 > Start Evaluation (200000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-23 08:53:36 > Calculating FID Score.... [INFO] 2021-07-23 08:54:38 > Calculating Inception Score.... [INFO] 2021-07-23 08:55:35 > Calculate F_beta Score.... [INFO] 2021-07-23 08:58:00 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-23 08:58:01 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-23 08:58:02 > Calculate Accuracies.... [INFO] 2021-07-23 08:58:58 > Calculate Accuracies.... [INFO] 2021-07-23 08:59:47 > F_8 score (Step: 200000, Using valid images): 0.9892616153833466 [INFO] 2021-07-23 08:59:47 > F_1/8 score (Step: 200000, Using valid images): 0.9896107548282566 [INFO] 2021-07-23 08:59:47 > FID score (Step: 200000, Using valid moments): 8.209684472333379 [INFO] 2021-07-23 08:59:47 > Inception score (Step: 200000, 50000 generated images): 96.21745300292969 [INFO] 2021-07-23 08:59:47 > Best FID score (Step: 200000, Using valid moments): 8.209684472333379 [INFO] 2021-07-23 09:00:36 > Generator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=G-current-weights-step=200000.pth [INFO] 2021-07-23 09:00:36 > Discriminator checkpoint is ./checkpoints/CCMGAN2048-train-2021_06_22_06_11_37/model=D-current-weights-step=200000.pth [INFO] 2021-07-23 09:00:39 > Start Evaluation (200000 Step): CCMGAN2048-train-2021_06_22_06_11_37 [INFO] 2021-07-23 09:07:11 > Calculating FID Score.... [INFO] 2021-07-23 09:08:12 > Calculating Inception Score.... [INFO] 2021-07-23 09:09:08 > Calculate F_beta Score.... [INFO] 2021-07-23 09:11:35 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/pr_curve.png [INFO] 2021-07-23 09:11:36 > Save image to ./figures/CCMGAN2048-train-2021_06_22_06_11_37/sim_heatmap.png [INFO] 2021-07-23 09:11:37 > Calculate Accuracies.... [INFO] 2021-07-23 09:12:33 > Calculate Accuracies.... [INFO] 2021-07-23 09:13:22 > F_8 score (Step: 200000, Using valid images): 0.9892405615062726 [INFO] 2021-07-23 09:13:22 > F_1/8 score (Step: 200000, Using valid images): 0.988505944838483 [INFO] 2021-07-23 09:13:22 > FID score (Step: 200000, Using valid moments): 8.20614322505321 [INFO] 2021-07-23 09:13:22 > Inception score (Step: 200000, 50000 generated images): 96.29906463623047 [INFO] 2021-07-23 09:13:22 > Best FID score (Step: 200000, Using valid moments): 8.20614322505321