grep: warning: GREP_OPTIONS is deprecated; please use an alias or script
LAUNCH INFO 2022-09-28 13:05:28,358 -----------  Configuration  ----------------------
LAUNCH INFO 2022-09-28 13:05:28,358 devices: None
LAUNCH INFO 2022-09-28 13:05:28,358 elastic_level: -1
LAUNCH INFO 2022-09-28 13:05:28,358 elastic_timeout: 30
LAUNCH INFO 2022-09-28 13:05:28,358 gloo_port: 6767
LAUNCH INFO 2022-09-28 13:05:28,358 host: None
LAUNCH INFO 2022-09-28 13:05:28,358 job_id: default
LAUNCH INFO 2022-09-28 13:05:28,358 legacy: False
LAUNCH INFO 2022-09-28 13:05:28,358 log_dir: log
LAUNCH INFO 2022-09-28 13:05:28,358 log_level: INFO
LAUNCH INFO 2022-09-28 13:05:28,358 master: None
LAUNCH INFO 2022-09-28 13:05:28,358 max_restart: 3
LAUNCH INFO 2022-09-28 13:05:28,358 nnodes: 1
LAUNCH INFO 2022-09-28 13:05:28,358 nproc_per_node: None
LAUNCH INFO 2022-09-28 13:05:28,358 rank: -1
LAUNCH INFO 2022-09-28 13:05:28,358 run_mode: collective
LAUNCH INFO 2022-09-28 13:05:28,358 server_num: None
LAUNCH INFO 2022-09-28 13:05:28,359 servers: 
LAUNCH INFO 2022-09-28 13:05:28,359 trainer_num: None
LAUNCH INFO 2022-09-28 13:05:28,359 trainers: 
LAUNCH INFO 2022-09-28 13:05:28,359 training_script: tools/train.py
LAUNCH INFO 2022-09-28 13:05:28,359 training_script_args: ['--config', 'configs/iassd/iassd_kitti.yaml', '--save_interval', '1', '--resume', '--save_dir', 'outputs/iassd_v17']
LAUNCH INFO 2022-09-28 13:05:28,359 with_gloo: 0
LAUNCH INFO 2022-09-28 13:05:28,359 --------------------------------------------------
LAUNCH INFO 2022-09-28 13:05:28,371 Job: default, mode collective, replicas 1[1:1], elastic False
LAUNCH INFO 2022-09-28 13:05:28,373 Run Pod: qldepk, replicas 4, status ready
LAUNCH INFO 2022-09-28 13:05:28,410 Watching Pod: qldepk, replicas 4, status running
grep: warning: GREP_OPTIONS is deprecated; please use an alias or script
W0928 13:05:31.996887 32545 custom_operator.cc:698] Operator (nms_normal_gpu) has been registered.
W0928 13:05:31.996932 32545 custom_operator.cc:698] Operator (nms_gpu) has been registered.
W0928 13:05:31.996938 32545 custom_operator.cc:698] Operator (boxes_overlap_bev_gpu) has been registered.
W0928 13:05:31.996943 32545 custom_operator.cc:698] Operator (boxes_iou_bev_gpu) has been registered.
W0928 13:05:31.996948 32545 custom_operator.cc:698] Operator (boxes_iou_bev_cpu) has been registered.
W0928 13:05:32.012367 32545 custom_operator.cc:698] Operator (grid_sample_3d) has been registered.
W0928 13:05:32.012398 32545 custom_operator.cc:698] Operator (nms_normal_gpu) has been registered.
W0928 13:05:32.012404 32545 custom_operator.cc:698] Operator (nms_gpu) has been registered.
W0928 13:05:32.012409 32545 custom_operator.cc:698] Operator (boxes_overlap_bev_gpu) has been registered.
W0928 13:05:32.012414 32545 custom_operator.cc:698] Operator (boxes_iou_bev_gpu) has been registered.
W0928 13:05:32.012419 32545 custom_operator.cc:698] Operator (boxes_iou_bev_cpu) has been registered.
W0928 13:05:32.039530 32545 custom_operator.cc:698] Operator (centerpoint_postprocess) has been registered.
W0928 13:05:32.039561 32545 custom_operator.cc:698] Operator (grid_sample_3d) has been registered.
W0928 13:05:32.039566 32545 custom_operator.cc:698] Operator (nms_normal_gpu) has been registered.
W0928 13:05:32.039572 32545 custom_operator.cc:698] Operator (nms_gpu) has been registered.
W0928 13:05:32.039577 32545 custom_operator.cc:698] Operator (boxes_overlap_bev_gpu) has been registered.
W0928 13:05:32.039660 32545 custom_operator.cc:698] Operator (boxes_iou_bev_gpu) has been registered.
W0928 13:05:32.039667 32545 custom_operator.cc:698] Operator (boxes_iou_bev_cpu) has been registered.
2022-09-28 13:05:32,246 -     INFO - Load 2207 Pedestrian database infos
2022-09-28 13:05:32,246 -     INFO - Load 14357 Car database infos
2022-09-28 13:05:32,250 -     INFO - Load 734 Cyclist database infos
2022-09-28 13:05:32,250 -     INFO - After filtering min_num_points_in_box:
2022-09-28 13:05:32,250 -     INFO - Load 2161 Pedestrian database infos
2022-09-28 13:05:32,250 -     INFO - Load 13442 Car database infos
2022-09-28 13:05:32,250 -     INFO - Load 699 Cyclist database infos
2022-09-28 13:05:32,286 -     INFO - After filtering ignored difficulty:
2022-09-28 13:05:32,286 -     INFO - Load 2066 Pedestrian database infos
2022-09-28 13:05:32,286 -     INFO - Load 10520 Car database infos
2022-09-28 13:05:32,286 -     INFO - Load 580 Cyclist database infos
2022-09-28 13:05:32,694 -     INFO - 
------------Environment Information-------------
platform:
    Linux-4.14.0_1-0-0-41-x86_64-with-debian-stretch-sid
    gcc (GCC) 8.2.0
    Python - 3.6.13 |Anaconda, Inc.| (default, Jun  4 2021, 14:25:59)  [GCC 7.5.0]

Science Toolkits:
    cv2 - 4.6.0
    numpy - 1.19.2
    numba - 0.53.1
    pandas - 1.1.5
    pillow - 8.3.2
    skimage - 0.17.2

PaddlePaddle:
    paddle(gpu) - 2.3.1
    paddle3d - 0.5.0
    paddleseg - 2.5.0
    FLAGS_cudnn_deterministic - Not set.
    FLAGS_cudnn_exhaustive_search - Not set.

CUDA:
    cudnn - 7605
    nvcc - Cuda compilation tools, release 10.2, V10.2.89

GPUs:
    GPU 0: Tesla V100-SXM2-16GB
    GPU 1: Tesla V100-SXM2-16GB
    GPU 4: Tesla V100-SXM2-16GB
    GPU 5: Tesla V100-SXM2-16GB
------------------------------------------------
2022-09-28 13:05:32,713 -     INFO - 
---------------Config Information---------------
batch_size: 8
epochs: 80
lr_scheduler:
  div_factor: 10
  lr_max: 0.01
  moms:
  - 0.95
  - 0.85
  pct_start: 0.4
  total_step: 9280
  type: OneCycle
model:
  backbone:
    aggregation_mlps:
    - - 64
    - - 128
    - - 256
    - - 256
    - []
    - - 512
    confidence_mlps:
    - []
    - - 128
    - - 256
    - []
    - []
    - []
    ctr_index:
    - -1
    - -1
    - -1
    - -1
    - -1
    - 5
    dilated_group:
    - false
    - false
    - false
    - false
    - false
    - false
    input_channel: 4
    layer_input:
    - 0
    - 1
    - 2
    - 3
    - 4
    - 3
    layer_types:
    - SA_Layer
    - SA_Layer
    - SA_Layer
    - SA_Layer
    - Vote_Layer
    - SA_Layer
    max_translate_range:
    - 3.0
    - 3.0
    - 2.0
    mlps:
    - - - 16
        - 16
        - 32
      - - 32
        - 32
        - 64
    - - - 64
        - 64
        - 128
      - - 64
        - 96
        - 128
    - - - 128
        - 128
        - 256
      - - 128
        - 256
        - 256
    - []
    - - 128
    - - - 256
        - 256
        - 512
      - - 256
        - 512
        - 1024
    npoint_list:
    - 4096
    - 1024
    - 512
    - 256
    - null
    - 256
    nsample_list:
    - - 16
      - 32
    - - 16
      - 32
    - - 16
      - 32
    - []
    - []
    - - 16
      - 32
    num_classes: 3
    radius_list:
    - - 0.2
      - 0.8
    - - 0.8
      - 1.6
    - - 1.6
      - 4.8
    - []
    - []
    - - 4.8
      - 6.4
    sample_method_list: &id001
    - D-FPS
    - D-FPS
    - ctr_aware
    - ctr_aware
    - null
    - null
    type: IASSD_Backbone
  head:
    cls_fc:
    - 256
    - 256
    input_channel: 512
    loss_config:
      centerness_regularization: true
      centerness_regularization_sa: true
      corner_loss_regularization: true
      loss_cls: WeightedClassificationLoss
      loss_ins: WeightedClassificationLoss
      loss_reg: WeightedSmoothL1Loss
      loss_weight:
        code_weights:
        - 1.0
        - 1.0
        - 1.0
        - 1.0
        - 1.0
        - 1.0
        corner_weight: 1.0
        dir_weight: 0.2
        ins_aware_weight:
        - 0
        - 1.0
        - 1.0
        point_box_weight: 1.0
        point_cls_weight: 1.0
        vote_weight: 1.0
      sample_method_list: *id001
    num_classes: 3
    reg_fc:
    - 256
    - 256
    target_config:
      box_coder_config:
        angle_bin_num: 12
        mean_size:
        - - 3.9
          - 1.6
          - 1.56
        - - 0.8
          - 0.6
          - 1.73
        - - 1.76
          - 0.6
          - 1.73
        use_mean_size: true
      extra_width:
      - 1.0
      - 1.0
      - 1.0
      gt_extra_width:
      - 0.2
      - 0.2
      - 0.2
    type: IASSD_Head
  post_process_cfg:
    nms_config:
      nms_post_maxsize: 500
      nms_pre_maxsize: 4096
      nms_thresh: 0.01
    score_thresh: 0.1
  type: IASSD
optimizer:
  beta1: 0.9
  beta2: 0.99
  clip_grad_by_norm: 10.0
  learning_rate: 0.01
  type: AdamWOnecycle
  weight_decay: 0.01
train_dataset:
  class_names:
  - Car
  - Pedestrian
  - Cyclist
  dataset_root: datasets/KITTI
  mode: train
  transforms:
  - dim: 4
    type: LoadPointCloud
    use_dim: 4
  - type: RemoveCameraInvisiblePointsKITTIV2
  - class_names:
    - Car
    - Pedestrian
    - Cyclist
    database_anno_path: datasets/KITTI/kitti_train_gt_database/anno_info_train.pkl
    database_root: datasets/KITTI
    ignored_difficulty:
    - -1
    max_num_samples_per_class:
      Car: 20
      Cyclist: 15
      Pedestrian: 15
    min_num_points_in_box_per_class:
      Car: 5
      Cyclist: 5
      Pedestrian: 5
    type: SamplingDatabase
  - type: RandomVerticalFlip
  - max_rot: 0.78539816
    min_rot: -0.78539816
    type: GlobalRotate
  - max_scale: 1.05
    min_scale: 0.95
    type: GlobalScale
  - point_cloud_range:
    - 0
    - -40
    - -3
    - 70.4
    - 40
    - 1
    type: FilterBBoxOutsideRange
  - point_cloud_range:
    - 0
    - -40
    - -3
    - 70.4
    - 40
    - 1
    type: FilterPointsOutsideRange
  - num_points: 16384
    type: SamplePoint
  - type: ShufflePoint
  - type: ConvertBoxFormat
  type: KittiPCDataset
  use_road_plane: true
val_dataset:
  class_names:
  - Car
  - Pedestrian
  - Cyclist
  dataset_root: datasets/KITTI
  mode: val
  transforms:
  - dim: 4
    type: LoadPointCloud
    use_dim: 4
  - type: RemoveCameraInvisiblePointsKITTIV2
  - point_cloud_range:
    - 0
    - -40
    - -3
    - 70.4
    - 40
    - 1
    type: FilterPointsOutsideRange
  - num_points: 16384
    type: SamplePoint
  type: KittiPCDataset
------------------------------------------------
W0928 13:05:32.717221 32545 gpu_resources.cc:61] Please NOTE: device: 0, GPU Compute Capability: 7.0, Driver API Version: 11.2, Runtime API Version: 10.2
W0928 13:05:32.717267 32545 gpu_resources.cc:91] device: 0, cuDNN Version: 7.6.
2022-09-28 13:05:34,992 -  WARNING - Attempt to restore parameters from an empty checkpoint
server not ready, wait 3 sec to retry...
not ready endpoints:['10.255.125.21:57138']
I0928 13:05:38.008255 32545 nccl_context.cc:83] init nccl context nranks: 4 local rank: 0 gpu id: 0 ring id: 0
2022-09-28 13:05:44,752 -  WARNING - No custom op pointnet2_ops found, try JIT build
Python 3.6.13 :: Anaconda, Inc.
Compiling user custom op, it will cost a few seconds.....
grep: warning: GREP_OPTIONS is deprecated; please use an alias or script
W0928 13:05:47.115602 32545 custom_operator.cc:698] Operator (centerpoint_postprocess) has been registered.
W0928 13:05:47.115658 32545 custom_operator.cc:698] Operator (grid_sample_3d) has been registered.
W0928 13:05:47.115672 32545 custom_operator.cc:698] Operator (nms_normal_gpu) has been registered.
W0928 13:05:47.115684 32545 custom_operator.cc:698] Operator (nms_gpu) has been registered.
W0928 13:05:47.115697 32545 custom_operator.cc:698] Operator (boxes_overlap_bev_gpu) has been registered.
W0928 13:05:47.115707 32545 custom_operator.cc:698] Operator (hard_voxelize) has been registered.
W0928 13:05:47.115722 32545 custom_operator.cc:698] Operator (boxes_iou_bev_gpu) has been registered.
W0928 13:05:47.115736 32545 custom_operator.cc:698] Operator (boxes_iou_bev_cpu) has been registered.
2022-09-28 13:05:47,152 -     INFO - pointnet2_ops builded success!
/workspace/dependency/anaconda3/envs/paddle3d/lib/python3.6/site-packages/paddle/nn/layer/norm.py:654: UserWarning: When training, we now always track global mean and variance.
  "When training, we now always track global mean and variance.")
2022-09-28 13:06:05,644 -     INFO - [TRAIN] epoch=1/80, iter=10/9280, loss=7.535858, lr=0.001000 | ETA 02:09:53
2022-09-28 13:06:14,032 -     INFO - [TRAIN] epoch=1/80, iter=20/9280, loss=3.896413, lr=0.001001 | ETA 02:05:32
2022-09-28 13:06:22,184 -     INFO - [TRAIN] epoch=1/80, iter=30/9280, loss=3.207487, lr=0.001001 | ETA 02:08:16
2022-09-28 13:06:30,368 -     INFO - [TRAIN] epoch=1/80, iter=40/9280, loss=2.917337, lr=0.001002 | ETA 02:06:10
2022-09-28 13:06:38,575 -     INFO - [TRAIN] epoch=1/80, iter=50/9280, loss=2.769599, lr=0.001004 | ETA 02:04:10
2022-09-28 13:06:46,943 -     INFO - [TRAIN] epoch=1/80, iter=60/9280, loss=2.665681, lr=0.001006 | ETA 02:14:37
2022-09-28 13:06:55,527 -     INFO - [TRAIN] epoch=1/80, iter=70/9280, loss=2.533807, lr=0.001008 | ETA 02:05:26
2022-09-28 13:07:03,862 -     INFO - [TRAIN] epoch=1/80, iter=80/9280, loss=2.476595, lr=0.001010 | ETA 02:05:32
2022-09-28 13:07:16,072 -     INFO - [TRAIN] epoch=1/80, iter=90/9280, loss=2.428738, lr=0.001013 | ETA 04:04:45
2022-09-28 13:07:32,379 -     INFO - [TRAIN] epoch=1/80, iter=100/9280, loss=2.341649, lr=0.001016 | ETA 04:09:54
2022-09-28 13:07:49,084 -     INFO - [TRAIN] epoch=1/80, iter=110/9280, loss=2.325075, lr=0.001019 | ETA 04:20:06
2022-09-28 13:07:59,344 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_1
2022-09-28 13:08:11,923 -     INFO - [TRAIN] epoch=2/80, iter=120/9280, loss=2.273679, lr=0.001023 | ETA 05:08:28
2022-09-28 13:08:24,620 -     INFO - [TRAIN] epoch=2/80, iter=130/9280, loss=2.275899, lr=0.001027 | ETA 02:13:35
2022-09-28 13:08:32,978 -     INFO - [TRAIN] epoch=2/80, iter=140/9280, loss=2.135127, lr=0.001031 | ETA 02:08:24
2022-09-28 13:08:41,503 -     INFO - [TRAIN] epoch=2/80, iter=150/9280, loss=2.067654, lr=0.001036 | ETA 02:08:08
2022-09-28 13:08:50,000 -     INFO - [TRAIN] epoch=2/80, iter=160/9280, loss=1.998865, lr=0.001041 | ETA 02:11:21
2022-09-28 13:08:58,408 -     INFO - [TRAIN] epoch=2/80, iter=170/9280, loss=1.982072, lr=0.001046 | ETA 02:09:22
2022-09-28 13:09:06,655 -     INFO - [TRAIN] epoch=2/80, iter=180/9280, loss=1.868630, lr=0.001052 | ETA 02:04:07
2022-09-28 13:09:15,007 -     INFO - [TRAIN] epoch=2/80, iter=190/9280, loss=1.904788, lr=0.001057 | ETA 02:02:48
2022-09-28 13:09:23,560 -     INFO - [TRAIN] epoch=2/80, iter=200/9280, loss=1.764109, lr=0.001064 | ETA 02:14:25
2022-09-28 13:09:31,806 -     INFO - [TRAIN] epoch=2/80, iter=210/9280, loss=1.716554, lr=0.001070 | ETA 02:07:21
2022-09-28 13:09:43,024 -     INFO - [TRAIN] epoch=2/80, iter=220/9280, loss=1.652753, lr=0.001077 | ETA 04:01:31
2022-09-28 13:09:59,601 -     INFO - [TRAIN] epoch=2/80, iter=230/9280, loss=1.642350, lr=0.001084 | ETA 04:09:21
2022-09-28 13:10:03,045 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_2
2022-09-28 13:10:22,387 -     INFO - [TRAIN] epoch=3/80, iter=240/9280, loss=1.610760, lr=0.001092 | ETA 04:09:59
2022-09-28 13:10:38,691 -     INFO - [TRAIN] epoch=3/80, iter=250/9280, loss=1.577772, lr=0.001100 | ETA 04:05:22
2022-09-28 13:10:52,593 -     INFO - [TRAIN] epoch=3/80, iter=260/9280, loss=1.511978, lr=0.001108 | ETA 02:16:15
2022-09-28 13:11:01,047 -     INFO - [TRAIN] epoch=3/80, iter=270/9280, loss=1.479034, lr=0.001116 | ETA 02:10:24
2022-09-28 13:11:09,413 -     INFO - [TRAIN] epoch=3/80, iter=280/9280, loss=1.445870, lr=0.001125 | ETA 02:04:19
2022-09-28 13:11:17,670 -     INFO - [TRAIN] epoch=3/80, iter=290/9280, loss=1.371512, lr=0.001134 | ETA 02:06:20
2022-09-28 13:11:25,997 -     INFO - [TRAIN] epoch=3/80, iter=300/9280, loss=1.332426, lr=0.001143 | ETA 02:01:24
2022-09-28 13:11:34,298 -     INFO - [TRAIN] epoch=3/80, iter=310/9280, loss=1.303703, lr=0.001153 | ETA 02:05:31
2022-09-28 13:11:42,542 -     INFO - [TRAIN] epoch=3/80, iter=320/9280, loss=1.315964, lr=0.001163 | ETA 02:04:43
2022-09-28 13:11:50,672 -     INFO - [TRAIN] epoch=3/80, iter=330/9280, loss=1.310012, lr=0.001173 | ETA 02:00:29
2022-09-28 13:11:59,261 -     INFO - [TRAIN] epoch=3/80, iter=340/9280, loss=1.294896, lr=0.001184 | ETA 02:02:07
2022-09-28 13:12:06,051 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_3
2022-09-28 13:12:13,867 -     INFO - [TRAIN] epoch=4/80, iter=350/9280, loss=1.245068, lr=0.001195 | ETA 05:56:36
2022-09-28 13:12:22,161 -     INFO - [TRAIN] epoch=4/80, iter=360/9280, loss=1.215106, lr=0.001206 | ETA 02:01:16
2022-09-28 13:12:30,577 -     INFO - [TRAIN] epoch=4/80, iter=370/9280, loss=1.207589, lr=0.001218 | ETA 02:11:16
2022-09-28 13:12:39,068 -     INFO - [TRAIN] epoch=4/80, iter=380/9280, loss=1.178198, lr=0.001230 | ETA 02:01:58
2022-09-28 13:12:47,283 -     INFO - [TRAIN] epoch=4/80, iter=390/9280, loss=1.209461, lr=0.001242 | ETA 02:01:05
2022-09-28 13:12:55,522 -     INFO - [TRAIN] epoch=4/80, iter=400/9280, loss=1.198926, lr=0.001254 | ETA 02:01:02
2022-09-28 13:13:03,995 -     INFO - [TRAIN] epoch=4/80, iter=410/9280, loss=1.181021, lr=0.001267 | ETA 02:04:48
2022-09-28 13:13:12,371 -     INFO - [TRAIN] epoch=4/80, iter=420/9280, loss=1.175312, lr=0.001280 | ETA 02:00:09
2022-09-28 13:13:20,984 -     INFO - [TRAIN] epoch=4/80, iter=430/9280, loss=1.124807, lr=0.001293 | ETA 02:07:59
2022-09-28 13:13:29,239 -     INFO - [TRAIN] epoch=4/80, iter=440/9280, loss=1.144619, lr=0.001307 | ETA 02:02:22
2022-09-28 13:13:37,665 -     INFO - [TRAIN] epoch=4/80, iter=450/9280, loss=1.126702, lr=0.001321 | ETA 02:00:36
2022-09-28 13:13:46,310 -     INFO - [TRAIN] epoch=4/80, iter=460/9280, loss=1.148268, lr=0.001335 | ETA 02:13:12
2022-09-28 13:13:50,066 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_4
2022-09-28 13:14:01,477 -     INFO - [TRAIN] epoch=5/80, iter=470/9280, loss=1.093322, lr=0.001350 | ETA 02:15:45
2022-09-28 13:14:10,166 -     INFO - [TRAIN] epoch=5/80, iter=480/9280, loss=1.114813, lr=0.001365 | ETA 02:13:11
2022-09-28 13:14:18,902 -     INFO - [TRAIN] epoch=5/80, iter=490/9280, loss=1.148118, lr=0.001380 | ETA 02:05:36
2022-09-28 13:14:27,628 -     INFO - [TRAIN] epoch=5/80, iter=500/9280, loss=1.099784, lr=0.001395 | ETA 02:06:03
2022-09-28 13:14:35,945 -     INFO - [TRAIN] epoch=5/80, iter=510/9280, loss=1.067455, lr=0.001411 | ETA 02:05:07
2022-09-28 13:14:44,182 -     INFO - [TRAIN] epoch=5/80, iter=520/9280, loss=1.079800, lr=0.001427 | ETA 01:58:23
2022-09-28 13:14:52,580 -     INFO - [TRAIN] epoch=5/80, iter=530/9280, loss=1.111170, lr=0.001444 | ETA 02:05:00
2022-09-28 13:15:01,025 -     INFO - [TRAIN] epoch=5/80, iter=540/9280, loss=1.081363, lr=0.001460 | ETA 02:04:57
2022-09-28 13:15:09,618 -     INFO - [TRAIN] epoch=5/80, iter=550/9280, loss=1.025913, lr=0.001477 | ETA 02:07:15
2022-09-28 13:15:17,769 -     INFO - [TRAIN] epoch=5/80, iter=560/9280, loss=1.036566, lr=0.001494 | ETA 02:00:07
2022-09-28 13:15:25,976 -     INFO - [TRAIN] epoch=5/80, iter=570/9280, loss=1.056338, lr=0.001512 | ETA 01:59:56
2022-09-28 13:15:34,153 -     INFO - [TRAIN] epoch=5/80, iter=580/9280, loss=1.036433, lr=0.001530 | ETA 01:57:55
2022-09-28 13:15:34,296 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_5
2022-09-28 13:15:48,477 -     INFO - [TRAIN] epoch=6/80, iter=590/9280, loss=1.068719, lr=0.001548 | ETA 01:58:00
2022-09-28 13:15:56,704 -     INFO - [TRAIN] epoch=6/80, iter=600/9280, loss=1.044390, lr=0.001566 | ETA 02:00:23
2022-09-28 13:16:05,047 -     INFO - [TRAIN] epoch=6/80, iter=610/9280, loss=1.068686, lr=0.001585 | ETA 01:58:41
2022-09-28 13:16:13,456 -     INFO - [TRAIN] epoch=6/80, iter=620/9280, loss=1.025780, lr=0.001604 | ETA 01:59:28
2022-09-28 13:16:21,728 -     INFO - [TRAIN] epoch=6/80, iter=630/9280, loss=1.051596, lr=0.001623 | ETA 01:58:07
2022-09-28 13:16:29,958 -     INFO - [TRAIN] epoch=6/80, iter=640/9280, loss=0.997729, lr=0.001642 | ETA 01:59:51
2022-09-28 13:16:38,178 -     INFO - [TRAIN] epoch=6/80, iter=650/9280, loss=0.987508, lr=0.001662 | ETA 01:56:02
2022-09-28 13:16:46,910 -     INFO - [TRAIN] epoch=6/80, iter=660/9280, loss=0.985233, lr=0.001682 | ETA 02:07:14
2022-09-28 13:16:55,217 -     INFO - [TRAIN] epoch=6/80, iter=670/9280, loss=0.998365, lr=0.001702 | ETA 02:03:55
2022-09-28 13:17:03,341 -     INFO - [TRAIN] epoch=6/80, iter=680/9280, loss=0.968280, lr=0.001723 | ETA 01:58:01
2022-09-28 13:17:11,596 -     INFO - [TRAIN] epoch=6/80, iter=690/9280, loss=0.997382, lr=0.001744 | ETA 01:59:04
2022-09-28 13:17:16,488 -     INFO - Pop model from outputs/iassd_v17/epoch_1
2022-09-28 13:17:16,625 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_6
2022-09-28 13:17:25,941 -     INFO - [TRAIN] epoch=7/80, iter=700/9280, loss=0.985541, lr=0.001765 | ETA 02:49:41
2022-09-28 13:17:34,533 -     INFO - [TRAIN] epoch=7/80, iter=710/9280, loss=0.981434, lr=0.001786 | ETA 02:02:22
2022-09-28 13:17:43,024 -     INFO - [TRAIN] epoch=7/80, iter=720/9280, loss=0.985025, lr=0.001808 | ETA 01:57:23
2022-09-28 13:17:51,411 -     INFO - [TRAIN] epoch=7/80, iter=730/9280, loss=1.003489, lr=0.001830 | ETA 01:59:02
2022-09-28 13:18:00,063 -     INFO - [TRAIN] epoch=7/80, iter=740/9280, loss=0.988961, lr=0.001852 | ETA 02:03:38
2022-09-28 13:18:08,381 -     INFO - [TRAIN] epoch=7/80, iter=750/9280, loss=0.972037, lr=0.001874 | ETA 01:57:50
2022-09-28 13:18:16,786 -     INFO - [TRAIN] epoch=7/80, iter=760/9280, loss=0.967005, lr=0.001897 | ETA 01:59:33
2022-09-28 13:18:25,486 -     INFO - [TRAIN] epoch=7/80, iter=770/9280, loss=0.962661, lr=0.001920 | ETA 02:04:50
2022-09-28 13:18:33,899 -     INFO - [TRAIN] epoch=7/80, iter=780/9280, loss=0.936271, lr=0.001943 | ETA 02:00:58
2022-09-28 13:18:42,168 -     INFO - [TRAIN] epoch=7/80, iter=790/9280, loss=0.962325, lr=0.001967 | ETA 01:53:39
2022-09-28 13:18:50,627 -     INFO - [TRAIN] epoch=7/80, iter=800/9280, loss=0.949881, lr=0.001990 | ETA 02:00:04
2022-09-28 13:18:59,424 -     INFO - [TRAIN] epoch=7/80, iter=810/9280, loss=0.985865, lr=0.002014 | ETA 02:06:46
2022-09-28 13:19:01,128 -     INFO - Pop model from outputs/iassd_v17/epoch_2
2022-09-28 13:19:01,271 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_7
2022-09-28 13:19:14,028 -     INFO - [TRAIN] epoch=8/80, iter=820/9280, loss=0.998737, lr=0.002038 | ETA 02:02:40
2022-09-28 13:19:22,273 -     INFO - [TRAIN] epoch=8/80, iter=830/9280, loss=0.957534, lr=0.002063 | ETA 02:00:46
2022-09-28 13:19:30,901 -     INFO - [TRAIN] epoch=8/80, iter=840/9280, loss=0.978322, lr=0.002088 | ETA 01:59:16
2022-09-28 13:19:39,046 -     INFO - [TRAIN] epoch=8/80, iter=850/9280, loss=0.981489, lr=0.002113 | ETA 01:56:07
2022-09-28 13:19:47,373 -     INFO - [TRAIN] epoch=8/80, iter=860/9280, loss=0.945587, lr=0.002138 | ETA 01:57:21
2022-09-28 13:19:55,581 -     INFO - [TRAIN] epoch=8/80, iter=870/9280, loss=0.921693, lr=0.002163 | ETA 01:55:16
2022-09-28 13:20:03,914 -     INFO - [TRAIN] epoch=8/80, iter=880/9280, loss=0.975071, lr=0.002189 | ETA 02:00:47
2022-09-28 13:20:12,037 -     INFO - [TRAIN] epoch=8/80, iter=890/9280, loss=0.906732, lr=0.002215 | ETA 01:56:08
2022-09-28 13:20:20,298 -     INFO - [TRAIN] epoch=8/80, iter=900/9280, loss=0.928346, lr=0.002241 | ETA 02:00:15
2022-09-28 13:20:28,674 -     INFO - [TRAIN] epoch=8/80, iter=910/9280, loss=0.919780, lr=0.002267 | ETA 01:52:24
2022-09-28 13:20:36,896 -     INFO - [TRAIN] epoch=8/80, iter=920/9280, loss=0.911619, lr=0.002294 | ETA 01:55:06
2022-09-28 13:20:44,021 -     INFO - Pop model from outputs/iassd_v17/epoch_3
2022-09-28 13:20:44,159 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_8
2022-09-28 13:20:51,783 -     INFO - [TRAIN] epoch=9/80, iter=930/9280, loss=0.943416, lr=0.002321 | ETA 05:30:22
2022-09-28 13:21:00,240 -     INFO - [TRAIN] epoch=9/80, iter=940/9280, loss=0.903004, lr=0.002348 | ETA 02:01:35
2022-09-28 13:21:08,642 -     INFO - [TRAIN] epoch=9/80, iter=950/9280, loss=0.909714, lr=0.002375 | ETA 01:54:12
2022-09-28 13:21:17,091 -     INFO - [TRAIN] epoch=9/80, iter=960/9280, loss=0.919942, lr=0.002403 | ETA 01:56:42
2022-09-28 13:21:25,434 -     INFO - [TRAIN] epoch=9/80, iter=970/9280, loss=0.930323, lr=0.002430 | ETA 01:52:06
2022-09-28 13:21:33,691 -     INFO - [TRAIN] epoch=9/80, iter=980/9280, loss=0.899068, lr=0.002458 | ETA 01:57:28
2022-09-28 13:21:42,380 -     INFO - [TRAIN] epoch=9/80, iter=990/9280, loss=0.906355, lr=0.002486 | ETA 01:57:27
2022-09-28 13:21:50,756 -     INFO - [TRAIN] epoch=9/80, iter=1000/9280, loss=0.906094, lr=0.002515 | ETA 01:55:17
2022-09-28 13:21:59,175 -     INFO - [TRAIN] epoch=9/80, iter=1010/9280, loss=0.908068, lr=0.002543 | ETA 01:56:58
2022-09-28 13:22:07,732 -     INFO - [TRAIN] epoch=9/80, iter=1020/9280, loss=0.907126, lr=0.002572 | ETA 01:54:43
2022-09-28 13:22:16,140 -     INFO - [TRAIN] epoch=9/80, iter=1030/9280, loss=0.925415, lr=0.002601 | ETA 01:54:25
2022-09-28 13:22:24,540 -     INFO - [TRAIN] epoch=9/80, iter=1040/9280, loss=0.906839, lr=0.002631 | ETA 01:55:20
2022-09-28 13:22:27,907 -     INFO - Pop model from outputs/iassd_v17/epoch_4
2022-09-28 13:22:28,055 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_9
2022-09-28 13:22:39,073 -     INFO - [TRAIN] epoch=10/80, iter=1050/9280, loss=0.925759, lr=0.002660 | ETA 02:12:09
2022-09-28 13:22:47,664 -     INFO - [TRAIN] epoch=10/80, iter=1060/9280, loss=0.889758, lr=0.002690 | ETA 01:54:31
2022-09-28 13:22:56,277 -     INFO - [TRAIN] epoch=10/80, iter=1070/9280, loss=0.936537, lr=0.002719 | ETA 01:57:44
2022-09-28 13:23:04,947 -     INFO - [TRAIN] epoch=10/80, iter=1080/9280, loss=0.913612, lr=0.002750 | ETA 01:56:34
2022-09-28 13:23:13,413 -     INFO - [TRAIN] epoch=10/80, iter=1090/9280, loss=0.900186, lr=0.002780 | ETA 01:53:26
2022-09-28 13:23:21,880 -     INFO - [TRAIN] epoch=10/80, iter=1100/9280, loss=0.866604, lr=0.002810 | ETA 01:57:08
2022-09-28 13:23:30,259 -     INFO - [TRAIN] epoch=10/80, iter=1110/9280, loss=0.895158, lr=0.002841 | ETA 01:53:04
2022-09-28 13:23:38,585 -     INFO - [TRAIN] epoch=10/80, iter=1120/9280, loss=0.896303, lr=0.002872 | ETA 01:51:57
2022-09-28 13:23:46,948 -     INFO - [TRAIN] epoch=10/80, iter=1130/9280, loss=0.904736, lr=0.002903 | ETA 01:52:34
2022-09-28 13:23:55,350 -     INFO - [TRAIN] epoch=10/80, iter=1140/9280, loss=0.894419, lr=0.002934 | ETA 01:53:02
2022-09-28 13:24:03,829 -     INFO - [TRAIN] epoch=10/80, iter=1150/9280, loss=0.931375, lr=0.002965 | ETA 01:56:24
2022-09-28 13:24:12,260 -     INFO - [TRAIN] epoch=10/80, iter=1160/9280, loss=0.932314, lr=0.002997 | ETA 01:51:07
2022-09-28 13:24:12,278 -     INFO - Pop model from outputs/iassd_v17/epoch_5
2022-09-28 13:24:12,446 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_10
2022-09-28 13:24:27,135 -     INFO - [TRAIN] epoch=11/80, iter=1170/9280, loss=0.915187, lr=0.003029 | ETA 01:55:21
2022-09-28 13:24:35,666 -     INFO - [TRAIN] epoch=11/80, iter=1180/9280, loss=0.888940, lr=0.003060 | ETA 01:51:33
2022-09-28 13:24:44,000 -     INFO - [TRAIN] epoch=11/80, iter=1190/9280, loss=0.927753, lr=0.003093 | ETA 01:52:16
2022-09-28 13:24:52,314 -     INFO - [TRAIN] epoch=11/80, iter=1200/9280, loss=0.903373, lr=0.003125 | ETA 01:53:25
2022-09-28 13:25:00,685 -     INFO - [TRAIN] epoch=11/80, iter=1210/9280, loss=0.872004, lr=0.003157 | ETA 01:56:21
2022-09-28 13:25:09,393 -     INFO - [TRAIN] epoch=11/80, iter=1220/9280, loss=0.876472, lr=0.003190 | ETA 02:00:07
2022-09-28 13:25:18,077 -     INFO - [TRAIN] epoch=11/80, iter=1230/9280, loss=0.863201, lr=0.003223 | ETA 01:50:17
2022-09-28 13:25:26,482 -     INFO - [TRAIN] epoch=11/80, iter=1240/9280, loss=0.874418, lr=0.003255 | ETA 01:53:42
2022-09-28 13:25:34,686 -     INFO - [TRAIN] epoch=11/80, iter=1250/9280, loss=0.846592, lr=0.003289 | ETA 01:51:18
2022-09-28 13:25:43,075 -     INFO - [TRAIN] epoch=11/80, iter=1260/9280, loss=0.838685, lr=0.003322 | ETA 01:50:36
2022-09-28 13:25:51,475 -     INFO - [TRAIN] epoch=11/80, iter=1270/9280, loss=0.847513, lr=0.003355 | ETA 01:53:17
2022-09-28 13:25:56,530 -     INFO - Pop model from outputs/iassd_v17/epoch_6
2022-09-28 13:25:56,670 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_11
2022-09-28 13:26:05,846 -     INFO - [TRAIN] epoch=12/80, iter=1280/9280, loss=0.863194, lr=0.003389 | ETA 02:40:46
2022-09-28 13:26:14,288 -     INFO - [TRAIN] epoch=12/80, iter=1290/9280, loss=0.882049, lr=0.003423 | ETA 01:54:01
2022-09-28 13:26:22,956 -     INFO - [TRAIN] epoch=12/80, iter=1300/9280, loss=0.883029, lr=0.003456 | ETA 01:51:35
2022-09-28 13:26:31,332 -     INFO - [TRAIN] epoch=12/80, iter=1310/9280, loss=0.914736, lr=0.003490 | ETA 01:53:04
2022-09-28 13:26:39,788 -     INFO - [TRAIN] epoch=12/80, iter=1320/9280, loss=0.934388, lr=0.003525 | ETA 01:51:46
2022-09-28 13:26:48,840 -     INFO - [TRAIN] epoch=12/80, iter=1330/9280, loss=0.899549, lr=0.003559 | ETA 02:06:14
2022-09-28 13:26:57,428 -     INFO - [TRAIN] epoch=12/80, iter=1340/9280, loss=0.873017, lr=0.003593 | ETA 01:51:48
2022-09-28 13:27:05,946 -     INFO - [TRAIN] epoch=12/80, iter=1350/9280, loss=0.875321, lr=0.003628 | ETA 01:50:35
2022-09-28 13:27:14,994 -     INFO - [TRAIN] epoch=12/80, iter=1360/9280, loss=0.959023, lr=0.003662 | ETA 02:01:42
2022-09-28 13:27:23,998 -     INFO - [TRAIN] epoch=12/80, iter=1370/9280, loss=0.982029, lr=0.003697 | ETA 01:51:05
2022-09-28 13:27:32,471 -     INFO - [TRAIN] epoch=12/80, iter=1380/9280, loss=0.926863, lr=0.003732 | ETA 01:50:36
2022-09-28 13:27:41,220 -     INFO - [TRAIN] epoch=12/80, iter=1390/9280, loss=0.933219, lr=0.003767 | ETA 01:50:42
2022-09-28 13:27:42,872 -     INFO - Pop model from outputs/iassd_v17/epoch_7
2022-09-28 13:27:43,015 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_12
2022-09-28 13:27:56,154 -     INFO - [TRAIN] epoch=13/80, iter=1400/9280, loss=0.917411, lr=0.003803 | ETA 01:58:06
2022-09-28 13:28:04,920 -     INFO - [TRAIN] epoch=13/80, iter=1410/9280, loss=0.866123, lr=0.003838 | ETA 01:48:57
2022-09-28 13:28:13,322 -     INFO - [TRAIN] epoch=13/80, iter=1420/9280, loss=0.894255, lr=0.003873 | ETA 01:50:43
2022-09-28 13:28:21,998 -     INFO - [TRAIN] epoch=13/80, iter=1430/9280, loss=0.857776, lr=0.003909 | ETA 01:53:45
2022-09-28 13:28:30,525 -     INFO - [TRAIN] epoch=13/80, iter=1440/9280, loss=0.857069, lr=0.003945 | ETA 01:50:56
2022-09-28 13:28:38,946 -     INFO - [TRAIN] epoch=13/80, iter=1450/9280, loss=0.821928, lr=0.003980 | ETA 01:54:29
2022-09-28 13:28:47,556 -     INFO - [TRAIN] epoch=13/80, iter=1460/9280, loss=0.835391, lr=0.004016 | ETA 01:54:01
2022-09-28 13:28:55,981 -     INFO - [TRAIN] epoch=13/80, iter=1470/9280, loss=0.822648, lr=0.004052 | ETA 01:49:46
2022-09-28 13:29:04,499 -     INFO - [TRAIN] epoch=13/80, iter=1480/9280, loss=0.824813, lr=0.004088 | ETA 01:52:10
2022-09-28 13:29:12,940 -     INFO - [TRAIN] epoch=13/80, iter=1490/9280, loss=0.839266, lr=0.004125 | ETA 01:48:20
2022-09-28 13:29:21,702 -     INFO - [TRAIN] epoch=13/80, iter=1500/9280, loss=0.869960, lr=0.004161 | ETA 02:04:10
2022-09-28 13:29:29,380 -     INFO - Pop model from outputs/iassd_v17/epoch_8
2022-09-28 13:29:29,526 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_13
2022-09-28 13:29:37,096 -     INFO - [TRAIN] epoch=14/80, iter=1510/9280, loss=0.886462, lr=0.004197 | ETA 05:10:47
2022-09-28 13:29:45,412 -     INFO - [TRAIN] epoch=14/80, iter=1520/9280, loss=0.920494, lr=0.004234 | ETA 01:51:18
2022-09-28 13:29:54,102 -     INFO - [TRAIN] epoch=14/80, iter=1530/9280, loss=0.955086, lr=0.004270 | ETA 01:52:31
2022-09-28 13:30:03,187 -     INFO - [TRAIN] epoch=14/80, iter=1540/9280, loss=0.929081, lr=0.004307 | ETA 01:52:24
2022-09-28 13:30:11,623 -     INFO - [TRAIN] epoch=14/80, iter=1550/9280, loss=0.964529, lr=0.004344 | ETA 01:47:21
2022-09-28 13:30:19,939 -     INFO - [TRAIN] epoch=14/80, iter=1560/9280, loss=0.959943, lr=0.004381 | ETA 01:45:06
2022-09-28 13:30:28,230 -     INFO - [TRAIN] epoch=14/80, iter=1570/9280, loss=0.905879, lr=0.004418 | ETA 01:47:11
2022-09-28 13:30:36,692 -     INFO - [TRAIN] epoch=14/80, iter=1580/9280, loss=0.936912, lr=0.004455 | ETA 01:51:29
2022-09-28 13:30:45,452 -     INFO - [TRAIN] epoch=14/80, iter=1590/9280, loss=0.905325, lr=0.004492 | ETA 01:51:12
2022-09-28 13:30:53,960 -     INFO - [TRAIN] epoch=14/80, iter=1600/9280, loss=1.139267, lr=0.004529 | ETA 01:48:25
2022-09-28 13:31:02,371 -     INFO - [TRAIN] epoch=14/80, iter=1610/9280, loss=1.158696, lr=0.004566 | ETA 01:45:18
2022-09-28 13:31:11,061 -     INFO - [TRAIN] epoch=14/80, iter=1620/9280, loss=1.080738, lr=0.004603 | ETA 01:55:16
2022-09-28 13:31:14,562 -     INFO - Pop model from outputs/iassd_v17/epoch_9
2022-09-28 13:31:14,704 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_14
2022-09-28 13:31:26,152 -     INFO - [TRAIN] epoch=15/80, iter=1630/9280, loss=0.999532, lr=0.004641 | ETA 02:02:16
2022-09-28 13:31:34,597 -     INFO - [TRAIN] epoch=15/80, iter=1640/9280, loss=0.963462, lr=0.004678 | ETA 01:45:37
2022-09-28 13:31:42,894 -     INFO - [TRAIN] epoch=15/80, iter=1650/9280, loss=0.959731, lr=0.004716 | ETA 01:48:04
2022-09-28 13:31:51,405 -     INFO - [TRAIN] epoch=15/80, iter=1660/9280, loss=0.937759, lr=0.004753 | ETA 01:46:39
2022-09-28 13:31:59,748 -     INFO - [TRAIN] epoch=15/80, iter=1670/9280, loss=0.903313, lr=0.004791 | ETA 01:46:21
2022-09-28 13:32:08,163 -     INFO - [TRAIN] epoch=15/80, iter=1680/9280, loss=0.891437, lr=0.004828 | ETA 01:44:47
2022-09-28 13:32:16,463 -     INFO - [TRAIN] epoch=15/80, iter=1690/9280, loss=0.883560, lr=0.004866 | ETA 01:46:05
2022-09-28 13:32:24,829 -     INFO - [TRAIN] epoch=15/80, iter=1700/9280, loss=0.919211, lr=0.004904 | ETA 01:44:48
2022-09-28 13:32:33,033 -     INFO - [TRAIN] epoch=15/80, iter=1710/9280, loss=0.882631, lr=0.004942 | ETA 01:43:38
2022-09-28 13:32:41,513 -     INFO - [TRAIN] epoch=15/80, iter=1720/9280, loss=0.889982, lr=0.004979 | ETA 01:44:31
2022-09-28 13:32:49,800 -     INFO - [TRAIN] epoch=15/80, iter=1730/9280, loss=0.881874, lr=0.005017 | ETA 01:44:30
2022-09-28 13:32:58,044 -     INFO - [TRAIN] epoch=15/80, iter=1740/9280, loss=0.874423, lr=0.005055 | ETA 01:43:37
2022-09-28 13:32:58,049 -     INFO - Pop model from outputs/iassd_v17/epoch_10
2022-09-28 13:32:58,196 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_15
2022-09-28 13:33:12,709 -     INFO - [TRAIN] epoch=16/80, iter=1750/9280, loss=0.886328, lr=0.005093 | ETA 01:46:06
2022-09-28 13:33:21,554 -     INFO - [TRAIN] epoch=16/80, iter=1760/9280, loss=0.866811, lr=0.005131 | ETA 01:54:29
2022-09-28 13:33:30,075 -     INFO - [TRAIN] epoch=16/80, iter=1770/9280, loss=0.866686, lr=0.005169 | ETA 01:44:11
2022-09-28 13:33:38,721 -     INFO - [TRAIN] epoch=16/80, iter=1780/9280, loss=0.844522, lr=0.005207 | ETA 01:50:55
2022-09-28 13:33:47,214 -     INFO - [TRAIN] epoch=16/80, iter=1790/9280, loss=0.845933, lr=0.005245 | ETA 01:44:35
2022-09-28 13:33:55,640 -     INFO - [TRAIN] epoch=16/80, iter=1800/9280, loss=0.822568, lr=0.005283 | ETA 01:50:03
2022-09-28 13:34:04,030 -     INFO - [TRAIN] epoch=16/80, iter=1810/9280, loss=0.801037, lr=0.005321 | ETA 01:45:40
2022-09-28 13:34:12,741 -     INFO - [TRAIN] epoch=16/80, iter=1820/9280, loss=0.818015, lr=0.005359 | ETA 01:52:40
2022-09-28 13:34:21,439 -     INFO - [TRAIN] epoch=16/80, iter=1830/9280, loss=0.825378, lr=0.005397 | ETA 01:45:06
2022-09-28 13:34:30,042 -     INFO - [TRAIN] epoch=16/80, iter=1840/9280, loss=0.891160, lr=0.005435 | ETA 01:46:52
2022-09-28 13:34:38,385 -     INFO - [TRAIN] epoch=16/80, iter=1850/9280, loss=0.953428, lr=0.005473 | ETA 01:43:47
2022-09-28 13:34:43,586 -     INFO - Pop model from outputs/iassd_v17/epoch_11
2022-09-28 13:34:43,726 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_16
2022-09-28 13:34:53,485 -     INFO - [TRAIN] epoch=17/80, iter=1860/9280, loss=0.907404, lr=0.005511 | ETA 02:36:39
2022-09-28 13:35:01,989 -     INFO - [TRAIN] epoch=17/80, iter=1870/9280, loss=0.876588, lr=0.005550 | ETA 01:45:04
2022-09-28 13:35:10,359 -     INFO - [TRAIN] epoch=17/80, iter=1880/9280, loss=0.871107, lr=0.005588 | ETA 01:42:05
2022-09-28 13:35:18,790 -     INFO - [TRAIN] epoch=17/80, iter=1890/9280, loss=0.853086, lr=0.005626 | ETA 01:43:54
2022-09-28 13:35:27,414 -     INFO - [TRAIN] epoch=17/80, iter=1900/9280, loss=0.851523, lr=0.005664 | ETA 01:49:43
2022-09-28 13:35:36,172 -     INFO - [TRAIN] epoch=17/80, iter=1910/9280, loss=0.846921, lr=0.005702 | ETA 01:42:36
2022-09-28 13:35:44,665 -     INFO - [TRAIN] epoch=17/80, iter=1920/9280, loss=0.836848, lr=0.005740 | ETA 01:44:15
2022-09-28 13:35:53,010 -     INFO - [TRAIN] epoch=17/80, iter=1930/9280, loss=0.828265, lr=0.005778 | ETA 01:42:57
2022-09-28 13:36:01,410 -     INFO - [TRAIN] epoch=17/80, iter=1940/9280, loss=0.803814, lr=0.005816 | ETA 01:42:42
2022-09-28 13:36:09,677 -     INFO - [TRAIN] epoch=17/80, iter=1950/9280, loss=0.794827, lr=0.005854 | ETA 01:40:03
2022-09-28 13:36:18,042 -     INFO - [TRAIN] epoch=17/80, iter=1960/9280, loss=0.914064, lr=0.005892 | ETA 01:43:58
2022-09-28 13:36:26,399 -     INFO - [TRAIN] epoch=17/80, iter=1970/9280, loss=0.912581, lr=0.005930 | ETA 01:41:05
2022-09-28 13:36:28,051 -     INFO - Pop model from outputs/iassd_v17/epoch_12
2022-09-28 13:36:28,190 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_17
2022-09-28 13:36:41,326 -     INFO - [TRAIN] epoch=18/80, iter=1980/9280, loss=0.881959, lr=0.005968 | ETA 01:49:36
2022-09-28 13:36:50,054 -     INFO - [TRAIN] epoch=18/80, iter=1990/9280, loss=0.857038, lr=0.006005 | ETA 01:52:00
2022-09-28 13:36:58,917 -     INFO - [TRAIN] epoch=18/80, iter=2000/9280, loss=0.849767, lr=0.006043 | ETA 01:49:00
2022-09-28 13:37:07,496 -     INFO - [TRAIN] epoch=18/80, iter=2010/9280, loss=0.870493, lr=0.006081 | ETA 01:41:04
2022-09-28 13:37:15,910 -     INFO - [TRAIN] epoch=18/80, iter=2020/9280, loss=0.836563, lr=0.006119 | ETA 01:42:27
2022-09-28 13:37:24,343 -     INFO - [TRAIN] epoch=18/80, iter=2030/9280, loss=0.806538, lr=0.006157 | ETA 01:41:55
2022-09-28 13:37:32,868 -     INFO - [TRAIN] epoch=18/80, iter=2040/9280, loss=0.835681, lr=0.006194 | ETA 01:42:22
2022-09-28 13:37:41,280 -     INFO - [TRAIN] epoch=18/80, iter=2050/9280, loss=0.819294, lr=0.006232 | ETA 01:39:49
2022-09-28 13:37:49,707 -     INFO - [TRAIN] epoch=18/80, iter=2060/9280, loss=0.844640, lr=0.006269 | ETA 01:42:52
2022-09-28 13:37:58,104 -     INFO - [TRAIN] epoch=18/80, iter=2070/9280, loss=0.897991, lr=0.006307 | ETA 01:43:10
2022-09-28 13:38:06,567 -     INFO - [TRAIN] epoch=18/80, iter=2080/9280, loss=0.910990, lr=0.006344 | ETA 01:42:47
2022-09-28 13:38:13,153 -     INFO - Pop model from outputs/iassd_v17/epoch_13
2022-09-28 13:38:13,292 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_18
2022-09-28 13:38:21,038 -     INFO - [TRAIN] epoch=19/80, iter=2090/9280, loss=0.951570, lr=0.006382 | ETA 04:46:11
2022-09-28 13:38:29,394 -     INFO - [TRAIN] epoch=19/80, iter=2100/9280, loss=0.892115, lr=0.006419 | ETA 01:38:09
2022-09-28 13:38:37,715 -     INFO - [TRAIN] epoch=19/80, iter=2110/9280, loss=0.864141, lr=0.006456 | ETA 01:39:27
2022-09-28 13:38:46,147 -     INFO - [TRAIN] epoch=19/80, iter=2120/9280, loss=0.840610, lr=0.006493 | ETA 01:39:27
2022-09-28 13:38:54,498 -     INFO - [TRAIN] epoch=19/80, iter=2130/9280, loss=0.823380, lr=0.006530 | ETA 01:39:27
2022-09-28 13:39:02,864 -     INFO - [TRAIN] epoch=19/80, iter=2140/9280, loss=0.841295, lr=0.006568 | ETA 01:39:47
2022-09-28 13:39:11,233 -     INFO - [TRAIN] epoch=19/80, iter=2150/9280, loss=0.877576, lr=0.006604 | ETA 01:38:35
2022-09-28 13:39:19,601 -     INFO - [TRAIN] epoch=19/80, iter=2160/9280, loss=0.855247, lr=0.006641 | ETA 01:41:53
2022-09-28 13:39:27,991 -     INFO - [TRAIN] epoch=19/80, iter=2170/9280, loss=0.847203, lr=0.006678 | ETA 01:38:15
2022-09-28 13:39:36,558 -     INFO - [TRAIN] epoch=19/80, iter=2180/9280, loss=0.891560, lr=0.006715 | ETA 01:39:27
2022-09-28 13:39:45,023 -     INFO - [TRAIN] epoch=19/80, iter=2190/9280, loss=1.025821, lr=0.006752 | ETA 01:40:07
2022-09-28 13:39:53,557 -     INFO - [TRAIN] epoch=19/80, iter=2200/9280, loss=0.937531, lr=0.006788 | ETA 01:39:10
2022-09-28 13:39:56,881 -     INFO - Pop model from outputs/iassd_v17/epoch_14
2022-09-28 13:39:57,019 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_19
2022-09-28 13:40:08,421 -     INFO - [TRAIN] epoch=20/80, iter=2210/9280, loss=0.885454, lr=0.006824 | ETA 01:48:37
2022-09-28 13:40:16,938 -     INFO - [TRAIN] epoch=20/80, iter=2220/9280, loss=0.880522, lr=0.006861 | ETA 01:40:41
2022-09-28 13:40:25,448 -     INFO - [TRAIN] epoch=20/80, iter=2230/9280, loss=0.890334, lr=0.006897 | ETA 01:39:36
2022-09-28 13:40:33,886 -     INFO - [TRAIN] epoch=20/80, iter=2240/9280, loss=0.864768, lr=0.006933 | ETA 01:40:58
2022-09-28 13:40:42,184 -     INFO - [TRAIN] epoch=20/80, iter=2250/9280, loss=0.867538, lr=0.006969 | ETA 01:37:01
2022-09-28 13:40:50,511 -     INFO - [TRAIN] epoch=20/80, iter=2260/9280, loss=0.853845, lr=0.007005 | ETA 01:36:48
2022-09-28 13:40:59,098 -     INFO - [TRAIN] epoch=20/80, iter=2270/9280, loss=0.969676, lr=0.007041 | ETA 01:36:49
2022-09-28 13:41:07,461 -     INFO - [TRAIN] epoch=20/80, iter=2280/9280, loss=1.245549, lr=0.007077 | ETA 01:36:52
2022-09-28 13:41:15,821 -     INFO - [TRAIN] epoch=20/80, iter=2290/9280, loss=1.449034, lr=0.007112 | ETA 01:36:43
2022-09-28 13:41:24,224 -     INFO - [TRAIN] epoch=20/80, iter=2300/9280, loss=1.243642, lr=0.007148 | ETA 01:36:59
2022-09-28 13:41:32,613 -     INFO - [TRAIN] epoch=20/80, iter=2310/9280, loss=1.111625, lr=0.007183 | ETA 01:35:31
2022-09-28 13:41:40,878 -     INFO - [TRAIN] epoch=20/80, iter=2320/9280, loss=1.047149, lr=0.007219 | ETA 01:35:58
2022-09-28 13:41:40,883 -     INFO - Pop model from outputs/iassd_v17/epoch_15
2022-09-28 13:41:41,025 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_20
2022-09-28 13:41:56,023 -     INFO - [TRAIN] epoch=21/80, iter=2330/9280, loss=0.987829, lr=0.007254 | ETA 01:45:46
2022-09-28 13:42:04,752 -     INFO - [TRAIN] epoch=21/80, iter=2340/9280, loss=0.949713, lr=0.007289 | ETA 01:42:39
2022-09-28 13:42:13,161 -     INFO - [TRAIN] epoch=21/80, iter=2350/9280, loss=0.939327, lr=0.007324 | ETA 01:37:41
2022-09-28 13:42:21,579 -     INFO - [TRAIN] epoch=21/80, iter=2360/9280, loss=0.931307, lr=0.007358 | ETA 01:38:01
2022-09-28 13:42:30,081 -     INFO - [TRAIN] epoch=21/80, iter=2370/9280, loss=0.888828, lr=0.007393 | ETA 01:37:59
2022-09-28 13:42:38,673 -     INFO - [TRAIN] epoch=21/80, iter=2380/9280, loss=0.877003, lr=0.007427 | ETA 01:41:46
2022-09-28 13:42:47,150 -     INFO - [TRAIN] epoch=21/80, iter=2390/9280, loss=0.871635, lr=0.007462 | ETA 01:36:52
2022-09-28 13:42:55,594 -     INFO - [TRAIN] epoch=21/80, iter=2400/9280, loss=0.862768, lr=0.007496 | ETA 01:34:30
2022-09-28 13:43:04,002 -     INFO - [TRAIN] epoch=21/80, iter=2410/9280, loss=0.828898, lr=0.007530 | ETA 01:37:51
2022-09-28 13:43:12,411 -     INFO - [TRAIN] epoch=21/80, iter=2420/9280, loss=0.861132, lr=0.007564 | ETA 01:36:43
2022-09-28 13:43:20,847 -     INFO - [TRAIN] epoch=21/80, iter=2430/9280, loss=0.973962, lr=0.007598 | ETA 01:38:05
2022-09-28 13:43:26,038 -     INFO - Pop model from outputs/iassd_v17/epoch_16
2022-09-28 13:43:26,179 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_21
2022-09-28 13:43:36,032 -     INFO - [TRAIN] epoch=22/80, iter=2440/9280, loss=0.955650, lr=0.007631 | ETA 02:24:55
2022-09-28 13:43:44,429 -     INFO - [TRAIN] epoch=22/80, iter=2450/9280, loss=0.948256, lr=0.007665 | ETA 01:34:50
2022-09-28 13:43:52,852 -     INFO - [TRAIN] epoch=22/80, iter=2460/9280, loss=0.999990, lr=0.007698 | ETA 01:34:54
2022-09-28 13:44:01,394 -     INFO - [TRAIN] epoch=22/80, iter=2470/9280, loss=0.979075, lr=0.007731 | ETA 01:36:50
2022-09-28 13:44:10,475 -     INFO - [TRAIN] epoch=22/80, iter=2480/9280, loss=0.914061, lr=0.007764 | ETA 01:45:24
2022-09-28 13:44:19,391 -     INFO - [TRAIN] epoch=22/80, iter=2490/9280, loss=0.894653, lr=0.007797 | ETA 01:38:44
2022-09-28 13:44:27,533 -     INFO - [TRAIN] epoch=22/80, iter=2500/9280, loss=0.842880, lr=0.007830 | ETA 01:31:26
2022-09-28 13:44:35,924 -     INFO - [TRAIN] epoch=22/80, iter=2510/9280, loss=0.849064, lr=0.007862 | ETA 01:39:37
2022-09-28 13:44:44,588 -     INFO - [TRAIN] epoch=22/80, iter=2520/9280, loss=0.820557, lr=0.007895 | ETA 01:35:21
2022-09-28 13:44:52,874 -     INFO - [TRAIN] epoch=22/80, iter=2530/9280, loss=0.814861, lr=0.007927 | ETA 01:32:00
2022-09-28 13:45:01,419 -     INFO - [TRAIN] epoch=22/80, iter=2540/9280, loss=0.829742, lr=0.007959 | ETA 01:34:04
2022-09-28 13:45:09,572 -     INFO - [TRAIN] epoch=22/80, iter=2550/9280, loss=0.818148, lr=0.007991 | ETA 01:31:15
2022-09-28 13:45:11,230 -     INFO - Pop model from outputs/iassd_v17/epoch_17
2022-09-28 13:45:11,378 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_22
2022-09-28 13:45:23,806 -     INFO - [TRAIN] epoch=23/80, iter=2560/9280, loss=0.834295, lr=0.008022 | ETA 01:34:56
2022-09-28 13:45:32,328 -     INFO - [TRAIN] epoch=23/80, iter=2570/9280, loss=0.814271, lr=0.008054 | ETA 01:37:53
2022-09-28 13:45:40,627 -     INFO - [TRAIN] epoch=23/80, iter=2580/9280, loss=0.821596, lr=0.008085 | ETA 01:32:30
2022-09-28 13:45:48,856 -     INFO - [TRAIN] epoch=23/80, iter=2590/9280, loss=0.798140, lr=0.008116 | ETA 01:29:38
2022-09-28 13:45:57,126 -     INFO - [TRAIN] epoch=23/80, iter=2600/9280, loss=0.812299, lr=0.008147 | ETA 01:34:18
2022-09-28 13:46:05,248 -     INFO - [TRAIN] epoch=23/80, iter=2610/9280, loss=0.831371, lr=0.008178 | ETA 01:31:24
2022-09-28 13:46:13,555 -     INFO - [TRAIN] epoch=23/80, iter=2620/9280, loss=0.904763, lr=0.008208 | ETA 01:34:02
2022-09-28 13:46:22,312 -     INFO - [TRAIN] epoch=23/80, iter=2630/9280, loss=0.944947, lr=0.008238 | ETA 01:38:38
2022-09-28 13:46:30,599 -     INFO - [TRAIN] epoch=23/80, iter=2640/9280, loss=0.901671, lr=0.008269 | ETA 01:31:14
2022-09-28 13:46:39,335 -     INFO - [TRAIN] epoch=23/80, iter=2650/9280, loss=0.919103, lr=0.008298 | ETA 01:35:09
2022-09-28 13:46:47,601 -     INFO - [TRAIN] epoch=23/80, iter=2660/9280, loss=0.999080, lr=0.008328 | ETA 01:29:51
2022-09-28 13:46:54,033 -     INFO - Pop model from outputs/iassd_v17/epoch_18
2022-09-28 13:46:54,223 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_23
2022-09-28 13:47:01,860 -     INFO - [TRAIN] epoch=24/80, iter=2670/9280, loss=0.912800, lr=0.008358 | ETA 04:20:57
2022-09-28 13:47:10,159 -     INFO - [TRAIN] epoch=24/80, iter=2680/9280, loss=0.880720, lr=0.008387 | ETA 01:33:02
2022-09-28 13:47:18,378 -     INFO - [TRAIN] epoch=24/80, iter=2690/9280, loss=0.828318, lr=0.008416 | ETA 01:31:01
2022-09-28 13:47:27,281 -     INFO - [TRAIN] epoch=24/80, iter=2700/9280, loss=0.829558, lr=0.008445 | ETA 01:33:59
2022-09-28 13:47:36,075 -     INFO - [TRAIN] epoch=24/80, iter=2710/9280, loss=0.829899, lr=0.008474 | ETA 01:34:35
2022-09-28 13:47:44,288 -     INFO - [TRAIN] epoch=24/80, iter=2720/9280, loss=0.819894, lr=0.008502 | ETA 01:30:40
2022-09-28 13:47:52,634 -     INFO - [TRAIN] epoch=24/80, iter=2730/9280, loss=0.865361, lr=0.008530 | ETA 01:29:59
2022-09-28 13:48:01,285 -     INFO - [TRAIN] epoch=24/80, iter=2740/9280, loss=0.928022, lr=0.008559 | ETA 01:30:40
2022-09-28 13:48:09,518 -     INFO - [TRAIN] epoch=24/80, iter=2750/9280, loss=0.861665, lr=0.008586 | ETA 01:28:31
2022-09-28 13:48:17,764 -     INFO - [TRAIN] epoch=24/80, iter=2760/9280, loss=0.821212, lr=0.008614 | ETA 01:31:40
2022-09-28 13:48:25,953 -     INFO - [TRAIN] epoch=24/80, iter=2770/9280, loss=0.805220, lr=0.008641 | ETA 01:28:48
2022-09-28 13:48:34,240 -     INFO - [TRAIN] epoch=24/80, iter=2780/9280, loss=0.921661, lr=0.008668 | ETA 01:29:15
2022-09-28 13:48:37,513 -     INFO - Pop model from outputs/iassd_v17/epoch_19
2022-09-28 13:48:37,654 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_24
2022-09-28 13:48:48,591 -     INFO - [TRAIN] epoch=25/80, iter=2790/9280, loss=0.924863, lr=0.008695 | ETA 01:39:43
2022-09-28 13:48:56,878 -     INFO - [TRAIN] epoch=25/80, iter=2800/9280, loss=0.881913, lr=0.008722 | ETA 01:30:13
2022-09-28 13:49:05,098 -     INFO - [TRAIN] epoch=25/80, iter=2810/9280, loss=0.869695, lr=0.008749 | ETA 01:28:10
2022-09-28 13:49:13,383 -     INFO - [TRAIN] epoch=25/80, iter=2820/9280, loss=0.843857, lr=0.008775 | ETA 01:28:51
2022-09-28 13:49:22,120 -     INFO - [TRAIN] epoch=25/80, iter=2830/9280, loss=0.871450, lr=0.008801 | ETA 01:37:03
2022-09-28 13:49:30,904 -     INFO - [TRAIN] epoch=25/80, iter=2840/9280, loss=0.883367, lr=0.008827 | ETA 01:33:09
2022-09-28 13:49:39,275 -     INFO - [TRAIN] epoch=25/80, iter=2850/9280, loss=0.850594, lr=0.008852 | ETA 01:35:05
2022-09-28 13:49:47,438 -     INFO - [TRAIN] epoch=25/80, iter=2860/9280, loss=0.890245, lr=0.008877 | ETA 01:26:54
2022-09-28 13:49:56,000 -     INFO - [TRAIN] epoch=25/80, iter=2870/9280, loss=1.535504, lr=0.008902 | ETA 01:31:43
2022-09-28 13:50:04,271 -     INFO - [TRAIN] epoch=25/80, iter=2880/9280, loss=1.653969, lr=0.008927 | ETA 01:28:17
2022-09-28 13:50:12,508 -     INFO - [TRAIN] epoch=25/80, iter=2890/9280, loss=1.407190, lr=0.008952 | ETA 01:27:33
2022-09-28 13:50:20,950 -     INFO - [TRAIN] epoch=25/80, iter=2900/9280, loss=1.263530, lr=0.008976 | ETA 01:26:52
2022-09-28 13:50:20,955 -     INFO - Pop model from outputs/iassd_v17/epoch_20
2022-09-28 13:50:21,094 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_25
2022-09-28 13:50:35,978 -     INFO - [TRAIN] epoch=26/80, iter=2910/9280, loss=1.246137, lr=0.009000 | ETA 01:33:46
2022-09-28 13:50:45,018 -     INFO - [TRAIN] epoch=26/80, iter=2920/9280, loss=1.100065, lr=0.009024 | ETA 01:34:39
2022-09-28 13:50:53,417 -     INFO - [TRAIN] epoch=26/80, iter=2930/9280, loss=1.076239, lr=0.009048 | ETA 01:32:50
2022-09-28 13:51:02,028 -     INFO - [TRAIN] epoch=26/80, iter=2940/9280, loss=1.166521, lr=0.009071 | ETA 01:27:34
2022-09-28 13:51:10,679 -     INFO - [TRAIN] epoch=26/80, iter=2950/9280, loss=1.138531, lr=0.009094 | ETA 01:30:28
2022-09-28 13:51:19,059 -     INFO - [TRAIN] epoch=26/80, iter=2960/9280, loss=1.074988, lr=0.009117 | ETA 01:32:23
2022-09-28 13:51:27,538 -     INFO - [TRAIN] epoch=26/80, iter=2970/9280, loss=0.998679, lr=0.009139 | ETA 01:26:46
2022-09-28 13:51:35,930 -     INFO - [TRAIN] epoch=26/80, iter=2980/9280, loss=0.943429, lr=0.009162 | ETA 01:28:52
2022-09-28 13:51:44,489 -     INFO - [TRAIN] epoch=26/80, iter=2990/9280, loss=0.951023, lr=0.009184 | ETA 01:25:50
2022-09-28 13:51:52,588 -     INFO - [TRAIN] epoch=26/80, iter=3000/9280, loss=0.951355, lr=0.009205 | ETA 01:23:36
2022-09-28 13:52:01,197 -     INFO - [TRAIN] epoch=26/80, iter=3010/9280, loss=0.929441, lr=0.009227 | ETA 01:31:26
2022-09-28 13:52:06,202 -     INFO - Pop model from outputs/iassd_v17/epoch_21
2022-09-28 13:52:06,343 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_26
2022-09-28 13:52:15,904 -     INFO - [TRAIN] epoch=27/80, iter=3020/9280, loss=0.924964, lr=0.009248 | ETA 02:06:31
2022-09-28 13:52:24,059 -     INFO - [TRAIN] epoch=27/80, iter=3030/9280, loss=0.940278, lr=0.009269 | ETA 01:24:38
2022-09-28 13:52:32,585 -     INFO - [TRAIN] epoch=27/80, iter=3040/9280, loss=0.905012, lr=0.009290 | ETA 01:27:35
2022-09-28 13:52:40,979 -     INFO - [TRAIN] epoch=27/80, iter=3050/9280, loss=0.928133, lr=0.009310 | ETA 01:25:49
2022-09-28 13:52:49,293 -     INFO - [TRAIN] epoch=27/80, iter=3060/9280, loss=0.947478, lr=0.009330 | ETA 01:28:32
2022-09-28 13:52:57,614 -     INFO - [TRAIN] epoch=27/80, iter=3070/9280, loss=0.885389, lr=0.009350 | ETA 01:27:15
2022-09-28 13:53:05,865 -     INFO - [TRAIN] epoch=27/80, iter=3080/9280, loss=0.874577, lr=0.009370 | ETA 01:24:18
2022-09-28 13:53:14,092 -     INFO - [TRAIN] epoch=27/80, iter=3090/9280, loss=0.890658, lr=0.009389 | ETA 01:24:28
2022-09-28 13:53:22,613 -     INFO - [TRAIN] epoch=27/80, iter=3100/9280, loss=0.915423, lr=0.009408 | ETA 01:24:04
2022-09-28 13:53:31,250 -     INFO - [TRAIN] epoch=27/80, iter=3110/9280, loss=0.862200, lr=0.009427 | ETA 01:31:58
2022-09-28 13:53:39,713 -     INFO - [TRAIN] epoch=27/80, iter=3120/9280, loss=0.840926, lr=0.009445 | ETA 01:26:10
2022-09-28 13:53:47,791 -     INFO - [TRAIN] epoch=27/80, iter=3130/9280, loss=0.845766, lr=0.009463 | ETA 01:21:26
2022-09-28 13:53:49,433 -     INFO - Pop model from outputs/iassd_v17/epoch_22
2022-09-28 13:53:49,578 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_27
2022-09-28 13:54:02,189 -     INFO - [TRAIN] epoch=28/80, iter=3140/9280, loss=0.830276, lr=0.009481 | ETA 01:30:28
2022-09-28 13:54:10,388 -     INFO - [TRAIN] epoch=28/80, iter=3150/9280, loss=0.867856, lr=0.009499 | ETA 01:21:56
2022-09-28 13:54:18,719 -     INFO - [TRAIN] epoch=28/80, iter=3160/9280, loss=0.844558, lr=0.009516 | ETA 01:26:53
2022-09-28 13:54:26,863 -     INFO - [TRAIN] epoch=28/80, iter=3170/9280, loss=0.795330, lr=0.009533 | ETA 01:22:31
2022-09-28 13:54:35,492 -     INFO - [TRAIN] epoch=28/80, iter=3180/9280, loss=0.826016, lr=0.009550 | ETA 01:27:56
2022-09-28 13:54:43,742 -     INFO - [TRAIN] epoch=28/80, iter=3190/9280, loss=0.790159, lr=0.009566 | ETA 01:24:25
2022-09-28 13:54:52,412 -     INFO - [TRAIN] epoch=28/80, iter=3200/9280, loss=0.807952, lr=0.009582 | ETA 01:24:39
2022-09-28 13:55:00,732 -     INFO - [TRAIN] epoch=28/80, iter=3210/9280, loss=0.791913, lr=0.009598 | ETA 01:24:28
2022-09-28 13:55:09,153 -     INFO - [TRAIN] epoch=28/80, iter=3220/9280, loss=0.807404, lr=0.009614 | ETA 01:21:35
2022-09-28 13:55:17,272 -     INFO - [TRAIN] epoch=28/80, iter=3230/9280, loss=0.838100, lr=0.009629 | ETA 01:21:13
2022-09-28 13:55:25,589 -     INFO - [TRAIN] epoch=28/80, iter=3240/9280, loss=0.861706, lr=0.009644 | ETA 01:22:39
2022-09-28 13:55:32,152 -     INFO - Pop model from outputs/iassd_v17/epoch_23
2022-09-28 13:55:32,293 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_28
2022-09-28 13:55:39,951 -     INFO - [TRAIN] epoch=29/80, iter=3250/9280, loss=0.861860, lr=0.009659 | ETA 03:57:00
2022-09-28 13:55:48,243 -     INFO - [TRAIN] epoch=29/80, iter=3260/9280, loss=0.868640, lr=0.009673 | ETA 01:21:23
2022-09-28 13:55:56,692 -     INFO - [TRAIN] epoch=29/80, iter=3270/9280, loss=0.817921, lr=0.009687 | ETA 01:24:35
2022-09-28 13:56:05,117 -     INFO - [TRAIN] epoch=29/80, iter=3280/9280, loss=0.871753, lr=0.009701 | ETA 01:27:56
2022-09-28 13:56:13,449 -     INFO - [TRAIN] epoch=29/80, iter=3290/9280, loss=0.872919, lr=0.009715 | ETA 01:26:55
2022-09-28 13:56:21,757 -     INFO - [TRAIN] epoch=29/80, iter=3300/9280, loss=0.826306, lr=0.009728 | ETA 01:22:02
2022-09-28 13:56:29,962 -     INFO - [TRAIN] epoch=29/80, iter=3310/9280, loss=0.800829, lr=0.009741 | ETA 01:23:10
2022-09-28 13:56:38,490 -     INFO - [TRAIN] epoch=29/80, iter=3320/9280, loss=0.804430, lr=0.009753 | ETA 01:27:25
2022-09-28 13:56:46,742 -     INFO - [TRAIN] epoch=29/80, iter=3330/9280, loss=0.790448, lr=0.009766 | ETA 01:21:35
2022-09-28 13:56:55,271 -     INFO - [TRAIN] epoch=29/80, iter=3340/9280, loss=0.775042, lr=0.009778 | ETA 01:23:17
2022-09-28 13:57:03,649 -     INFO - [TRAIN] epoch=29/80, iter=3350/9280, loss=0.832543, lr=0.009789 | ETA 01:19:58
2022-09-28 13:57:11,850 -     INFO - [TRAIN] epoch=29/80, iter=3360/9280, loss=0.837987, lr=0.009801 | ETA 01:19:48
2022-09-28 13:57:15,051 -     INFO - Pop model from outputs/iassd_v17/epoch_24
2022-09-28 13:57:15,199 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_29
2022-09-28 13:57:26,269 -     INFO - [TRAIN] epoch=30/80, iter=3370/9280, loss=0.822257, lr=0.009812 | ETA 01:29:31
2022-09-28 13:57:34,688 -     INFO - [TRAIN] epoch=30/80, iter=3380/9280, loss=0.780591, lr=0.009822 | ETA 01:22:37
2022-09-28 13:57:42,813 -     INFO - [TRAIN] epoch=30/80, iter=3390/9280, loss=0.784412, lr=0.009833 | ETA 01:21:46
2022-09-28 13:57:50,968 -     INFO - [TRAIN] epoch=30/80, iter=3400/9280, loss=0.797392, lr=0.009843 | ETA 01:20:34
2022-09-28 13:57:59,179 -     INFO - [TRAIN] epoch=30/80, iter=3410/9280, loss=0.792035, lr=0.009853 | ETA 01:19:56
2022-09-28 13:58:07,940 -     INFO - [TRAIN] epoch=30/80, iter=3420/9280, loss=0.779272, lr=0.009862 | ETA 01:27:32
2022-09-28 13:58:16,241 -     INFO - [TRAIN] epoch=30/80, iter=3430/9280, loss=0.754072, lr=0.009872 | ETA 01:20:43
2022-09-28 13:58:24,487 -     INFO - [TRAIN] epoch=30/80, iter=3440/9280, loss=0.785223, lr=0.009880 | ETA 01:20:32
2022-09-28 13:58:33,168 -     INFO - [TRAIN] epoch=30/80, iter=3450/9280, loss=0.745734, lr=0.009889 | ETA 01:26:10
2022-09-28 13:58:41,404 -     INFO - [TRAIN] epoch=30/80, iter=3460/9280, loss=0.743807, lr=0.009897 | ETA 01:19:54
2022-09-28 13:58:49,595 -     INFO - [TRAIN] epoch=30/80, iter=3470/9280, loss=0.776769, lr=0.009905 | ETA 01:20:48
2022-09-28 13:58:57,780 -     INFO - [TRAIN] epoch=30/80, iter=3480/9280, loss=0.769666, lr=0.009913 | ETA 01:18:15
2022-09-28 13:58:57,786 -     INFO - Pop model from outputs/iassd_v17/epoch_25
2022-09-28 13:58:57,927 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_30
2022-09-28 13:59:12,607 -     INFO - [TRAIN] epoch=31/80, iter=3490/9280, loss=0.762292, lr=0.009920 | ETA 01:20:05
2022-09-28 13:59:20,905 -     INFO - [TRAIN] epoch=31/80, iter=3500/9280, loss=0.747374, lr=0.009927 | ETA 01:17:07
2022-09-28 13:59:29,141 -     INFO - [TRAIN] epoch=31/80, iter=3510/9280, loss=0.763001, lr=0.009934 | ETA 01:17:29
2022-09-28 13:59:37,356 -     INFO - [TRAIN] epoch=31/80, iter=3520/9280, loss=0.793041, lr=0.009940 | ETA 01:17:50
2022-09-28 13:59:45,513 -     INFO - [TRAIN] epoch=31/80, iter=3530/9280, loss=0.757423, lr=0.009946 | ETA 01:18:50
2022-09-28 13:59:53,911 -     INFO - [TRAIN] epoch=31/80, iter=3540/9280, loss=0.774278, lr=0.009952 | ETA 01:19:23
2022-09-28 14:00:02,422 -     INFO - [TRAIN] epoch=31/80, iter=3550/9280, loss=0.776278, lr=0.009957 | ETA 01:21:28
2022-09-28 14:00:11,165 -     INFO - [TRAIN] epoch=31/80, iter=3560/9280, loss=0.765619, lr=0.009962 | ETA 01:20:52
2022-09-28 14:00:19,707 -     INFO - [TRAIN] epoch=31/80, iter=3570/9280, loss=0.762785, lr=0.009967 | ETA 01:19:53
2022-09-28 14:00:28,472 -     INFO - [TRAIN] epoch=31/80, iter=3580/9280, loss=0.774983, lr=0.009972 | ETA 01:23:28
2022-09-28 14:00:36,700 -     INFO - [TRAIN] epoch=31/80, iter=3590/9280, loss=0.767337, lr=0.009976 | ETA 01:18:06
2022-09-28 14:00:41,686 -     INFO - Pop model from outputs/iassd_v17/epoch_26
2022-09-28 14:00:41,852 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_31
2022-09-28 14:00:51,030 -     INFO - [TRAIN] epoch=32/80, iter=3600/9280, loss=0.759960, lr=0.009979 | ETA 01:52:13
2022-09-28 14:00:59,236 -     INFO - [TRAIN] epoch=32/80, iter=3610/9280, loss=0.793505, lr=0.009983 | ETA 01:17:52
2022-09-28 14:01:07,925 -     INFO - [TRAIN] epoch=32/80, iter=3620/9280, loss=0.805419, lr=0.009986 | ETA 01:22:29
2022-09-28 14:01:16,402 -     INFO - [TRAIN] epoch=32/80, iter=3630/9280, loss=0.892293, lr=0.009989 | ETA 01:18:44
2022-09-28 14:01:24,746 -     INFO - [TRAIN] epoch=32/80, iter=3640/9280, loss=0.848652, lr=0.009991 | ETA 01:17:44
2022-09-28 14:01:32,973 -     INFO - [TRAIN] epoch=32/80, iter=3650/9280, loss=0.825424, lr=0.009994 | ETA 01:16:32
2022-09-28 14:01:41,061 -     INFO - [TRAIN] epoch=32/80, iter=3660/9280, loss=1.142179, lr=0.009995 | ETA 01:15:46
2022-09-28 14:01:49,395 -     INFO - [TRAIN] epoch=32/80, iter=3670/9280, loss=1.099769, lr=0.009997 | ETA 01:16:32
2022-09-28 14:01:57,627 -     INFO - [TRAIN] epoch=32/80, iter=3680/9280, loss=0.939725, lr=0.009998 | ETA 01:15:47
2022-09-28 14:02:05,832 -     INFO - [TRAIN] epoch=32/80, iter=3690/9280, loss=0.889239, lr=0.009999 | ETA 01:16:52
2022-09-28 14:02:14,212 -     INFO - [TRAIN] epoch=32/80, iter=3700/9280, loss=0.859397, lr=0.010000 | ETA 01:16:00
2022-09-28 14:02:22,486 -     INFO - [TRAIN] epoch=32/80, iter=3710/9280, loss=0.870305, lr=0.010000 | ETA 01:16:47
2022-09-28 14:02:24,127 -     INFO - Pop model from outputs/iassd_v17/epoch_27
2022-09-28 14:02:24,269 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_32
2022-09-28 14:02:37,136 -     INFO - [TRAIN] epoch=33/80, iter=3720/9280, loss=0.836013, lr=0.010000 | ETA 01:17:12
2022-09-28 14:02:45,462 -     INFO - [TRAIN] epoch=33/80, iter=3730/9280, loss=0.822600, lr=0.010000 | ETA 01:21:36
2022-09-28 14:02:53,683 -     INFO - [TRAIN] epoch=33/80, iter=3740/9280, loss=0.806034, lr=0.009999 | ETA 01:16:22
2022-09-28 14:03:02,834 -     INFO - [TRAIN] epoch=33/80, iter=3750/9280, loss=0.796563, lr=0.009999 | ETA 01:28:06
2022-09-28 14:03:12,550 -     INFO - [TRAIN] epoch=33/80, iter=3760/9280, loss=0.783079, lr=0.009998 | ETA 01:28:28
2022-09-28 14:03:22,399 -     INFO - [TRAIN] epoch=33/80, iter=3770/9280, loss=0.784279, lr=0.009997 | ETA 01:30:13
2022-09-28 14:03:32,460 -     INFO - [TRAIN] epoch=33/80, iter=3780/9280, loss=0.775822, lr=0.009996 | ETA 01:32:12
2022-09-28 14:03:42,326 -     INFO - [TRAIN] epoch=33/80, iter=3790/9280, loss=0.757120, lr=0.009995 | ETA 01:30:43
2022-09-28 14:03:52,536 -     INFO - [TRAIN] epoch=33/80, iter=3800/9280, loss=0.761765, lr=0.009994 | ETA 01:39:41
2022-09-28 14:04:03,022 -     INFO - [TRAIN] epoch=33/80, iter=3810/9280, loss=0.762564, lr=0.009993 | ETA 01:15:19
2022-09-28 14:04:11,292 -     INFO - [TRAIN] epoch=33/80, iter=3820/9280, loss=0.744299, lr=0.009991 | ETA 01:16:03
2022-09-28 14:04:17,799 -     INFO - Pop model from outputs/iassd_v17/epoch_28
2022-09-28 14:04:17,937 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_33
2022-09-28 14:04:26,015 -     INFO - [TRAIN] epoch=34/80, iter=3830/9280, loss=0.744615, lr=0.009989 | ETA 03:43:00
2022-09-28 14:04:34,500 -     INFO - [TRAIN] epoch=34/80, iter=3840/9280, loss=0.744390, lr=0.009987 | ETA 01:18:31
2022-09-28 14:04:43,080 -     INFO - [TRAIN] epoch=34/80, iter=3850/9280, loss=0.744268, lr=0.009985 | ETA 01:21:04
2022-09-28 14:04:51,364 -     INFO - [TRAIN] epoch=34/80, iter=3860/9280, loss=0.755551, lr=0.009983 | ETA 01:15:09
2022-09-28 14:04:59,559 -     INFO - [TRAIN] epoch=34/80, iter=3870/9280, loss=0.750547, lr=0.009980 | ETA 01:13:42
2022-09-28 14:05:07,716 -     INFO - [TRAIN] epoch=34/80, iter=3880/9280, loss=0.751627, lr=0.009978 | ETA 01:13:45
2022-09-28 14:05:15,950 -     INFO - [TRAIN] epoch=34/80, iter=3890/9280, loss=0.734534, lr=0.009975 | ETA 01:13:40
2022-09-28 14:05:24,187 -     INFO - [TRAIN] epoch=34/80, iter=3900/9280, loss=0.735812, lr=0.009972 | ETA 01:13:16
2022-09-28 14:05:32,468 -     INFO - [TRAIN] epoch=34/80, iter=3910/9280, loss=0.742930, lr=0.009969 | ETA 01:14:27
2022-09-28 14:05:40,758 -     INFO - [TRAIN] epoch=34/80, iter=3920/9280, loss=0.723159, lr=0.009966 | ETA 01:15:36
2022-09-28 14:05:49,283 -     INFO - [TRAIN] epoch=34/80, iter=3930/9280, loss=0.716940, lr=0.009963 | ETA 01:21:14
2022-09-28 14:05:57,848 -     INFO - [TRAIN] epoch=34/80, iter=3940/9280, loss=0.731426, lr=0.009959 | ETA 01:12:16
2022-09-28 14:06:01,060 -     INFO - Pop model from outputs/iassd_v17/epoch_29
2022-09-28 14:06:01,207 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_34
2022-09-28 14:06:11,994 -     INFO - [TRAIN] epoch=35/80, iter=3950/9280, loss=0.743968, lr=0.009955 | ETA 01:22:31
2022-09-28 14:06:20,302 -     INFO - [TRAIN] epoch=35/80, iter=3960/9280, loss=0.722083, lr=0.009952 | ETA 01:13:28
2022-09-28 14:06:28,556 -     INFO - [TRAIN] epoch=35/80, iter=3970/9280, loss=0.731302, lr=0.009948 | ETA 01:11:56
2022-09-28 14:06:37,085 -     INFO - [TRAIN] epoch=35/80, iter=3980/9280, loss=0.717623, lr=0.009943 | ETA 01:19:45
2022-09-28 14:06:45,678 -     INFO - [TRAIN] epoch=35/80, iter=3990/9280, loss=0.733170, lr=0.009939 | ETA 01:13:23
2022-09-28 14:06:54,766 -     INFO - [TRAIN] epoch=35/80, iter=4000/9280, loss=0.724382, lr=0.009935 | ETA 01:22:39
2022-09-28 14:07:03,120 -     INFO - [TRAIN] epoch=35/80, iter=4010/9280, loss=0.721927, lr=0.009930 | ETA 01:12:08
2022-09-28 14:07:11,389 -     INFO - [TRAIN] epoch=35/80, iter=4020/9280, loss=0.724946, lr=0.009925 | ETA 01:13:13
2022-09-28 14:07:19,762 -     INFO - [TRAIN] epoch=35/80, iter=4030/9280, loss=0.707818, lr=0.009920 | ETA 01:13:17
2022-09-28 14:07:27,945 -     INFO - [TRAIN] epoch=35/80, iter=4040/9280, loss=0.712146, lr=0.009915 | ETA 01:12:51
2022-09-28 14:07:36,215 -     INFO - [TRAIN] epoch=35/80, iter=4050/9280, loss=0.737075, lr=0.009910 | ETA 01:11:31
2022-09-28 14:07:44,522 -     INFO - [TRAIN] epoch=35/80, iter=4060/9280, loss=0.724148, lr=0.009904 | ETA 01:09:58
2022-09-28 14:07:44,527 -     INFO - Pop model from outputs/iassd_v17/epoch_30
2022-09-28 14:07:44,670 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_35
2022-09-28 14:07:59,354 -     INFO - [TRAIN] epoch=36/80, iter=4070/9280, loss=0.723727, lr=0.009899 | ETA 01:13:02
2022-09-28 14:08:07,590 -     INFO - [TRAIN] epoch=36/80, iter=4080/9280, loss=0.704184, lr=0.009893 | ETA 01:11:45
2022-09-28 14:08:15,853 -     INFO - [TRAIN] epoch=36/80, iter=4090/9280, loss=0.728302, lr=0.009887 | ETA 01:09:37
2022-09-28 14:08:24,764 -     INFO - [TRAIN] epoch=36/80, iter=4100/9280, loss=0.719129, lr=0.009881 | ETA 01:16:17
2022-09-28 14:08:32,921 -     INFO - [TRAIN] epoch=36/80, iter=4110/9280, loss=0.719887, lr=0.009875 | ETA 01:10:57
2022-09-28 14:08:41,342 -     INFO - [TRAIN] epoch=36/80, iter=4120/9280, loss=0.709194, lr=0.009869 | ETA 01:17:07
2022-09-28 14:08:49,654 -     INFO - [TRAIN] epoch=36/80, iter=4130/9280, loss=0.698935, lr=0.009862 | ETA 01:09:07
2022-09-28 14:08:58,372 -     INFO - [TRAIN] epoch=36/80, iter=4140/9280, loss=0.718321, lr=0.009856 | ETA 01:14:31
2022-09-28 14:09:06,591 -     INFO - [TRAIN] epoch=36/80, iter=4150/9280, loss=0.697120, lr=0.009849 | ETA 01:09:35
2022-09-28 14:09:15,048 -     INFO - [TRAIN] epoch=36/80, iter=4160/9280, loss=0.710679, lr=0.009842 | ETA 01:16:11
2022-09-28 14:09:23,792 -     INFO - [TRAIN] epoch=36/80, iter=4170/9280, loss=0.715467, lr=0.009835 | ETA 01:10:22
2022-09-28 14:09:28,635 -     INFO - Pop model from outputs/iassd_v17/epoch_31
2022-09-28 14:09:28,798 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_36
2022-09-28 14:09:38,137 -     INFO - [TRAIN] epoch=37/80, iter=4180/9280, loss=0.711616, lr=0.009827 | ETA 01:42:24
2022-09-28 14:09:46,819 -     INFO - [TRAIN] epoch=37/80, iter=4190/9280, loss=0.724889, lr=0.009820 | ETA 01:17:25
2022-09-28 14:09:55,302 -     INFO - [TRAIN] epoch=37/80, iter=4200/9280, loss=0.728662, lr=0.009812 | ETA 01:10:22
2022-09-28 14:10:03,630 -     INFO - [TRAIN] epoch=37/80, iter=4210/9280, loss=0.703452, lr=0.009805 | ETA 01:11:24
2022-09-28 14:10:11,772 -     INFO - [TRAIN] epoch=37/80, iter=4220/9280, loss=0.715354, lr=0.009797 | ETA 01:08:47
2022-09-28 14:10:19,988 -     INFO - [TRAIN] epoch=37/80, iter=4230/9280, loss=0.715020, lr=0.009789 | ETA 01:10:11
2022-09-28 14:10:28,237 -     INFO - [TRAIN] epoch=37/80, iter=4240/9280, loss=0.687799, lr=0.009781 | ETA 01:08:13
2022-09-28 14:10:37,124 -     INFO - [TRAIN] epoch=37/80, iter=4250/9280, loss=0.713720, lr=0.009772 | ETA 01:18:14
2022-09-28 14:10:46,239 -     INFO - [TRAIN] epoch=37/80, iter=4260/9280, loss=0.690096, lr=0.009764 | ETA 01:15:34
2022-09-28 14:10:54,885 -     INFO - [TRAIN] epoch=37/80, iter=4270/9280, loss=0.709104, lr=0.009755 | ETA 01:16:22
2022-09-28 14:11:03,484 -     INFO - [TRAIN] epoch=37/80, iter=4280/9280, loss=0.708624, lr=0.009746 | ETA 01:12:32
2022-09-28 14:11:11,973 -     INFO - [TRAIN] epoch=37/80, iter=4290/9280, loss=0.702621, lr=0.009737 | ETA 01:07:18
2022-09-28 14:11:13,575 -     INFO - Pop model from outputs/iassd_v17/epoch_32
2022-09-28 14:11:13,716 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_37
2022-09-28 14:11:26,157 -     INFO - [TRAIN] epoch=38/80, iter=4300/9280, loss=0.704594, lr=0.009728 | ETA 01:09:39
2022-09-28 14:11:34,544 -     INFO - [TRAIN] epoch=38/80, iter=4310/9280, loss=0.698130, lr=0.009719 | ETA 01:08:59
2022-09-28 14:11:42,874 -     INFO - [TRAIN] epoch=38/80, iter=4320/9280, loss=0.709658, lr=0.009710 | ETA 01:08:54
2022-09-28 14:11:50,962 -     INFO - [TRAIN] epoch=38/80, iter=4330/9280, loss=0.700921, lr=0.009700 | ETA 01:07:07
2022-09-28 14:11:59,302 -     INFO - [TRAIN] epoch=38/80, iter=4340/9280, loss=0.697147, lr=0.009690 | ETA 01:06:43
2022-09-28 14:12:07,459 -     INFO - [TRAIN] epoch=38/80, iter=4350/9280, loss=0.702518, lr=0.009681 | ETA 01:08:34
2022-09-28 14:12:15,634 -     INFO - [TRAIN] epoch=38/80, iter=4360/9280, loss=0.696790, lr=0.009671 | ETA 01:06:00
2022-09-28 14:12:24,148 -     INFO - [TRAIN] epoch=38/80, iter=4370/9280, loss=0.680045, lr=0.009660 | ETA 01:14:32
2022-09-28 14:12:32,366 -     INFO - [TRAIN] epoch=38/80, iter=4380/9280, loss=0.680285, lr=0.009650 | ETA 01:06:30
2022-09-28 14:12:40,518 -     INFO - [TRAIN] epoch=38/80, iter=4390/9280, loss=0.677127, lr=0.009640 | ETA 01:06:23
2022-09-28 14:12:48,739 -     INFO - [TRAIN] epoch=38/80, iter=4400/9280, loss=0.694285, lr=0.009629 | ETA 01:06:11
2022-09-28 14:12:55,657 -     INFO - Pop model from outputs/iassd_v17/epoch_33
2022-09-28 14:12:55,811 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_38
2022-09-28 14:13:03,449 -     INFO - [TRAIN] epoch=39/80, iter=4410/9280, loss=0.710626, lr=0.009618 | ETA 03:13:20
2022-09-28 14:13:11,838 -     INFO - [TRAIN] epoch=39/80, iter=4420/9280, loss=0.714959, lr=0.009607 | ETA 01:06:48
2022-09-28 14:13:19,937 -     INFO - [TRAIN] epoch=39/80, iter=4430/9280, loss=0.705137, lr=0.009596 | ETA 01:05:15
2022-09-28 14:13:28,096 -     INFO - [TRAIN] epoch=39/80, iter=4440/9280, loss=0.715117, lr=0.009585 | ETA 01:06:05
2022-09-28 14:13:36,210 -     INFO - [TRAIN] epoch=39/80, iter=4450/9280, loss=0.693410, lr=0.009574 | ETA 01:06:06
2022-09-28 14:13:44,358 -     INFO - [TRAIN] epoch=39/80, iter=4460/9280, loss=0.697317, lr=0.009562 | ETA 01:06:20
2022-09-28 14:13:52,612 -     INFO - [TRAIN] epoch=39/80, iter=4470/9280, loss=0.685567, lr=0.009551 | ETA 01:08:41
2022-09-28 14:14:00,891 -     INFO - [TRAIN] epoch=39/80, iter=4480/9280, loss=0.701006, lr=0.009539 | ETA 01:08:00
2022-09-28 14:14:09,060 -     INFO - [TRAIN] epoch=39/80, iter=4490/9280, loss=0.680332, lr=0.009527 | ETA 01:05:26
2022-09-28 14:14:17,299 -     INFO - [TRAIN] epoch=39/80, iter=4500/9280, loss=0.682798, lr=0.009515 | ETA 01:07:26
2022-09-28 14:14:26,040 -     INFO - [TRAIN] epoch=39/80, iter=4510/9280, loss=0.670046, lr=0.009503 | ETA 01:10:45
2022-09-28 14:14:34,653 -     INFO - [TRAIN] epoch=39/80, iter=4520/9280, loss=0.677692, lr=0.009491 | ETA 01:11:23
2022-09-28 14:14:38,195 -     INFO - Pop model from outputs/iassd_v17/epoch_34
2022-09-28 14:14:38,340 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_39
2022-09-28 14:14:49,164 -     INFO - [TRAIN] epoch=40/80, iter=4530/9280, loss=0.700996, lr=0.009478 | ETA 01:14:29
2022-09-28 14:14:57,432 -     INFO - [TRAIN] epoch=40/80, iter=4540/9280, loss=0.678387, lr=0.009465 | ETA 01:06:07
2022-09-28 14:15:05,817 -     INFO - [TRAIN] epoch=40/80, iter=4550/9280, loss=0.713602, lr=0.009453 | ETA 01:06:00
2022-09-28 14:15:21,411 -     INFO - [TRAIN] epoch=40/80, iter=4560/9280, loss=0.704324, lr=0.009440 | ETA 05:38:40
2022-09-28 14:16:36,165 -     INFO - [TRAIN] epoch=40/80, iter=4570/9280, loss=0.692488, lr=0.009427 | ETA 09:47:54
2022-09-28 14:17:51,168 -     INFO - [TRAIN] epoch=40/80, iter=4580/9280, loss=0.699146, lr=0.009414 | ETA 09:46:41
2022-09-28 14:19:06,091 -     INFO - [TRAIN] epoch=40/80, iter=4590/9280, loss=0.689446, lr=0.009400 | ETA 09:46:51
2022-09-28 14:20:20,989 -     INFO - [TRAIN] epoch=40/80, iter=4600/9280, loss=0.662542, lr=0.009387 | ETA 09:37:37
2022-09-28 14:21:34,659 -     INFO - [TRAIN] epoch=40/80, iter=4610/9280, loss=0.663722, lr=0.009373 | ETA 09:33:17
2022-09-28 14:22:48,348 -     INFO - [TRAIN] epoch=40/80, iter=4620/9280, loss=0.687397, lr=0.009359 | ETA 09:32:48
2022-09-28 14:24:02,163 -     INFO - [TRAIN] epoch=40/80, iter=4630/9280, loss=0.668729, lr=0.009346 | ETA 09:31:55
2022-09-28 14:25:15,770 -     INFO - [TRAIN] epoch=40/80, iter=4640/9280, loss=0.688933, lr=0.009332 | ETA 09:27:47
2022-09-28 14:25:15,776 -     INFO - Pop model from outputs/iassd_v17/epoch_35
2022-09-28 14:25:16,104 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_40
2022-09-28 14:25:35,256 -     INFO - [TRAIN] epoch=41/80, iter=4650/9280, loss=0.694726, lr=0.009317 | ETA 01:03:31
2022-09-28 14:25:43,351 -     INFO - [TRAIN] epoch=41/80, iter=4660/9280, loss=0.696766, lr=0.009303 | ETA 01:02:42
2022-09-28 14:25:51,380 -     INFO - [TRAIN] epoch=41/80, iter=4670/9280, loss=0.703699, lr=0.009289 | ETA 01:02:08
2022-09-28 14:25:59,813 -     INFO - [TRAIN] epoch=41/80, iter=4680/9280, loss=0.676009, lr=0.009274 | ETA 01:01:41
2022-09-28 14:26:07,975 -     INFO - [TRAIN] epoch=41/80, iter=4690/9280, loss=0.694744, lr=0.009259 | ETA 01:04:31
2022-09-28 14:26:16,175 -     INFO - [TRAIN] epoch=41/80, iter=4700/9280, loss=0.687007, lr=0.009245 | ETA 01:01:57
2022-09-28 14:26:24,694 -     INFO - [TRAIN] epoch=41/80, iter=4710/9280, loss=0.664274, lr=0.009230 | ETA 01:07:38
2022-09-28 14:26:32,703 -     INFO - [TRAIN] epoch=41/80, iter=4720/9280, loss=0.657977, lr=0.009214 | ETA 01:00:52
2022-09-28 14:26:40,774 -     INFO - [TRAIN] epoch=41/80, iter=4730/9280, loss=0.647501, lr=0.009199 | ETA 01:01:00
2022-09-28 14:26:48,865 -     INFO - [TRAIN] epoch=41/80, iter=4740/9280, loss=0.657462, lr=0.009184 | ETA 01:02:32
2022-09-28 14:26:56,938 -     INFO - [TRAIN] epoch=41/80, iter=4750/9280, loss=0.664604, lr=0.009168 | ETA 01:00:54
2022-09-28 14:27:01,690 -     INFO - Pop model from outputs/iassd_v17/epoch_36
2022-09-28 14:27:01,826 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_41
2022-09-28 14:27:11,036 -     INFO - [TRAIN] epoch=42/80, iter=4760/9280, loss=0.681009, lr=0.009153 | ETA 01:28:32
2022-09-28 14:27:19,049 -     INFO - [TRAIN] epoch=42/80, iter=4770/9280, loss=0.673993, lr=0.009137 | ETA 01:00:00
2022-09-28 14:27:27,421 -     INFO - [TRAIN] epoch=42/80, iter=4780/9280, loss=0.669038, lr=0.009121 | ETA 01:05:32
2022-09-28 14:27:36,234 -     INFO - [TRAIN] epoch=42/80, iter=4790/9280, loss=0.678003, lr=0.009105 | ETA 01:06:16
2022-09-28 14:27:44,966 -     INFO - [TRAIN] epoch=42/80, iter=4800/9280, loss=0.654812, lr=0.009089 | ETA 01:02:23
2022-09-28 14:27:53,126 -     INFO - [TRAIN] epoch=42/80, iter=4810/9280, loss=0.682206, lr=0.009072 | ETA 01:03:34
2022-09-28 14:28:01,871 -     INFO - [TRAIN] epoch=42/80, iter=4820/9280, loss=0.673696, lr=0.009056 | ETA 01:04:44
2022-09-28 14:28:10,737 -     INFO - [TRAIN] epoch=42/80, iter=4830/9280, loss=0.647242, lr=0.009039 | ETA 01:05:55
2022-09-28 14:28:19,180 -     INFO - [TRAIN] epoch=42/80, iter=4840/9280, loss=0.644522, lr=0.009023 | ETA 01:03:20
2022-09-28 14:28:27,279 -     INFO - [TRAIN] epoch=42/80, iter=4850/9280, loss=0.658123, lr=0.009006 | ETA 00:58:58
2022-09-28 14:28:35,693 -     INFO - [TRAIN] epoch=42/80, iter=4860/9280, loss=0.651953, lr=0.008989 | ETA 01:03:45
2022-09-28 14:28:44,064 -     INFO - [TRAIN] epoch=42/80, iter=4870/9280, loss=0.665214, lr=0.008972 | ETA 00:58:04
2022-09-28 14:28:45,641 -     INFO - Pop model from outputs/iassd_v17/epoch_37
2022-09-28 14:28:45,780 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_42
2022-09-28 14:28:58,837 -     INFO - [TRAIN] epoch=43/80, iter=4880/9280, loss=0.707340, lr=0.008955 | ETA 01:11:48
2022-09-28 14:29:07,317 -     INFO - [TRAIN] epoch=43/80, iter=4890/9280, loss=0.704748, lr=0.008937 | ETA 00:59:49
2022-09-28 14:29:16,050 -     INFO - [TRAIN] epoch=43/80, iter=4900/9280, loss=0.727202, lr=0.008920 | ETA 01:04:00
2022-09-28 14:29:24,603 -     INFO - [TRAIN] epoch=43/80, iter=4910/9280, loss=0.694418, lr=0.008902 | ETA 01:00:59
2022-09-28 14:29:32,908 -     INFO - [TRAIN] epoch=43/80, iter=4920/9280, loss=0.679928, lr=0.008885 | ETA 01:01:15
2022-09-28 14:29:41,731 -     INFO - [TRAIN] epoch=43/80, iter=4930/9280, loss=0.681502, lr=0.008867 | ETA 01:03:25
2022-09-28 14:29:49,939 -     INFO - [TRAIN] epoch=43/80, iter=4940/9280, loss=0.681338, lr=0.008849 | ETA 00:59:05
2022-09-28 14:29:58,243 -     INFO - [TRAIN] epoch=43/80, iter=4950/9280, loss=0.656266, lr=0.008831 | ETA 01:02:55
2022-09-28 14:30:07,048 -     INFO - [TRAIN] epoch=43/80, iter=4960/9280, loss=0.647907, lr=0.008813 | ETA 01:02:45
2022-09-28 14:30:15,619 -     INFO - [TRAIN] epoch=43/80, iter=4970/9280, loss=0.642153, lr=0.008794 | ETA 01:02:36
2022-09-28 14:30:23,737 -     INFO - [TRAIN] epoch=43/80, iter=4980/9280, loss=0.658664, lr=0.008776 | ETA 00:56:51
2022-09-28 14:30:30,630 -     INFO - Pop model from outputs/iassd_v17/epoch_38
2022-09-28 14:30:30,779 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_43
2022-09-28 14:30:38,607 -     INFO - [TRAIN] epoch=44/80, iter=4990/9280, loss=0.668022, lr=0.008757 | ETA 02:54:14
2022-09-28 14:30:47,558 -     INFO - [TRAIN] epoch=44/80, iter=5000/9280, loss=0.672417, lr=0.008739 | ETA 01:03:30
2022-09-28 14:30:55,668 -     INFO - [TRAIN] epoch=44/80, iter=5010/9280, loss=0.656448, lr=0.008720 | ETA 00:59:27
2022-09-28 14:31:03,759 -     INFO - [TRAIN] epoch=44/80, iter=5020/9280, loss=0.663375, lr=0.008701 | ETA 00:56:48
2022-09-28 14:31:12,225 -     INFO - [TRAIN] epoch=44/80, iter=5030/9280, loss=0.640838, lr=0.008682 | ETA 01:02:10
2022-09-28 14:31:20,261 -     INFO - [TRAIN] epoch=44/80, iter=5040/9280, loss=0.654207, lr=0.008663 | ETA 00:56:16
2022-09-28 14:31:28,914 -     INFO - [TRAIN] epoch=44/80, iter=5050/9280, loss=0.652004, lr=0.008644 | ETA 00:57:30
2022-09-28 14:31:37,221 -     INFO - [TRAIN] epoch=44/80, iter=5060/9280, loss=0.640908, lr=0.008624 | ETA 00:56:58
2022-09-28 14:31:45,256 -     INFO - [TRAIN] epoch=44/80, iter=5070/9280, loss=0.641960, lr=0.008605 | ETA 00:57:40
2022-09-28 14:31:53,268 -     INFO - [TRAIN] epoch=44/80, iter=5080/9280, loss=0.621117, lr=0.008585 | ETA 00:56:16
2022-09-28 14:32:01,286 -     INFO - [TRAIN] epoch=44/80, iter=5090/9280, loss=0.639120, lr=0.008565 | ETA 00:56:54
2022-09-28 14:32:09,314 -     INFO - [TRAIN] epoch=44/80, iter=5100/9280, loss=0.658992, lr=0.008546 | ETA 00:55:52
2022-09-28 14:32:12,477 -     INFO - Pop model from outputs/iassd_v17/epoch_39
2022-09-28 14:32:12,612 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_44
2022-09-28 14:32:23,305 -     INFO - [TRAIN] epoch=45/80, iter=5110/9280, loss=0.646484, lr=0.008526 | ETA 01:02:26
2022-09-28 14:32:31,902 -     INFO - [TRAIN] epoch=45/80, iter=5120/9280, loss=0.639428, lr=0.008506 | ETA 00:59:22
2022-09-28 14:32:40,646 -     INFO - [TRAIN] epoch=45/80, iter=5130/9280, loss=0.662376, lr=0.008485 | ETA 01:02:23
2022-09-28 14:32:48,860 -     INFO - [TRAIN] epoch=45/80, iter=5140/9280, loss=0.658950, lr=0.008465 | ETA 00:58:16
2022-09-28 14:32:56,972 -     INFO - [TRAIN] epoch=45/80, iter=5150/9280, loss=0.659661, lr=0.008445 | ETA 00:55:28
2022-09-28 14:33:05,047 -     INFO - [TRAIN] epoch=45/80, iter=5160/9280, loss=0.650748, lr=0.008424 | ETA 00:56:20
2022-09-28 14:33:13,046 -     INFO - [TRAIN] epoch=45/80, iter=5170/9280, loss=0.648917, lr=0.008404 | ETA 00:53:51
2022-09-28 14:33:21,355 -     INFO - [TRAIN] epoch=45/80, iter=5180/9280, loss=0.640188, lr=0.008383 | ETA 00:59:44
2022-09-28 14:33:29,868 -     INFO - [TRAIN] epoch=45/80, iter=5190/9280, loss=0.638602, lr=0.008362 | ETA 00:54:20
2022-09-28 14:33:37,848 -     INFO - [TRAIN] epoch=45/80, iter=5200/9280, loss=0.625615, lr=0.008341 | ETA 00:54:35
2022-09-28 14:33:46,207 -     INFO - [TRAIN] epoch=45/80, iter=5210/9280, loss=0.644910, lr=0.008320 | ETA 00:59:23
2022-09-28 14:33:54,715 -     INFO - [TRAIN] epoch=45/80, iter=5220/9280, loss=0.655817, lr=0.008299 | ETA 00:59:22
2022-09-28 14:33:54,725 -     INFO - Pop model from outputs/iassd_v17/epoch_40
2022-09-28 14:33:54,869 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_45
2022-09-28 14:34:09,582 -     INFO - [TRAIN] epoch=46/80, iter=5230/9280, loss=0.640633, lr=0.008278 | ETA 01:00:12
2022-09-28 14:34:17,881 -     INFO - [TRAIN] epoch=46/80, iter=5240/9280, loss=0.638279, lr=0.008256 | ETA 00:56:52
2022-09-28 14:34:26,525 -     INFO - [TRAIN] epoch=46/80, iter=5250/9280, loss=0.659185, lr=0.008235 | ETA 00:58:00
2022-09-28 14:34:35,962 -     INFO - [TRAIN] epoch=46/80, iter=5260/9280, loss=0.636104, lr=0.008213 | ETA 00:54:10
2022-09-28 14:34:44,077 -     INFO - [TRAIN] epoch=46/80, iter=5270/9280, loss=0.648991, lr=0.008192 | ETA 00:58:19
2022-09-28 14:34:52,410 -     INFO - [TRAIN] epoch=46/80, iter=5280/9280, loss=0.647083, lr=0.008170 | ETA 00:58:08
2022-09-28 14:35:01,189 -     INFO - [TRAIN] epoch=46/80, iter=5290/9280, loss=0.638341, lr=0.008148 | ETA 00:57:13
2022-09-28 14:35:09,510 -     INFO - [TRAIN] epoch=46/80, iter=5300/9280, loss=0.633430, lr=0.008126 | ETA 00:54:22
2022-09-28 14:35:18,320 -     INFO - [TRAIN] epoch=46/80, iter=5310/9280, loss=0.635537, lr=0.008104 | ETA 00:56:52
2022-09-28 14:35:26,318 -     INFO - [TRAIN] epoch=46/80, iter=5320/9280, loss=0.646497, lr=0.008082 | ETA 00:53:17
2022-09-28 14:35:34,678 -     INFO - [TRAIN] epoch=46/80, iter=5330/9280, loss=0.642693, lr=0.008059 | ETA 00:53:11
2022-09-28 14:35:39,485 -     INFO - Pop model from outputs/iassd_v17/epoch_41
2022-09-28 14:35:39,621 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_46
2022-09-28 14:35:48,939 -     INFO - [TRAIN] epoch=47/80, iter=5340/9280, loss=0.653552, lr=0.008037 | ETA 01:21:53
2022-09-28 14:35:57,238 -     INFO - [TRAIN] epoch=47/80, iter=5350/9280, loss=0.652752, lr=0.008015 | ETA 00:52:28
2022-09-28 14:36:05,912 -     INFO - [TRAIN] epoch=47/80, iter=5360/9280, loss=0.654035, lr=0.007992 | ETA 00:56:51
2022-09-28 14:36:14,043 -     INFO - [TRAIN] epoch=47/80, iter=5370/9280, loss=0.649273, lr=0.007969 | ETA 00:52:37
2022-09-28 14:36:22,338 -     INFO - [TRAIN] epoch=47/80, iter=5380/9280, loss=0.642848, lr=0.007947 | ETA 00:56:02
2022-09-28 14:36:31,116 -     INFO - [TRAIN] epoch=47/80, iter=5390/9280, loss=0.638724, lr=0.007924 | ETA 00:57:13
2022-09-28 14:36:39,874 -     INFO - [TRAIN] epoch=47/80, iter=5400/9280, loss=0.649883, lr=0.007901 | ETA 00:56:40
2022-09-28 14:36:48,313 -     INFO - [TRAIN] epoch=47/80, iter=5410/9280, loss=0.631927, lr=0.007878 | ETA 00:51:53
2022-09-28 14:36:56,963 -     INFO - [TRAIN] epoch=47/80, iter=5420/9280, loss=0.646251, lr=0.007855 | ETA 00:55:15
2022-09-28 14:37:05,126 -     INFO - [TRAIN] epoch=47/80, iter=5430/9280, loss=0.634169, lr=0.007832 | ETA 00:55:20
2022-09-28 14:37:13,926 -     INFO - [TRAIN] epoch=47/80, iter=5440/9280, loss=0.616372, lr=0.007808 | ETA 00:56:48
2022-09-28 14:37:22,791 -     INFO - [TRAIN] epoch=47/80, iter=5450/9280, loss=0.644894, lr=0.007785 | ETA 00:56:00
2022-09-28 14:37:24,563 -     INFO - Pop model from outputs/iassd_v17/epoch_42
2022-09-28 14:37:24,699 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_47
2022-09-28 14:37:37,281 -     INFO - [TRAIN] epoch=48/80, iter=5460/9280, loss=0.640384, lr=0.007761 | ETA 00:53:24
2022-09-28 14:37:45,636 -     INFO - [TRAIN] epoch=48/80, iter=5470/9280, loss=0.631745, lr=0.007738 | ETA 00:53:05
2022-09-28 14:37:54,265 -     INFO - [TRAIN] epoch=48/80, iter=5480/9280, loss=0.643775, lr=0.007714 | ETA 00:55:03
2022-09-28 14:38:02,507 -     INFO - [TRAIN] epoch=48/80, iter=5490/9280, loss=0.623610, lr=0.007690 | ETA 00:50:52
2022-09-28 14:38:10,926 -     INFO - [TRAIN] epoch=48/80, iter=5500/9280, loss=0.622362, lr=0.007667 | ETA 00:54:50
2022-09-28 14:38:19,775 -     INFO - [TRAIN] epoch=48/80, iter=5510/9280, loss=0.639008, lr=0.007643 | ETA 01:01:46
2022-09-28 14:38:28,344 -     INFO - [TRAIN] epoch=48/80, iter=5520/9280, loss=0.618368, lr=0.007619 | ETA 01:00:10
2022-09-28 14:38:37,129 -     INFO - [TRAIN] epoch=48/80, iter=5530/9280, loss=0.614328, lr=0.007595 | ETA 00:54:50
2022-09-28 14:38:45,185 -     INFO - [TRAIN] epoch=48/80, iter=5540/9280, loss=0.617594, lr=0.007571 | ETA 00:49:55
2022-09-28 14:38:53,534 -     INFO - [TRAIN] epoch=48/80, iter=5550/9280, loss=0.624441, lr=0.007546 | ETA 00:51:46
2022-09-28 14:39:01,471 -     INFO - [TRAIN] epoch=48/80, iter=5560/9280, loss=0.623401, lr=0.007522 | ETA 00:49:02
2022-09-28 14:39:07,839 -     INFO - Pop model from outputs/iassd_v17/epoch_43
2022-09-28 14:39:07,972 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_48
2022-09-28 14:39:15,565 -     INFO - [TRAIN] epoch=49/80, iter=5570/9280, loss=0.641727, lr=0.007498 | ETA 02:25:17
2022-09-28 14:39:24,317 -     INFO - [TRAIN] epoch=49/80, iter=5580/9280, loss=0.639750, lr=0.007473 | ETA 00:51:47
2022-09-28 14:39:33,166 -     INFO - [TRAIN] epoch=49/80, iter=5590/9280, loss=0.641799, lr=0.007449 | ETA 00:55:45
2022-09-28 14:39:41,193 -     INFO - [TRAIN] epoch=49/80, iter=5600/9280, loss=0.638531, lr=0.007424 | ETA 00:48:46
2022-09-28 14:39:49,442 -     INFO - [TRAIN] epoch=49/80, iter=5610/9280, loss=0.640759, lr=0.007399 | ETA 00:50:59
2022-09-28 14:39:57,946 -     INFO - [TRAIN] epoch=49/80, iter=5620/9280, loss=0.627937, lr=0.007374 | ETA 00:51:29
2022-09-28 14:40:06,437 -     INFO - [TRAIN] epoch=49/80, iter=5630/9280, loss=0.621421, lr=0.007350 | ETA 00:50:58
2022-09-28 14:40:15,085 -     INFO - [TRAIN] epoch=49/80, iter=5640/9280, loss=0.630577, lr=0.007325 | ETA 00:52:07
2022-09-28 14:40:23,629 -     INFO - [TRAIN] epoch=49/80, iter=5650/9280, loss=0.626907, lr=0.007300 | ETA 00:53:44
2022-09-28 14:40:32,296 -     INFO - [TRAIN] epoch=49/80, iter=5660/9280, loss=0.610130, lr=0.007275 | ETA 00:50:29
2022-09-28 14:40:40,608 -     INFO - [TRAIN] epoch=49/80, iter=5670/9280, loss=0.619449, lr=0.007249 | ETA 00:49:39
2022-09-28 14:40:49,195 -     INFO - [TRAIN] epoch=49/80, iter=5680/9280, loss=0.634968, lr=0.007224 | ETA 00:52:59
2022-09-28 14:40:52,815 -     INFO - Pop model from outputs/iassd_v17/epoch_44
2022-09-28 14:40:52,955 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_49
2022-09-28 14:41:04,004 -     INFO - [TRAIN] epoch=50/80, iter=5690/9280, loss=0.627844, lr=0.007199 | ETA 00:54:52
2022-09-28 14:41:12,188 -     INFO - [TRAIN] epoch=50/80, iter=5700/9280, loss=0.614529, lr=0.007173 | ETA 00:49:51
2022-09-28 14:41:20,574 -     INFO - [TRAIN] epoch=50/80, iter=5710/9280, loss=0.643321, lr=0.007148 | ETA 00:48:43
2022-09-28 14:41:28,919 -     INFO - [TRAIN] epoch=50/80, iter=5720/9280, loss=0.618562, lr=0.007122 | ETA 00:49:43
2022-09-28 14:41:37,276 -     INFO - [TRAIN] epoch=50/80, iter=5730/9280, loss=0.627381, lr=0.007097 | ETA 00:51:05
2022-09-28 14:41:45,663 -     INFO - [TRAIN] epoch=50/80, iter=5740/9280, loss=0.644035, lr=0.007071 | ETA 00:49:32
2022-09-28 14:41:53,981 -     INFO - [TRAIN] epoch=50/80, iter=5750/9280, loss=0.634910, lr=0.007046 | ETA 00:48:12
2022-09-28 14:42:02,307 -     INFO - [TRAIN] epoch=50/80, iter=5760/9280, loss=0.623834, lr=0.007020 | ETA 00:50:03
2022-09-28 14:42:10,773 -     INFO - [TRAIN] epoch=50/80, iter=5770/9280, loss=0.599403, lr=0.006994 | ETA 00:49:31
2022-09-28 14:42:19,706 -     INFO - [TRAIN] epoch=50/80, iter=5780/9280, loss=0.606196, lr=0.006968 | ETA 00:50:37
2022-09-28 14:42:27,964 -     INFO - [TRAIN] epoch=50/80, iter=5790/9280, loss=0.607128, lr=0.006942 | ETA 00:47:40
2022-09-28 14:42:38,631 -     INFO - [TRAIN] epoch=50/80, iter=5800/9280, loss=0.632320, lr=0.006916 | ETA 00:58:49
2022-09-28 14:42:38,641 -     INFO - Pop model from outputs/iassd_v17/epoch_45
2022-09-28 14:42:38,785 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_50
2022-09-28 14:42:54,827 -     INFO - [TRAIN] epoch=51/80, iter=5810/9280, loss=0.632718, lr=0.006890 | ETA 00:53:33
2022-09-28 14:43:05,909 -     INFO - [TRAIN] epoch=51/80, iter=5820/9280, loss=0.607448, lr=0.006864 | ETA 00:59:10
2022-09-28 14:43:17,054 -     INFO - [TRAIN] epoch=51/80, iter=5830/9280, loss=0.628450, lr=0.006838 | ETA 01:07:58
2022-09-28 14:43:26,762 -     INFO - [TRAIN] epoch=51/80, iter=5840/9280, loss=0.621580, lr=0.006811 | ETA 00:52:32
2022-09-28 14:43:38,034 -     INFO - [TRAIN] epoch=51/80, iter=5850/9280, loss=0.611850, lr=0.006785 | ETA 01:08:17
2022-09-28 14:43:50,626 -     INFO - [TRAIN] epoch=51/80, iter=5860/9280, loss=0.670222, lr=0.006759 | ETA 01:15:12
2022-09-28 14:44:04,397 -     INFO - [TRAIN] epoch=51/80, iter=5870/9280, loss=0.750077, lr=0.006732 | ETA 01:24:59
2022-09-28 14:44:17,322 -     INFO - [TRAIN] epoch=51/80, iter=5880/9280, loss=0.701398, lr=0.006706 | ETA 01:04:55
2022-09-28 14:44:25,702 -     INFO - [TRAIN] epoch=51/80, iter=5890/9280, loss=0.662162, lr=0.006679 | ETA 00:46:08
2022-09-28 14:44:34,088 -     INFO - [TRAIN] epoch=51/80, iter=5900/9280, loss=0.657609, lr=0.006653 | ETA 00:47:40
2022-09-28 14:44:42,623 -     INFO - [TRAIN] epoch=51/80, iter=5910/9280, loss=0.649338, lr=0.006626 | ETA 00:47:32
2022-09-28 14:44:47,714 -     INFO - Pop model from outputs/iassd_v17/epoch_46
2022-09-28 14:44:47,854 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_51
2022-09-28 14:44:57,416 -     INFO - [TRAIN] epoch=52/80, iter=5920/9280, loss=0.633835, lr=0.006599 | ETA 01:09:22
2022-09-28 14:45:05,954 -     INFO - [TRAIN] epoch=52/80, iter=5930/9280, loss=0.634921, lr=0.006572 | ETA 00:47:05
2022-09-28 14:45:14,409 -     INFO - [TRAIN] epoch=52/80, iter=5940/9280, loss=0.633585, lr=0.006546 | ETA 00:49:32
2022-09-28 14:45:22,838 -     INFO - [TRAIN] epoch=52/80, iter=5950/9280, loss=0.630161, lr=0.006519 | ETA 00:46:19
2022-09-28 14:45:31,050 -     INFO - [TRAIN] epoch=52/80, iter=5960/9280, loss=0.606986, lr=0.006492 | ETA 00:45:51
2022-09-28 14:45:39,402 -     INFO - [TRAIN] epoch=52/80, iter=5970/9280, loss=0.621750, lr=0.006465 | ETA 00:45:50
2022-09-28 14:45:47,963 -     INFO - [TRAIN] epoch=52/80, iter=5980/9280, loss=0.609540, lr=0.006438 | ETA 00:49:38
2022-09-28 14:45:56,547 -     INFO - [TRAIN] epoch=52/80, iter=5990/9280, loss=0.626421, lr=0.006411 | ETA 00:47:13
2022-09-28 14:46:04,910 -     INFO - [TRAIN] epoch=52/80, iter=6000/9280, loss=0.603767, lr=0.006384 | ETA 00:45:26
2022-09-28 14:46:13,352 -     INFO - [TRAIN] epoch=52/80, iter=6010/9280, loss=0.578794, lr=0.006357 | ETA 00:46:12
2022-09-28 14:46:21,703 -     INFO - [TRAIN] epoch=52/80, iter=6020/9280, loss=0.601949, lr=0.006330 | ETA 00:45:57
2022-09-28 14:46:30,097 -     INFO - [TRAIN] epoch=52/80, iter=6030/9280, loss=0.608555, lr=0.006302 | ETA 00:45:36
2022-09-28 14:46:31,745 -     INFO - Pop model from outputs/iassd_v17/epoch_47
2022-09-28 14:46:31,886 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_52
2022-09-28 14:46:44,654 -     INFO - [TRAIN] epoch=53/80, iter=6040/9280, loss=0.631484, lr=0.006275 | ETA 00:46:56
2022-09-28 14:46:53,074 -     INFO - [TRAIN] epoch=53/80, iter=6050/9280, loss=0.604851, lr=0.006248 | ETA 00:45:04
2022-09-28 14:47:01,453 -     INFO - [TRAIN] epoch=53/80, iter=6060/9280, loss=0.607847, lr=0.006220 | ETA 00:44:48
2022-09-28 14:47:09,708 -     INFO - [TRAIN] epoch=53/80, iter=6070/9280, loss=0.592830, lr=0.006193 | ETA 00:44:00
2022-09-28 14:47:17,980 -     INFO - [TRAIN] epoch=53/80, iter=6080/9280, loss=0.606346, lr=0.006166 | ETA 00:43:58
2022-09-28 14:47:26,343 -     INFO - [TRAIN] epoch=53/80, iter=6090/9280, loss=0.606786, lr=0.006138 | ETA 00:44:17
2022-09-28 14:47:34,699 -     INFO - [TRAIN] epoch=53/80, iter=6100/9280, loss=0.602224, lr=0.006111 | ETA 00:43:57
2022-09-28 14:47:43,157 -     INFO - [TRAIN] epoch=53/80, iter=6110/9280, loss=0.602185, lr=0.006083 | ETA 00:45:11
2022-09-28 14:47:52,004 -     INFO - [TRAIN] epoch=53/80, iter=6120/9280, loss=0.602568, lr=0.006056 | ETA 00:53:15
2022-09-28 14:48:00,630 -     INFO - [TRAIN] epoch=53/80, iter=6130/9280, loss=0.594010, lr=0.006028 | ETA 00:45:11
2022-09-28 14:48:09,046 -     INFO - [TRAIN] epoch=53/80, iter=6140/9280, loss=0.601142, lr=0.006000 | ETA 00:44:05
2022-09-28 14:48:15,721 -     INFO - Pop model from outputs/iassd_v17/epoch_48
2022-09-28 14:48:15,861 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_53
2022-09-28 14:48:23,710 -     INFO - [TRAIN] epoch=54/80, iter=6150/9280, loss=0.604348, lr=0.005973 | ETA 02:05:58
2022-09-28 14:48:32,081 -     INFO - [TRAIN] epoch=54/80, iter=6160/9280, loss=0.613736, lr=0.005945 | ETA 00:43:14
2022-09-28 14:48:40,460 -     INFO - [TRAIN] epoch=54/80, iter=6170/9280, loss=0.614366, lr=0.005917 | ETA 00:43:39
2022-09-28 14:48:50,814 -     INFO - [TRAIN] epoch=54/80, iter=6180/9280, loss=0.584911, lr=0.005890 | ETA 01:16:48
2022-09-28 14:49:04,402 -     INFO - [TRAIN] epoch=54/80, iter=6190/9280, loss=0.597283, lr=0.005862 | ETA 01:10:45
2022-09-28 14:49:16,809 -     INFO - [TRAIN] epoch=54/80, iter=6200/9280, loss=0.609103, lr=0.005834 | ETA 00:56:51
2022-09-28 14:49:28,362 -     INFO - [TRAIN] epoch=54/80, iter=6210/9280, loss=0.603992, lr=0.005806 | ETA 00:51:35
2022-09-28 14:49:37,167 -     INFO - [TRAIN] epoch=54/80, iter=6220/9280, loss=0.595852, lr=0.005778 | ETA 00:43:37
2022-09-28 14:49:45,493 -     INFO - [TRAIN] epoch=54/80, iter=6230/9280, loss=0.600137, lr=0.005750 | ETA 00:41:57
2022-09-28 14:49:54,134 -     INFO - [TRAIN] epoch=54/80, iter=6240/9280, loss=0.593880, lr=0.005723 | ETA 00:45:24
2022-09-28 14:50:02,596 -     INFO - [TRAIN] epoch=54/80, iter=6250/9280, loss=0.596284, lr=0.005695 | ETA 00:42:26
2022-09-28 14:50:10,816 -     INFO - [TRAIN] epoch=54/80, iter=6260/9280, loss=0.612329, lr=0.005667 | ETA 00:41:31
2022-09-28 14:50:14,097 -     INFO - Pop model from outputs/iassd_v17/epoch_49
2022-09-28 14:50:14,235 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_54
2022-09-28 14:50:25,467 -     INFO - [TRAIN] epoch=55/80, iter=6270/9280, loss=0.604559, lr=0.005639 | ETA 00:47:25
2022-09-28 14:50:34,064 -     INFO - [TRAIN] epoch=55/80, iter=6280/9280, loss=0.592507, lr=0.005611 | ETA 00:42:00
2022-09-28 14:50:42,370 -     INFO - [TRAIN] epoch=55/80, iter=6290/9280, loss=0.620202, lr=0.005583 | ETA 00:41:01
2022-09-28 14:50:50,782 -     INFO - [TRAIN] epoch=55/80, iter=6300/9280, loss=0.613828, lr=0.005555 | ETA 00:42:15
2022-09-28 14:50:59,405 -     INFO - [TRAIN] epoch=55/80, iter=6310/9280, loss=0.591403, lr=0.005527 | ETA 00:42:04
2022-09-28 14:51:07,790 -     INFO - [TRAIN] epoch=55/80, iter=6320/9280, loss=0.609695, lr=0.005499 | ETA 00:41:05
2022-09-28 14:51:16,295 -     INFO - [TRAIN] epoch=55/80, iter=6330/9280, loss=0.587320, lr=0.005470 | ETA 00:41:57
2022-09-28 14:51:24,623 -     INFO - [TRAIN] epoch=55/80, iter=6340/9280, loss=0.578481, lr=0.005442 | ETA 00:40:55
2022-09-28 14:51:32,901 -     INFO - [TRAIN] epoch=55/80, iter=6350/9280, loss=0.591587, lr=0.005414 | ETA 00:40:06
2022-09-28 14:51:41,320 -     INFO - [TRAIN] epoch=55/80, iter=6360/9280, loss=0.586860, lr=0.005386 | ETA 00:40:02
2022-09-28 14:51:49,685 -     INFO - [TRAIN] epoch=55/80, iter=6370/9280, loss=0.599534, lr=0.005358 | ETA 00:41:16
2022-09-28 14:51:58,111 -     INFO - [TRAIN] epoch=55/80, iter=6380/9280, loss=0.583573, lr=0.005330 | ETA 00:40:44
2022-09-28 14:51:58,122 -     INFO - Pop model from outputs/iassd_v17/epoch_50
2022-09-28 14:51:58,264 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_55
2022-09-28 14:52:12,991 -     INFO - [TRAIN] epoch=56/80, iter=6390/9280, loss=0.601034, lr=0.005302 | ETA 00:41:20
2022-09-28 14:52:21,428 -     INFO - [TRAIN] epoch=56/80, iter=6400/9280, loss=0.585900, lr=0.005274 | ETA 00:39:43
2022-09-28 14:52:29,744 -     INFO - [TRAIN] epoch=56/80, iter=6410/9280, loss=0.587291, lr=0.005245 | ETA 00:39:42
2022-09-28 14:52:39,571 -     INFO - [TRAIN] epoch=56/80, iter=6420/9280, loss=0.589323, lr=0.005217 | ETA 01:06:54
2022-09-28 14:52:50,865 -     INFO - [TRAIN] epoch=56/80, iter=6430/9280, loss=0.601091, lr=0.005189 | ETA 00:51:28
2022-09-28 14:53:02,946 -     INFO - [TRAIN] epoch=56/80, iter=6440/9280, loss=0.590295, lr=0.005161 | ETA 00:46:09
2022-09-28 14:53:15,175 -     INFO - [TRAIN] epoch=56/80, iter=6450/9280, loss=0.585459, lr=0.005133 | ETA 01:06:55
2022-09-28 14:53:28,068 -     INFO - [TRAIN] epoch=56/80, iter=6460/9280, loss=0.589967, lr=0.005104 | ETA 01:02:32
2022-09-28 14:53:41,624 -     INFO - [TRAIN] epoch=56/80, iter=6470/9280, loss=0.583745, lr=0.005076 | ETA 01:02:57
2022-09-28 14:53:54,241 -     INFO - [TRAIN] epoch=56/80, iter=6480/9280, loss=0.589478, lr=0.005048 | ETA 01:00:52
2022-09-28 14:54:08,152 -     INFO - [TRAIN] epoch=56/80, iter=6490/9280, loss=0.597029, lr=0.005020 | ETA 01:08:30
2022-09-28 14:54:16,874 -     INFO - Pop model from outputs/iassd_v17/epoch_51
2022-09-28 14:54:17,101 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_56
2022-09-28 14:54:32,614 -     INFO - [TRAIN] epoch=57/80, iter=6500/9280, loss=0.604507, lr=0.004992 | ETA 01:35:16
2022-09-28 14:54:45,408 -     INFO - [TRAIN] epoch=57/80, iter=6510/9280, loss=0.599845, lr=0.004963 | ETA 00:58:29
2022-09-28 14:54:59,317 -     INFO - [TRAIN] epoch=57/80, iter=6520/9280, loss=0.593663, lr=0.004935 | ETA 01:12:10
2022-09-28 14:55:13,020 -     INFO - [TRAIN] epoch=57/80, iter=6530/9280, loss=0.603694, lr=0.004907 | ETA 01:01:33
2022-09-28 14:55:27,660 -     INFO - [TRAIN] epoch=57/80, iter=6540/9280, loss=0.600444, lr=0.004879 | ETA 00:59:36
2022-09-28 14:55:42,917 -     INFO - [TRAIN] epoch=57/80, iter=6550/9280, loss=0.592210, lr=0.004851 | ETA 01:12:12
2022-09-28 14:55:56,215 -     INFO - [TRAIN] epoch=57/80, iter=6560/9280, loss=0.582449, lr=0.004822 | ETA 01:01:37
2022-09-28 14:56:10,264 -     INFO - [TRAIN] epoch=57/80, iter=6570/9280, loss=0.583179, lr=0.004794 | ETA 01:05:40
2022-09-28 14:56:24,206 -     INFO - [TRAIN] epoch=57/80, iter=6580/9280, loss=0.585531, lr=0.004766 | ETA 00:58:22
2022-09-28 14:56:36,821 -     INFO - [TRAIN] epoch=57/80, iter=6590/9280, loss=0.583028, lr=0.004738 | ETA 01:01:56
2022-09-28 14:56:49,176 -     INFO - [TRAIN] epoch=57/80, iter=6600/9280, loss=0.589115, lr=0.004710 | ETA 00:52:17
2022-09-28 14:57:02,085 -     INFO - [TRAIN] epoch=57/80, iter=6610/9280, loss=0.583029, lr=0.004681 | ETA 00:54:43
2022-09-28 14:57:04,337 -     INFO - Pop model from outputs/iassd_v17/epoch_52
2022-09-28 14:57:04,485 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_57
2022-09-28 14:57:27,709 -     INFO - [TRAIN] epoch=58/80, iter=6620/9280, loss=0.595589, lr=0.004653 | ETA 01:06:16
2022-09-28 14:57:41,716 -     INFO - [TRAIN] epoch=58/80, iter=6630/9280, loss=0.576220, lr=0.004625 | ETA 00:55:28
2022-09-28 14:57:54,359 -     INFO - [TRAIN] epoch=58/80, iter=6640/9280, loss=0.589502, lr=0.004597 | ETA 01:03:10
2022-09-28 14:58:09,065 -     INFO - [TRAIN] epoch=58/80, iter=6650/9280, loss=0.584493, lr=0.004569 | ETA 01:03:24
2022-09-28 14:58:22,418 -     INFO - [TRAIN] epoch=58/80, iter=6660/9280, loss=0.583082, lr=0.004541 | ETA 00:56:07
2022-09-28 14:58:36,074 -     INFO - [TRAIN] epoch=58/80, iter=6670/9280, loss=0.573586, lr=0.004513 | ETA 01:02:07
2022-09-28 14:58:48,767 -     INFO - [TRAIN] epoch=58/80, iter=6680/9280, loss=0.599271, lr=0.004485 | ETA 00:52:11
2022-09-28 14:59:03,128 -     INFO - [TRAIN] epoch=58/80, iter=6690/9280, loss=0.584908, lr=0.004457 | ETA 00:59:51
2022-09-28 14:59:16,919 -     INFO - [TRAIN] epoch=58/80, iter=6700/9280, loss=0.563885, lr=0.004429 | ETA 01:11:16
2022-09-28 14:59:31,498 -     INFO - [TRAIN] epoch=58/80, iter=6710/9280, loss=0.579388, lr=0.004401 | ETA 01:05:34
2022-09-28 14:59:45,101 -     INFO - [TRAIN] epoch=58/80, iter=6720/9280, loss=0.577047, lr=0.004373 | ETA 00:57:18
2022-09-28 14:59:55,038 -     INFO - Pop model from outputs/iassd_v17/epoch_53
2022-09-28 14:59:55,371 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_58
2022-09-28 15:00:08,142 -     INFO - [TRAIN] epoch=59/80, iter=6730/9280, loss=0.603475, lr=0.004345 | ETA 02:50:48
2022-09-28 15:00:21,107 -     INFO - [TRAIN] epoch=59/80, iter=6740/9280, loss=0.585118, lr=0.004317 | ETA 00:53:51
2022-09-28 15:00:34,720 -     INFO - [TRAIN] epoch=59/80, iter=6750/9280, loss=0.575920, lr=0.004289 | ETA 00:56:08
2022-09-28 15:00:50,075 -     INFO - [TRAIN] epoch=59/80, iter=6760/9280, loss=0.577657, lr=0.004261 | ETA 01:07:35
2022-09-28 15:01:02,848 -     INFO - [TRAIN] epoch=59/80, iter=6770/9280, loss=0.574859, lr=0.004233 | ETA 00:47:08
2022-09-28 15:01:15,940 -     INFO - [TRAIN] epoch=59/80, iter=6780/9280, loss=0.583849, lr=0.004205 | ETA 00:57:43
2022-09-28 15:01:30,492 -     INFO - [TRAIN] epoch=59/80, iter=6790/9280, loss=0.580055, lr=0.004177 | ETA 01:02:37
2022-09-28 15:01:44,960 -     INFO - [TRAIN] epoch=59/80, iter=6800/9280, loss=0.564498, lr=0.004149 | ETA 00:56:51
2022-09-28 15:01:57,464 -     INFO - [TRAIN] epoch=59/80, iter=6810/9280, loss=0.572725, lr=0.004122 | ETA 00:50:06
2022-09-28 15:02:11,573 -     INFO - [TRAIN] epoch=59/80, iter=6820/9280, loss=0.564480, lr=0.004094 | ETA 01:00:08
2022-09-28 15:02:25,462 -     INFO - [TRAIN] epoch=59/80, iter=6830/9280, loss=0.587636, lr=0.004066 | ETA 00:56:41
2022-09-28 15:02:39,053 -     INFO - [TRAIN] epoch=59/80, iter=6840/9280, loss=0.585882, lr=0.004038 | ETA 00:58:13
2022-09-28 15:02:42,940 -     INFO - Pop model from outputs/iassd_v17/epoch_54
2022-09-28 15:02:43,091 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_59
2022-09-28 15:03:03,269 -     INFO - [TRAIN] epoch=60/80, iter=6850/9280, loss=0.581081, lr=0.004011 | ETA 00:58:59
2022-09-28 15:03:13,072 -     INFO - [TRAIN] epoch=60/80, iter=6860/9280, loss=0.580178, lr=0.003983 | ETA 00:35:04
2022-09-28 15:03:21,585 -     INFO - [TRAIN] epoch=60/80, iter=6870/9280, loss=0.583559, lr=0.003956 | ETA 00:33:34
2022-09-28 15:03:30,036 -     INFO - [TRAIN] epoch=60/80, iter=6880/9280, loss=0.567324, lr=0.003928 | ETA 00:34:04
2022-09-28 15:03:38,439 -     INFO - [TRAIN] epoch=60/80, iter=6890/9280, loss=0.564338, lr=0.003900 | ETA 00:33:30
2022-09-28 15:03:46,830 -     INFO - [TRAIN] epoch=60/80, iter=6900/9280, loss=0.566495, lr=0.003873 | ETA 00:33:50
2022-09-28 15:03:55,273 -     INFO - [TRAIN] epoch=60/80, iter=6910/9280, loss=0.573919, lr=0.003845 | ETA 00:32:57
2022-09-28 15:04:03,697 -     INFO - [TRAIN] epoch=60/80, iter=6920/9280, loss=0.559138, lr=0.003818 | ETA 00:32:36
2022-09-28 15:04:12,102 -     INFO - [TRAIN] epoch=60/80, iter=6930/9280, loss=0.584190, lr=0.003791 | ETA 00:33:27
2022-09-28 15:04:20,698 -     INFO - [TRAIN] epoch=60/80, iter=6940/9280, loss=0.558879, lr=0.003763 | ETA 00:33:40
2022-09-28 15:04:29,056 -     INFO - [TRAIN] epoch=60/80, iter=6950/9280, loss=0.574397, lr=0.003736 | ETA 00:32:22
2022-09-28 15:04:37,563 -     INFO - [TRAIN] epoch=60/80, iter=6960/9280, loss=0.575587, lr=0.003709 | ETA 00:32:14
2022-09-28 15:04:37,574 -     INFO - Pop model from outputs/iassd_v17/epoch_55
2022-09-28 15:04:37,721 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_60
2022-09-28 15:04:52,584 -     INFO - [TRAIN] epoch=61/80, iter=6970/9280, loss=0.572672, lr=0.003681 | ETA 00:32:37
2022-09-28 15:05:00,945 -     INFO - [TRAIN] epoch=61/80, iter=6980/9280, loss=0.570734, lr=0.003654 | ETA 00:31:24
2022-09-28 15:05:09,176 -     INFO - [TRAIN] epoch=61/80, iter=6990/9280, loss=0.570957, lr=0.003627 | ETA 00:32:07
2022-09-28 15:05:17,560 -     INFO - [TRAIN] epoch=61/80, iter=7000/9280, loss=0.567370, lr=0.003600 | ETA 00:32:28
2022-09-28 15:05:25,786 -     INFO - [TRAIN] epoch=61/80, iter=7010/9280, loss=0.560178, lr=0.003573 | ETA 00:31:00
2022-09-28 15:05:34,180 -     INFO - [TRAIN] epoch=61/80, iter=7020/9280, loss=0.560782, lr=0.003546 | ETA 00:31:16
2022-09-28 15:05:42,867 -     INFO - [TRAIN] epoch=61/80, iter=7030/9280, loss=0.567264, lr=0.003519 | ETA 00:31:40
2022-09-28 15:05:51,173 -     INFO - [TRAIN] epoch=61/80, iter=7040/9280, loss=0.575067, lr=0.003492 | ETA 00:30:58
2022-09-28 15:05:59,571 -     INFO - [TRAIN] epoch=61/80, iter=7050/9280, loss=0.557502, lr=0.003465 | ETA 00:30:28
2022-09-28 15:06:08,010 -     INFO - [TRAIN] epoch=61/80, iter=7060/9280, loss=0.561375, lr=0.003438 | ETA 00:30:04
2022-09-28 15:06:16,402 -     INFO - [TRAIN] epoch=61/80, iter=7070/9280, loss=0.555647, lr=0.003412 | ETA 00:30:15
2022-09-28 15:06:21,497 -     INFO - Pop model from outputs/iassd_v17/epoch_56
2022-09-28 15:06:21,639 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_61
2022-09-28 15:06:31,334 -     INFO - [TRAIN] epoch=62/80, iter=7080/9280, loss=0.571211, lr=0.003385 | ETA 00:46:04
2022-09-28 15:06:39,687 -     INFO - [TRAIN] epoch=62/80, iter=7090/9280, loss=0.575794, lr=0.003358 | ETA 00:30:07
2022-09-28 15:06:48,294 -     INFO - [TRAIN] epoch=62/80, iter=7100/9280, loss=0.566429, lr=0.003332 | ETA 00:31:05
2022-09-28 15:06:56,829 -     INFO - [TRAIN] epoch=62/80, iter=7110/9280, loss=0.570184, lr=0.003305 | ETA 00:31:59
2022-09-28 15:07:05,462 -     INFO - [TRAIN] epoch=62/80, iter=7120/9280, loss=0.556262, lr=0.003278 | ETA 00:29:49
2022-09-28 15:07:17,035 -     INFO - [TRAIN] epoch=62/80, iter=7130/9280, loss=0.571890, lr=0.003252 | ETA 00:55:24
2022-09-28 15:07:29,237 -     INFO - [TRAIN] epoch=62/80, iter=7140/9280, loss=0.559521, lr=0.003226 | ETA 00:46:38
2022-09-28 15:07:43,477 -     INFO - [TRAIN] epoch=62/80, iter=7150/9280, loss=0.561301, lr=0.003199 | ETA 00:49:12
2022-09-28 15:07:57,242 -     INFO - [TRAIN] epoch=62/80, iter=7160/9280, loss=0.552118, lr=0.003173 | ETA 00:50:06
2022-09-28 15:08:10,986 -     INFO - [TRAIN] epoch=62/80, iter=7170/9280, loss=0.551305, lr=0.003147 | ETA 00:47:03
2022-09-28 15:08:24,553 -     INFO - [TRAIN] epoch=62/80, iter=7180/9280, loss=0.575985, lr=0.003121 | ETA 00:51:48
2022-09-28 15:08:38,208 -     INFO - [TRAIN] epoch=62/80, iter=7190/9280, loss=0.555532, lr=0.003094 | ETA 00:41:28
2022-09-28 15:08:40,684 -     INFO - Pop model from outputs/iassd_v17/epoch_57
2022-09-28 15:08:40,972 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_62
2022-09-28 15:09:00,959 -     INFO - [TRAIN] epoch=63/80, iter=7200/9280, loss=0.557139, lr=0.003068 | ETA 00:50:37
2022-09-28 15:09:14,712 -     INFO - [TRAIN] epoch=63/80, iter=7210/9280, loss=0.548328, lr=0.003042 | ETA 00:49:32
2022-09-28 15:09:28,246 -     INFO - [TRAIN] epoch=63/80, iter=7220/9280, loss=0.565136, lr=0.003017 | ETA 00:48:52
2022-09-28 15:09:39,241 -     INFO - [TRAIN] epoch=63/80, iter=7230/9280, loss=0.562847, lr=0.002991 | ETA 00:32:37
2022-09-28 15:09:48,044 -     INFO - [TRAIN] epoch=63/80, iter=7240/9280, loss=0.547749, lr=0.002965 | ETA 00:29:00
2022-09-28 15:09:56,787 -     INFO - [TRAIN] epoch=63/80, iter=7250/9280, loss=0.554066, lr=0.002939 | ETA 00:29:17
2022-09-28 15:10:05,431 -     INFO - [TRAIN] epoch=63/80, iter=7260/9280, loss=0.551670, lr=0.002913 | ETA 00:29:14
2022-09-28 15:10:13,938 -     INFO - [TRAIN] epoch=63/80, iter=7270/9280, loss=0.556661, lr=0.002888 | ETA 00:29:12
2022-09-28 15:10:22,445 -     INFO - [TRAIN] epoch=63/80, iter=7280/9280, loss=0.547615, lr=0.002862 | ETA 00:28:19
2022-09-28 15:10:31,512 -     INFO - [TRAIN] epoch=63/80, iter=7290/9280, loss=0.556397, lr=0.002837 | ETA 00:36:11
2022-09-28 15:10:43,542 -     INFO - [TRAIN] epoch=63/80, iter=7300/9280, loss=0.565267, lr=0.002811 | ETA 00:42:14
2022-09-28 15:10:52,850 -     INFO - Pop model from outputs/iassd_v17/epoch_58
2022-09-28 15:10:53,084 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_63
2022-09-28 15:11:01,407 -     INFO - [TRAIN] epoch=64/80, iter=7310/9280, loss=0.558534, lr=0.002786 | ETA 01:25:42
2022-09-28 15:11:10,258 -     INFO - [TRAIN] epoch=64/80, iter=7320/9280, loss=0.561139, lr=0.002761 | ETA 00:29:12
2022-09-28 15:11:18,822 -     INFO - [TRAIN] epoch=64/80, iter=7330/9280, loss=0.557156, lr=0.002736 | ETA 00:27:46
2022-09-28 15:11:27,214 -     INFO - [TRAIN] epoch=64/80, iter=7340/9280, loss=0.562485, lr=0.002711 | ETA 00:27:16
2022-09-28 15:11:36,799 -     INFO - [TRAIN] epoch=64/80, iter=7350/9280, loss=0.555493, lr=0.002685 | ETA 00:29:30
2022-09-28 15:11:45,757 -     INFO - [TRAIN] epoch=64/80, iter=7360/9280, loss=0.562069, lr=0.002661 | ETA 00:26:36
2022-09-28 15:11:54,193 -     INFO - [TRAIN] epoch=64/80, iter=7370/9280, loss=0.554579, lr=0.002636 | ETA 00:26:50
2022-09-28 15:12:02,587 -     INFO - [TRAIN] epoch=64/80, iter=7380/9280, loss=0.553955, lr=0.002611 | ETA 00:26:54
2022-09-28 15:12:11,139 -     INFO - [TRAIN] epoch=64/80, iter=7390/9280, loss=0.550946, lr=0.002586 | ETA 00:26:49
2022-09-28 15:12:19,764 -     INFO - [TRAIN] epoch=64/80, iter=7400/9280, loss=0.549319, lr=0.002561 | ETA 00:26:11
2022-09-28 15:12:28,973 -     INFO - [TRAIN] epoch=64/80, iter=7410/9280, loss=0.545063, lr=0.002537 | ETA 00:33:56
2022-09-28 15:12:42,143 -     INFO - [TRAIN] epoch=64/80, iter=7420/9280, loss=0.546268, lr=0.002512 | ETA 00:42:01
2022-09-28 15:12:46,847 -     INFO - Pop model from outputs/iassd_v17/epoch_59
2022-09-28 15:12:47,061 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_64
2022-09-28 15:13:05,977 -     INFO - [TRAIN] epoch=65/80, iter=7430/9280, loss=0.550494, lr=0.002488 | ETA 00:45:42
2022-09-28 15:13:20,067 -     INFO - [TRAIN] epoch=65/80, iter=7440/9280, loss=0.558357, lr=0.002464 | ETA 00:44:41
2022-09-28 15:13:34,077 -     INFO - [TRAIN] epoch=65/80, iter=7450/9280, loss=0.564381, lr=0.002439 | ETA 00:46:43
2022-09-28 15:13:48,775 -     INFO - [TRAIN] epoch=65/80, iter=7460/9280, loss=0.558577, lr=0.002415 | ETA 00:47:55
2022-09-28 15:14:00,231 -     INFO - [TRAIN] epoch=65/80, iter=7470/9280, loss=0.561290, lr=0.002391 | ETA 00:32:55
2022-09-28 15:14:13,537 -     INFO - [TRAIN] epoch=65/80, iter=7480/9280, loss=0.566967, lr=0.002367 | ETA 00:42:56
2022-09-28 15:14:27,058 -     INFO - [TRAIN] epoch=65/80, iter=7490/9280, loss=0.543347, lr=0.002343 | ETA 00:39:42
2022-09-28 15:14:40,869 -     INFO - [TRAIN] epoch=65/80, iter=7500/9280, loss=0.550200, lr=0.002319 | ETA 00:40:40
2022-09-28 15:14:54,418 -     INFO - [TRAIN] epoch=65/80, iter=7510/9280, loss=0.554533, lr=0.002295 | ETA 00:39:35
2022-09-28 15:15:07,518 -     INFO - [TRAIN] epoch=65/80, iter=7520/9280, loss=0.553211, lr=0.002272 | ETA 00:41:46
2022-09-28 15:15:21,633 -     INFO - [TRAIN] epoch=65/80, iter=7530/9280, loss=0.546859, lr=0.002248 | ETA 00:42:32
2022-09-28 15:15:36,268 -     INFO - [TRAIN] epoch=65/80, iter=7540/9280, loss=0.559509, lr=0.002225 | ETA 00:42:03
2022-09-28 15:15:36,290 -     INFO - Pop model from outputs/iassd_v17/epoch_60
2022-09-28 15:15:36,506 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_65
2022-09-28 15:16:01,491 -     INFO - [TRAIN] epoch=66/80, iter=7550/9280, loss=0.566628, lr=0.002201 | ETA 00:38:27
2022-09-28 15:16:15,554 -     INFO - [TRAIN] epoch=66/80, iter=7560/9280, loss=0.555736, lr=0.002178 | ETA 00:47:08
2022-09-28 15:16:29,428 -     INFO - [TRAIN] epoch=66/80, iter=7570/9280, loss=0.551080, lr=0.002155 | ETA 00:34:13
2022-09-28 15:16:39,772 -     INFO - [TRAIN] epoch=66/80, iter=7580/9280, loss=0.547682, lr=0.002131 | ETA 00:26:00
2022-09-28 15:16:48,209 -     INFO - [TRAIN] epoch=66/80, iter=7590/9280, loss=0.550234, lr=0.002108 | ETA 00:23:37
2022-09-28 15:16:56,572 -     INFO - [TRAIN] epoch=66/80, iter=7600/9280, loss=0.560914, lr=0.002085 | ETA 00:23:17
2022-09-28 15:17:04,907 -     INFO - [TRAIN] epoch=66/80, iter=7610/9280, loss=0.554085, lr=0.002063 | ETA 00:23:13
2022-09-28 15:17:13,505 -     INFO - [TRAIN] epoch=66/80, iter=7620/9280, loss=0.525379, lr=0.002040 | ETA 00:23:17
2022-09-28 15:17:21,871 -     INFO - [TRAIN] epoch=66/80, iter=7630/9280, loss=0.533902, lr=0.002017 | ETA 00:23:02
2022-09-28 15:17:30,228 -     INFO - [TRAIN] epoch=66/80, iter=7640/9280, loss=0.544454, lr=0.001994 | ETA 00:23:18
2022-09-28 15:17:38,557 -     INFO - [TRAIN] epoch=66/80, iter=7650/9280, loss=0.547014, lr=0.001972 | ETA 00:22:35
2022-09-28 15:17:43,515 -     INFO - Pop model from outputs/iassd_v17/epoch_61
2022-09-28 15:17:43,670 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_66
2022-09-28 15:17:53,330 -     INFO - [TRAIN] epoch=67/80, iter=7660/9280, loss=0.547202, lr=0.001950 | ETA 00:34:23
2022-09-28 15:18:01,866 -     INFO - [TRAIN] epoch=67/80, iter=7670/9280, loss=0.552419, lr=0.001927 | ETA 00:22:19
2022-09-28 15:18:10,128 -     INFO - [TRAIN] epoch=67/80, iter=7680/9280, loss=0.558300, lr=0.001905 | ETA 00:21:59
2022-09-28 15:18:18,419 -     INFO - [TRAIN] epoch=67/80, iter=7690/9280, loss=0.548221, lr=0.001883 | ETA 00:22:02
2022-09-28 15:18:27,143 -     INFO - [TRAIN] epoch=67/80, iter=7700/9280, loss=0.548800, lr=0.001861 | ETA 00:22:41
2022-09-28 15:18:35,540 -     INFO - [TRAIN] epoch=67/80, iter=7710/9280, loss=0.536671, lr=0.001839 | ETA 00:22:17
2022-09-28 15:18:43,871 -     INFO - [TRAIN] epoch=67/80, iter=7720/9280, loss=0.534288, lr=0.001817 | ETA 00:21:21
2022-09-28 15:18:52,282 -     INFO - [TRAIN] epoch=67/80, iter=7730/9280, loss=0.544953, lr=0.001796 | ETA 00:21:23
2022-09-28 15:19:00,646 -     INFO - [TRAIN] epoch=67/80, iter=7740/9280, loss=0.542898, lr=0.001774 | ETA 00:21:50
2022-09-28 15:19:10,298 -     INFO - [TRAIN] epoch=67/80, iter=7750/9280, loss=0.526393, lr=0.001752 | ETA 00:23:56
2022-09-28 15:19:19,355 -     INFO - [TRAIN] epoch=67/80, iter=7760/9280, loss=0.524197, lr=0.001731 | ETA 00:22:46
2022-09-28 15:19:28,099 -     INFO - [TRAIN] epoch=67/80, iter=7770/9280, loss=0.545095, lr=0.001710 | ETA 00:21:13
2022-09-28 15:19:29,756 -     INFO - Pop model from outputs/iassd_v17/epoch_62
2022-09-28 15:19:29,904 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_67
2022-09-28 15:19:43,263 -     INFO - [TRAIN] epoch=68/80, iter=7780/9280, loss=0.537610, lr=0.001689 | ETA 00:22:50
2022-09-28 15:19:52,771 -     INFO - [TRAIN] epoch=68/80, iter=7790/9280, loss=0.542763, lr=0.001667 | ETA 00:29:05
2022-09-28 15:20:05,219 -     INFO - [TRAIN] epoch=68/80, iter=7800/9280, loss=0.564028, lr=0.001646 | ETA 00:30:38
2022-09-28 15:20:16,537 -     INFO - [TRAIN] epoch=68/80, iter=7810/9280, loss=0.530911, lr=0.001626 | ETA 00:27:17
2022-09-28 15:20:26,433 -     INFO - [TRAIN] epoch=68/80, iter=7820/9280, loss=0.539824, lr=0.001605 | ETA 00:22:00
2022-09-28 15:20:34,900 -     INFO - [TRAIN] epoch=68/80, iter=7830/9280, loss=0.540344, lr=0.001584 | ETA 00:20:17
2022-09-28 15:20:43,356 -     INFO - [TRAIN] epoch=68/80, iter=7840/9280, loss=0.545238, lr=0.001564 | ETA 00:19:54
2022-09-28 15:20:51,649 -     INFO - [TRAIN] epoch=68/80, iter=7850/9280, loss=0.541094, lr=0.001543 | ETA 00:19:35
2022-09-28 15:20:59,945 -     INFO - [TRAIN] epoch=68/80, iter=7860/9280, loss=0.526456, lr=0.001523 | ETA 00:19:26
2022-09-28 15:21:08,382 -     INFO - [TRAIN] epoch=68/80, iter=7870/9280, loss=0.529443, lr=0.001503 | ETA 00:19:23
2022-09-28 15:21:16,817 -     INFO - [TRAIN] epoch=68/80, iter=7880/9280, loss=0.533725, lr=0.001483 | ETA 00:19:22
2022-09-28 15:21:23,458 -     INFO - Pop model from outputs/iassd_v17/epoch_63
2022-09-28 15:21:23,617 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_68
2022-09-28 15:21:31,430 -     INFO - [TRAIN] epoch=69/80, iter=7890/9280, loss=0.540397, lr=0.001463 | ETA 00:55:46
2022-09-28 15:21:39,764 -     INFO - [TRAIN] epoch=69/80, iter=7900/9280, loss=0.543696, lr=0.001443 | ETA 00:18:45
2022-09-28 15:21:47,908 -     INFO - [TRAIN] epoch=69/80, iter=7910/9280, loss=0.552179, lr=0.001423 | ETA 00:18:28
2022-09-28 15:21:56,331 -     INFO - [TRAIN] epoch=69/80, iter=7920/9280, loss=0.527681, lr=0.001403 | ETA 00:18:45
2022-09-28 15:22:05,001 -     INFO - [TRAIN] epoch=69/80, iter=7930/9280, loss=0.553317, lr=0.001384 | ETA 00:19:31
2022-09-28 15:22:13,509 -     INFO - [TRAIN] epoch=69/80, iter=7940/9280, loss=0.528218, lr=0.001364 | ETA 00:19:03
2022-09-28 15:22:21,792 -     INFO - [TRAIN] epoch=69/80, iter=7950/9280, loss=0.545528, lr=0.001345 | ETA 00:18:45
2022-09-28 15:22:30,106 -     INFO - [TRAIN] epoch=69/80, iter=7960/9280, loss=0.544734, lr=0.001326 | ETA 00:18:13
2022-09-28 15:22:38,375 -     INFO - [TRAIN] epoch=69/80, iter=7970/9280, loss=0.536341, lr=0.001307 | ETA 00:18:07
2022-09-28 15:22:46,738 -     INFO - [TRAIN] epoch=69/80, iter=7980/9280, loss=0.535303, lr=0.001288 | ETA 00:17:53
2022-09-28 15:22:55,056 -     INFO - [TRAIN] epoch=69/80, iter=7990/9280, loss=0.529404, lr=0.001269 | ETA 00:17:52
2022-09-28 15:23:03,901 -     INFO - [TRAIN] epoch=69/80, iter=8000/9280, loss=0.532204, lr=0.001250 | ETA 00:20:06
2022-09-28 15:23:07,579 -     INFO - Pop model from outputs/iassd_v17/epoch_64
2022-09-28 15:23:07,718 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_69
2022-09-28 15:23:19,191 -     INFO - [TRAIN] epoch=70/80, iter=8010/9280, loss=0.553436, lr=0.001232 | ETA 00:19:57
2022-09-28 15:23:27,561 -     INFO - [TRAIN] epoch=70/80, iter=8020/9280, loss=0.535283, lr=0.001213 | ETA 00:17:13
2022-09-28 15:23:35,916 -     INFO - [TRAIN] epoch=70/80, iter=8030/9280, loss=0.551605, lr=0.001195 | ETA 00:17:19
2022-09-28 15:23:44,294 -     INFO - [TRAIN] epoch=70/80, iter=8040/9280, loss=0.544118, lr=0.001177 | ETA 00:17:25
2022-09-28 15:23:52,651 -     INFO - [TRAIN] epoch=70/80, iter=8050/9280, loss=0.546710, lr=0.001158 | ETA 00:16:40
2022-09-28 15:24:01,052 -     INFO - [TRAIN] epoch=70/80, iter=8060/9280, loss=0.540320, lr=0.001140 | ETA 00:16:36
2022-09-28 15:24:09,264 -     INFO - [TRAIN] epoch=70/80, iter=8070/9280, loss=0.531670, lr=0.001123 | ETA 00:16:34
2022-09-28 15:24:17,535 -     INFO - [TRAIN] epoch=70/80, iter=8080/9280, loss=0.522496, lr=0.001105 | ETA 00:16:29
2022-09-28 15:24:25,760 -     INFO - [TRAIN] epoch=70/80, iter=8090/9280, loss=0.526572, lr=0.001087 | ETA 00:16:21
2022-09-28 15:24:34,507 -     INFO - [TRAIN] epoch=70/80, iter=8100/9280, loss=0.520798, lr=0.001070 | ETA 00:17:07
2022-09-28 15:24:43,023 -     INFO - [TRAIN] epoch=70/80, iter=8110/9280, loss=0.533383, lr=0.001052 | ETA 00:16:34
2022-09-28 15:24:51,288 -     INFO - [TRAIN] epoch=70/80, iter=8120/9280, loss=0.531472, lr=0.001035 | ETA 00:16:14
2022-09-28 15:24:51,299 -     INFO - Pop model from outputs/iassd_v17/epoch_65
2022-09-28 15:24:51,445 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_70
2022-09-28 15:25:06,145 -     INFO - [TRAIN] epoch=71/80, iter=8130/9280, loss=0.526449, lr=0.001018 | ETA 00:15:55
2022-09-28 15:25:14,526 -     INFO - [TRAIN] epoch=71/80, iter=8140/9280, loss=0.533134, lr=0.001001 | ETA 00:16:12
2022-09-28 15:25:22,752 -     INFO - [TRAIN] epoch=71/80, iter=8150/9280, loss=0.543365, lr=0.000984 | ETA 00:15:35
2022-09-28 15:25:31,039 -     INFO - [TRAIN] epoch=71/80, iter=8160/9280, loss=0.533817, lr=0.000967 | ETA 00:15:38
2022-09-28 15:25:39,406 -     INFO - [TRAIN] epoch=71/80, iter=8170/9280, loss=0.537037, lr=0.000951 | ETA 00:15:27
2022-09-28 15:25:47,669 -     INFO - [TRAIN] epoch=71/80, iter=8180/9280, loss=0.525503, lr=0.000934 | ETA 00:15:03
2022-09-28 15:25:55,949 -     INFO - [TRAIN] epoch=71/80, iter=8190/9280, loss=0.521676, lr=0.000918 | ETA 00:15:38
2022-09-28 15:26:04,452 -     INFO - [TRAIN] epoch=71/80, iter=8200/9280, loss=0.526493, lr=0.000902 | ETA 00:15:05
2022-09-28 15:26:13,013 -     INFO - [TRAIN] epoch=71/80, iter=8210/9280, loss=0.530303, lr=0.000886 | ETA 00:15:03
2022-09-28 15:26:21,299 -     INFO - [TRAIN] epoch=71/80, iter=8220/9280, loss=0.525454, lr=0.000870 | ETA 00:14:39
2022-09-28 15:26:29,646 -     INFO - [TRAIN] epoch=71/80, iter=8230/9280, loss=0.531994, lr=0.000854 | ETA 00:14:37
2022-09-28 15:26:34,645 -     INFO - Pop model from outputs/iassd_v17/epoch_66
2022-09-28 15:26:34,783 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_71
2022-09-28 15:26:44,508 -     INFO - [TRAIN] epoch=72/80, iter=8240/9280, loss=0.526491, lr=0.000838 | ETA 00:21:45
2022-09-28 15:26:53,085 -     INFO - [TRAIN] epoch=72/80, iter=8250/9280, loss=0.529360, lr=0.000822 | ETA 00:15:18
2022-09-28 15:27:01,622 -     INFO - [TRAIN] epoch=72/80, iter=8260/9280, loss=0.534785, lr=0.000807 | ETA 00:14:31
2022-09-28 15:27:09,846 -     INFO - [TRAIN] epoch=72/80, iter=8270/9280, loss=0.532268, lr=0.000792 | ETA 00:13:40
2022-09-28 15:27:18,224 -     INFO - [TRAIN] epoch=72/80, iter=8280/9280, loss=0.526110, lr=0.000777 | ETA 00:14:10
2022-09-28 15:27:26,524 -     INFO - [TRAIN] epoch=72/80, iter=8290/9280, loss=0.542046, lr=0.000762 | ETA 00:13:40
2022-09-28 15:27:34,857 -     INFO - [TRAIN] epoch=72/80, iter=8300/9280, loss=0.512776, lr=0.000747 | ETA 00:13:33
2022-09-28 15:27:43,326 -     INFO - [TRAIN] epoch=72/80, iter=8310/9280, loss=0.519687, lr=0.000732 | ETA 00:13:39
2022-09-28 15:27:51,624 -     INFO - [TRAIN] epoch=72/80, iter=8320/9280, loss=0.515754, lr=0.000717 | ETA 00:13:12
2022-09-28 15:28:00,146 -     INFO - [TRAIN] epoch=72/80, iter=8330/9280, loss=0.513811, lr=0.000703 | ETA 00:13:32
2022-09-28 15:28:08,543 -     INFO - [TRAIN] epoch=72/80, iter=8340/9280, loss=0.531869, lr=0.000688 | ETA 00:13:34
2022-09-28 15:28:16,872 -     INFO - [TRAIN] epoch=72/80, iter=8350/9280, loss=0.539640, lr=0.000674 | ETA 00:12:44
2022-09-28 15:28:18,486 -     INFO - Pop model from outputs/iassd_v17/epoch_67
2022-09-28 15:28:18,633 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_72
2022-09-28 15:28:31,533 -     INFO - [TRAIN] epoch=73/80, iter=8360/9280, loss=0.547362, lr=0.000660 | ETA 00:13:25
2022-09-28 15:28:40,041 -     INFO - [TRAIN] epoch=73/80, iter=8370/9280, loss=0.520215, lr=0.000646 | ETA 00:13:07
2022-09-28 15:28:48,342 -     INFO - [TRAIN] epoch=73/80, iter=8380/9280, loss=0.531384, lr=0.000632 | ETA 00:12:21
2022-09-28 15:28:56,794 -     INFO - [TRAIN] epoch=73/80, iter=8390/9280, loss=0.522104, lr=0.000619 | ETA 00:12:31
2022-09-28 15:29:05,370 -     INFO - [TRAIN] epoch=73/80, iter=8400/9280, loss=0.520155, lr=0.000605 | ETA 00:12:54
2022-09-28 15:29:13,830 -     INFO - [TRAIN] epoch=73/80, iter=8410/9280, loss=0.525351, lr=0.000592 | ETA 00:12:02
2022-09-28 15:29:22,150 -     INFO - [TRAIN] epoch=73/80, iter=8420/9280, loss=0.530840, lr=0.000579 | ETA 00:12:07
2022-09-28 15:29:30,768 -     INFO - [TRAIN] epoch=73/80, iter=8430/9280, loss=0.504776, lr=0.000565 | ETA 00:11:52
2022-09-28 15:29:39,147 -     INFO - [TRAIN] epoch=73/80, iter=8440/9280, loss=0.517801, lr=0.000553 | ETA 00:12:01
2022-09-28 15:29:47,549 -     INFO - [TRAIN] epoch=73/80, iter=8450/9280, loss=0.522428, lr=0.000540 | ETA 00:11:27
2022-09-28 15:29:56,007 -     INFO - [TRAIN] epoch=73/80, iter=8460/9280, loss=0.529452, lr=0.000527 | ETA 00:11:59
2022-09-28 15:30:02,539 -     INFO - Pop model from outputs/iassd_v17/epoch_68
2022-09-28 15:30:02,685 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_73
2022-09-28 15:30:10,718 -     INFO - [TRAIN] epoch=74/80, iter=8470/9280, loss=0.533360, lr=0.000514 | ETA 00:33:10
2022-09-28 15:30:19,035 -     INFO - [TRAIN] epoch=74/80, iter=8480/9280, loss=0.518755, lr=0.000502 | ETA 00:11:07
2022-09-28 15:30:27,900 -     INFO - [TRAIN] epoch=74/80, iter=8490/9280, loss=0.538472, lr=0.000490 | ETA 00:11:12
2022-09-28 15:30:36,282 -     INFO - [TRAIN] epoch=74/80, iter=8500/9280, loss=0.530483, lr=0.000478 | ETA 00:10:59
2022-09-28 15:30:44,753 -     INFO - [TRAIN] epoch=74/80, iter=8510/9280, loss=0.541971, lr=0.000466 | ETA 00:10:54
2022-09-28 15:30:53,220 -     INFO - [TRAIN] epoch=74/80, iter=8520/9280, loss=0.528416, lr=0.000454 | ETA 00:10:22
2022-09-28 15:31:01,545 -     INFO - [TRAIN] epoch=74/80, iter=8530/9280, loss=0.518762, lr=0.000442 | ETA 00:10:19
2022-09-28 15:31:09,963 -     INFO - [TRAIN] epoch=74/80, iter=8540/9280, loss=0.514327, lr=0.000431 | ETA 00:10:40
2022-09-28 15:31:18,664 -     INFO - [TRAIN] epoch=74/80, iter=8550/9280, loss=0.520720, lr=0.000419 | ETA 00:10:15
2022-09-28 15:31:27,098 -     INFO - [TRAIN] epoch=74/80, iter=8560/9280, loss=0.509983, lr=0.000408 | ETA 00:10:02
2022-09-28 15:31:35,581 -     INFO - [TRAIN] epoch=74/80, iter=8570/9280, loss=0.532266, lr=0.000397 | ETA 00:09:45
2022-09-28 15:31:44,149 -     INFO - [TRAIN] epoch=74/80, iter=8580/9280, loss=0.530912, lr=0.000386 | ETA 00:10:03
2022-09-28 15:31:47,636 -     INFO - Pop model from outputs/iassd_v17/epoch_69
2022-09-28 15:31:47,793 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_74
2022-09-28 15:31:59,138 -     INFO - [TRAIN] epoch=75/80, iter=8590/9280, loss=0.534967, lr=0.000375 | ETA 00:10:48
2022-09-28 15:32:07,402 -     INFO - [TRAIN] epoch=75/80, iter=8600/9280, loss=0.523781, lr=0.000365 | ETA 00:09:27
2022-09-28 15:32:15,718 -     INFO - [TRAIN] epoch=75/80, iter=8610/9280, loss=0.525396, lr=0.000354 | ETA 00:09:16
2022-09-28 15:32:24,160 -     INFO - [TRAIN] epoch=75/80, iter=8620/9280, loss=0.514106, lr=0.000344 | ETA 00:09:24
2022-09-28 15:32:32,527 -     INFO - [TRAIN] epoch=75/80, iter=8630/9280, loss=0.517835, lr=0.000334 | ETA 00:09:01
2022-09-28 15:32:40,938 -     INFO - [TRAIN] epoch=75/80, iter=8640/9280, loss=0.512575, lr=0.000324 | ETA 00:09:00
2022-09-28 15:32:49,393 -     INFO - [TRAIN] epoch=75/80, iter=8650/9280, loss=0.521940, lr=0.000314 | ETA 00:08:38
2022-09-28 15:32:57,727 -     INFO - [TRAIN] epoch=75/80, iter=8660/9280, loss=0.517368, lr=0.000304 | ETA 00:08:44
2022-09-28 15:33:06,061 -     INFO - [TRAIN] epoch=75/80, iter=8670/9280, loss=0.521411, lr=0.000294 | ETA 00:08:32
2022-09-28 15:33:14,431 -     INFO - [TRAIN] epoch=75/80, iter=8680/9280, loss=0.500385, lr=0.000285 | ETA 00:08:29
2022-09-28 15:33:22,896 -     INFO - [TRAIN] epoch=75/80, iter=8690/9280, loss=0.525531, lr=0.000276 | ETA 00:08:13
2022-09-28 15:33:31,250 -     INFO - [TRAIN] epoch=75/80, iter=8700/9280, loss=0.520712, lr=0.000266 | ETA 00:08:05
2022-09-28 15:33:31,261 -     INFO - Pop model from outputs/iassd_v17/epoch_70
2022-09-28 15:33:31,411 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_75
2022-09-28 15:33:45,919 -     INFO - [TRAIN] epoch=76/80, iter=8710/9280, loss=0.521261, lr=0.000257 | ETA 00:07:56
2022-09-28 15:33:54,344 -     INFO - [TRAIN] epoch=76/80, iter=8720/9280, loss=0.510931, lr=0.000248 | ETA 00:07:51
2022-09-28 15:34:02,641 -     INFO - [TRAIN] epoch=76/80, iter=8730/9280, loss=0.533488, lr=0.000240 | ETA 00:07:31
2022-09-28 15:34:11,088 -     INFO - [TRAIN] epoch=76/80, iter=8740/9280, loss=0.528539, lr=0.000231 | ETA 00:07:29
2022-09-28 15:34:19,614 -     INFO - [TRAIN] epoch=76/80, iter=8750/9280, loss=0.514473, lr=0.000223 | ETA 00:07:26
2022-09-28 15:34:28,001 -     INFO - [TRAIN] epoch=76/80, iter=8760/9280, loss=0.522784, lr=0.000215 | ETA 00:07:10
LAUNCH INFO 2022-09-28 15:42:12,208 Pod completed
LAUNCH INFO 2022-09-28 15:42:12,209 Exit code 0
2022-09-28 15:34:36,393 -     INFO - [TRAIN] epoch=76/80, iter=8770/9280, loss=0.527819, lr=0.000206 | ETA 00:07:11
2022-09-28 15:34:44,822 -     INFO - [TRAIN] epoch=76/80, iter=8780/9280, loss=0.508860, lr=0.000199 | ETA 00:07:03
2022-09-28 15:34:53,141 -     INFO - [TRAIN] epoch=76/80, iter=8790/9280, loss=0.513028, lr=0.000191 | ETA 00:06:46
2022-09-28 15:35:01,381 -     INFO - [TRAIN] epoch=76/80, iter=8800/9280, loss=0.519377, lr=0.000183 | ETA 00:06:36
2022-09-28 15:35:09,765 -     INFO - [TRAIN] epoch=76/80, iter=8810/9280, loss=0.523505, lr=0.000176 | ETA 00:06:47
2022-09-28 15:35:14,898 -     INFO - Pop model from outputs/iassd_v17/epoch_71
2022-09-28 15:35:15,044 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_76
2022-09-28 15:35:24,577 -     INFO - [TRAIN] epoch=77/80, iter=8820/9280, loss=0.524505, lr=0.000168 | ETA 00:09:33
2022-09-28 15:35:33,023 -     INFO - [TRAIN] epoch=77/80, iter=8830/9280, loss=0.526138, lr=0.000161 | ETA 00:06:12
2022-09-28 15:35:41,906 -     INFO - [TRAIN] epoch=77/80, iter=8840/9280, loss=0.530431, lr=0.000154 | ETA 00:06:41
2022-09-28 15:35:50,442 -     INFO - [TRAIN] epoch=77/80, iter=8850/9280, loss=0.532226, lr=0.000147 | ETA 00:06:28
2022-09-28 15:35:58,894 -     INFO - [TRAIN] epoch=77/80, iter=8860/9280, loss=0.520015, lr=0.000140 | ETA 00:06:08
2022-09-28 15:36:07,459 -     INFO - [TRAIN] epoch=77/80, iter=8870/9280, loss=0.529466, lr=0.000134 | ETA 00:05:49
2022-09-28 15:36:16,132 -     INFO - [TRAIN] epoch=77/80, iter=8880/9280, loss=0.520357, lr=0.000128 | ETA 00:05:42
2022-09-28 15:36:24,459 -     INFO - [TRAIN] epoch=77/80, iter=8890/9280, loss=0.510453, lr=0.000121 | ETA 00:05:21
2022-09-28 15:36:32,864 -     INFO - [TRAIN] epoch=77/80, iter=8900/9280, loss=0.524001, lr=0.000115 | ETA 00:05:16
2022-09-28 15:36:41,181 -     INFO - [TRAIN] epoch=77/80, iter=8910/9280, loss=0.510484, lr=0.000109 | ETA 00:05:10
2022-09-28 15:36:49,630 -     INFO - [TRAIN] epoch=77/80, iter=8920/9280, loss=0.515325, lr=0.000103 | ETA 00:04:59
2022-09-28 15:36:58,225 -     INFO - [TRAIN] epoch=77/80, iter=8930/9280, loss=0.518725, lr=0.000098 | ETA 00:05:14
2022-09-28 15:37:00,047 -     INFO - Pop model from outputs/iassd_v17/epoch_72
2022-09-28 15:37:00,200 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_77
2022-09-28 15:37:13,198 -     INFO - [TRAIN] epoch=78/80, iter=8940/9280, loss=0.517095, lr=0.000092 | ETA 00:05:01
2022-09-28 15:37:21,528 -     INFO - [TRAIN] epoch=78/80, iter=8950/9280, loss=0.524901, lr=0.000087 | ETA 00:04:32
2022-09-28 15:37:29,750 -     INFO - [TRAIN] epoch=78/80, iter=8960/9280, loss=0.534826, lr=0.000082 | ETA 00:04:14
2022-09-28 15:37:37,990 -     INFO - [TRAIN] epoch=78/80, iter=8970/9280, loss=0.530550, lr=0.000077 | ETA 00:04:14
2022-09-28 15:37:46,201 -     INFO - [TRAIN] epoch=78/80, iter=8980/9280, loss=0.523640, lr=0.000072 | ETA 00:04:09
2022-09-28 15:37:54,437 -     INFO - [TRAIN] epoch=78/80, iter=8990/9280, loss=0.524039, lr=0.000067 | ETA 00:03:56
2022-09-28 15:38:02,844 -     INFO - [TRAIN] epoch=78/80, iter=9000/9280, loss=0.512265, lr=0.000063 | ETA 00:03:50
2022-09-28 15:38:11,072 -     INFO - [TRAIN] epoch=78/80, iter=9010/9280, loss=0.513184, lr=0.000058 | ETA 00:03:41
2022-09-28 15:38:19,294 -     INFO - [TRAIN] epoch=78/80, iter=9020/9280, loss=0.501922, lr=0.000054 | ETA 00:03:35
2022-09-28 15:38:27,611 -     INFO - [TRAIN] epoch=78/80, iter=9030/9280, loss=0.511153, lr=0.000050 | ETA 00:03:28
2022-09-28 15:38:36,088 -     INFO - [TRAIN] epoch=78/80, iter=9040/9280, loss=0.516675, lr=0.000046 | ETA 00:03:12
2022-09-28 15:38:42,613 -     INFO - Pop model from outputs/iassd_v17/epoch_73
2022-09-28 15:38:42,768 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_78
2022-09-28 15:38:50,585 -     INFO - [TRAIN] epoch=79/80, iter=9050/9280, loss=0.517518, lr=0.000043 | ETA 00:09:12
2022-09-28 15:38:59,028 -     INFO - [TRAIN] epoch=79/80, iter=9060/9280, loss=0.522508, lr=0.000039 | ETA 00:03:05
2022-09-28 15:39:07,262 -     INFO - [TRAIN] epoch=79/80, iter=9070/9280, loss=0.519553, lr=0.000035 | ETA 00:02:48
2022-09-28 15:39:15,388 -     INFO - [TRAIN] epoch=79/80, iter=9080/9280, loss=0.528837, lr=0.000032 | ETA 00:02:46
2022-09-28 15:39:23,845 -     INFO - [TRAIN] epoch=79/80, iter=9090/9280, loss=0.513624, lr=0.000029 | ETA 00:02:47
2022-09-28 15:39:32,075 -     INFO - [TRAIN] epoch=79/80, iter=9100/9280, loss=0.523129, lr=0.000026 | ETA 00:02:28
2022-09-28 15:39:40,165 -     INFO - [TRAIN] epoch=79/80, iter=9110/9280, loss=0.513409, lr=0.000023 | ETA 00:02:18
2022-09-28 15:39:48,339 -     INFO - [TRAIN] epoch=79/80, iter=9120/9280, loss=0.513195, lr=0.000021 | ETA 00:02:10
2022-09-28 15:39:56,607 -     INFO - [TRAIN] epoch=79/80, iter=9130/9280, loss=0.517803, lr=0.000018 | ETA 00:02:04
2022-09-28 15:40:04,979 -     INFO - [TRAIN] epoch=79/80, iter=9140/9280, loss=0.507560, lr=0.000016 | ETA 00:01:58
2022-09-28 15:40:13,318 -     INFO - [TRAIN] epoch=79/80, iter=9150/9280, loss=0.518931, lr=0.000014 | ETA 00:01:47
2022-09-28 15:40:21,505 -     INFO - [TRAIN] epoch=79/80, iter=9160/9280, loss=0.533370, lr=0.000012 | ETA 00:01:37
2022-09-28 15:40:24,714 -     INFO - Pop model from outputs/iassd_v17/epoch_74
2022-09-28 15:40:24,851 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_79
2022-09-28 15:40:35,984 -     INFO - [TRAIN] epoch=80/80, iter=9170/9280, loss=0.529080, lr=0.000010 | ETA 00:01:40
2022-09-28 15:40:44,361 -     INFO - [TRAIN] epoch=80/80, iter=9180/9280, loss=0.521647, lr=0.000008 | ETA 00:01:23
2022-09-28 15:40:52,738 -     INFO - [TRAIN] epoch=80/80, iter=9190/9280, loss=0.526098, lr=0.000007 | ETA 00:01:15
2022-09-28 15:41:01,039 -     INFO - [TRAIN] epoch=80/80, iter=9200/9280, loss=0.509500, lr=0.000005 | ETA 00:01:06
2022-09-28 15:41:09,744 -     INFO - [TRAIN] epoch=80/80, iter=9210/9280, loss=0.526057, lr=0.000004 | ETA 00:00:59
2022-09-28 15:41:17,987 -     INFO - [TRAIN] epoch=80/80, iter=9220/9280, loss=0.512972, lr=0.000003 | ETA 00:00:48
2022-09-28 15:41:26,407 -     INFO - [TRAIN] epoch=80/80, iter=9230/9280, loss=0.507376, lr=0.000002 | ETA 00:00:42
2022-09-28 15:41:34,566 -     INFO - [TRAIN] epoch=80/80, iter=9240/9280, loss=0.524480, lr=0.000001 | ETA 00:00:32
2022-09-28 15:41:42,916 -     INFO - [TRAIN] epoch=80/80, iter=9250/9280, loss=0.514535, lr=0.000001 | ETA 00:00:24
2022-09-28 15:41:51,336 -     INFO - [TRAIN] epoch=80/80, iter=9260/9280, loss=0.515812, lr=0.000000 | ETA 00:00:17
2022-09-28 15:41:59,654 -     INFO - [TRAIN] epoch=80/80, iter=9270/9280, loss=0.512044, lr=0.000000 | ETA 00:00:08
2022-09-28 15:42:07,918 -     INFO - [TRAIN] epoch=80/80, iter=9280/9280, loss=0.517052, lr=0.000000 | ETA 00:00:00
2022-09-28 15:42:07,929 -     INFO - Pop model from outputs/iassd_v17/epoch_75
2022-09-28 15:42:08,075 -     INFO - Push model to checkpoint outputs/iassd_v17/epoch_80
2022-09-28 15:42:08,157 -     INFO - Training is complete.