2013-11-14 07:00:37,040 INFO     repeater     task os75bb_beamplots ended after 6.4 seconds
2013-11-14 07:00:37,099 INFO     repeater     task os75bb_beamplots starting 301.7 seconds late
2013-11-14 07:00:43,250 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 07:00:43,250 INFO     repeater     task os75bb_beamplots ended after 6.2 seconds
2013-11-14 07:00:43,251 INFO     repeater     task os75nb_beamplots starting 307.8 seconds late
2013-11-14 07:00:49,261 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 07:00:49,261 INFO     repeater     task os75nb_beamplots ended after 6.0 seconds
2013-11-14 07:00:49,264 INFO     repeater     task os75nb_beamplots starting 313.8 seconds late
2013-11-14 07:00:55,793 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 07:00:55,793 INFO     repeater     task os75nb_beamplots ended after 6.5 seconds
2013-11-14 07:00:55,794 INFO     repeater     task phins_hcorrstats starting 620.3 seconds late
2013-11-14 07:01:01,518 INFO     repeater     task phins_hcorrstats ended after 5.7 seconds
2013-11-14 07:01:01,519 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 07:01:01,520 INFO     repeater     task posmv_hcorrstats starting 626.1 seconds late
2013-11-14 07:01:06,562 INFO     repeater     task posmv_hcorrstats ended after 5.0 seconds
2013-11-14 07:01:06,562 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 07:01:11,566 INFO     repeater     task wh300_lastensq starting 566.6 seconds late
2013-11-14 07:01:26,766 INFO     repeater     task wh300_lastensq ended after 15.2 seconds
2013-11-14 07:01:26,767 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 06:59:35
2013-11-14 07:01:26,769 INFO     repeater     task os75bb_lastensq starting 341.8 seconds late
2013-11-14 07:01:32,993 INFO     repeater     task os75bb_lastensq ended after 6.2 seconds
2013-11-14 07:01:32,994 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 07:00:35
2013-11-14 07:01:32,996 INFO     repeater     task os75nb_lastensq starting 48.0 seconds late
2013-11-14 07:01:39,083 INFO     repeater     task os75nb_lastensq ended after 6.1 seconds
2013-11-14 07:01:39,084 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 07:00:35
2013-11-14 07:01:49,112 INFO     repeater     task wh300_lastensq starting 4.1 seconds late
2013-11-14 07:02:00,530 INFO     repeater     task wh300_lastensq ended after 11.4 seconds
2013-11-14 07:02:00,531 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 07:01:35
2013-11-14 07:03:46,121 INFO     repeater     task wh300_lastensq starting 1.1 seconds late
2013-11-14 07:03:57,185 INFO     repeater     task wh300_lastensq ended after 11.1 seconds
2013-11-14 07:03:57,186 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 07:03:35
2013-11-14 07:05:37,637 INFO     repeater     task wh300_quick starting 2.2 seconds late
2013-11-14 07:09:06,563 INFO     repeater     task wh300_quick ended after 208.9 seconds
2013-11-14 07:09:06,606 INFO     repeater     task wh300_3dayplots starting 211.2 seconds late
2013-11-14 07:10:22,313 INFO     repeater     task wh300_3dayplots ended after 75.7 seconds
2013-11-14 07:10:22,315 INFO     repeater     task os75bb_lastensq starting 277.3 seconds late
2013-11-14 07:10:40,072 INFO     repeater     task os75bb_lastensq ended after 17.8 seconds
2013-11-14 07:10:40,073 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 07:05:35
2013-11-14 07:10:40,079 INFO     repeater     task os75bb_quick starting 304.7 seconds late
2013-11-14 07:12:16,695 INFO     repeater     task os75bb_quick ended after 96.6 seconds
2013-11-14 07:12:16,697 INFO     repeater     task os75bb_3dayplots starting 401.3 seconds late
2013-11-14 07:13:39,497 INFO     repeater     task os75bb_3dayplots ended after 82.8 seconds
2013-11-14 07:13:39,498 INFO     repeater     task os75nb_lastensq starting 474.5 seconds late
2013-11-14 07:13:51,445 INFO     repeater     task os75nb_lastensq ended after 11.9 seconds
2013-11-14 07:13:51,446 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 07:10:35
2013-11-14 07:13:51,447 INFO     repeater     task os75nb_quick starting 496.0 seconds late
2013-11-14 07:15:05,569 INFO     repeater     task os75nb_quick ended after 74.1 seconds
2013-11-14 07:15:05,571 INFO     repeater     task os75nb_3dayplots starting 570.1 seconds late
2013-11-14 07:16:12,288 INFO     repeater     task os75nb_3dayplots ended after 66.7 seconds
2013-11-14 07:16:12,289 INFO     repeater     task wh300_beamplots starting 636.9 seconds late
2013-11-14 07:16:23,468 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 07:16:23,469 INFO     repeater     task wh300_beamplots ended after 11.2 seconds
2013-11-14 07:16:23,469 INFO     repeater     task wh300_beamplots: added 1 extra increments to time_to_run
2013-11-14 07:16:23,471 INFO     repeater     task wh300_beamplots starting 648.0 seconds late
2013-11-14 07:16:34,209 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 07:16:34,209 INFO     repeater     task wh300_beamplots ended after 10.7 seconds
2013-11-14 07:16:34,209 INFO     repeater     task wh300_beamplots: added 1 extra increments to time_to_run
2013-11-14 07:16:34,210 INFO     repeater     task os75bb_beamplots starting 658.8 seconds late
2013-11-14 07:16:42,905 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 07:16:42,905 INFO     repeater     task os75bb_beamplots ended after 8.7 seconds
2013-11-14 07:16:42,906 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 07:16:42,907 INFO     repeater     task os75bb_beamplots starting 667.5 seconds late
2013-11-14 07:16:51,229 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 07:16:51,230 INFO     repeater     task os75bb_beamplots ended after 8.3 seconds
2013-11-14 07:16:51,230 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 07:16:51,235 INFO     repeater     task os75nb_beamplots starting 675.8 seconds late
2013-11-14 07:16:58,865 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 07:16:58,866 INFO     repeater     task os75nb_beamplots ended after 7.6 seconds
2013-11-14 07:16:58,866 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 07:16:58,867 INFO     repeater     task os75nb_beamplots starting 683.4 seconds late
2013-11-14 07:17:07,662 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 07:17:07,663 INFO     repeater     task os75nb_beamplots ended after 8.8 seconds
2013-11-14 07:17:07,663 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 07:17:07,664 INFO     repeater     task phins_hcorrstats starting 692.2 seconds late
2013-11-14 07:17:14,472 INFO     repeater     task phins_hcorrstats ended after 6.8 seconds
2013-11-14 07:17:14,475 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 07:17:14,476 INFO     repeater     task posmv_hcorrstats starting 699.0 seconds late
2013-11-14 07:17:19,556 INFO     repeater     task posmv_hcorrstats ended after 5.1 seconds
2013-11-14 07:17:19,562 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 07:17:24,568 INFO     repeater     task wh300_lastensq starting 699.6 seconds late
2013-11-14 07:17:39,620 INFO     repeater     task wh300_lastensq ended after 15.1 seconds
2013-11-14 07:17:39,621 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 07:15:35
2013-11-14 07:17:39,623 INFO     repeater     task os75bb_lastensq starting 414.6 seconds late
2013-11-14 07:17:46,354 INFO     repeater     task os75bb_lastensq ended after 6.7 seconds
2013-11-14 07:17:46,354 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 07:15:35
2013-11-14 07:17:46,357 INFO     repeater     task os75nb_lastensq starting 121.4 seconds late
2013-11-14 07:17:53,034 INFO     repeater     task os75nb_lastensq ended after 6.7 seconds
2013-11-14 07:17:53,034 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 07:15:35
2013-11-14 07:17:58,066 INFO     repeater     task wh300_lastensq starting 13.1 seconds late
2013-11-14 07:18:14,941 INFO     repeater     task wh300_lastensq ended after 16.9 seconds
2013-11-14 07:18:14,942 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 07:17:35
2013-11-14 07:19:45,280 INFO     repeater     task wh300_lastensq starting 0.3 seconds late
2013-11-14 07:19:56,415 INFO     repeater     task wh300_lastensq ended after 11.1 seconds
2013-11-14 07:19:56,416 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 07:19:35
2013-11-14 07:20:36,553 INFO     repeater     task wh300_quick starting 1.1 seconds late
2013-11-14 07:23:11,174 INFO     repeater     task wh300_quick ended after 154.6 seconds
2013-11-14 07:23:11,203 INFO     repeater     task wh300_3dayplots starting 155.8 seconds late
2013-11-14 07:24:27,507 INFO     repeater     task wh300_3dayplots ended after 76.3 seconds
2013-11-14 07:24:27,509 INFO     repeater     task os75bb_lastensq starting 222.5 seconds late
2013-11-14 07:24:37,836 INFO     repeater     task os75bb_lastensq ended after 10.3 seconds
2013-11-14 07:24:37,838 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 07:20:35
2013-11-14 07:24:37,841 INFO     repeater     task os75bb_quick starting 242.4 seconds late
2013-11-14 07:26:16,098 INFO     repeater     task os75bb_quick ended after 98.3 seconds
2013-11-14 07:26:18,026 INFO     repeater     task os75bb_3dayplots starting 342.6 seconds late
2013-11-14 07:27:39,782 INFO     repeater     task os75bb_3dayplots ended after 81.8 seconds
2013-11-14 07:27:39,783 INFO     repeater     task os75nb_lastensq starting 414.8 seconds late
2013-11-14 07:27:47,634 INFO     repeater     task os75nb_lastensq ended after 7.9 seconds
2013-11-14 07:27:47,634 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 07:25:35
2013-11-14 07:27:47,635 INFO     repeater     task os75nb_quick starting 432.2 seconds late
2013-11-14 07:29:07,491 INFO     repeater     task os75nb_quick ended after 79.9 seconds
2013-11-14 07:29:07,492 INFO     repeater     task os75nb_3dayplots starting 512.1 seconds late
2013-11-14 07:30:17,984 INFO     repeater     task os75nb_3dayplots ended after 70.5 seconds
2013-11-14 07:30:17,985 INFO     repeater     task wh300_beamplots starting 282.6 seconds late
2013-11-14 07:30:28,893 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 07:30:28,893 INFO     repeater     task wh300_beamplots ended after 10.9 seconds
2013-11-14 07:30:28,894 INFO     repeater     task wh300_beamplots starting 293.5 seconds late
2013-11-14 07:30:39,683 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 07:30:39,683 INFO     repeater     task wh300_beamplots ended after 10.8 seconds
2013-11-14 07:30:39,684 INFO     repeater     task os75bb_beamplots starting 304.3 seconds late
2013-11-14 07:30:48,253 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 07:30:48,254 INFO     repeater     task os75bb_beamplots ended after 8.6 seconds
2013-11-14 07:30:48,255 INFO     repeater     task os75bb_beamplots starting 312.8 seconds late
2013-11-14 07:30:56,911 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 07:30:56,912 INFO     repeater     task os75bb_beamplots ended after 8.7 seconds
2013-11-14 07:30:56,915 INFO     repeater     task os75nb_beamplots starting 321.5 seconds late
2013-11-14 07:31:06,431 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 07:31:06,433 INFO     repeater     task os75nb_beamplots ended after 9.5 seconds
2013-11-14 07:31:06,435 INFO     repeater     task os75nb_beamplots starting 331.0 seconds late
2013-11-14 07:31:15,773 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 07:31:15,774 INFO     repeater     task os75nb_beamplots ended after 9.3 seconds
2013-11-14 07:31:15,774 INFO     repeater     task phins_hcorrstats starting 640.3 seconds late
2013-11-14 07:31:22,035 INFO     repeater     task phins_hcorrstats ended after 6.3 seconds
2013-11-14 07:31:22,036 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 07:31:22,037 INFO     repeater     task posmv_hcorrstats starting 646.6 seconds late
2013-11-14 07:31:27,108 INFO     repeater     task posmv_hcorrstats ended after 5.1 seconds
2013-11-14 07:31:27,109 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 07:31:32,112 INFO     repeater     task wh300_lastensq starting 587.1 seconds late
2013-11-14 07:31:46,251 INFO     repeater     task wh300_lastensq ended after 14.1 seconds
2013-11-14 07:31:46,252 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 07:29:35
2013-11-14 07:31:46,252 INFO     repeater     task wh300_lastensq: added 1 extra increments to time_to_run
2013-11-14 07:31:46,254 INFO     repeater     task os75bb_lastensq starting 361.3 seconds late
2013-11-14 07:31:52,876 INFO     repeater     task os75bb_lastensq ended after 6.6 seconds
2013-11-14 07:31:52,877 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 07:30:35
2013-11-14 07:31:52,879 INFO     repeater     task os75nb_lastensq starting 67.9 seconds late
2013-11-14 07:31:59,352 INFO     repeater     task os75nb_lastensq ended after 6.5 seconds
2013-11-14 07:31:59,354 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 07:30:35
2013-11-14 07:33:55,556 INFO     repeater     task wh300_lastensq starting 0.6 seconds late
2013-11-14 07:34:11,649 INFO     repeater     task wh300_lastensq ended after 16.1 seconds
2013-11-14 07:34:11,650 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 07:33:35
2013-11-14 07:35:37,430 INFO     repeater     task wh300_quick starting 2.0 seconds late
2013-11-14 07:37:51,620 INFO     repeater     task wh300_quick ended after 134.2 seconds
2013-11-14 07:37:51,641 INFO     repeater     task wh300_3dayplots starting 136.2 seconds late
2013-11-14 07:39:20,425 INFO     repeater     task wh300_3dayplots ended after 88.8 seconds
2013-11-14 07:39:20,426 INFO     repeater     task os75bb_lastensq starting 215.4 seconds late
2013-11-14 07:39:35,816 INFO     repeater     task os75bb_lastensq ended after 15.4 seconds
2013-11-14 07:39:35,817 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 07:35:35
2013-11-14 07:39:35,818 INFO     repeater     task os75bb_quick starting 240.4 seconds late
2013-11-14 07:41:04,037 INFO     repeater     task os75bb_quick ended after 88.2 seconds
2013-11-14 07:41:04,038 INFO     repeater     task os75bb_3dayplots starting 328.6 seconds late
2013-11-14 07:42:14,160 INFO     repeater     task os75bb_3dayplots ended after 70.1 seconds
2013-11-14 07:42:14,161 INFO     repeater     task os75nb_lastensq starting 389.2 seconds late
2013-11-14 07:42:29,150 INFO     repeater     task os75nb_lastensq ended after 15.0 seconds
2013-11-14 07:42:29,151 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 07:40:35
2013-11-14 07:42:29,152 INFO     repeater     task os75nb_quick starting 413.7 seconds late
2013-11-14 07:43:56,476 INFO     repeater     task os75nb_quick ended after 87.3 seconds
2013-11-14 07:43:56,477 INFO     repeater     task os75nb_3dayplots starting 501.1 seconds late
2013-11-14 07:45:22,431 INFO     repeater     task os75nb_3dayplots ended after 86.0 seconds
2013-11-14 07:45:22,432 INFO     repeater     task wh300_beamplots starting 587.0 seconds late
2013-11-14 07:45:31,424 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 07:45:31,425 INFO     repeater     task wh300_beamplots ended after 9.0 seconds
2013-11-14 07:45:31,426 INFO     repeater     task wh300_beamplots starting 596.0 seconds late
2013-11-14 07:45:40,233 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 07:45:40,234 INFO     repeater     task wh300_beamplots ended after 8.8 seconds
2013-11-14 07:45:40,234 INFO     repeater     task wh300_beamplots: added 1 extra increments to time_to_run
2013-11-14 07:45:40,235 INFO     repeater     task os75bb_beamplots starting 604.8 seconds late
2013-11-14 07:45:46,923 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 07:45:46,923 INFO     repeater     task os75bb_beamplots ended after 6.7 seconds
2013-11-14 07:45:46,923 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 07:45:46,924 INFO     repeater     task os75bb_beamplots starting 611.5 seconds late
2013-11-14 07:45:52,887 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 07:45:52,888 INFO     repeater     task os75bb_beamplots ended after 6.0 seconds
2013-11-14 07:45:52,888 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 07:45:52,892 INFO     repeater     task os75nb_beamplots starting 617.5 seconds late
2013-11-14 07:45:59,010 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 07:45:59,011 INFO     repeater     task os75nb_beamplots ended after 6.1 seconds
2013-11-14 07:45:59,011 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 07:45:59,012 INFO     repeater     task os75nb_beamplots starting 623.6 seconds late
2013-11-14 07:46:07,786 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 07:46:07,786 INFO     repeater     task os75nb_beamplots ended after 8.8 seconds
2013-11-14 07:46:07,787 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 07:46:07,788 INFO     repeater     task phins_hcorrstats starting 632.3 seconds late
2013-11-14 07:46:19,013 INFO     repeater     task phins_hcorrstats ended after 11.2 seconds
2013-11-14 07:46:19,013 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 07:46:19,014 INFO     repeater     task posmv_hcorrstats starting 643.6 seconds late
2013-11-14 07:46:26,963 INFO     repeater     task posmv_hcorrstats ended after 7.9 seconds
2013-11-14 07:46:26,964 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 07:46:31,971 INFO     repeater     task wh300_lastensq starting 647.0 seconds late
2013-11-14 07:46:50,195 INFO     repeater     task wh300_lastensq ended after 18.2 seconds
2013-11-14 07:46:50,196 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 07:45:35
2013-11-14 07:46:50,199 INFO     repeater     task os75bb_lastensq starting 365.2 seconds late
2013-11-14 07:46:57,481 INFO     repeater     task os75bb_lastensq ended after 7.3 seconds
2013-11-14 07:46:57,482 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 07:45:35
2013-11-14 07:46:57,484 INFO     repeater     task os75nb_lastensq starting 72.5 seconds late
2013-11-14 07:47:03,873 INFO     repeater     task os75nb_lastensq ended after 6.4 seconds
2013-11-14 07:47:03,874 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 07:45:35
2013-11-14 07:47:03,878 INFO     repeater     task wh300_beamplots starting 88.5 seconds late
2013-11-14 07:47:12,287 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 07:47:12,287 INFO     repeater     task wh300_beamplots ended after 8.4 seconds
2013-11-14 07:47:47,544 INFO     repeater     task wh300_lastensq starting 2.5 seconds late
2013-11-14 07:47:59,494 INFO     repeater     task wh300_lastensq ended after 11.9 seconds
2013-11-14 07:47:59,495 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 07:47:35
2013-11-14 07:49:45,091 INFO     repeater     task wh300_lastensq starting 0.1 seconds late
2013-11-14 07:49:56,551 INFO     repeater     task wh300_lastensq ended after 11.5 seconds
2013-11-14 07:49:56,552 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 07:49:35
2013-11-14 07:50:36,758 INFO     repeater     task wh300_quick starting 1.3 seconds late
2013-11-14 07:53:09,616 INFO     repeater     task wh300_quick ended after 152.9 seconds
2013-11-14 07:53:09,646 INFO     repeater     task wh300_3dayplots starting 154.2 seconds late
2013-11-14 07:54:23,800 INFO     repeater     task wh300_3dayplots ended after 74.2 seconds
2013-11-14 07:54:23,801 INFO     repeater     task os75bb_lastensq starting 218.8 seconds late
2013-11-14 07:54:34,429 INFO     repeater     task os75bb_lastensq ended after 10.6 seconds
2013-11-14 07:54:34,430 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 07:50:35
2013-11-14 07:54:34,431 INFO     repeater     task os75bb_quick starting 239.0 seconds late
2013-11-14 07:56:09,556 INFO     repeater     task os75bb_quick ended after 95.1 seconds
2013-11-14 07:56:09,580 INFO     repeater     task os75bb_3dayplots starting 334.2 seconds late
2013-11-14 07:57:15,614 INFO     repeater     task os75bb_3dayplots ended after 66.0 seconds
2013-11-14 07:57:15,615 INFO     repeater     task os75nb_lastensq starting 390.6 seconds late
2013-11-14 07:57:23,954 INFO     repeater     task os75nb_lastensq ended after 8.3 seconds
2013-11-14 07:57:23,955 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 07:55:35
2013-11-14 07:57:23,956 INFO     repeater     task os75nb_quick starting 408.5 seconds late
2013-11-14 07:58:45,344 INFO     repeater     task os75nb_quick ended after 81.4 seconds
2013-11-14 07:58:45,346 INFO     repeater     task os75nb_3dayplots starting 489.9 seconds late
2013-11-14 08:00:08,931 INFO     repeater     task os75nb_3dayplots ended after 83.6 seconds
2013-11-14 08:00:08,932 INFO     repeater     task wh300_beamplots starting 273.5 seconds late
2013-11-14 08:00:17,854 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 08:00:17,854 INFO     repeater     task wh300_beamplots ended after 8.9 seconds
2013-11-14 08:00:17,855 INFO     repeater     task wh300_beamplots starting 282.4 seconds late
2013-11-14 08:00:27,171 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 08:00:27,172 INFO     repeater     task wh300_beamplots ended after 9.3 seconds
2013-11-14 08:00:27,173 INFO     repeater     task os75bb_beamplots starting 291.7 seconds late
2013-11-14 08:00:33,532 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 08:00:33,532 INFO     repeater     task os75bb_beamplots ended after 6.4 seconds
2013-11-14 08:00:33,533 INFO     repeater     task os75bb_beamplots starting 298.1 seconds late
2013-11-14 08:00:39,466 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 08:00:39,467 INFO     repeater     task os75bb_beamplots ended after 5.9 seconds
2013-11-14 08:00:39,479 INFO     repeater     task os75nb_beamplots starting 304.1 seconds late
2013-11-14 08:00:45,476 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 08:00:45,477 INFO     repeater     task os75nb_beamplots ended after 6.0 seconds
2013-11-14 08:00:45,478 INFO     repeater     task os75nb_beamplots starting 310.0 seconds late
2013-11-14 08:00:51,373 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 08:00:51,373 INFO     repeater     task os75nb_beamplots ended after 5.9 seconds
2013-11-14 08:00:51,374 INFO     repeater     task phins_hcorrstats starting 615.9 seconds late
2013-11-14 08:00:57,919 INFO     repeater     task phins_hcorrstats ended after 6.5 seconds
2013-11-14 08:00:57,920 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 08:00:57,921 INFO     repeater     task posmv_hcorrstats starting 622.5 seconds late
2013-11-14 08:01:02,792 INFO     repeater     task posmv_hcorrstats ended after 4.9 seconds
2013-11-14 08:01:02,792 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 08:01:07,804 INFO     repeater     task wh300_lastensq starting 562.8 seconds late
2013-11-14 08:01:21,169 INFO     repeater     task wh300_lastensq ended after 13.4 seconds
2013-11-14 08:01:21,170 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 07:59:35
2013-11-14 08:01:21,174 INFO     repeater     task os75bb_lastensq starting 336.2 seconds late
2013-11-14 08:01:28,469 INFO     repeater     task os75bb_lastensq ended after 7.3 seconds
2013-11-14 08:01:28,469 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 08:00:35
2013-11-14 08:01:28,483 INFO     repeater     task os75nb_lastensq starting 43.5 seconds late
2013-11-14 08:01:34,584 INFO     repeater     task os75nb_lastensq ended after 6.1 seconds
2013-11-14 08:01:34,585 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 08:00:35
2013-11-14 08:01:49,629 INFO     repeater     task wh300_lastensq starting 4.6 seconds late
2013-11-14 08:02:00,817 INFO     repeater     task wh300_lastensq ended after 11.2 seconds
2013-11-14 08:02:00,818 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 08:01:35
2013-11-14 08:03:46,187 INFO     repeater     task wh300_lastensq starting 1.2 seconds late
2013-11-14 08:03:57,368 INFO     repeater     task wh300_lastensq ended after 11.2 seconds
2013-11-14 08:03:57,369 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 08:03:35
2013-11-14 08:05:37,729 INFO     repeater     task wh300_quick starting 2.3 seconds late
2013-11-14 08:09:06,275 INFO     repeater     task wh300_quick ended after 208.5 seconds
2013-11-14 08:09:06,314 INFO     repeater     task wh300_3dayplots starting 210.9 seconds late
2013-11-14 08:10:20,522 INFO     repeater     task wh300_3dayplots ended after 74.2 seconds
2013-11-14 08:10:20,525 INFO     repeater     task os75bb_lastensq starting 275.5 seconds late
2013-11-14 08:10:38,233 INFO     repeater     task os75bb_lastensq ended after 17.7 seconds
2013-11-14 08:10:38,234 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 08:05:35
2013-11-14 08:10:38,235 INFO     repeater     task os75bb_quick starting 302.8 seconds late
2013-11-14 08:12:28,264 INFO     repeater     task os75bb_quick ended after 110.0 seconds
2013-11-14 08:12:28,265 INFO     repeater     task os75bb_3dayplots starting 412.8 seconds late
2013-11-14 08:13:45,988 INFO     repeater     task os75bb_3dayplots ended after 77.7 seconds
2013-11-14 08:13:45,989 INFO     repeater     task os75nb_lastensq starting 481.0 seconds late
2013-11-14 08:13:55,512 INFO     repeater     task os75nb_lastensq ended after 9.5 seconds
2013-11-14 08:13:55,526 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 08:10:35
2013-11-14 08:13:55,527 INFO     repeater     task os75nb_quick starting 500.1 seconds late
2013-11-14 08:15:18,948 INFO     repeater     task os75nb_quick ended after 83.4 seconds
2013-11-14 08:15:18,949 INFO     repeater     task os75nb_3dayplots starting 583.5 seconds late
2013-11-14 08:16:30,372 INFO     repeater     task os75nb_3dayplots ended after 71.4 seconds
2013-11-14 08:16:30,376 INFO     repeater     task wh300_beamplots starting 654.9 seconds late
2013-11-14 08:16:41,826 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 08:16:41,826 INFO     repeater     task wh300_beamplots ended after 11.5 seconds
2013-11-14 08:16:41,827 INFO     repeater     task wh300_beamplots: added 1 extra increments to time_to_run
2013-11-14 08:16:41,828 INFO     repeater     task wh300_beamplots starting 666.4 seconds late
2013-11-14 08:16:53,474 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 08:16:53,475 INFO     repeater     task wh300_beamplots ended after 11.6 seconds
2013-11-14 08:16:53,475 INFO     repeater     task wh300_beamplots: added 1 extra increments to time_to_run
2013-11-14 08:16:53,476 INFO     repeater     task os75bb_beamplots starting 678.0 seconds late
2013-11-14 08:17:03,790 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 08:17:03,790 INFO     repeater     task os75bb_beamplots ended after 10.3 seconds
2013-11-14 08:17:03,791 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 08:17:03,796 INFO     repeater     task os75bb_beamplots starting 688.4 seconds late
2013-11-14 08:17:11,534 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 08:17:11,534 INFO     repeater     task os75bb_beamplots ended after 7.7 seconds
2013-11-14 08:17:11,535 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 08:17:11,535 INFO     repeater     task os75nb_beamplots starting 696.1 seconds late
2013-11-14 08:17:17,567 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 08:17:17,567 INFO     repeater     task os75nb_beamplots ended after 6.0 seconds
2013-11-14 08:17:17,567 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 08:17:17,568 INFO     repeater     task os75nb_beamplots starting 702.1 seconds late
2013-11-14 08:17:23,313 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 08:17:23,314 INFO     repeater     task os75nb_beamplots ended after 5.7 seconds
2013-11-14 08:17:23,314 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 08:17:23,315 INFO     repeater     task phins_hcorrstats starting 707.9 seconds late
2013-11-14 08:17:29,812 INFO     repeater     task phins_hcorrstats ended after 6.5 seconds
2013-11-14 08:17:29,812 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 08:17:29,814 INFO     repeater     task posmv_hcorrstats starting 714.4 seconds late
2013-11-14 08:17:34,646 INFO     repeater     task posmv_hcorrstats ended after 4.8 seconds
2013-11-14 08:17:34,646 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 08:17:39,652 INFO     repeater     task wh300_lastensq starting 714.7 seconds late
2013-11-14 08:17:54,601 INFO     repeater     task wh300_lastensq ended after 14.9 seconds
2013-11-14 08:17:54,602 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 08:17:35
2013-11-14 08:17:54,608 INFO     repeater     task os75bb_lastensq starting 429.6 seconds late
2013-11-14 08:18:01,198 INFO     repeater     task os75bb_lastensq ended after 6.6 seconds
2013-11-14 08:18:01,199 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 08:15:35
2013-11-14 08:18:01,202 INFO     repeater     task os75nb_lastensq starting 136.2 seconds late
2013-11-14 08:18:11,269 INFO     repeater     task os75nb_lastensq ended after 10.1 seconds
2013-11-14 08:18:11,270 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 08:15:35
2013-11-14 08:19:46,753 INFO     repeater     task wh300_lastensq starting 1.8 seconds late
2013-11-14 08:19:58,067 INFO     repeater     task wh300_lastensq ended after 11.3 seconds
2013-11-14 08:19:58,068 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 08:19:35
2013-11-14 08:20:38,382 INFO     repeater     task wh300_quick starting 3.0 seconds late
2013-11-14 08:23:10,445 INFO     repeater     task wh300_quick ended after 152.1 seconds
2013-11-14 08:23:10,473 INFO     repeater     task wh300_3dayplots starting 155.1 seconds late
2013-11-14 08:24:26,061 INFO     repeater     task wh300_3dayplots ended after 75.6 seconds
2013-11-14 08:24:26,062 INFO     repeater     task os75bb_lastensq starting 221.1 seconds late
2013-11-14 08:24:37,902 INFO     repeater     task os75bb_lastensq ended after 11.8 seconds
2013-11-14 08:24:37,903 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 08:20:35
2013-11-14 08:24:37,905 INFO     repeater     task os75bb_quick starting 242.5 seconds late
2013-11-14 08:26:16,025 INFO     repeater     task os75bb_quick ended after 98.1 seconds
2013-11-14 08:26:16,142 INFO     repeater     task os75bb_3dayplots starting 340.7 seconds late
2013-11-14 08:27:39,758 INFO     repeater     task os75bb_3dayplots ended after 83.6 seconds
2013-11-14 08:27:39,759 INFO     repeater     task os75nb_lastensq starting 414.8 seconds late
2013-11-14 08:27:49,197 INFO     repeater     task os75nb_lastensq ended after 9.4 seconds
2013-11-14 08:27:49,198 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 08:25:35
2013-11-14 08:27:49,200 INFO     repeater     task os75nb_quick starting 433.8 seconds late
2013-11-14 08:29:08,705 INFO     repeater     task os75nb_quick ended after 79.5 seconds
2013-11-14 08:29:08,706 INFO     repeater     task os75nb_3dayplots starting 513.3 seconds late
2013-11-14 08:30:17,118 INFO     repeater     task os75nb_3dayplots ended after 68.4 seconds
2013-11-14 08:30:17,119 INFO     repeater     task wh300_beamplots starting 281.7 seconds late
2013-11-14 08:30:29,218 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 08:30:29,219 INFO     repeater     task wh300_beamplots ended after 12.1 seconds
2013-11-14 08:30:29,220 INFO     repeater     task wh300_beamplots starting 293.8 seconds late
2013-11-14 08:30:40,107 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 08:30:40,108 INFO     repeater     task wh300_beamplots ended after 10.9 seconds
2013-11-14 08:30:40,109 INFO     repeater     task os75bb_beamplots starting 304.7 seconds late
2013-11-14 08:30:49,272 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 08:30:49,273 INFO     repeater     task os75bb_beamplots ended after 9.2 seconds
2013-11-14 08:30:49,275 INFO     repeater     task os75bb_beamplots starting 313.8 seconds late
2013-11-14 08:30:56,730 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 08:30:56,731 INFO     repeater     task os75bb_beamplots ended after 7.5 seconds
2013-11-14 08:30:56,732 INFO     repeater     task os75nb_beamplots starting 321.3 seconds late
2013-11-14 08:31:06,810 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 08:31:06,811 INFO     repeater     task os75nb_beamplots ended after 10.1 seconds
2013-11-14 08:31:06,812 INFO     repeater     task os75nb_beamplots starting 331.4 seconds late
2013-11-14 08:31:13,997 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 08:31:14,009 INFO     repeater     task os75nb_beamplots ended after 7.2 seconds
2013-11-14 08:31:14,010 INFO     repeater     task phins_hcorrstats starting 638.6 seconds late
2013-11-14 08:31:20,308 INFO     repeater     task phins_hcorrstats ended after 6.3 seconds
2013-11-14 08:31:20,308 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 08:31:20,309 INFO     repeater     task posmv_hcorrstats starting 644.9 seconds late
2013-11-14 08:31:25,373 INFO     repeater     task posmv_hcorrstats ended after 5.1 seconds
2013-11-14 08:31:25,373 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 08:31:30,379 INFO     repeater     task wh300_lastensq starting 585.4 seconds late
2013-11-14 08:31:44,001 INFO     repeater     task wh300_lastensq ended after 13.6 seconds
2013-11-14 08:31:44,002 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 08:29:35
2013-11-14 08:31:44,004 INFO     repeater     task os75bb_lastensq starting 359.0 seconds late
2013-11-14 08:31:50,705 INFO     repeater     task os75bb_lastensq ended after 6.7 seconds
2013-11-14 08:31:50,706 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 08:30:35
2013-11-14 08:31:50,709 INFO     repeater     task os75nb_lastensq starting 65.7 seconds late
2013-11-14 08:31:56,963 INFO     repeater     task os75nb_lastensq ended after 6.3 seconds
2013-11-14 08:31:56,964 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 08:30:35
2013-11-14 08:32:01,976 INFO     repeater     task wh300_lastensq starting 17.0 seconds late
2013-11-14 08:32:19,269 INFO     repeater     task wh300_lastensq ended after 17.3 seconds
2013-11-14 08:32:19,270 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 08:31:35
2013-11-14 08:33:49,600 INFO     repeater     task wh300_lastensq starting 4.6 seconds late
2013-11-14 08:34:00,566 INFO     repeater     task wh300_lastensq ended after 11.0 seconds
2013-11-14 08:34:00,567 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 08:33:35
2013-11-14 08:35:35,886 INFO     repeater     task wh300_quick starting 0.5 seconds late
2013-11-14 08:37:55,099 INFO     repeater     task wh300_quick ended after 139.2 seconds
2013-11-14 08:37:55,100 INFO     repeater     task wh300_3dayplots starting 139.7 seconds late
2013-11-14 08:39:21,673 INFO     repeater     task wh300_3dayplots ended after 86.6 seconds
2013-11-14 08:39:21,674 INFO     repeater     task os75bb_lastensq starting 216.7 seconds late
2013-11-14 08:39:33,284 INFO     repeater     task os75bb_lastensq ended after 11.6 seconds
2013-11-14 08:39:33,285 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 08:35:35
2013-11-14 08:39:33,287 INFO     repeater     task os75bb_quick starting 237.9 seconds late
2013-11-14 08:40:59,948 INFO     repeater     task os75bb_quick ended after 86.7 seconds
2013-11-14 08:40:59,952 INFO     repeater     task os75bb_3dayplots starting 324.5 seconds late
2013-11-14 08:42:06,859 INFO     repeater     task os75bb_3dayplots ended after 66.9 seconds
2013-11-14 08:42:06,860 INFO     repeater     task os75nb_lastensq starting 381.9 seconds late
2013-11-14 08:42:18,477 INFO     repeater     task os75nb_lastensq ended after 11.6 seconds
2013-11-14 08:42:18,478 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 08:40:35
2013-11-14 08:42:18,479 INFO     repeater     task os75nb_quick starting 403.1 seconds late
2013-11-14 08:43:41,097 INFO     repeater     task os75nb_quick ended after 82.6 seconds
2013-11-14 08:43:41,098 INFO     repeater     task os75nb_3dayplots starting 485.7 seconds late
2013-11-14 08:45:02,527 INFO     repeater     task os75nb_3dayplots ended after 81.4 seconds
2013-11-14 08:45:02,539 INFO     repeater     task wh300_beamplots starting 567.1 seconds late
2013-11-14 08:45:13,489 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 08:45:13,490 INFO     repeater     task wh300_beamplots ended after 11.0 seconds
2013-11-14 08:45:13,490 INFO     repeater     task wh300_beamplots starting 578.1 seconds late
2013-11-14 08:45:22,313 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 08:45:22,313 INFO     repeater     task wh300_beamplots ended after 8.8 seconds
2013-11-14 08:45:22,314 INFO     repeater     task os75bb_beamplots starting 586.9 seconds late
2013-11-14 08:45:28,773 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 08:45:28,773 INFO     repeater     task os75bb_beamplots ended after 6.5 seconds
2013-11-14 08:45:28,774 INFO     repeater     task os75bb_beamplots starting 593.3 seconds late
2013-11-14 08:45:34,759 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 08:45:34,765 INFO     repeater     task os75bb_beamplots ended after 6.0 seconds
2013-11-14 08:45:34,771 INFO     repeater     task os75nb_beamplots starting 599.3 seconds late
2013-11-14 08:45:41,133 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 08:45:41,133 INFO     repeater     task os75nb_beamplots ended after 6.4 seconds
2013-11-14 08:45:41,133 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 08:45:41,134 INFO     repeater     task os75nb_beamplots starting 605.7 seconds late
2013-11-14 08:45:47,036 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 08:45:47,037 INFO     repeater     task os75nb_beamplots ended after 5.9 seconds
2013-11-14 08:45:47,037 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 08:45:47,038 INFO     repeater     task phins_hcorrstats starting 611.6 seconds late
2013-11-14 08:45:53,088 INFO     repeater     task phins_hcorrstats ended after 6.1 seconds
2013-11-14 08:45:53,089 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 08:45:53,090 INFO     repeater     task posmv_hcorrstats starting 617.6 seconds late
2013-11-14 08:45:58,120 INFO     repeater     task posmv_hcorrstats ended after 5.0 seconds
2013-11-14 08:45:58,120 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 08:46:03,126 INFO     repeater     task wh300_lastensq starting 618.1 seconds late
2013-11-14 08:46:24,962 INFO     repeater     task wh300_lastensq ended after 21.8 seconds
2013-11-14 08:46:24,966 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 08:45:35
2013-11-14 08:46:24,978 INFO     repeater     task os75bb_lastensq starting 340.0 seconds late
2013-11-14 08:46:34,948 INFO     repeater     task os75bb_lastensq ended after 10.0 seconds
2013-11-14 08:46:34,949 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 08:45:35
2013-11-14 08:46:34,951 INFO     repeater     task os75nb_lastensq starting 50.0 seconds late
2013-11-14 08:46:43,124 INFO     repeater     task os75nb_lastensq ended after 8.2 seconds
2013-11-14 08:46:43,125 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 08:45:35
2013-11-14 08:46:43,128 INFO     repeater     task wh300_beamplots starting 67.7 seconds late
2013-11-14 08:46:51,219 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 08:46:51,220 INFO     repeater     task wh300_beamplots ended after 8.1 seconds
2013-11-14 08:46:51,221 INFO     repeater     task wh300_beamplots starting 75.8 seconds late
2013-11-14 08:46:59,989 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 08:46:59,990 INFO     repeater     task wh300_beamplots ended after 8.8 seconds
2013-11-14 08:46:59,991 INFO     repeater     task os75bb_beamplots starting 84.6 seconds late
2013-11-14 08:47:06,020 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 08:47:06,020 INFO     repeater     task os75bb_beamplots ended after 6.0 seconds
2013-11-14 08:47:06,021 INFO     repeater     task os75bb_beamplots starting 90.6 seconds late
2013-11-14 08:47:12,129 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 08:47:12,130 INFO     repeater     task os75bb_beamplots ended after 6.1 seconds
2013-11-14 08:47:47,235 INFO     repeater     task wh300_lastensq starting 2.2 seconds late
2013-11-14 08:47:58,489 INFO     repeater     task wh300_lastensq ended after 11.3 seconds
2013-11-14 08:47:58,489 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 08:47:35
2013-11-14 08:49:49,150 INFO     repeater     task wh300_lastensq starting 4.2 seconds late
2013-11-14 08:50:00,245 INFO     repeater     task wh300_lastensq ended after 11.1 seconds
2013-11-14 08:50:00,246 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 08:49:35
2013-11-14 08:50:40,398 INFO     repeater     task wh300_quick starting 5.0 seconds late
2013-11-14 08:53:06,831 INFO     repeater     task wh300_quick ended after 146.4 seconds
2013-11-14 08:53:06,832 INFO     repeater     task wh300_3dayplots starting 151.4 seconds late
2013-11-14 08:54:19,127 INFO     repeater     task wh300_3dayplots ended after 72.3 seconds
2013-11-14 08:54:19,129 INFO     repeater     task os75bb_lastensq starting 214.1 seconds late
2013-11-14 08:54:34,554 INFO     repeater     task os75bb_lastensq ended after 15.4 seconds
2013-11-14 08:54:34,555 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 08:50:35
2013-11-14 08:54:34,557 INFO     repeater     task os75bb_quick starting 239.1 seconds late
2013-11-14 08:56:08,191 INFO     repeater     task os75bb_quick ended after 93.6 seconds
2013-11-14 08:56:08,206 INFO     repeater     task os75bb_3dayplots starting 332.8 seconds late
2013-11-14 08:57:15,378 INFO     repeater     task os75bb_3dayplots ended after 67.2 seconds
2013-11-14 08:57:15,379 INFO     repeater     task os75nb_lastensq starting 390.4 seconds late
2013-11-14 08:57:25,613 INFO     repeater     task os75nb_lastensq ended after 10.2 seconds
2013-11-14 08:57:25,614 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 08:55:35
2013-11-14 08:57:25,616 INFO     repeater     task os75nb_quick starting 410.2 seconds late
2013-11-14 08:58:53,058 INFO     repeater     task os75nb_quick ended after 87.4 seconds
2013-11-14 08:58:53,060 INFO     repeater     task os75nb_3dayplots starting 497.6 seconds late
2013-11-14 09:00:13,493 INFO     repeater     task os75nb_3dayplots ended after 80.4 seconds
2013-11-14 09:00:13,494 INFO     repeater     task wh300_beamplots starting 278.1 seconds late
2013-11-14 09:00:22,157 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 09:00:22,157 INFO     repeater     task wh300_beamplots ended after 8.7 seconds
2013-11-14 09:00:22,158 INFO     repeater     task wh300_beamplots starting 286.7 seconds late
2013-11-14 09:00:31,056 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 09:00:31,056 INFO     repeater     task wh300_beamplots ended after 8.9 seconds
2013-11-14 09:00:31,058 INFO     repeater     task os75bb_beamplots starting 295.6 seconds late
2013-11-14 09:00:37,914 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 09:00:37,914 INFO     repeater     task os75bb_beamplots ended after 6.9 seconds
2013-11-14 09:00:37,918 INFO     repeater     task os75bb_beamplots starting 302.5 seconds late
2013-11-14 09:00:43,970 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 09:00:43,982 INFO     repeater     task os75bb_beamplots ended after 6.1 seconds
2013-11-14 09:00:43,983 INFO     repeater     task os75nb_beamplots starting 308.6 seconds late
2013-11-14 09:00:49,902 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 09:00:49,903 INFO     repeater     task os75nb_beamplots ended after 5.9 seconds
2013-11-14 09:00:49,904 INFO     repeater     task os75nb_beamplots starting 314.5 seconds late
2013-11-14 09:00:55,715 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 09:00:55,716 INFO     repeater     task os75nb_beamplots ended after 5.8 seconds
2013-11-14 09:00:55,717 INFO     repeater     task phins_hcorrstats starting 620.3 seconds late
2013-11-14 09:01:01,908 INFO     repeater     task phins_hcorrstats ended after 6.2 seconds
2013-11-14 09:01:01,908 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 09:01:01,911 INFO     repeater     task posmv_hcorrstats starting 626.5 seconds late
2013-11-14 09:01:07,034 INFO     repeater     task posmv_hcorrstats ended after 5.1 seconds
2013-11-14 09:01:07,034 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 09:01:12,041 INFO     repeater     task wh300_lastensq starting 567.0 seconds late
2013-11-14 09:01:27,714 INFO     repeater     task wh300_lastensq ended after 15.7 seconds
2013-11-14 09:01:27,715 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 08:59:35
2013-11-14 09:01:27,717 INFO     repeater     task os75bb_lastensq starting 342.7 seconds late
2013-11-14 09:01:34,848 INFO     repeater     task os75bb_lastensq ended after 7.1 seconds
2013-11-14 09:01:34,849 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 09:00:35
2013-11-14 09:01:34,851 INFO     repeater     task os75nb_lastensq starting 49.9 seconds late
2013-11-14 09:01:40,796 INFO     repeater     task os75nb_lastensq ended after 5.9 seconds
2013-11-14 09:01:40,797 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 09:00:35
2013-11-14 09:01:45,807 INFO     repeater     task wh300_lastensq starting 0.8 seconds late
2013-11-14 09:01:57,241 INFO     repeater     task wh300_lastensq ended after 11.4 seconds
2013-11-14 09:01:57,242 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 09:01:35
2013-11-14 09:03:47,663 INFO     repeater     task wh300_lastensq starting 2.7 seconds late
2013-11-14 09:03:59,258 INFO     repeater     task wh300_lastensq ended after 11.6 seconds
2013-11-14 09:03:59,259 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 09:03:35
2013-11-14 09:05:39,613 INFO     repeater     task wh300_quick starting 4.2 seconds late
2013-11-14 09:09:10,341 INFO     repeater     task wh300_quick ended after 210.7 seconds
2013-11-14 09:09:10,390 INFO     repeater     task wh300_3dayplots starting 215.0 seconds late
2013-11-14 09:10:28,743 INFO     repeater     task wh300_3dayplots ended after 78.4 seconds
2013-11-14 09:10:28,745 INFO     repeater     task os75bb_lastensq starting 283.7 seconds late
2013-11-14 09:10:45,814 INFO     repeater     task os75bb_lastensq ended after 17.1 seconds
2013-11-14 09:10:45,815 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 09:05:35
2013-11-14 09:10:45,815 INFO     repeater     task os75bb_lastensq: added 1 extra increments to time_to_run
2013-11-14 09:10:45,816 INFO     repeater     task os75bb_quick starting 310.4 seconds late
2013-11-14 09:12:45,626 INFO     repeater     task os75bb_quick ended after 119.8 seconds
2013-11-14 09:12:45,627 INFO     repeater     task os75bb_3dayplots starting 430.2 seconds late
2013-11-14 09:13:56,458 INFO     repeater     task os75bb_3dayplots ended after 70.8 seconds
2013-11-14 09:13:56,472 INFO     repeater     task os75nb_lastensq starting 491.5 seconds late
2013-11-14 09:14:10,931 INFO     repeater     task os75nb_lastensq ended after 14.5 seconds
2013-11-14 09:14:10,932 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 09:10:35
2013-11-14 09:14:10,933 INFO     repeater     task os75nb_quick starting 515.5 seconds late
2013-11-14 09:15:31,284 INFO     repeater     task os75nb_quick ended after 80.4 seconds
2013-11-14 09:15:31,288 INFO     repeater     task os75nb_3dayplots starting 595.9 seconds late
2013-11-14 09:16:48,629 INFO     repeater     task os75nb_3dayplots ended after 77.3 seconds
2013-11-14 09:16:48,633 INFO     repeater     task wh300_beamplots starting 673.2 seconds late
2013-11-14 09:17:01,999 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 09:17:01,999 INFO     repeater     task wh300_beamplots ended after 13.4 seconds
2013-11-14 09:17:02,001 INFO     repeater     task wh300_beamplots: added 1 extra increments to time_to_run
2013-11-14 09:17:02,005 INFO     repeater     task wh300_beamplots starting 686.6 seconds late
2013-11-14 09:17:14,276 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 09:17:14,277 INFO     repeater     task wh300_beamplots ended after 12.3 seconds
2013-11-14 09:17:14,277 INFO     repeater     task wh300_beamplots: added 1 extra increments to time_to_run
2013-11-14 09:17:14,278 INFO     repeater     task os75bb_beamplots starting 698.9 seconds late
2013-11-14 09:17:21,027 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 09:17:21,027 INFO     repeater     task os75bb_beamplots ended after 6.7 seconds
2013-11-14 09:17:21,027 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 09:17:21,028 INFO     repeater     task os75bb_beamplots starting 705.6 seconds late
2013-11-14 09:17:27,152 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 09:17:27,152 INFO     repeater     task os75bb_beamplots ended after 6.1 seconds
2013-11-14 09:17:27,152 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 09:17:27,153 INFO     repeater     task os75nb_beamplots starting 711.7 seconds late
2013-11-14 09:17:33,252 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 09:17:33,253 INFO     repeater     task os75nb_beamplots ended after 6.1 seconds
2013-11-14 09:17:33,253 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 09:17:33,254 INFO     repeater     task os75nb_beamplots starting 717.8 seconds late
2013-11-14 09:17:39,154 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 09:17:39,154 INFO     repeater     task os75nb_beamplots ended after 5.9 seconds
2013-11-14 09:17:39,154 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 09:17:39,158 INFO     repeater     task phins_hcorrstats starting 723.7 seconds late
2013-11-14 09:17:45,659 INFO     repeater     task phins_hcorrstats ended after 6.5 seconds
2013-11-14 09:17:45,660 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 09:17:45,662 INFO     repeater     task posmv_hcorrstats starting 730.2 seconds late
2013-11-14 09:17:50,898 INFO     repeater     task posmv_hcorrstats ended after 5.2 seconds
2013-11-14 09:17:50,898 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 09:17:55,907 INFO     repeater     task wh300_lastensq starting 730.9 seconds late
2013-11-14 09:18:18,537 INFO     repeater     task wh300_lastensq ended after 22.6 seconds
2013-11-14 09:18:18,539 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 09:17:35
2013-11-14 09:18:18,543 INFO     repeater     task os75bb_lastensq starting 143.5 seconds late
2013-11-14 09:18:27,555 INFO     repeater     task os75bb_lastensq ended after 9.0 seconds
2013-11-14 09:18:27,556 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 09:15:35
2013-11-14 09:18:27,558 INFO     repeater     task os75nb_lastensq starting 162.6 seconds late
2013-11-14 09:18:37,500 INFO     repeater     task os75nb_lastensq ended after 9.9 seconds
2013-11-14 09:18:37,501 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 09:15:35
2013-11-14 09:19:47,905 INFO     repeater     task wh300_lastensq starting 2.9 seconds late
2013-11-14 09:19:59,357 INFO     repeater     task wh300_lastensq ended after 11.5 seconds
2013-11-14 09:19:59,358 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 09:19:35
2013-11-14 09:20:39,523 INFO     repeater     task wh300_quick starting 4.1 seconds late
2013-11-14 09:23:15,982 INFO     repeater     task wh300_quick ended after 156.5 seconds
2013-11-14 09:23:15,983 INFO     repeater     task wh300_3dayplots starting 160.6 seconds late
2013-11-14 09:24:31,402 INFO     repeater     task wh300_3dayplots ended after 75.4 seconds
2013-11-14 09:24:31,403 INFO     repeater     task os75bb_lastensq starting 226.4 seconds late
2013-11-14 09:24:40,869 INFO     repeater     task os75bb_lastensq ended after 9.5 seconds
2013-11-14 09:24:40,870 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 09:20:35
2013-11-14 09:24:40,871 INFO     repeater     task os75bb_quick starting 245.5 seconds late
2013-11-14 09:26:19,170 INFO     repeater     task os75bb_quick ended after 98.3 seconds
2013-11-14 09:26:19,187 INFO     repeater     task os75bb_3dayplots starting 343.8 seconds late
2013-11-14 09:27:46,501 INFO     repeater     task os75bb_3dayplots ended after 87.3 seconds
2013-11-14 09:27:46,502 INFO     repeater     task os75nb_lastensq starting 421.5 seconds late
2013-11-14 09:27:54,363 INFO     repeater     task os75nb_lastensq ended after 7.9 seconds
2013-11-14 09:27:54,364 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 09:25:35
2013-11-14 09:27:54,365 INFO     repeater     task os75nb_quick starting 438.9 seconds late
2013-11-14 09:29:15,790 INFO     repeater     task os75nb_quick ended after 81.4 seconds
2013-11-14 09:29:15,791 INFO     repeater     task os75nb_3dayplots starting 520.4 seconds late
2013-11-14 09:30:28,273 INFO     repeater     task os75nb_3dayplots ended after 72.5 seconds
2013-11-14 09:30:28,275 INFO     repeater     task wh300_beamplots starting 292.8 seconds late
2013-11-14 09:30:40,684 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 09:30:40,685 INFO     repeater     task wh300_beamplots ended after 12.4 seconds
2013-11-14 09:30:40,688 INFO     repeater     task wh300_beamplots starting 305.3 seconds late
2013-11-14 09:30:51,808 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 09:30:51,809 INFO     repeater     task wh300_beamplots ended after 11.1 seconds
2013-11-14 09:30:51,810 INFO     repeater     task os75bb_beamplots starting 316.4 seconds late
2013-11-14 09:31:02,600 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 09:31:02,600 INFO     repeater     task os75bb_beamplots ended after 10.8 seconds
2013-11-14 09:31:02,602 INFO     repeater     task os75bb_beamplots starting 327.2 seconds late
2013-11-14 09:31:12,464 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 09:31:12,465 INFO     repeater     task os75bb_beamplots ended after 9.9 seconds
2013-11-14 09:31:12,466 INFO     repeater     task os75nb_beamplots starting 337.0 seconds late
2013-11-14 09:31:18,480 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 09:31:18,480 INFO     repeater     task os75nb_beamplots ended after 6.0 seconds
2013-11-14 09:31:18,496 INFO     repeater     task os75nb_beamplots starting 343.1 seconds late
2013-11-14 09:31:24,465 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 09:31:24,466 INFO     repeater     task os75nb_beamplots ended after 6.0 seconds
2013-11-14 09:31:24,466 INFO     repeater     task phins_hcorrstats starting 649.0 seconds late
2013-11-14 09:31:31,117 INFO     repeater     task phins_hcorrstats ended after 6.7 seconds
2013-11-14 09:31:31,117 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 09:31:31,118 INFO     repeater     task posmv_hcorrstats starting 655.7 seconds late
2013-11-14 09:31:36,357 INFO     repeater     task posmv_hcorrstats ended after 5.2 seconds
2013-11-14 09:31:36,357 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 09:31:41,363 INFO     repeater     task wh300_lastensq starting 596.4 seconds late
2013-11-14 09:31:56,227 INFO     repeater     task wh300_lastensq ended after 14.9 seconds
2013-11-14 09:31:56,228 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 09:31:35
2013-11-14 09:31:56,235 INFO     repeater     task os75bb_lastensq starting 371.2 seconds late
2013-11-14 09:32:04,705 INFO     repeater     task os75bb_lastensq ended after 8.5 seconds
2013-11-14 09:32:04,710 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 09:30:35
2013-11-14 09:32:04,717 INFO     repeater     task os75nb_lastensq starting 79.7 seconds late
2013-11-14 09:32:15,144 INFO     repeater     task os75nb_lastensq ended after 10.4 seconds
2013-11-14 09:32:15,146 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 09:30:35
2013-11-14 09:33:45,455 INFO     repeater     task wh300_lastensq starting 0.5 seconds late
2013-11-14 09:33:56,768 INFO     repeater     task wh300_lastensq ended after 11.3 seconds
2013-11-14 09:33:56,769 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 09:33:35
2013-11-14 09:35:37,139 INFO     repeater     task wh300_quick starting 1.7 seconds late
2013-11-14 09:37:56,277 INFO     repeater     task wh300_quick ended after 139.1 seconds
2013-11-14 09:37:56,278 INFO     repeater     task wh300_3dayplots starting 140.9 seconds late
2013-11-14 09:39:29,650 INFO     repeater     task wh300_3dayplots ended after 93.4 seconds
2013-11-14 09:39:29,652 INFO     repeater     task os75bb_lastensq starting 224.7 seconds late
2013-11-14 09:39:44,843 INFO     repeater     task os75bb_lastensq ended after 15.2 seconds
2013-11-14 09:39:44,844 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 09:35:35
2013-11-14 09:39:44,845 INFO     repeater     task os75bb_quick starting 249.4 seconds late
2013-11-14 09:41:12,010 INFO     repeater     task os75bb_quick ended after 87.2 seconds
2013-11-14 09:41:12,024 INFO     repeater     task os75bb_3dayplots starting 336.6 seconds late
2013-11-14 09:42:27,772 INFO     repeater     task os75bb_3dayplots ended after 75.7 seconds
2013-11-14 09:42:27,773 INFO     repeater     task os75nb_lastensq starting 402.8 seconds late
2013-11-14 09:42:43,718 INFO     repeater     task os75nb_lastensq ended after 15.9 seconds
2013-11-14 09:42:43,719 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 09:40:35
2013-11-14 09:42:43,721 INFO     repeater     task os75nb_quick starting 428.3 seconds late
2013-11-14 09:44:05,301 INFO     repeater     task os75nb_quick ended after 81.6 seconds
2013-11-14 09:44:05,302 INFO     repeater     task os75nb_3dayplots starting 509.9 seconds late
2013-11-14 09:45:30,365 INFO     repeater     task os75nb_3dayplots ended after 85.1 seconds
2013-11-14 09:45:30,366 INFO     repeater     task wh300_beamplots starting 594.9 seconds late
2013-11-14 09:45:39,502 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 09:45:39,502 INFO     repeater     task wh300_beamplots ended after 9.1 seconds
2013-11-14 09:45:39,503 INFO     repeater     task wh300_beamplots: added 1 extra increments to time_to_run
2013-11-14 09:45:39,504 INFO     repeater     task wh300_beamplots starting 604.1 seconds late
2013-11-14 09:45:48,542 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 09:45:48,543 INFO     repeater     task wh300_beamplots ended after 9.0 seconds
2013-11-14 09:45:48,543 INFO     repeater     task wh300_beamplots: added 1 extra increments to time_to_run
2013-11-14 09:45:48,544 INFO     repeater     task os75bb_beamplots starting 613.1 seconds late
2013-11-14 09:45:55,033 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 09:45:55,033 INFO     repeater     task os75bb_beamplots ended after 6.5 seconds
2013-11-14 09:45:55,034 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 09:45:55,034 INFO     repeater     task os75bb_beamplots starting 619.6 seconds late
2013-11-14 09:46:01,196 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 09:46:01,196 INFO     repeater     task os75bb_beamplots ended after 6.2 seconds
2013-11-14 09:46:01,196 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 09:46:01,197 INFO     repeater     task os75nb_beamplots starting 625.8 seconds late
2013-11-14 09:46:10,723 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 09:46:10,725 INFO     repeater     task os75nb_beamplots ended after 9.5 seconds
2013-11-14 09:46:10,726 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 09:46:10,733 INFO     repeater     task os75nb_beamplots starting 635.3 seconds late
2013-11-14 09:46:21,037 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 09:46:21,038 INFO     repeater     task os75nb_beamplots ended after 10.3 seconds
2013-11-14 09:46:21,040 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 09:46:21,050 INFO     repeater     task phins_hcorrstats starting 645.6 seconds late
2013-11-14 09:46:30,287 INFO     repeater     task phins_hcorrstats ended after 9.2 seconds
2013-11-14 09:46:30,288 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 09:46:30,290 INFO     repeater     task posmv_hcorrstats starting 654.8 seconds late
2013-11-14 09:46:37,067 INFO     repeater     task posmv_hcorrstats ended after 6.8 seconds
2013-11-14 09:46:37,068 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 09:46:42,074 INFO     repeater     task wh300_lastensq starting 657.1 seconds late
2013-11-14 09:47:00,454 INFO     repeater     task wh300_lastensq ended after 18.4 seconds
2013-11-14 09:47:00,460 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 09:45:35
2013-11-14 09:47:00,463 INFO     repeater     task os75bb_lastensq starting 375.5 seconds late
2013-11-14 09:47:06,907 INFO     repeater     task os75bb_lastensq ended after 6.4 seconds
2013-11-14 09:47:06,908 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 09:45:35
2013-11-14 09:47:06,911 INFO     repeater     task os75nb_lastensq starting 81.9 seconds late
2013-11-14 09:47:13,365 INFO     repeater     task os75nb_lastensq ended after 6.5 seconds
2013-11-14 09:47:13,366 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 09:45:35
2013-11-14 09:47:48,553 INFO     repeater     task wh300_lastensq starting 3.6 seconds late
2013-11-14 09:48:00,703 INFO     repeater     task wh300_lastensq ended after 12.1 seconds
2013-11-14 09:48:00,704 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 09:47:35
2013-11-14 09:49:46,294 INFO     repeater     task wh300_lastensq starting 1.3 seconds late
2013-11-14 09:49:57,927 INFO     repeater     task wh300_lastensq ended after 11.6 seconds
2013-11-14 09:49:57,928 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 09:49:35
2013-11-14 09:50:38,093 INFO     repeater     task wh300_quick starting 2.7 seconds late
2013-11-14 09:53:03,994 INFO     repeater     task wh300_quick ended after 145.9 seconds
2013-11-14 09:53:03,995 INFO     repeater     task wh300_3dayplots starting 148.6 seconds late
2013-11-14 09:54:19,096 INFO     repeater     task wh300_3dayplots ended after 75.1 seconds
2013-11-14 09:54:19,102 INFO     repeater     task os75bb_lastensq starting 214.1 seconds late
2013-11-14 09:54:30,724 INFO     repeater     task os75bb_lastensq ended after 11.6 seconds
2013-11-14 09:54:30,725 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 09:50:35
2013-11-14 09:54:30,727 INFO     repeater     task os75bb_quick starting 235.3 seconds late
2013-11-14 09:56:08,810 INFO     repeater     task os75bb_quick ended after 98.1 seconds
2013-11-14 09:56:08,826 INFO     repeater     task os75bb_3dayplots starting 333.4 seconds late
2013-11-14 09:57:16,412 INFO     repeater     task os75bb_3dayplots ended after 67.6 seconds
2013-11-14 09:57:16,416 INFO     repeater     task os75nb_lastensq starting 391.4 seconds late
2013-11-14 09:57:25,665 INFO     repeater     task os75nb_lastensq ended after 9.2 seconds
2013-11-14 09:57:25,666 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 09:55:35
2013-11-14 09:57:25,670 INFO     repeater     task os75nb_quick starting 410.2 seconds late
2013-11-14 09:58:48,665 INFO     repeater     task os75nb_quick ended after 83.0 seconds
2013-11-14 09:58:48,666 INFO     repeater     task os75nb_3dayplots starting 493.2 seconds late
2013-11-14 10:00:13,341 INFO     repeater     task os75nb_3dayplots ended after 84.7 seconds
2013-11-14 10:00:13,342 INFO     repeater     task wh300_beamplots starting 277.9 seconds late
2013-11-14 10:00:22,797 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 10:00:22,797 INFO     repeater     task wh300_beamplots ended after 9.5 seconds
2013-11-14 10:00:22,798 INFO     repeater     task wh300_beamplots starting 287.4 seconds late
2013-11-14 10:00:31,529 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 10:00:31,530 INFO     repeater     task wh300_beamplots ended after 8.7 seconds
2013-11-14 10:00:31,531 INFO     repeater     task os75bb_beamplots starting 296.1 seconds late
2013-11-14 10:00:38,016 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 10:00:38,017 INFO     repeater     task os75bb_beamplots ended after 6.5 seconds
2013-11-14 10:00:38,018 INFO     repeater     task os75bb_beamplots starting 302.6 seconds late
2013-11-14 10:00:44,514 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 10:00:44,514 INFO     repeater     task os75bb_beamplots ended after 6.5 seconds
2013-11-14 10:00:44,515 INFO     repeater     task os75nb_beamplots starting 309.1 seconds late
2013-11-14 10:00:50,573 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 10:00:50,573 INFO     repeater     task os75nb_beamplots ended after 6.1 seconds
2013-11-14 10:00:50,574 INFO     repeater     task os75nb_beamplots starting 315.1 seconds late
2013-11-14 10:00:56,569 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 10:00:56,569 INFO     repeater     task os75nb_beamplots ended after 6.0 seconds
2013-11-14 10:00:56,570 INFO     repeater     task phins_hcorrstats starting 621.1 seconds late
2013-11-14 10:01:02,832 INFO     repeater     task phins_hcorrstats ended after 6.3 seconds
2013-11-14 10:01:02,844 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 10:01:02,845 INFO     repeater     task posmv_hcorrstats starting 627.4 seconds late
2013-11-14 10:01:08,082 INFO     repeater     task posmv_hcorrstats ended after 5.2 seconds
2013-11-14 10:01:08,083 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 10:01:13,089 INFO     repeater     task wh300_lastensq starting 568.1 seconds late
2013-11-14 10:01:27,419 INFO     repeater     task wh300_lastensq ended after 14.3 seconds
2013-11-14 10:01:27,421 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 09:59:35
2013-11-14 10:01:27,423 INFO     repeater     task os75bb_lastensq starting 342.4 seconds late
2013-11-14 10:01:34,320 INFO     repeater     task os75bb_lastensq ended after 6.9 seconds
2013-11-14 10:01:34,321 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 10:00:35
2013-11-14 10:01:34,324 INFO     repeater     task os75nb_lastensq starting 49.3 seconds late
2013-11-14 10:01:40,726 INFO     repeater     task os75nb_lastensq ended after 6.4 seconds
2013-11-14 10:01:40,727 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 10:00:35
2013-11-14 10:01:45,739 INFO     repeater     task wh300_lastensq starting 0.7 seconds late
2013-11-14 10:01:57,268 INFO     repeater     task wh300_lastensq ended after 11.5 seconds
2013-11-14 10:01:57,269 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 10:01:35
2013-11-14 10:03:47,831 INFO     repeater     task wh300_lastensq starting 2.8 seconds late
2013-11-14 10:03:59,216 INFO     repeater     task wh300_lastensq ended after 11.4 seconds
2013-11-14 10:03:59,217 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 10:03:35
2013-11-14 10:05:39,827 INFO     repeater     task wh300_quick starting 4.4 seconds late
2013-11-14 10:09:08,767 INFO     repeater     task wh300_quick ended after 208.9 seconds
2013-11-14 10:09:08,808 INFO     repeater     task wh300_3dayplots starting 213.4 seconds late
2013-11-14 10:10:27,334 INFO     repeater     task wh300_3dayplots ended after 78.5 seconds
2013-11-14 10:10:27,335 INFO     repeater     task os75bb_lastensq starting 282.3 seconds late
2013-11-14 10:10:43,655 INFO     repeater     task os75bb_lastensq ended after 16.3 seconds
2013-11-14 10:10:43,656 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 10:05:35
2013-11-14 10:10:43,657 INFO     repeater     task os75bb_quick starting 308.2 seconds late
2013-11-14 10:12:27,478 INFO     repeater     task os75bb_quick ended after 103.8 seconds
2013-11-14 10:12:27,479 INFO     repeater     task os75bb_3dayplots starting 412.1 seconds late
2013-11-14 10:13:46,232 INFO     repeater     task os75bb_3dayplots ended after 78.8 seconds
2013-11-14 10:13:46,233 INFO     repeater     task os75nb_lastensq starting 481.2 seconds late
2013-11-14 10:13:56,915 INFO     repeater     task os75nb_lastensq ended after 10.7 seconds
2013-11-14 10:13:56,916 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 10:10:35
2013-11-14 10:13:56,917 INFO     repeater     task os75nb_quick starting 501.5 seconds late
2013-11-14 10:15:19,753 INFO     repeater     task os75nb_quick ended after 82.8 seconds
2013-11-14 10:15:19,754 INFO     repeater     task os75nb_3dayplots starting 584.3 seconds late
2013-11-14 10:16:33,620 INFO     repeater     task os75nb_3dayplots ended after 73.9 seconds
2013-11-14 10:16:33,624 INFO     repeater     task wh300_beamplots starting 658.2 seconds late
2013-11-14 10:16:45,139 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 10:16:45,140 INFO     repeater     task wh300_beamplots ended after 11.5 seconds
2013-11-14 10:16:45,154 INFO     repeater     task wh300_beamplots: added 1 extra increments to time_to_run
2013-11-14 10:16:45,155 INFO     repeater     task wh300_beamplots starting 669.7 seconds late
2013-11-14 10:16:56,325 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 10:16:56,326 INFO     repeater     task wh300_beamplots ended after 11.2 seconds
2013-11-14 10:16:56,327 INFO     repeater     task wh300_beamplots: added 1 extra increments to time_to_run
2013-11-14 10:16:56,328 INFO     repeater     task os75bb_beamplots starting 680.9 seconds late
2013-11-14 10:17:07,147 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 10:17:07,148 INFO     repeater     task os75bb_beamplots ended after 10.8 seconds
2013-11-14 10:17:07,149 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 10:17:07,151 INFO     repeater     task os75bb_beamplots starting 691.7 seconds late
2013-11-14 10:17:14,036 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 10:17:14,037 INFO     repeater     task os75bb_beamplots ended after 6.9 seconds
2013-11-14 10:17:14,037 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 10:17:14,038 INFO     repeater     task os75nb_beamplots starting 698.6 seconds late
2013-11-14 10:17:20,257 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 10:17:20,257 INFO     repeater     task os75nb_beamplots ended after 6.2 seconds
2013-11-14 10:17:20,257 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 10:17:20,258 INFO     repeater     task os75nb_beamplots starting 704.8 seconds late
2013-11-14 10:17:26,508 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 10:17:26,509 INFO     repeater     task os75nb_beamplots ended after 6.3 seconds
2013-11-14 10:17:26,509 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 10:17:26,513 INFO     repeater     task phins_hcorrstats starting 711.1 seconds late
2013-11-14 10:17:32,333 INFO     repeater     task phins_hcorrstats ended after 5.8 seconds
2013-11-14 10:17:32,333 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 10:17:32,334 INFO     repeater     task posmv_hcorrstats starting 716.9 seconds late
2013-11-14 10:17:37,587 INFO     repeater     task posmv_hcorrstats ended after 5.3 seconds
2013-11-14 10:17:37,588 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 10:17:42,594 INFO     repeater     task wh300_lastensq starting 717.6 seconds late
2013-11-14 10:17:57,289 INFO     repeater     task wh300_lastensq ended after 14.7 seconds
2013-11-14 10:17:57,290 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 10:17:35
2013-11-14 10:17:57,293 INFO     repeater     task os75bb_lastensq starting 432.3 seconds late
2013-11-14 10:18:04,643 INFO     repeater     task os75bb_lastensq ended after 7.3 seconds
2013-11-14 10:18:04,646 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 10:15:35
2013-11-14 10:18:04,653 INFO     repeater     task os75nb_lastensq starting 139.7 seconds late
2013-11-14 10:18:14,961 INFO     repeater     task os75nb_lastensq ended after 10.3 seconds
2013-11-14 10:18:14,962 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 10:15:35
2013-11-14 10:19:45,292 INFO     repeater     task wh300_lastensq starting 0.3 seconds late
2013-11-14 10:19:56,339 INFO     repeater     task wh300_lastensq ended after 11.0 seconds
2013-11-14 10:19:56,340 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 10:19:35
2013-11-14 10:20:36,492 INFO     repeater     task wh300_quick starting 1.1 seconds late
2013-11-14 10:23:10,155 INFO     repeater     task wh300_quick ended after 153.7 seconds
2013-11-14 10:23:10,180 INFO     repeater     task wh300_3dayplots starting 154.8 seconds late
2013-11-14 10:24:28,527 INFO     repeater     task wh300_3dayplots ended after 78.3 seconds
2013-11-14 10:24:28,532 INFO     repeater     task os75bb_lastensq starting 223.5 seconds late
2013-11-14 10:24:39,227 INFO     repeater     task os75bb_lastensq ended after 10.7 seconds
2013-11-14 10:24:39,228 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 10:20:35
2013-11-14 10:24:39,229 INFO     repeater     task os75bb_quick starting 243.8 seconds late
2013-11-14 10:26:18,333 INFO     repeater     task os75bb_quick ended after 99.1 seconds
2013-11-14 10:26:18,334 INFO     repeater     task os75bb_3dayplots starting 342.9 seconds late
2013-11-14 10:27:42,319 INFO     repeater     task os75bb_3dayplots ended after 84.0 seconds
2013-11-14 10:27:42,320 INFO     repeater     task os75nb_lastensq starting 417.3 seconds late
2013-11-14 10:27:50,448 INFO     repeater     task os75nb_lastensq ended after 8.1 seconds
2013-11-14 10:27:50,449 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 10:25:35
2013-11-14 10:27:50,456 INFO     repeater     task os75nb_quick starting 435.0 seconds late
2013-11-14 10:29:15,043 INFO     repeater     task os75nb_quick ended after 84.6 seconds
2013-11-14 10:29:15,062 INFO     repeater     task os75nb_3dayplots starting 519.6 seconds late
2013-11-14 10:30:29,567 INFO     repeater     task os75nb_3dayplots ended after 74.5 seconds
2013-11-14 10:30:29,568 INFO     repeater     task wh300_beamplots starting 294.1 seconds late
2013-11-14 10:30:41,654 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 10:30:41,655 INFO     repeater     task wh300_beamplots ended after 12.1 seconds
2013-11-14 10:30:41,656 INFO     repeater     task wh300_beamplots starting 306.2 seconds late
2013-11-14 10:30:52,679 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 10:30:52,680 INFO     repeater     task wh300_beamplots ended after 11.0 seconds
2013-11-14 10:30:52,681 INFO     repeater     task os75bb_beamplots starting 317.3 seconds late
2013-11-14 10:31:03,314 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 10:31:03,314 INFO     repeater     task os75bb_beamplots ended after 10.6 seconds
2013-11-14 10:31:03,315 INFO     repeater     task os75bb_beamplots starting 327.9 seconds late
2013-11-14 10:31:12,855 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 10:31:12,855 INFO     repeater     task os75bb_beamplots ended after 9.5 seconds
2013-11-14 10:31:12,856 INFO     repeater     task os75nb_beamplots starting 337.4 seconds late
2013-11-14 10:31:18,769 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 10:31:18,770 INFO     repeater     task os75nb_beamplots ended after 5.9 seconds
2013-11-14 10:31:18,771 INFO     repeater     task os75nb_beamplots starting 343.3 seconds late
2013-11-14 10:31:24,679 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 10:31:24,679 INFO     repeater     task os75nb_beamplots ended after 5.9 seconds
2013-11-14 10:31:24,680 INFO     repeater     task phins_hcorrstats starting 649.2 seconds late
2013-11-14 10:31:30,837 INFO     repeater     task phins_hcorrstats ended after 6.2 seconds
2013-11-14 10:31:30,838 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 10:31:30,839 INFO     repeater     task posmv_hcorrstats starting 655.4 seconds late
2013-11-14 10:31:36,064 INFO     repeater     task posmv_hcorrstats ended after 5.2 seconds
2013-11-14 10:31:36,065 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 10:31:41,068 INFO     repeater     task wh300_lastensq starting 596.1 seconds late
2013-11-14 10:31:55,967 INFO     repeater     task wh300_lastensq ended after 14.9 seconds
2013-11-14 10:31:55,968 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 10:31:35
2013-11-14 10:31:55,970 INFO     repeater     task os75bb_lastensq starting 371.0 seconds late
2013-11-14 10:32:04,366 INFO     repeater     task os75bb_lastensq ended after 8.4 seconds
2013-11-14 10:32:04,366 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 10:30:35
2013-11-14 10:32:04,371 INFO     repeater     task os75nb_lastensq starting 79.4 seconds late
2013-11-14 10:32:14,476 INFO     repeater     task os75nb_lastensq ended after 10.1 seconds
2013-11-14 10:32:14,478 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 10:30:35
2013-11-14 10:33:45,013 INFO     repeater     task wh300_lastensq starting 0.0 seconds late
2013-11-14 10:33:56,670 INFO     repeater     task wh300_lastensq ended after 11.7 seconds
2013-11-14 10:33:56,671 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 10:33:35
2013-11-14 10:35:37,078 INFO     repeater     task wh300_quick starting 1.7 seconds late
2013-11-14 10:37:54,345 INFO     repeater     task wh300_quick ended after 137.3 seconds
2013-11-14 10:37:54,372 INFO     repeater     task wh300_3dayplots starting 139.0 seconds late
2013-11-14 10:39:28,462 INFO     repeater     task wh300_3dayplots ended after 94.1 seconds
2013-11-14 10:39:28,463 INFO     repeater     task os75bb_lastensq starting 223.5 seconds late
2013-11-14 10:39:42,001 INFO     repeater     task os75bb_lastensq ended after 13.5 seconds
2013-11-14 10:39:42,002 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 10:35:35
2013-11-14 10:39:42,005 INFO     repeater     task os75bb_quick starting 246.6 seconds late
2013-11-14 10:41:07,977 INFO     repeater     task os75bb_quick ended after 86.0 seconds
2013-11-14 10:41:07,978 INFO     repeater     task os75bb_3dayplots starting 332.6 seconds late
2013-11-14 10:42:22,689 INFO     repeater     task os75bb_3dayplots ended after 74.7 seconds
2013-11-14 10:42:22,690 INFO     repeater     task os75nb_lastensq starting 397.7 seconds late
2013-11-14 10:42:37,721 INFO     repeater     task os75nb_lastensq ended after 15.0 seconds
2013-11-14 10:42:37,722 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 10:40:35
2013-11-14 10:42:37,728 INFO     repeater     task os75nb_quick starting 422.3 seconds late
2013-11-14 10:44:01,073 INFO     repeater     task os75nb_quick ended after 83.3 seconds
2013-11-14 10:44:01,074 INFO     repeater     task os75nb_3dayplots starting 505.6 seconds late
2013-11-14 10:45:27,229 INFO     repeater     task os75nb_3dayplots ended after 86.2 seconds
2013-11-14 10:45:27,230 INFO     repeater     task wh300_beamplots starting 591.8 seconds late
2013-11-14 10:45:36,417 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 10:45:36,418 INFO     repeater     task wh300_beamplots ended after 9.2 seconds
2013-11-14 10:45:36,418 INFO     repeater     task wh300_beamplots: added 1 extra increments to time_to_run
2013-11-14 10:45:36,419 INFO     repeater     task wh300_beamplots starting 601.0 seconds late
2013-11-14 10:45:45,402 INFO     repeater     task wh300_beamplots output:
Starting procsetup

2013-11-14 10:45:45,403 INFO     repeater     task wh300_beamplots ended after 9.0 seconds
2013-11-14 10:45:45,403 INFO     repeater     task wh300_beamplots: added 1 extra increments to time_to_run
2013-11-14 10:45:45,404 INFO     repeater     task os75bb_beamplots starting 610.0 seconds late
2013-11-14 10:45:51,856 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 10:45:51,857 INFO     repeater     task os75bb_beamplots ended after 6.5 seconds
2013-11-14 10:45:51,870 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 10:45:51,871 INFO     repeater     task os75bb_beamplots starting 616.4 seconds late
2013-11-14 10:45:58,284 INFO     repeater     task os75bb_beamplots output:
Starting procsetup

2013-11-14 10:45:58,285 INFO     repeater     task os75bb_beamplots ended after 6.4 seconds
2013-11-14 10:45:58,285 INFO     repeater     task os75bb_beamplots: added 1 extra increments to time_to_run
2013-11-14 10:45:58,286 INFO     repeater     task os75nb_beamplots starting 622.9 seconds late
2013-11-14 10:46:05,640 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 10:46:05,641 INFO     repeater     task os75nb_beamplots ended after 7.4 seconds
2013-11-14 10:46:05,642 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 10:46:05,644 INFO     repeater     task os75nb_beamplots starting 630.2 seconds late
2013-11-14 10:46:15,936 INFO     repeater     task os75nb_beamplots output:
Starting procsetup

2013-11-14 10:46:15,936 INFO     repeater     task os75nb_beamplots ended after 10.3 seconds
2013-11-14 10:46:15,937 INFO     repeater     task os75nb_beamplots: added 1 extra increments to time_to_run
2013-11-14 10:46:15,937 INFO     repeater     task phins_hcorrstats starting 640.5 seconds late
2013-11-14 10:46:25,287 INFO     repeater     task phins_hcorrstats ended after 9.3 seconds
2013-11-14 10:46:25,288 INFO     repeater     task phins_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 10:46:25,289 INFO     repeater     task posmv_hcorrstats starting 649.8 seconds late
2013-11-14 10:46:32,284 INFO     repeater     task posmv_hcorrstats ended after 7.0 seconds
2013-11-14 10:46:32,285 INFO     repeater     task posmv_hcorrstats: added 2 extra increments to time_to_run
2013-11-14 10:46:37,291 INFO     repeater     task wh300_lastensq starting 652.3 seconds late
2013-11-14 10:46:54,859 INFO     repeater     task wh300_lastensq ended after 17.6 seconds
2013-11-14 10:46:54,859 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 10:45:35
2013-11-14 10:46:54,875 INFO     repeater     task os75bb_lastensq starting 369.9 seconds late
2013-11-14 10:47:01,862 INFO     repeater     task os75bb_lastensq ended after 7.0 seconds
2013-11-14 10:47:01,863 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 10:45:35
2013-11-14 10:47:01,866 INFO     repeater     task os75nb_lastensq starting 76.9 seconds late
2013-11-14 10:47:07,808 INFO     repeater     task os75nb_lastensq ended after 5.9 seconds
2013-11-14 10:47:07,809 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 10:45:35
2013-11-14 10:47:47,924 INFO     repeater     task wh300_lastensq starting 2.9 seconds late
2013-11-14 10:47:59,307 INFO     repeater     task wh300_lastensq ended after 11.4 seconds
2013-11-14 10:47:59,308 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 10:47:35
2013-11-14 10:49:49,814 INFO     repeater     task wh300_lastensq starting 4.8 seconds late
2013-11-14 10:50:01,036 INFO     repeater     task wh300_lastensq ended after 11.2 seconds
2013-11-14 10:50:01,037 INFO     repeater     task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/14 10:49:35
2013-11-14 10:50:36,183 INFO     repeater     task wh300_quick starting 0.8 seconds late
2013-11-14 10:53:03,494 INFO     repeater     task wh300_quick ended after 147.3 seconds
2013-11-14 10:53:03,518 INFO     repeater     task wh300_3dayplots starting 148.1 seconds late
2013-11-14 10:54:17,043 INFO     repeater     task wh300_3dayplots ended after 73.5 seconds
2013-11-14 10:54:17,044 INFO     repeater     task os75bb_lastensq starting 212.0 seconds late
2013-11-14 10:54:30,981 INFO     repeater     task os75bb_lastensq ended after 13.9 seconds
2013-11-14 10:54:30,983 INFO     repeater     task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/14 10:50:35
2013-11-14 10:54:30,984 INFO     repeater     task os75bb_quick starting 235.6 seconds late
2013-11-14 10:56:08,166 INFO     repeater     task os75bb_quick ended after 97.2 seconds
2013-11-14 10:56:08,173 INFO     repeater     task os75bb_3dayplots starting 332.8 seconds late
2013-11-14 10:57:36,538 INFO     repeater     task os75bb_3dayplots ended after 88.4 seconds
2013-11-14 10:57:36,539 INFO     repeater     task os75nb_lastensq starting 411.5 seconds late
2013-11-14 10:57:44,326 INFO     repeater     task os75nb_lastensq ended after 7.8 seconds
2013-11-14 10:57:44,327 INFO     repeater     task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/14 10:55:35
2013-11-14 10:57:44,328 INFO     repeater     task os75nb_quick starting 428.9 seconds late
2013-11-14 10:59:07,525 INFO     repeater     task os75nb_quick ended after 83.2 seconds
2013-11-14 10:59:07,538 INFO     repeater     task os75nb_3dayplots starting 512.1 seconds late
2013-11-14 10:59:51,285 INFO     Translate    translate exiting, ixgps /home/data/kn213_03/rbin/phins 
2013-11-14 10:59:51,288 INFO     Translate    translate exiting, gps /home/data/kn213_03/rbin/gps_ms512 
2013-11-14 10:59:51,291 INFO     Translate    translate exiting, gps /home/data/kn213_03/rbin/posmv 
2013-11-14 10:59:51,293 INFO     Translate    translate exiting, hdg /home/data/kn213_03/rbin/phins 
2013-11-14 10:59:51,295 INFO     Translate    translate exiting, hdg /home/data/kn213_03/rbin/gyro 
2013-11-14 10:59:51,296 INFO     Translate    translate exiting, pmv /home/data/kn213_03/rbin/posmv 
2013-11-14 10:59:51,339 INFO     Translate    translate exiting, gps /home/data/kn213_03/rbin/gpsnav 
2013-11-14 10:59:51,355 INFO     Translate    translate exiting, gps /home/data/kn213_03/rbin/gps_cnav 
2013-11-14 11:00:15,471 INFO     repeater     task os75nb_3dayplots ended after 67.9 seconds
2013-11-14 11:00:20,503 INFO     root         cleanup_figs not_logging
2013-11-14 11:00:20,633 INFO     root         Exiting DAS_while_logging.py