2013-11-12 19:01:57,707 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 19:01:35 2013-11-12 19:03:48,558 INFO repeater task wh300_lastensq starting 3.6 seconds late 2013-11-12 19:03:59,875 INFO repeater task wh300_lastensq ended after 11.3 seconds 2013-11-12 19:03:59,876 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 19:03:35 2013-11-12 19:05:40,358 INFO repeater task wh300_quick starting 4.9 seconds late 2013-11-12 19:08:55,500 INFO repeater task wh300_quick ended after 195.1 seconds 2013-11-12 19:08:55,502 INFO repeater task wh300_3dayplots starting 200.1 seconds late 2013-11-12 19:10:05,595 INFO repeater task wh300_3dayplots ended after 70.1 seconds 2013-11-12 19:10:05,597 INFO repeater task os75bb_lastensq starting 260.6 seconds late 2013-11-12 19:10:16,135 INFO repeater task os75bb_lastensq ended after 10.5 seconds 2013-11-12 19:10:16,136 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 19:05:35 2013-11-12 19:10:16,137 INFO repeater task os75bb_quick starting 280.7 seconds late 2013-11-12 19:11:51,161 INFO repeater task os75bb_quick ended after 95.0 seconds 2013-11-12 19:11:51,170 INFO repeater task os75bb_3dayplots starting 375.8 seconds late 2013-11-12 19:13:16,200 INFO repeater task os75bb_3dayplots ended after 85.0 seconds 2013-11-12 19:13:16,203 INFO repeater task os75nb_lastensq starting 451.2 seconds late 2013-11-12 19:13:24,844 INFO repeater task os75nb_lastensq ended after 8.6 seconds 2013-11-12 19:13:24,845 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 19:10:35 2013-11-12 19:13:24,846 INFO repeater task os75nb_quick starting 469.4 seconds late 2013-11-12 19:14:41,559 INFO repeater task os75nb_quick ended after 76.7 seconds 2013-11-12 19:14:41,560 INFO repeater task os75nb_3dayplots starting 546.1 seconds late 2013-11-12 19:15:46,176 INFO repeater task os75nb_3dayplots ended after 64.6 seconds 2013-11-12 19:15:46,177 INFO repeater task wh300_beamplots starting 610.8 seconds late 2013-11-12 19:15:55,409 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 19:15:55,409 INFO repeater task wh300_beamplots ended after 9.2 seconds 2013-11-12 19:15:55,409 INFO repeater task wh300_beamplots: added 1 extra increments to time_to_run 2013-11-12 19:15:55,410 INFO repeater task wh300_beamplots starting 620.0 seconds late 2013-11-12 19:16:05,154 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 19:16:05,155 INFO repeater task wh300_beamplots ended after 9.7 seconds 2013-11-12 19:16:05,155 INFO repeater task wh300_beamplots: added 1 extra increments to time_to_run 2013-11-12 19:16:05,158 INFO repeater task os75bb_beamplots starting 629.7 seconds late 2013-11-12 19:16:15,846 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 19:16:15,847 INFO repeater task os75bb_beamplots ended after 10.7 seconds 2013-11-12 19:16:15,847 INFO repeater task os75bb_beamplots: added 1 extra increments to time_to_run 2013-11-12 19:16:15,849 INFO repeater task os75bb_beamplots starting 640.4 seconds late 2013-11-12 19:16:23,344 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 19:16:23,344 INFO repeater task os75bb_beamplots ended after 7.5 seconds 2013-11-12 19:16:23,345 INFO repeater task os75bb_beamplots: added 1 extra increments to time_to_run 2013-11-12 19:16:23,346 INFO repeater task os75nb_beamplots starting 647.9 seconds late 2013-11-12 19:16:31,221 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 19:16:31,221 INFO repeater task os75nb_beamplots ended after 7.9 seconds 2013-11-12 19:16:31,221 INFO repeater task os75nb_beamplots: added 1 extra increments to time_to_run 2013-11-12 19:16:31,222 INFO repeater task os75nb_beamplots starting 655.8 seconds late 2013-11-12 19:16:39,113 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 19:16:39,113 INFO repeater task os75nb_beamplots ended after 7.9 seconds 2013-11-12 19:16:39,114 INFO repeater task os75nb_beamplots: added 1 extra increments to time_to_run 2013-11-12 19:16:39,115 INFO repeater task phins_hcorrstats starting 663.7 seconds late 2013-11-12 19:16:47,702 INFO repeater task phins_hcorrstats ended after 8.6 seconds 2013-11-12 19:16:47,703 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 19:16:47,705 INFO repeater task posmv_hcorrstats starting 672.3 seconds late 2013-11-12 19:16:55,480 INFO repeater task posmv_hcorrstats ended after 7.8 seconds 2013-11-12 19:16:55,481 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 19:17:00,485 INFO repeater task wh300_lastensq starting 675.5 seconds late 2013-11-12 19:17:14,409 INFO repeater task wh300_lastensq ended after 13.9 seconds 2013-11-12 19:17:14,410 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 19:15:35 2013-11-12 19:17:14,412 INFO repeater task os75bb_lastensq starting 389.4 seconds late 2013-11-12 19:17:20,991 INFO repeater task os75bb_lastensq ended after 6.6 seconds 2013-11-12 19:17:20,992 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 19:15:35 2013-11-12 19:17:20,994 INFO repeater task os75nb_lastensq starting 96.0 seconds late 2013-11-12 19:17:27,168 INFO repeater task os75nb_lastensq ended after 6.2 seconds 2013-11-12 19:17:27,169 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 19:15:35 2013-11-12 19:17:47,245 INFO repeater task wh300_lastensq starting 2.2 seconds late 2013-11-12 19:17:58,507 INFO repeater task wh300_lastensq ended after 11.3 seconds 2013-11-12 19:17:58,508 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 19:17:35 2013-11-12 19:19:49,024 INFO repeater task wh300_lastensq starting 4.0 seconds late 2013-11-12 19:20:00,374 INFO repeater task wh300_lastensq ended after 11.3 seconds 2013-11-12 19:20:00,375 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 19:19:35 2013-11-12 19:20:35,552 INFO repeater task wh300_quick starting 0.1 seconds late 2013-11-12 19:23:04,469 INFO repeater task wh300_quick ended after 148.9 seconds 2013-11-12 19:23:04,470 INFO repeater task wh300_3dayplots starting 149.1 seconds late 2013-11-12 19:24:13,257 INFO repeater task wh300_3dayplots ended after 68.8 seconds 2013-11-12 19:24:13,260 INFO repeater task os75bb_lastensq starting 208.3 seconds late 2013-11-12 19:24:23,169 INFO repeater task os75bb_lastensq ended after 9.9 seconds 2013-11-12 19:24:23,170 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 19:20:35 2013-11-12 19:24:23,171 INFO repeater task os75bb_quick starting 227.8 seconds late 2013-11-12 19:25:54,914 INFO repeater task os75bb_quick ended after 91.7 seconds 2013-11-12 19:25:54,916 INFO repeater task os75bb_3dayplots starting 319.5 seconds late 2013-11-12 19:27:19,510 INFO repeater task os75bb_3dayplots ended after 84.6 seconds 2013-11-12 19:27:19,512 INFO repeater task os75nb_lastensq starting 394.5 seconds late 2013-11-12 19:27:26,245 INFO repeater task os75nb_lastensq ended after 6.7 seconds 2013-11-12 19:27:26,246 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 19:25:35 2013-11-12 19:27:26,247 INFO repeater task os75nb_quick starting 410.8 seconds late 2013-11-12 19:28:46,960 INFO repeater task os75nb_quick ended after 80.7 seconds 2013-11-12 19:28:46,977 INFO repeater task os75nb_3dayplots starting 491.6 seconds late 2013-11-12 19:29:50,579 INFO repeater task os75nb_3dayplots ended after 63.6 seconds 2013-11-12 19:29:50,580 INFO repeater task wh300_beamplots starting 255.2 seconds late 2013-11-12 19:29:59,900 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 19:29:59,901 INFO repeater task wh300_beamplots ended after 9.3 seconds 2013-11-12 19:29:59,901 INFO repeater task wh300_beamplots starting 264.5 seconds late 2013-11-12 19:30:13,171 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 19:30:13,172 INFO repeater task wh300_beamplots ended after 13.3 seconds 2013-11-12 19:30:13,174 INFO repeater task os75bb_beamplots starting 277.7 seconds late 2013-11-12 19:30:21,214 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 19:30:21,215 INFO repeater task os75bb_beamplots ended after 8.0 seconds 2013-11-12 19:30:21,217 INFO repeater task os75bb_beamplots starting 285.8 seconds late 2013-11-12 19:30:29,735 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 19:30:29,736 INFO repeater task os75bb_beamplots ended after 8.5 seconds 2013-11-12 19:30:29,737 INFO repeater task os75nb_beamplots starting 294.3 seconds late 2013-11-12 19:30:37,635 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 19:30:37,635 INFO repeater task os75nb_beamplots ended after 7.9 seconds 2013-11-12 19:30:37,639 INFO repeater task os75nb_beamplots starting 302.2 seconds late 2013-11-12 19:30:47,185 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 19:30:47,186 INFO repeater task os75nb_beamplots ended after 9.5 seconds 2013-11-12 19:30:47,187 INFO repeater task phins_hcorrstats starting 611.7 seconds late 2013-11-12 19:30:56,152 INFO repeater task phins_hcorrstats ended after 9.0 seconds 2013-11-12 19:30:56,152 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 19:30:56,153 INFO repeater task posmv_hcorrstats starting 620.7 seconds late 2013-11-12 19:31:01,210 INFO repeater task posmv_hcorrstats ended after 5.1 seconds 2013-11-12 19:31:01,211 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 19:31:06,214 INFO repeater task wh300_lastensq starting 561.2 seconds late 2013-11-12 19:31:20,471 INFO repeater task wh300_lastensq ended after 14.3 seconds 2013-11-12 19:31:20,472 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 19:29:35 2013-11-12 19:31:20,480 INFO repeater task os75bb_lastensq starting 335.5 seconds late 2013-11-12 19:31:26,834 INFO repeater task os75bb_lastensq ended after 6.4 seconds 2013-11-12 19:31:26,835 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 19:30:35 2013-11-12 19:31:26,838 INFO repeater task os75nb_lastensq starting 41.8 seconds late 2013-11-12 19:31:33,055 INFO repeater task os75nb_lastensq ended after 6.2 seconds 2013-11-12 19:31:33,056 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 19:30:35 2013-11-12 19:31:48,101 INFO repeater task wh300_lastensq starting 3.1 seconds late 2013-11-12 19:31:59,425 INFO repeater task wh300_lastensq ended after 11.3 seconds 2013-11-12 19:31:59,426 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 19:31:35 2013-11-12 19:33:45,026 INFO repeater task wh300_lastensq starting 0.0 seconds late 2013-11-12 19:33:56,381 INFO repeater task wh300_lastensq ended after 11.4 seconds 2013-11-12 19:33:56,382 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 19:33:35 2013-11-12 19:35:37,005 INFO repeater task wh300_quick starting 1.6 seconds late 2013-11-12 19:37:52,113 INFO repeater task wh300_quick ended after 135.1 seconds 2013-11-12 19:37:52,114 INFO repeater task wh300_3dayplots starting 136.7 seconds late 2013-11-12 19:39:12,869 INFO repeater task wh300_3dayplots ended after 80.8 seconds 2013-11-12 19:39:12,871 INFO repeater task os75bb_lastensq starting 207.9 seconds late 2013-11-12 19:39:30,868 INFO repeater task os75bb_lastensq ended after 18.0 seconds 2013-11-12 19:39:30,869 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 19:35:35 2013-11-12 19:39:30,870 INFO repeater task os75bb_quick starting 235.5 seconds late 2013-11-12 19:40:54,417 INFO repeater task os75bb_quick ended after 83.5 seconds 2013-11-12 19:40:54,424 INFO repeater task os75bb_3dayplots starting 319.0 seconds late 2013-11-12 19:41:58,784 INFO repeater task os75bb_3dayplots ended after 64.4 seconds 2013-11-12 19:41:58,785 INFO repeater task os75nb_lastensq starting 373.8 seconds late 2013-11-12 19:42:14,186 INFO repeater task os75nb_lastensq ended after 15.4 seconds 2013-11-12 19:42:14,187 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 19:40:35 2013-11-12 19:42:14,190 INFO repeater task os75nb_quick starting 398.8 seconds late 2013-11-12 19:43:41,448 INFO repeater task os75nb_quick ended after 87.3 seconds 2013-11-12 19:43:41,449 INFO repeater task os75nb_3dayplots starting 486.0 seconds late 2013-11-12 19:44:57,592 INFO repeater task os75nb_3dayplots ended after 76.1 seconds 2013-11-12 19:44:57,596 INFO repeater task wh300_beamplots starting 562.2 seconds late 2013-11-12 19:45:10,009 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 19:45:10,009 INFO repeater task wh300_beamplots ended after 12.4 seconds 2013-11-12 19:45:10,010 INFO repeater task wh300_beamplots starting 574.6 seconds late 2013-11-12 19:45:18,673 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 19:45:18,674 INFO repeater task wh300_beamplots ended after 8.7 seconds 2013-11-12 19:45:18,675 INFO repeater task os75bb_beamplots starting 583.2 seconds late 2013-11-12 19:45:25,420 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 19:45:25,420 INFO repeater task os75bb_beamplots ended after 6.7 seconds 2013-11-12 19:45:25,421 INFO repeater task os75bb_beamplots starting 590.0 seconds late 2013-11-12 19:45:31,672 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 19:45:31,673 INFO repeater task os75bb_beamplots ended after 6.3 seconds 2013-11-12 19:45:31,674 INFO repeater task os75nb_beamplots starting 596.2 seconds late 2013-11-12 19:45:37,491 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 19:45:37,492 INFO repeater task os75nb_beamplots ended after 5.8 seconds 2013-11-12 19:45:37,492 INFO repeater task os75nb_beamplots: added 1 extra increments to time_to_run 2013-11-12 19:45:37,493 INFO repeater task os75nb_beamplots starting 602.1 seconds late 2013-11-12 19:45:43,357 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 19:45:43,358 INFO repeater task os75nb_beamplots ended after 5.9 seconds 2013-11-12 19:45:43,358 INFO repeater task os75nb_beamplots: added 1 extra increments to time_to_run 2013-11-12 19:45:43,359 INFO repeater task phins_hcorrstats starting 607.9 seconds late 2013-11-12 19:45:49,972 INFO repeater task phins_hcorrstats ended after 6.6 seconds 2013-11-12 19:45:49,973 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 19:45:49,974 INFO repeater task posmv_hcorrstats starting 614.5 seconds late 2013-11-12 19:45:54,787 INFO repeater task posmv_hcorrstats ended after 4.8 seconds 2013-11-12 19:45:54,787 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 19:45:59,793 INFO repeater task wh300_lastensq starting 614.8 seconds late 2013-11-12 19:46:21,638 INFO repeater task wh300_lastensq ended after 21.8 seconds 2013-11-12 19:46:21,639 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 19:45:35 2013-11-12 19:46:21,642 INFO repeater task os75bb_lastensq starting 336.6 seconds late 2013-11-12 19:46:31,304 INFO repeater task os75bb_lastensq ended after 9.7 seconds 2013-11-12 19:46:31,307 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 19:45:35 2013-11-12 19:46:31,327 INFO repeater task os75nb_lastensq starting 46.3 seconds late 2013-11-12 19:46:40,184 INFO repeater task os75nb_lastensq ended after 8.9 seconds 2013-11-12 19:46:40,185 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 19:45:35 2013-11-12 19:46:40,190 INFO repeater task wh300_beamplots starting 64.8 seconds late 2013-11-12 19:46:48,869 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 19:46:48,870 INFO repeater task wh300_beamplots ended after 8.7 seconds 2013-11-12 19:46:48,870 INFO repeater task wh300_beamplots starting 73.4 seconds late 2013-11-12 19:46:57,804 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 19:46:57,805 INFO repeater task wh300_beamplots ended after 8.9 seconds 2013-11-12 19:46:57,805 INFO repeater task os75bb_beamplots starting 82.4 seconds late 2013-11-12 19:47:03,856 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 19:47:03,856 INFO repeater task os75bb_beamplots ended after 6.1 seconds 2013-11-12 19:47:03,857 INFO repeater task os75bb_beamplots starting 88.4 seconds late 2013-11-12 19:47:09,971 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 19:47:09,971 INFO repeater task os75bb_beamplots ended after 6.1 seconds 2013-11-12 19:47:45,070 INFO repeater task wh300_lastensq starting 0.1 seconds late 2013-11-12 19:47:56,296 INFO repeater task wh300_lastensq ended after 11.2 seconds 2013-11-12 19:47:56,297 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 19:47:35 2013-11-12 19:49:46,653 INFO repeater task wh300_lastensq starting 1.7 seconds late 2013-11-12 19:49:58,023 INFO repeater task wh300_lastensq ended after 11.4 seconds 2013-11-12 19:49:58,024 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 19:49:35 2013-11-12 19:50:38,196 INFO repeater task wh300_quick starting 2.8 seconds late 2013-11-12 19:52:56,988 INFO repeater task wh300_quick ended after 138.8 seconds 2013-11-12 19:52:56,991 INFO repeater task wh300_3dayplots starting 141.6 seconds late 2013-11-12 19:54:03,883 INFO repeater task wh300_3dayplots ended after 66.9 seconds 2013-11-12 19:54:03,884 INFO repeater task os75bb_lastensq starting 198.9 seconds late 2013-11-12 19:54:16,122 INFO repeater task os75bb_lastensq ended after 12.2 seconds 2013-11-12 19:54:16,123 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 19:50:35 2013-11-12 19:54:16,124 INFO repeater task os75bb_quick starting 220.7 seconds late 2013-11-12 19:55:56,568 INFO repeater task os75bb_quick ended after 100.4 seconds 2013-11-12 19:55:56,574 INFO repeater task os75bb_3dayplots starting 321.2 seconds late 2013-11-12 19:57:01,022 INFO repeater task os75bb_3dayplots ended after 64.4 seconds 2013-11-12 19:57:01,023 INFO repeater task os75nb_lastensq starting 376.0 seconds late 2013-11-12 19:57:08,589 INFO repeater task os75nb_lastensq ended after 7.6 seconds 2013-11-12 19:57:08,590 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 19:55:35 2013-11-12 19:57:08,591 INFO repeater task os75nb_quick starting 393.2 seconds late 2013-11-12 19:58:24,138 INFO repeater task os75nb_quick ended after 75.5 seconds 2013-11-12 19:58:24,140 INFO repeater task os75nb_3dayplots starting 468.7 seconds late 2013-11-12 19:59:46,920 INFO repeater task os75nb_3dayplots ended after 82.8 seconds 2013-11-12 19:59:46,922 INFO repeater task wh300_beamplots starting 251.5 seconds late 2013-11-12 19:59:56,786 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 19:59:56,787 INFO repeater task wh300_beamplots ended after 9.9 seconds 2013-11-12 19:59:56,788 INFO repeater task wh300_beamplots starting 261.4 seconds late 2013-11-12 20:00:06,087 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 20:00:06,087 INFO repeater task wh300_beamplots ended after 9.3 seconds 2013-11-12 20:00:06,088 INFO repeater task os75bb_beamplots starting 270.7 seconds late 2013-11-12 20:00:12,591 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 20:00:12,592 INFO repeater task os75bb_beamplots ended after 6.5 seconds 2013-11-12 20:00:12,593 INFO repeater task os75bb_beamplots starting 277.2 seconds late 2013-11-12 20:00:18,769 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 20:00:18,770 INFO repeater task os75bb_beamplots ended after 6.2 seconds 2013-11-12 20:00:18,771 INFO repeater task os75nb_beamplots starting 283.3 seconds late 2013-11-12 20:00:24,718 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 20:00:24,719 INFO repeater task os75nb_beamplots ended after 5.9 seconds 2013-11-12 20:00:24,721 INFO repeater task os75nb_beamplots starting 289.3 seconds late 2013-11-12 20:00:31,171 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 20:00:31,171 INFO repeater task os75nb_beamplots ended after 6.5 seconds 2013-11-12 20:00:31,172 INFO repeater task phins_hcorrstats starting 595.7 seconds late 2013-11-12 20:00:37,409 INFO repeater task phins_hcorrstats ended after 6.2 seconds 2013-11-12 20:00:37,410 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 20:00:37,411 INFO repeater task posmv_hcorrstats starting 602.0 seconds late 2013-11-12 20:00:42,442 INFO repeater task posmv_hcorrstats ended after 5.0 seconds 2013-11-12 20:00:42,443 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 20:00:47,449 INFO repeater task wh300_lastensq starting 542.4 seconds late 2013-11-12 20:01:00,755 INFO repeater task wh300_lastensq ended after 13.3 seconds 2013-11-12 20:01:00,756 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 19:59:35 2013-11-12 20:01:00,773 INFO repeater task os75bb_lastensq starting 315.8 seconds late 2013-11-12 20:01:08,086 INFO repeater task os75bb_lastensq ended after 7.3 seconds 2013-11-12 20:01:08,087 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 20:00:35 2013-11-12 20:01:08,090 INFO repeater task os75nb_lastensq starting 23.1 seconds late 2013-11-12 20:01:13,872 INFO repeater task os75nb_lastensq ended after 5.8 seconds 2013-11-12 20:01:13,873 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 20:00:35 2013-11-12 20:01:48,981 INFO repeater task wh300_lastensq starting 4.0 seconds late 2013-11-12 20:02:00,162 INFO repeater task wh300_lastensq ended after 11.2 seconds 2013-11-12 20:02:00,163 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 20:01:35 2013-11-12 20:03:45,559 INFO repeater task wh300_lastensq starting 0.6 seconds late 2013-11-12 20:03:56,660 INFO repeater task wh300_lastensq ended after 11.1 seconds 2013-11-12 20:03:56,662 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 20:03:35 2013-11-12 20:05:37,050 INFO repeater task wh300_quick starting 1.6 seconds late 2013-11-12 20:09:00,373 INFO repeater task wh300_quick ended after 203.3 seconds 2013-11-12 20:09:00,404 INFO repeater task wh300_3dayplots starting 205.0 seconds late 2013-11-12 20:10:12,073 INFO repeater task wh300_3dayplots ended after 71.7 seconds 2013-11-12 20:10:12,076 INFO repeater task os75bb_lastensq starting 267.1 seconds late 2013-11-12 20:10:28,762 INFO repeater task os75bb_lastensq ended after 16.7 seconds 2013-11-12 20:10:28,763 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 20:05:35 2013-11-12 20:10:28,765 INFO repeater task os75bb_quick starting 293.3 seconds late 2013-11-12 20:12:01,179 INFO repeater task os75bb_quick ended after 92.4 seconds 2013-11-12 20:12:01,180 INFO repeater task os75bb_3dayplots starting 385.8 seconds late 2013-11-12 20:13:26,517 INFO repeater task os75bb_3dayplots ended after 85.3 seconds 2013-11-12 20:13:26,521 INFO repeater task os75nb_lastensq starting 461.5 seconds late 2013-11-12 20:13:36,785 INFO repeater task os75nb_lastensq ended after 10.3 seconds 2013-11-12 20:13:36,786 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 20:10:35 2013-11-12 20:13:36,787 INFO repeater task os75nb_quick starting 481.4 seconds late 2013-11-12 20:14:55,411 INFO repeater task os75nb_quick ended after 78.6 seconds 2013-11-12 20:14:55,412 INFO repeater task os75nb_3dayplots starting 560.0 seconds late 2013-11-12 20:15:56,776 INFO repeater task os75nb_3dayplots ended after 61.4 seconds 2013-11-12 20:15:56,777 INFO repeater task wh300_beamplots starting 621.4 seconds late 2013-11-12 20:16:08,326 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 20:16:08,326 INFO repeater task wh300_beamplots ended after 11.5 seconds 2013-11-12 20:16:08,326 INFO repeater task wh300_beamplots: added 1 extra increments to time_to_run 2013-11-12 20:16:08,327 INFO repeater task wh300_beamplots starting 632.9 seconds late 2013-11-12 20:16:20,657 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 20:16:20,657 INFO repeater task wh300_beamplots ended after 12.3 seconds 2013-11-12 20:16:20,658 INFO repeater task wh300_beamplots: added 1 extra increments to time_to_run 2013-11-12 20:16:20,659 INFO repeater task os75bb_beamplots starting 645.2 seconds late 2013-11-12 20:16:28,683 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 20:16:28,683 INFO repeater task os75bb_beamplots ended after 8.0 seconds 2013-11-12 20:16:28,684 INFO repeater task os75bb_beamplots: added 1 extra increments to time_to_run 2013-11-12 20:16:28,688 INFO repeater task os75bb_beamplots starting 653.3 seconds late 2013-11-12 20:16:37,160 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 20:16:37,160 INFO repeater task os75bb_beamplots ended after 8.5 seconds 2013-11-12 20:16:37,175 INFO repeater task os75bb_beamplots: added 1 extra increments to time_to_run 2013-11-12 20:16:37,179 INFO repeater task os75nb_beamplots starting 661.8 seconds late 2013-11-12 20:16:44,580 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 20:16:44,581 INFO repeater task os75nb_beamplots ended after 7.4 seconds 2013-11-12 20:16:44,582 INFO repeater task os75nb_beamplots: added 1 extra increments to time_to_run 2013-11-12 20:16:44,583 INFO repeater task os75nb_beamplots starting 669.1 seconds late 2013-11-12 20:16:53,503 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 20:16:53,503 INFO repeater task os75nb_beamplots ended after 8.9 seconds 2013-11-12 20:16:53,503 INFO repeater task os75nb_beamplots: added 1 extra increments to time_to_run 2013-11-12 20:16:53,504 INFO repeater task phins_hcorrstats starting 678.1 seconds late 2013-11-12 20:17:03,039 INFO repeater task phins_hcorrstats ended after 9.5 seconds 2013-11-12 20:17:03,040 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 20:17:03,047 INFO repeater task posmv_hcorrstats starting 687.6 seconds late 2013-11-12 20:17:08,331 INFO repeater task posmv_hcorrstats ended after 5.3 seconds 2013-11-12 20:17:08,332 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 20:17:13,340 INFO repeater task wh300_lastensq starting 688.3 seconds late 2013-11-12 20:17:27,575 INFO repeater task wh300_lastensq ended after 14.2 seconds 2013-11-12 20:17:27,576 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 20:15:35 2013-11-12 20:17:27,578 INFO repeater task os75bb_lastensq starting 402.6 seconds late 2013-11-12 20:17:34,257 INFO repeater task os75bb_lastensq ended after 6.7 seconds 2013-11-12 20:17:34,258 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 20:15:35 2013-11-12 20:17:34,261 INFO repeater task os75nb_lastensq starting 109.3 seconds late 2013-11-12 20:17:40,141 INFO repeater task os75nb_lastensq ended after 5.9 seconds 2013-11-12 20:17:40,142 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 20:15:35 2013-11-12 20:17:45,158 INFO repeater task wh300_lastensq starting 0.2 seconds late 2013-11-12 20:17:56,296 INFO repeater task wh300_lastensq ended after 11.1 seconds 2013-11-12 20:17:56,297 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 20:17:35 2013-11-12 20:19:46,781 INFO repeater task wh300_lastensq starting 1.8 seconds late 2013-11-12 20:19:58,108 INFO repeater task wh300_lastensq ended after 11.3 seconds 2013-11-12 20:19:58,109 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 20:19:35 2013-11-12 20:20:38,347 INFO repeater task wh300_quick starting 2.9 seconds late 2013-11-12 20:22:56,027 INFO repeater task wh300_quick ended after 137.7 seconds 2013-11-12 20:22:56,028 INFO repeater task wh300_3dayplots starting 140.6 seconds late 2013-11-12 20:24:01,589 INFO repeater task wh300_3dayplots ended after 65.6 seconds 2013-11-12 20:24:01,593 INFO repeater task os75bb_lastensq starting 196.6 seconds late 2013-11-12 20:24:14,111 INFO repeater task os75bb_lastensq ended after 12.5 seconds 2013-11-12 20:24:14,116 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 20:20:35 2013-11-12 20:24:14,118 INFO repeater task os75bb_quick starting 218.7 seconds late 2013-11-12 20:25:52,211 INFO repeater task os75bb_quick ended after 98.1 seconds 2013-11-12 20:25:52,212 INFO repeater task os75bb_3dayplots starting 316.8 seconds late 2013-11-12 20:27:15,366 INFO repeater task os75bb_3dayplots ended after 83.2 seconds 2013-11-12 20:27:15,369 INFO repeater task os75nb_lastensq starting 390.4 seconds late 2013-11-12 20:27:25,317 INFO repeater task os75nb_lastensq ended after 9.9 seconds 2013-11-12 20:27:25,317 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 20:25:35 2013-11-12 20:27:25,320 INFO repeater task os75nb_quick starting 409.9 seconds late 2013-11-12 20:28:48,170 INFO repeater task os75nb_quick ended after 82.9 seconds 2013-11-12 20:28:48,176 INFO repeater task os75nb_3dayplots starting 492.8 seconds late 2013-11-12 20:29:50,345 INFO repeater task os75nb_3dayplots ended after 62.2 seconds 2013-11-12 20:29:50,346 INFO repeater task wh300_beamplots starting 254.9 seconds late 2013-11-12 20:29:59,756 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 20:29:59,757 INFO repeater task wh300_beamplots ended after 9.4 seconds 2013-11-12 20:29:59,758 INFO repeater task wh300_beamplots starting 264.3 seconds late 2013-11-12 20:30:13,239 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 20:30:13,239 INFO repeater task wh300_beamplots ended after 13.5 seconds 2013-11-12 20:30:13,240 INFO repeater task os75bb_beamplots starting 277.8 seconds late 2013-11-12 20:30:22,068 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 20:30:22,069 INFO repeater task os75bb_beamplots ended after 8.8 seconds 2013-11-12 20:30:22,070 INFO repeater task os75bb_beamplots starting 286.6 seconds late 2013-11-12 20:30:30,047 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 20:30:30,048 INFO repeater task os75bb_beamplots ended after 8.0 seconds 2013-11-12 20:30:30,050 INFO repeater task os75nb_beamplots starting 294.6 seconds late 2013-11-12 20:30:38,207 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 20:30:38,208 INFO repeater task os75nb_beamplots ended after 8.2 seconds 2013-11-12 20:30:38,209 INFO repeater task os75nb_beamplots starting 302.8 seconds late 2013-11-12 20:30:47,664 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 20:30:47,665 INFO repeater task os75nb_beamplots ended after 9.5 seconds 2013-11-12 20:30:47,673 INFO repeater task phins_hcorrstats starting 612.2 seconds late 2013-11-12 20:30:56,275 INFO repeater task phins_hcorrstats ended after 8.6 seconds 2013-11-12 20:30:56,276 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 20:30:56,277 INFO repeater task posmv_hcorrstats starting 620.8 seconds late 2013-11-12 20:31:01,427 INFO repeater task posmv_hcorrstats ended after 5.2 seconds 2013-11-12 20:31:01,427 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 20:31:06,433 INFO repeater task wh300_lastensq starting 561.4 seconds late 2013-11-12 20:31:20,796 INFO repeater task wh300_lastensq ended after 14.4 seconds 2013-11-12 20:31:20,797 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 20:29:35 2013-11-12 20:31:20,799 INFO repeater task os75bb_lastensq starting 335.8 seconds late 2013-11-12 20:31:27,331 INFO repeater task os75bb_lastensq ended after 6.5 seconds 2013-11-12 20:31:27,332 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 20:30:35 2013-11-12 20:31:27,334 INFO repeater task os75nb_lastensq starting 42.3 seconds late 2013-11-12 20:31:33,641 INFO repeater task os75nb_lastensq ended after 6.3 seconds 2013-11-12 20:31:33,642 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 20:30:35 2013-11-12 20:31:48,715 INFO repeater task wh300_lastensq starting 3.7 seconds late 2013-11-12 20:32:00,254 INFO repeater task wh300_lastensq ended after 11.5 seconds 2013-11-12 20:32:00,255 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 20:31:35 2013-11-12 20:33:45,671 INFO repeater task wh300_lastensq starting 0.7 seconds late 2013-11-12 20:33:56,990 INFO repeater task wh300_lastensq ended after 11.3 seconds 2013-11-12 20:33:56,991 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 20:33:35 2013-11-12 20:35:37,380 INFO repeater task wh300_quick starting 2.0 seconds late 2013-11-12 20:37:46,527 INFO repeater task wh300_quick ended after 129.1 seconds 2013-11-12 20:37:46,528 INFO repeater task wh300_3dayplots starting 131.1 seconds late 2013-11-12 20:39:03,009 INFO repeater task wh300_3dayplots ended after 76.5 seconds 2013-11-12 20:39:03,010 INFO repeater task os75bb_lastensq starting 198.0 seconds late 2013-11-12 20:39:15,647 INFO repeater task os75bb_lastensq ended after 12.6 seconds 2013-11-12 20:39:15,648 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 20:35:35 2013-11-12 20:39:15,649 INFO repeater task os75bb_quick starting 220.2 seconds late 2013-11-12 20:40:40,873 INFO repeater task os75bb_quick ended after 85.2 seconds 2013-11-12 20:40:40,893 INFO repeater task os75bb_3dayplots starting 305.5 seconds late 2013-11-12 20:41:45,344 INFO repeater task os75bb_3dayplots ended after 64.5 seconds 2013-11-12 20:41:45,345 INFO repeater task os75nb_lastensq starting 360.3 seconds late 2013-11-12 20:41:56,029 INFO repeater task os75nb_lastensq ended after 10.7 seconds 2013-11-12 20:41:56,030 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 20:40:35 2013-11-12 20:41:56,031 INFO repeater task os75nb_quick starting 380.6 seconds late 2013-11-12 20:43:26,117 INFO repeater task os75nb_quick ended after 90.1 seconds 2013-11-12 20:43:26,118 INFO repeater task os75nb_3dayplots starting 470.7 seconds late 2013-11-12 20:44:38,930 INFO repeater task os75nb_3dayplots ended after 72.8 seconds 2013-11-12 20:44:38,931 INFO repeater task wh300_beamplots starting 543.5 seconds late 2013-11-12 20:44:50,008 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 20:44:50,009 INFO repeater task wh300_beamplots ended after 11.1 seconds 2013-11-12 20:44:50,010 INFO repeater task wh300_beamplots starting 554.6 seconds late 2013-11-12 20:45:04,828 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 20:45:04,829 INFO repeater task wh300_beamplots ended after 14.8 seconds 2013-11-12 20:45:04,829 INFO repeater task os75bb_beamplots starting 569.4 seconds late 2013-11-12 20:45:11,310 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 20:45:11,310 INFO repeater task os75bb_beamplots ended after 6.5 seconds 2013-11-12 20:45:11,312 INFO repeater task os75bb_beamplots starting 575.9 seconds late 2013-11-12 20:45:17,894 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 20:45:17,895 INFO repeater task os75bb_beamplots ended after 6.6 seconds 2013-11-12 20:45:17,897 INFO repeater task os75nb_beamplots starting 582.5 seconds late 2013-11-12 20:45:24,043 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 20:45:24,044 INFO repeater task os75nb_beamplots ended after 6.1 seconds 2013-11-12 20:45:24,045 INFO repeater task os75nb_beamplots starting 588.6 seconds late 2013-11-12 20:45:30,029 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 20:45:30,042 INFO repeater task os75nb_beamplots ended after 6.0 seconds 2013-11-12 20:45:30,043 INFO repeater task phins_hcorrstats starting 594.6 seconds late 2013-11-12 20:45:36,213 INFO repeater task phins_hcorrstats ended after 6.2 seconds 2013-11-12 20:45:36,214 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 20:45:36,215 INFO repeater task posmv_hcorrstats starting 600.8 seconds late 2013-11-12 20:45:41,258 INFO repeater task posmv_hcorrstats ended after 5.0 seconds 2013-11-12 20:45:41,259 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 20:45:46,265 INFO repeater task wh300_lastensq starting 601.3 seconds late 2013-11-12 20:46:00,588 INFO repeater task wh300_lastensq ended after 14.3 seconds 2013-11-12 20:46:00,589 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 20:45:35 2013-11-12 20:46:00,591 INFO repeater task os75bb_lastensq starting 315.6 seconds late 2013-11-12 20:46:10,834 INFO repeater task os75bb_lastensq ended after 10.2 seconds 2013-11-12 20:46:10,835 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 20:45:35 2013-11-12 20:46:10,839 INFO repeater task os75nb_lastensq starting 25.8 seconds late 2013-11-12 20:46:19,178 INFO repeater task os75nb_lastensq ended after 8.3 seconds 2013-11-12 20:46:19,179 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 20:45:35 2013-11-12 20:46:19,189 INFO repeater task wh300_beamplots starting 43.8 seconds late 2013-11-12 20:46:30,898 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 20:46:30,898 INFO repeater task wh300_beamplots ended after 11.7 seconds 2013-11-12 20:46:30,901 INFO repeater task wh300_beamplots starting 55.5 seconds late 2013-11-12 20:46:42,992 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 20:46:42,992 INFO repeater task wh300_beamplots ended after 12.1 seconds 2013-11-12 20:46:42,993 INFO repeater task os75bb_beamplots starting 67.6 seconds late 2013-11-12 20:46:48,900 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 20:46:48,900 INFO repeater task os75bb_beamplots ended after 5.9 seconds 2013-11-12 20:46:48,901 INFO repeater task os75bb_beamplots starting 73.5 seconds late 2013-11-12 20:46:55,525 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 20:46:55,525 INFO repeater task os75bb_beamplots ended after 6.6 seconds 2013-11-12 20:46:55,527 INFO repeater task os75nb_beamplots starting 80.1 seconds late 2013-11-12 20:47:01,651 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 20:47:01,651 INFO repeater task os75nb_beamplots ended after 6.1 seconds 2013-11-12 20:47:01,652 INFO repeater task os75nb_beamplots starting 86.2 seconds late 2013-11-12 20:47:07,752 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 20:47:07,752 INFO repeater task os75nb_beamplots ended after 6.1 seconds 2013-11-12 20:47:47,878 INFO repeater task wh300_lastensq starting 2.9 seconds late 2013-11-12 20:47:59,138 INFO repeater task wh300_lastensq ended after 11.3 seconds 2013-11-12 20:47:59,139 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 20:47:35 2013-11-12 20:49:49,547 INFO repeater task wh300_lastensq starting 4.5 seconds late 2013-11-12 20:50:00,978 INFO repeater task wh300_lastensq ended after 11.4 seconds 2013-11-12 20:50:00,979 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 20:49:35 2013-11-12 20:50:36,145 INFO repeater task wh300_quick starting 0.7 seconds late 2013-11-12 20:52:50,111 INFO repeater task wh300_quick ended after 134.0 seconds 2013-11-12 20:52:50,121 INFO repeater task wh300_3dayplots starting 134.7 seconds late 2013-11-12 20:53:56,052 INFO repeater task wh300_3dayplots ended after 65.9 seconds 2013-11-12 20:53:56,053 INFO repeater task os75bb_lastensq starting 191.1 seconds late 2013-11-12 20:54:06,939 INFO repeater task os75bb_lastensq ended after 10.9 seconds 2013-11-12 20:54:06,942 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 20:50:35 2013-11-12 20:54:06,944 INFO repeater task os75bb_quick starting 211.5 seconds late 2013-11-12 20:55:45,078 INFO repeater task os75bb_quick ended after 98.1 seconds 2013-11-12 20:55:45,079 INFO repeater task os75bb_3dayplots starting 309.7 seconds late 2013-11-12 20:57:07,871 INFO repeater task os75bb_3dayplots ended after 82.8 seconds 2013-11-12 20:57:07,874 INFO repeater task os75nb_lastensq starting 382.9 seconds late 2013-11-12 20:57:18,998 INFO repeater task os75nb_lastensq ended after 11.1 seconds 2013-11-12 20:57:18,999 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 20:55:35 2013-11-12 20:57:19,000 INFO repeater task os75nb_quick starting 403.6 seconds late 2013-11-12 20:58:41,015 INFO repeater task os75nb_quick ended after 82.0 seconds 2013-11-12 20:58:41,016 INFO repeater task os75nb_3dayplots starting 485.6 seconds late 2013-11-12 20:59:45,521 INFO repeater task os75nb_3dayplots ended after 64.5 seconds 2013-11-12 20:59:45,523 INFO repeater task wh300_beamplots starting 250.1 seconds late 2013-11-12 20:59:54,653 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 20:59:54,654 INFO repeater task wh300_beamplots ended after 9.1 seconds 2013-11-12 20:59:54,655 INFO repeater task wh300_beamplots starting 259.2 seconds late 2013-11-12 21:00:03,965 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 21:00:03,966 INFO repeater task wh300_beamplots ended after 9.3 seconds 2013-11-12 21:00:03,970 INFO repeater task os75bb_beamplots starting 268.5 seconds late 2013-11-12 21:00:15,231 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 21:00:15,231 INFO repeater task os75bb_beamplots ended after 11.3 seconds 2013-11-12 21:00:15,232 INFO repeater task os75bb_beamplots starting 279.8 seconds late 2013-11-12 21:00:22,794 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 21:00:22,795 INFO repeater task os75bb_beamplots ended after 7.6 seconds 2013-11-12 21:00:22,795 INFO repeater task os75nb_beamplots starting 287.4 seconds late 2013-11-12 21:00:31,392 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 21:00:31,392 INFO repeater task os75nb_beamplots ended after 8.6 seconds 2013-11-12 21:00:31,394 INFO repeater task os75nb_beamplots starting 296.0 seconds late 2013-11-12 21:00:38,863 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 21:00:38,864 INFO repeater task os75nb_beamplots ended after 7.5 seconds 2013-11-12 21:00:38,865 INFO repeater task phins_hcorrstats starting 603.4 seconds late 2013-11-12 21:00:48,352 INFO repeater task phins_hcorrstats ended after 9.5 seconds 2013-11-12 21:00:48,353 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 21:00:48,354 INFO repeater task posmv_hcorrstats starting 612.9 seconds late 2013-11-12 21:00:56,221 INFO repeater task posmv_hcorrstats ended after 7.9 seconds 2013-11-12 21:00:56,221 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 21:01:01,222 INFO repeater task wh300_lastensq starting 556.2 seconds late 2013-11-12 21:01:14,772 INFO repeater task wh300_lastensq ended after 13.5 seconds 2013-11-12 21:01:14,773 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 20:59:35 2013-11-12 21:01:14,776 INFO repeater task os75bb_lastensq starting 329.8 seconds late 2013-11-12 21:01:22,020 INFO repeater task os75bb_lastensq ended after 7.2 seconds 2013-11-12 21:01:22,021 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 21:00:35 2013-11-12 21:01:22,033 INFO repeater task os75nb_lastensq starting 37.0 seconds late 2013-11-12 21:01:28,307 INFO repeater task os75nb_lastensq ended after 6.3 seconds 2013-11-12 21:01:28,308 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 21:00:35 2013-11-12 21:01:48,374 INFO repeater task wh300_lastensq starting 3.4 seconds late 2013-11-12 21:01:59,398 INFO repeater task wh300_lastensq ended after 11.0 seconds 2013-11-12 21:01:59,399 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 21:01:35 2013-11-12 21:03:49,782 INFO repeater task wh300_lastensq starting 4.8 seconds late 2013-11-12 21:04:00,966 INFO repeater task wh300_lastensq ended after 11.2 seconds 2013-11-12 21:04:00,967 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 21:03:35 2013-11-12 21:05:36,365 INFO repeater task wh300_quick starting 0.9 seconds late 2013-11-12 21:08:55,681 INFO repeater task wh300_quick ended after 199.3 seconds 2013-11-12 21:08:55,688 INFO repeater task wh300_3dayplots starting 200.3 seconds late 2013-11-12 21:10:05,420 INFO repeater task wh300_3dayplots ended after 69.7 seconds 2013-11-12 21:10:05,422 INFO repeater task os75bb_lastensq starting 260.4 seconds late 2013-11-12 21:10:20,867 INFO repeater task os75bb_lastensq ended after 15.4 seconds 2013-11-12 21:10:20,868 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 21:05:35 2013-11-12 21:10:20,869 INFO repeater task os75bb_quick starting 285.4 seconds late 2013-11-12 21:11:55,412 INFO repeater task os75bb_quick ended after 94.5 seconds 2013-11-12 21:11:55,414 INFO repeater task os75bb_3dayplots starting 380.0 seconds late 2013-11-12 21:13:20,711 INFO repeater task os75bb_3dayplots ended after 85.3 seconds 2013-11-12 21:13:20,712 INFO repeater task os75nb_lastensq starting 455.7 seconds late 2013-11-12 21:13:32,133 INFO repeater task os75nb_lastensq ended after 11.4 seconds 2013-11-12 21:13:32,134 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 21:10:35 2013-11-12 21:13:32,135 INFO repeater task os75nb_quick starting 476.7 seconds late 2013-11-12 21:14:52,329 INFO repeater task os75nb_quick ended after 80.2 seconds 2013-11-12 21:14:52,330 INFO repeater task os75nb_3dayplots starting 556.9 seconds late 2013-11-12 21:15:52,948 INFO repeater task os75nb_3dayplots ended after 60.6 seconds 2013-11-12 21:15:52,949 INFO repeater task wh300_beamplots starting 617.5 seconds late 2013-11-12 21:16:02,433 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 21:16:02,434 INFO repeater task wh300_beamplots ended after 9.5 seconds 2013-11-12 21:16:02,434 INFO repeater task wh300_beamplots: added 1 extra increments to time_to_run 2013-11-12 21:16:02,435 INFO repeater task wh300_beamplots starting 627.0 seconds late 2013-11-12 21:16:16,460 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 21:16:16,460 INFO repeater task wh300_beamplots ended after 14.0 seconds 2013-11-12 21:16:16,460 INFO repeater task wh300_beamplots: added 1 extra increments to time_to_run 2013-11-12 21:16:16,474 INFO repeater task os75bb_beamplots starting 641.0 seconds late 2013-11-12 21:16:24,979 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 21:16:24,979 INFO repeater task os75bb_beamplots ended after 8.5 seconds 2013-11-12 21:16:24,980 INFO repeater task os75bb_beamplots: added 1 extra increments to time_to_run 2013-11-12 21:16:24,982 INFO repeater task os75bb_beamplots starting 649.6 seconds late 2013-11-12 21:16:32,988 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 21:16:32,988 INFO repeater task os75bb_beamplots ended after 8.0 seconds 2013-11-12 21:16:32,989 INFO repeater task os75bb_beamplots: added 1 extra increments to time_to_run 2013-11-12 21:16:32,992 INFO repeater task os75nb_beamplots starting 657.6 seconds late 2013-11-12 21:16:41,372 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 21:16:41,372 INFO repeater task os75nb_beamplots ended after 8.4 seconds 2013-11-12 21:16:41,373 INFO repeater task os75nb_beamplots: added 1 extra increments to time_to_run 2013-11-12 21:16:41,373 INFO repeater task os75nb_beamplots starting 665.9 seconds late 2013-11-12 21:16:50,170 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 21:16:50,171 INFO repeater task os75nb_beamplots ended after 8.8 seconds 2013-11-12 21:16:50,171 INFO repeater task os75nb_beamplots: added 1 extra increments to time_to_run 2013-11-12 21:16:50,175 INFO repeater task phins_hcorrstats starting 674.7 seconds late 2013-11-12 21:16:59,320 INFO repeater task phins_hcorrstats ended after 9.1 seconds 2013-11-12 21:16:59,321 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 21:16:59,322 INFO repeater task posmv_hcorrstats starting 683.9 seconds late 2013-11-12 21:17:05,248 INFO repeater task posmv_hcorrstats ended after 5.9 seconds 2013-11-12 21:17:05,248 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 21:17:10,254 INFO repeater task wh300_lastensq starting 685.3 seconds late 2013-11-12 21:17:25,945 INFO repeater task wh300_lastensq ended after 15.7 seconds 2013-11-12 21:17:25,946 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 21:15:35 2013-11-12 21:17:25,953 INFO repeater task os75bb_lastensq starting 401.0 seconds late 2013-11-12 21:17:32,704 INFO repeater task os75bb_lastensq ended after 6.8 seconds 2013-11-12 21:17:32,705 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 21:15:35 2013-11-12 21:17:32,708 INFO repeater task os75nb_lastensq starting 107.7 seconds late 2013-11-12 21:17:38,682 INFO repeater task os75nb_lastensq ended after 6.0 seconds 2013-11-12 21:17:38,683 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 21:15:35 2013-11-12 21:17:48,712 INFO repeater task wh300_lastensq starting 3.7 seconds late 2013-11-12 21:17:59,966 INFO repeater task wh300_lastensq ended after 11.3 seconds 2013-11-12 21:17:59,966 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 21:17:35 2013-11-12 21:19:45,364 INFO repeater task wh300_lastensq starting 0.4 seconds late 2013-11-12 21:19:56,536 INFO repeater task wh300_lastensq ended after 11.2 seconds 2013-11-12 21:19:56,537 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 21:19:35 2013-11-12 21:20:36,697 INFO repeater task wh300_quick starting 1.3 seconds late 2013-11-12 21:22:56,425 INFO repeater task wh300_quick ended after 139.7 seconds 2013-11-12 21:22:56,456 INFO repeater task wh300_3dayplots starting 141.0 seconds late 2013-11-12 21:24:00,989 INFO repeater task wh300_3dayplots ended after 64.5 seconds 2013-11-12 21:24:00,990 INFO repeater task os75bb_lastensq starting 196.0 seconds late 2013-11-12 21:24:12,324 INFO repeater task os75bb_lastensq ended after 11.3 seconds 2013-11-12 21:24:12,326 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 21:20:35 2013-11-12 21:24:12,330 INFO repeater task os75bb_quick starting 216.9 seconds late 2013-11-12 21:25:54,101 INFO repeater task os75bb_quick ended after 101.8 seconds 2013-11-12 21:25:54,103 INFO repeater task os75bb_3dayplots starting 318.7 seconds late 2013-11-12 21:27:18,731 INFO repeater task os75bb_3dayplots ended after 84.6 seconds 2013-11-12 21:27:18,733 INFO repeater task os75nb_lastensq starting 393.7 seconds late 2013-11-12 21:27:26,794 INFO repeater task os75nb_lastensq ended after 8.1 seconds 2013-11-12 21:27:26,795 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 21:25:35 2013-11-12 21:27:26,796 INFO repeater task os75nb_quick starting 411.4 seconds late 2013-11-12 21:28:46,673 INFO repeater task os75nb_quick ended after 79.9 seconds 2013-11-12 21:28:46,696 INFO repeater task os75nb_3dayplots starting 491.3 seconds late 2013-11-12 21:29:49,391 INFO repeater task os75nb_3dayplots ended after 62.7 seconds 2013-11-12 21:29:49,396 INFO repeater task wh300_beamplots starting 254.0 seconds late 2013-11-12 21:29:58,081 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 21:29:58,081 INFO repeater task wh300_beamplots ended after 8.7 seconds 2013-11-12 21:29:58,082 INFO repeater task wh300_beamplots starting 262.7 seconds late 2013-11-12 21:30:11,046 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 21:30:11,047 INFO repeater task wh300_beamplots ended after 13.0 seconds 2013-11-12 21:30:11,048 INFO repeater task os75bb_beamplots starting 275.6 seconds late 2013-11-12 21:30:19,285 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 21:30:19,285 INFO repeater task os75bb_beamplots ended after 8.2 seconds 2013-11-12 21:30:19,288 INFO repeater task os75bb_beamplots starting 283.9 seconds late 2013-11-12 21:30:27,911 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 21:30:27,911 INFO repeater task os75bb_beamplots ended after 8.6 seconds 2013-11-12 21:30:27,912 INFO repeater task os75nb_beamplots starting 292.5 seconds late 2013-11-12 21:30:36,378 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 21:30:36,378 INFO repeater task os75nb_beamplots ended after 8.5 seconds 2013-11-12 21:30:36,381 INFO repeater task os75nb_beamplots starting 300.9 seconds late 2013-11-12 21:30:44,942 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 21:30:44,943 INFO repeater task os75nb_beamplots ended after 8.6 seconds 2013-11-12 21:30:44,944 INFO repeater task phins_hcorrstats starting 609.5 seconds late 2013-11-12 21:30:54,704 INFO repeater task phins_hcorrstats ended after 9.8 seconds 2013-11-12 21:30:54,704 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 21:30:54,706 INFO repeater task posmv_hcorrstats starting 619.3 seconds late 2013-11-12 21:31:00,446 INFO repeater task posmv_hcorrstats ended after 5.7 seconds 2013-11-12 21:31:00,447 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 21:31:05,448 INFO repeater task wh300_lastensq starting 560.4 seconds late 2013-11-12 21:31:19,793 INFO repeater task wh300_lastensq ended after 14.3 seconds 2013-11-12 21:31:19,794 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 21:29:35 2013-11-12 21:31:19,796 INFO repeater task os75bb_lastensq starting 334.8 seconds late 2013-11-12 21:31:26,576 INFO repeater task os75bb_lastensq ended after 6.8 seconds 2013-11-12 21:31:26,578 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 21:30:35 2013-11-12 21:31:26,596 INFO repeater task os75nb_lastensq starting 41.6 seconds late 2013-11-12 21:31:33,233 INFO repeater task os75nb_lastensq ended after 6.6 seconds 2013-11-12 21:31:33,234 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 21:30:35 2013-11-12 21:31:48,281 INFO repeater task wh300_lastensq starting 3.3 seconds late 2013-11-12 21:31:59,464 INFO repeater task wh300_lastensq ended after 11.2 seconds 2013-11-12 21:31:59,465 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 21:31:35 2013-11-12 21:33:49,900 INFO repeater task wh300_lastensq starting 4.9 seconds late 2013-11-12 21:34:01,254 INFO repeater task wh300_lastensq ended after 11.4 seconds 2013-11-12 21:34:01,255 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 21:33:35 2013-11-12 21:35:36,654 INFO repeater task wh300_quick starting 1.2 seconds late 2013-11-12 21:37:49,620 INFO repeater task wh300_quick ended after 133.0 seconds 2013-11-12 21:37:49,622 INFO repeater task wh300_3dayplots starting 134.2 seconds late 2013-11-12 21:39:14,035 INFO repeater task wh300_3dayplots ended after 84.4 seconds 2013-11-12 21:39:14,037 INFO repeater task os75bb_lastensq starting 209.0 seconds late 2013-11-12 21:39:28,912 INFO repeater task os75bb_lastensq ended after 14.9 seconds 2013-11-12 21:39:28,914 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 21:35:35 2013-11-12 21:39:28,915 INFO repeater task os75bb_quick starting 233.5 seconds late 2013-11-12 21:40:50,492 INFO repeater task os75bb_quick ended after 81.6 seconds 2013-11-12 21:40:50,501 INFO repeater task os75bb_3dayplots starting 315.1 seconds late 2013-11-12 21:41:53,522 INFO repeater task os75bb_3dayplots ended after 63.0 seconds 2013-11-12 21:41:53,523 INFO repeater task os75nb_lastensq starting 368.5 seconds late 2013-11-12 21:42:07,976 INFO repeater task os75nb_lastensq ended after 14.5 seconds 2013-11-12 21:42:07,977 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 21:40:35 2013-11-12 21:42:07,978 INFO repeater task os75nb_quick starting 392.6 seconds late 2013-11-12 21:43:28,716 INFO repeater task os75nb_quick ended after 80.7 seconds 2013-11-12 21:43:28,724 INFO repeater task os75nb_3dayplots starting 473.3 seconds late 2013-11-12 21:44:47,011 INFO repeater task os75nb_3dayplots ended after 78.3 seconds 2013-11-12 21:44:47,013 INFO repeater task wh300_beamplots starting 551.6 seconds late 2013-11-12 21:45:00,971 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 21:45:00,972 INFO repeater task wh300_beamplots ended after 14.0 seconds 2013-11-12 21:45:00,974 INFO repeater task wh300_beamplots starting 565.5 seconds late 2013-11-12 21:45:12,390 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 21:45:12,390 INFO repeater task wh300_beamplots ended after 11.4 seconds 2013-11-12 21:45:12,395 INFO repeater task os75bb_beamplots starting 577.0 seconds late 2013-11-12 21:45:18,821 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 21:45:18,821 INFO repeater task os75bb_beamplots ended after 6.4 seconds 2013-11-12 21:45:18,843 INFO repeater task os75bb_beamplots starting 583.4 seconds late 2013-11-12 21:45:25,137 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 21:45:25,138 INFO repeater task os75bb_beamplots ended after 6.3 seconds 2013-11-12 21:45:25,139 INFO repeater task os75nb_beamplots starting 589.7 seconds late 2013-11-12 21:45:30,971 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 21:45:30,972 INFO repeater task os75nb_beamplots ended after 5.8 seconds 2013-11-12 21:45:30,973 INFO repeater task os75nb_beamplots starting 595.5 seconds late 2013-11-12 21:45:37,659 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 21:45:37,660 INFO repeater task os75nb_beamplots ended after 6.7 seconds 2013-11-12 21:45:37,660 INFO repeater task os75nb_beamplots: added 1 extra increments to time_to_run 2013-11-12 21:45:37,661 INFO repeater task phins_hcorrstats starting 602.2 seconds late 2013-11-12 21:45:43,360 INFO repeater task phins_hcorrstats ended after 5.7 seconds 2013-11-12 21:45:43,361 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 21:45:43,362 INFO repeater task posmv_hcorrstats starting 607.9 seconds late 2013-11-12 21:45:48,525 INFO repeater task posmv_hcorrstats ended after 5.2 seconds 2013-11-12 21:45:48,525 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 21:45:53,531 INFO repeater task wh300_lastensq starting 608.5 seconds late 2013-11-12 21:46:11,212 INFO repeater task wh300_lastensq ended after 17.7 seconds 2013-11-12 21:46:11,214 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 21:45:35 2013-11-12 21:46:11,220 INFO repeater task os75bb_lastensq starting 326.2 seconds late 2013-11-12 21:46:21,861 INFO repeater task os75bb_lastensq ended after 10.6 seconds 2013-11-12 21:46:21,862 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 21:45:35 2013-11-12 21:46:21,866 INFO repeater task os75nb_lastensq starting 36.9 seconds late 2013-11-12 21:46:31,466 INFO repeater task os75nb_lastensq ended after 9.6 seconds 2013-11-12 21:46:31,467 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 21:45:35 2013-11-12 21:46:31,473 INFO repeater task wh300_beamplots starting 56.0 seconds late 2013-11-12 21:46:42,966 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 21:46:42,967 INFO repeater task wh300_beamplots ended after 11.5 seconds 2013-11-12 21:46:42,968 INFO repeater task wh300_beamplots starting 67.5 seconds late 2013-11-12 21:46:51,806 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 21:46:51,806 INFO repeater task wh300_beamplots ended after 8.8 seconds 2013-11-12 21:46:51,807 INFO repeater task os75bb_beamplots starting 76.4 seconds late 2013-11-12 21:46:57,768 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 21:46:57,769 INFO repeater task os75bb_beamplots ended after 6.0 seconds 2013-11-12 21:46:57,770 INFO repeater task os75bb_beamplots starting 82.3 seconds late 2013-11-12 21:47:04,070 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 21:47:04,070 INFO repeater task os75bb_beamplots ended after 6.3 seconds 2013-11-12 21:47:04,074 INFO repeater task os75nb_beamplots starting 88.6 seconds late 2013-11-12 21:47:10,389 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 21:47:10,390 INFO repeater task os75nb_beamplots ended after 6.3 seconds 2013-11-12 21:47:45,496 INFO repeater task wh300_lastensq starting 0.5 seconds late 2013-11-12 21:47:57,109 INFO repeater task wh300_lastensq ended after 11.6 seconds 2013-11-12 21:47:57,110 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 21:47:35 2013-11-12 21:49:47,610 INFO repeater task wh300_lastensq starting 2.6 seconds late 2013-11-12 21:49:58,998 INFO repeater task wh300_lastensq ended after 11.4 seconds 2013-11-12 21:49:58,999 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 21:49:35 2013-11-12 21:50:39,172 INFO repeater task wh300_quick starting 3.8 seconds late 2013-11-12 21:52:59,509 INFO repeater task wh300_quick ended after 140.3 seconds 2013-11-12 21:52:59,510 INFO repeater task wh300_3dayplots starting 144.1 seconds late 2013-11-12 21:54:03,830 INFO repeater task wh300_3dayplots ended after 64.3 seconds 2013-11-12 21:54:03,835 INFO repeater task os75bb_lastensq starting 198.8 seconds late 2013-11-12 21:54:16,294 INFO repeater task os75bb_lastensq ended after 12.5 seconds 2013-11-12 21:54:16,295 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 21:50:35 2013-11-12 21:54:16,297 INFO repeater task os75bb_quick starting 220.9 seconds late 2013-11-12 21:55:57,278 INFO repeater task os75bb_quick ended after 101.0 seconds 2013-11-12 21:55:57,279 INFO repeater task os75bb_3dayplots starting 321.9 seconds late 2013-11-12 21:57:03,781 INFO repeater task os75bb_3dayplots ended after 66.5 seconds 2013-11-12 21:57:03,782 INFO repeater task os75nb_lastensq starting 378.8 seconds late 2013-11-12 21:57:11,178 INFO repeater task os75nb_lastensq ended after 7.4 seconds 2013-11-12 21:57:11,179 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 21:55:35 2013-11-12 21:57:11,180 INFO repeater task os75nb_quick starting 395.8 seconds late 2013-11-12 21:58:23,947 INFO repeater task os75nb_quick ended after 72.8 seconds 2013-11-12 21:58:23,949 INFO repeater task os75nb_3dayplots starting 468.5 seconds late 2013-11-12 21:59:49,426 INFO repeater task os75nb_3dayplots ended after 85.5 seconds 2013-11-12 21:59:49,427 INFO repeater task wh300_beamplots starting 254.0 seconds late 2013-11-12 21:59:58,783 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 21:59:58,784 INFO repeater task wh300_beamplots ended after 9.4 seconds 2013-11-12 21:59:58,784 INFO repeater task wh300_beamplots starting 263.4 seconds late 2013-11-12 22:00:07,249 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 22:00:07,249 INFO repeater task wh300_beamplots ended after 8.5 seconds 2013-11-12 22:00:07,251 INFO repeater task os75bb_beamplots starting 271.8 seconds late 2013-11-12 22:00:14,326 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 22:00:14,326 INFO repeater task os75bb_beamplots ended after 7.1 seconds 2013-11-12 22:00:14,327 INFO repeater task os75bb_beamplots starting 278.9 seconds late 2013-11-12 22:00:20,626 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 22:00:20,627 INFO repeater task os75bb_beamplots ended after 6.3 seconds 2013-11-12 22:00:20,627 INFO repeater task os75nb_beamplots starting 285.2 seconds late 2013-11-12 22:00:26,446 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 22:00:26,446 INFO repeater task os75nb_beamplots ended after 5.8 seconds 2013-11-12 22:00:26,447 INFO repeater task os75nb_beamplots starting 291.0 seconds late 2013-11-12 22:00:32,396 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 22:00:32,397 INFO repeater task os75nb_beamplots ended after 5.9 seconds 2013-11-12 22:00:32,397 INFO repeater task phins_hcorrstats starting 596.9 seconds late 2013-11-12 22:00:39,040 INFO repeater task phins_hcorrstats ended after 6.6 seconds 2013-11-12 22:00:39,041 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 22:00:39,043 INFO repeater task posmv_hcorrstats starting 603.6 seconds late 2013-11-12 22:00:44,249 INFO repeater task posmv_hcorrstats ended after 5.2 seconds 2013-11-12 22:00:44,249 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 22:00:49,256 INFO repeater task wh300_lastensq starting 544.3 seconds late 2013-11-12 22:01:03,381 INFO repeater task wh300_lastensq ended after 14.1 seconds 2013-11-12 22:01:03,382 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 21:59:35 2013-11-12 22:01:03,384 INFO repeater task os75bb_lastensq starting 318.4 seconds late 2013-11-12 22:01:10,612 INFO repeater task os75bb_lastensq ended after 7.2 seconds 2013-11-12 22:01:10,613 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 22:00:35 2013-11-12 22:01:10,615 INFO repeater task os75nb_lastensq starting 25.6 seconds late 2013-11-12 22:01:16,715 INFO repeater task os75nb_lastensq ended after 6.1 seconds 2013-11-12 22:01:16,715 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 22:00:35 2013-11-12 22:01:46,818 INFO repeater task wh300_lastensq starting 1.8 seconds late 2013-11-12 22:01:58,004 INFO repeater task wh300_lastensq ended after 11.2 seconds 2013-11-12 22:01:58,005 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 22:01:35 2013-11-12 22:03:48,526 INFO repeater task wh300_lastensq starting 3.5 seconds late 2013-11-12 22:03:59,617 INFO repeater task wh300_lastensq ended after 11.1 seconds 2013-11-12 22:03:59,618 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 22:03:35 2013-11-12 22:05:40,022 INFO repeater task wh300_quick starting 4.6 seconds late 2013-11-12 22:08:51,189 INFO repeater task wh300_quick ended after 191.2 seconds 2013-11-12 22:08:51,233 INFO repeater task wh300_3dayplots starting 195.8 seconds late 2013-11-12 22:10:07,945 INFO repeater task wh300_3dayplots ended after 76.7 seconds 2013-11-12 22:10:07,946 INFO repeater task os75bb_lastensq starting 262.9 seconds late 2013-11-12 22:10:23,657 INFO repeater task os75bb_lastensq ended after 15.7 seconds 2013-11-12 22:10:23,661 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 22:05:35 2013-11-12 22:10:23,665 INFO repeater task os75bb_quick starting 288.2 seconds late 2013-11-12 22:12:08,193 INFO repeater task os75bb_quick ended after 104.5 seconds 2013-11-12 22:12:08,194 INFO repeater task os75bb_3dayplots starting 392.8 seconds late 2013-11-12 22:13:30,968 INFO repeater task os75bb_3dayplots ended after 82.8 seconds 2013-11-12 22:13:30,969 INFO repeater task os75nb_lastensq starting 466.0 seconds late 2013-11-12 22:13:41,995 INFO repeater task os75nb_lastensq ended after 11.0 seconds 2013-11-12 22:13:41,996 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 22:10:35 2013-11-12 22:13:41,997 INFO repeater task os75nb_quick starting 486.6 seconds late 2013-11-12 22:14:59,254 INFO repeater task os75nb_quick ended after 77.3 seconds 2013-11-12 22:14:59,255 INFO repeater task os75nb_3dayplots starting 563.8 seconds late 2013-11-12 22:15:59,526 INFO repeater task os75nb_3dayplots ended after 60.3 seconds 2013-11-12 22:15:59,527 INFO repeater task wh300_beamplots starting 624.1 seconds late 2013-11-12 22:16:13,058 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 22:16:13,071 INFO repeater task wh300_beamplots ended after 13.5 seconds 2013-11-12 22:16:13,071 INFO repeater task wh300_beamplots: added 1 extra increments to time_to_run 2013-11-12 22:16:13,072 INFO repeater task wh300_beamplots starting 637.6 seconds late 2013-11-12 22:16:24,254 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 22:16:24,254 INFO repeater task wh300_beamplots ended after 11.2 seconds 2013-11-12 22:16:24,255 INFO repeater task wh300_beamplots: added 1 extra increments to time_to_run 2013-11-12 22:16:24,256 INFO repeater task os75bb_beamplots starting 648.8 seconds late 2013-11-12 22:16:33,743 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 22:16:33,744 INFO repeater task os75bb_beamplots ended after 9.5 seconds 2013-11-12 22:16:33,745 INFO repeater task os75bb_beamplots: added 1 extra increments to time_to_run 2013-11-12 22:16:33,746 INFO repeater task os75bb_beamplots starting 658.3 seconds late 2013-11-12 22:16:41,704 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 22:16:41,705 INFO repeater task os75bb_beamplots ended after 8.0 seconds 2013-11-12 22:16:41,705 INFO repeater task os75bb_beamplots: added 1 extra increments to time_to_run 2013-11-12 22:16:41,706 INFO repeater task os75nb_beamplots starting 666.3 seconds late 2013-11-12 22:16:50,012 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 22:16:50,012 INFO repeater task os75nb_beamplots ended after 8.3 seconds 2013-11-12 22:16:50,013 INFO repeater task os75nb_beamplots: added 1 extra increments to time_to_run 2013-11-12 22:16:50,014 INFO repeater task os75nb_beamplots starting 674.6 seconds late 2013-11-12 22:16:59,990 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 22:16:59,991 INFO repeater task os75nb_beamplots ended after 10.0 seconds 2013-11-12 22:16:59,992 INFO repeater task os75nb_beamplots: added 1 extra increments to time_to_run 2013-11-12 22:16:59,994 INFO repeater task phins_hcorrstats starting 684.5 seconds late 2013-11-12 22:17:08,205 INFO repeater task phins_hcorrstats ended after 8.2 seconds 2013-11-12 22:17:08,206 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 22:17:08,208 INFO repeater task posmv_hcorrstats starting 692.8 seconds late 2013-11-12 22:17:13,419 INFO repeater task posmv_hcorrstats ended after 5.2 seconds 2013-11-12 22:17:13,420 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 22:17:18,426 INFO repeater task wh300_lastensq starting 693.4 seconds late 2013-11-12 22:17:33,120 INFO repeater task wh300_lastensq ended after 14.7 seconds 2013-11-12 22:17:33,121 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 22:15:35 2013-11-12 22:17:33,123 INFO repeater task os75bb_lastensq starting 408.1 seconds late 2013-11-12 22:17:40,084 INFO repeater task os75bb_lastensq ended after 7.0 seconds 2013-11-12 22:17:40,085 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 22:15:35 2013-11-12 22:17:40,089 INFO repeater task os75nb_lastensq starting 115.1 seconds late 2013-11-12 22:17:45,992 INFO repeater task os75nb_lastensq ended after 5.9 seconds 2013-11-12 22:17:45,993 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 22:15:35 2013-11-12 22:17:51,004 INFO repeater task wh300_lastensq starting 6.0 seconds late 2013-11-12 22:18:02,297 INFO repeater task wh300_lastensq ended after 11.3 seconds 2013-11-12 22:18:02,298 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 22:17:35 2013-11-12 22:19:47,687 INFO repeater task wh300_lastensq starting 2.7 seconds late 2013-11-12 22:19:58,783 INFO repeater task wh300_lastensq ended after 11.1 seconds 2013-11-12 22:19:58,784 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 22:19:35 2013-11-12 22:20:38,954 INFO repeater task wh300_quick starting 3.5 seconds late 2013-11-12 22:23:05,465 INFO repeater task wh300_quick ended after 146.5 seconds 2013-11-12 22:23:05,466 INFO repeater task wh300_3dayplots starting 150.0 seconds late 2013-11-12 22:24:13,655 INFO repeater task wh300_3dayplots ended after 68.2 seconds 2013-11-12 22:24:13,659 INFO repeater task os75bb_lastensq starting 208.7 seconds late 2013-11-12 22:24:27,398 INFO repeater task os75bb_lastensq ended after 13.7 seconds 2013-11-12 22:24:27,399 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 22:20:35 2013-11-12 22:24:27,404 INFO repeater task os75bb_quick starting 232.0 seconds late 2013-11-12 22:25:57,775 INFO repeater task os75bb_quick ended after 90.4 seconds 2013-11-12 22:25:57,787 INFO repeater task os75bb_3dayplots starting 322.4 seconds late 2013-11-12 22:27:20,400 INFO repeater task os75bb_3dayplots ended after 82.6 seconds 2013-11-12 22:27:20,402 INFO repeater task os75nb_lastensq starting 395.4 seconds late 2013-11-12 22:27:27,621 INFO repeater task os75nb_lastensq ended after 7.2 seconds 2013-11-12 22:27:27,622 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 22:25:35 2013-11-12 22:27:27,623 INFO repeater task os75nb_quick starting 412.2 seconds late 2013-11-12 22:28:49,970 INFO repeater task os75nb_quick ended after 82.3 seconds 2013-11-12 22:28:49,974 INFO repeater task os75nb_3dayplots starting 494.5 seconds late 2013-11-12 22:29:53,299 INFO repeater task os75nb_3dayplots ended after 63.3 seconds 2013-11-12 22:29:53,300 INFO repeater task wh300_beamplots starting 257.9 seconds late 2013-11-12 22:30:02,544 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 22:30:02,545 INFO repeater task wh300_beamplots ended after 9.2 seconds 2013-11-12 22:30:02,547 INFO repeater task wh300_beamplots starting 267.1 seconds late 2013-11-12 22:30:16,455 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 22:30:16,455 INFO repeater task wh300_beamplots ended after 13.9 seconds 2013-11-12 22:30:16,457 INFO repeater task os75bb_beamplots starting 281.0 seconds late 2013-11-12 22:30:26,406 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 22:30:26,406 INFO repeater task os75bb_beamplots ended after 9.9 seconds 2013-11-12 22:30:26,407 INFO repeater task os75bb_beamplots starting 291.0 seconds late 2013-11-12 22:30:35,030 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 22:30:35,031 INFO repeater task os75bb_beamplots ended after 8.6 seconds 2013-11-12 22:30:35,032 INFO repeater task os75nb_beamplots starting 299.6 seconds late 2013-11-12 22:30:42,905 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 22:30:42,905 INFO repeater task os75nb_beamplots ended after 7.9 seconds 2013-11-12 22:30:42,907 INFO repeater task os75nb_beamplots starting 307.5 seconds late 2013-11-12 22:30:52,709 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 22:30:52,709 INFO repeater task os75nb_beamplots ended after 9.8 seconds 2013-11-12 22:30:52,710 INFO repeater task phins_hcorrstats starting 617.3 seconds late 2013-11-12 22:31:00,396 INFO repeater task phins_hcorrstats ended after 7.7 seconds 2013-11-12 22:31:00,397 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 22:31:00,417 INFO repeater task posmv_hcorrstats starting 625.0 seconds late 2013-11-12 22:31:05,385 INFO repeater task posmv_hcorrstats ended after 5.0 seconds 2013-11-12 22:31:05,385 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 22:31:10,391 INFO repeater task wh300_lastensq starting 565.4 seconds late 2013-11-12 22:31:23,865 INFO repeater task wh300_lastensq ended after 13.5 seconds 2013-11-12 22:31:23,866 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 22:29:35 2013-11-12 22:31:23,869 INFO repeater task os75bb_lastensq starting 338.9 seconds late 2013-11-12 22:31:30,620 INFO repeater task os75bb_lastensq ended after 6.8 seconds 2013-11-12 22:31:30,621 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 22:30:35 2013-11-12 22:31:30,623 INFO repeater task os75nb_lastensq starting 45.6 seconds late 2013-11-12 22:31:36,634 INFO repeater task os75nb_lastensq ended after 6.0 seconds 2013-11-12 22:31:36,635 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 22:30:35 2013-11-12 22:31:46,661 INFO repeater task wh300_lastensq starting 1.7 seconds late 2013-11-12 22:31:58,113 INFO repeater task wh300_lastensq ended after 11.5 seconds 2013-11-12 22:31:58,113 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 22:31:35 2013-11-12 22:33:48,894 INFO repeater task wh300_lastensq starting 3.9 seconds late 2013-11-12 22:34:00,106 INFO repeater task wh300_lastensq ended after 11.2 seconds 2013-11-12 22:34:00,107 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 22:33:35 2013-11-12 22:35:35,575 INFO repeater task wh300_quick starting 0.2 seconds late 2013-11-12 22:37:50,682 INFO repeater task wh300_quick ended after 135.1 seconds 2013-11-12 22:37:50,683 INFO repeater task wh300_3dayplots starting 135.3 seconds late 2013-11-12 22:39:10,550 INFO repeater task wh300_3dayplots ended after 79.9 seconds 2013-11-12 22:39:10,552 INFO repeater task os75bb_lastensq starting 205.6 seconds late 2013-11-12 22:39:24,988 INFO repeater task os75bb_lastensq ended after 14.4 seconds 2013-11-12 22:39:24,989 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 22:35:35 2013-11-12 22:39:24,993 INFO repeater task os75bb_quick starting 229.6 seconds late 2013-11-12 22:40:47,574 INFO repeater task os75bb_quick ended after 82.6 seconds 2013-11-12 22:40:47,583 INFO repeater task os75bb_3dayplots starting 312.2 seconds late 2013-11-12 22:41:49,914 INFO repeater task os75bb_3dayplots ended after 62.3 seconds 2013-11-12 22:41:49,915 INFO repeater task os75nb_lastensq starting 364.9 seconds late 2013-11-12 22:42:01,353 INFO repeater task os75nb_lastensq ended after 11.4 seconds 2013-11-12 22:42:01,354 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 22:40:35 2013-11-12 22:42:01,355 INFO repeater task os75nb_quick starting 385.9 seconds late 2013-11-12 22:43:29,654 INFO repeater task os75nb_quick ended after 88.3 seconds 2013-11-12 22:43:29,655 INFO repeater task os75nb_3dayplots starting 474.2 seconds late 2013-11-12 22:44:40,839 INFO repeater task os75nb_3dayplots ended after 71.2 seconds 2013-11-12 22:44:40,841 INFO repeater task wh300_beamplots starting 545.4 seconds late 2013-11-12 22:44:51,406 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 22:44:51,406 INFO repeater task wh300_beamplots ended after 10.6 seconds 2013-11-12 22:44:51,438 INFO repeater task wh300_beamplots starting 556.0 seconds late 2013-11-12 22:45:05,918 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 22:45:05,919 INFO repeater task wh300_beamplots ended after 14.5 seconds 2013-11-12 22:45:05,920 INFO repeater task os75bb_beamplots starting 570.5 seconds late 2013-11-12 22:45:12,351 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 22:45:12,352 INFO repeater task os75bb_beamplots ended after 6.4 seconds 2013-11-12 22:45:12,353 INFO repeater task os75bb_beamplots starting 576.9 seconds late 2013-11-12 22:45:18,942 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 22:45:18,942 INFO repeater task os75bb_beamplots ended after 6.6 seconds 2013-11-12 22:45:18,947 INFO repeater task os75nb_beamplots starting 583.5 seconds late 2013-11-12 22:45:25,047 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 22:45:25,047 INFO repeater task os75nb_beamplots ended after 6.1 seconds 2013-11-12 22:45:25,048 INFO repeater task os75nb_beamplots starting 589.6 seconds late 2013-11-12 22:45:31,122 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 22:45:31,122 INFO repeater task os75nb_beamplots ended after 6.1 seconds 2013-11-12 22:45:31,123 INFO repeater task phins_hcorrstats starting 595.7 seconds late 2013-11-12 22:45:37,101 INFO repeater task phins_hcorrstats ended after 6.0 seconds 2013-11-12 22:45:37,102 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 22:45:37,103 INFO repeater task posmv_hcorrstats starting 601.7 seconds late 2013-11-12 22:45:42,217 INFO repeater task posmv_hcorrstats ended after 5.1 seconds 2013-11-12 22:45:42,218 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 22:45:47,224 INFO repeater task wh300_lastensq starting 602.2 seconds late 2013-11-12 22:46:03,203 INFO repeater task wh300_lastensq ended after 16.0 seconds 2013-11-12 22:46:03,204 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 22:45:35 2013-11-12 22:46:03,206 INFO repeater task os75bb_lastensq starting 318.2 seconds late 2013-11-12 22:46:13,734 INFO repeater task os75bb_lastensq ended after 10.5 seconds 2013-11-12 22:46:13,735 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 22:45:35 2013-11-12 22:46:13,738 INFO repeater task os75nb_lastensq starting 28.7 seconds late 2013-11-12 22:46:23,020 INFO repeater task os75nb_lastensq ended after 9.3 seconds 2013-11-12 22:46:23,021 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 22:45:35 2013-11-12 22:46:23,023 INFO repeater task wh300_beamplots starting 47.6 seconds late 2013-11-12 22:46:34,891 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 22:46:34,891 INFO repeater task wh300_beamplots ended after 11.9 seconds 2013-11-12 22:46:34,893 INFO repeater task wh300_beamplots starting 59.5 seconds late 2013-11-12 22:46:45,226 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 22:46:45,226 INFO repeater task wh300_beamplots ended after 10.3 seconds 2013-11-12 22:46:45,227 INFO repeater task os75bb_beamplots starting 69.8 seconds late 2013-11-12 22:46:51,493 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 22:46:51,494 INFO repeater task os75bb_beamplots ended after 6.3 seconds 2013-11-12 22:46:51,498 INFO repeater task os75bb_beamplots starting 76.1 seconds late 2013-11-12 22:46:58,230 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 22:46:58,230 INFO repeater task os75bb_beamplots ended after 6.7 seconds 2013-11-12 22:46:58,231 INFO repeater task os75nb_beamplots starting 82.8 seconds late 2013-11-12 22:47:04,054 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 22:47:04,054 INFO repeater task os75nb_beamplots ended after 5.8 seconds 2013-11-12 22:47:04,055 INFO repeater task os75nb_beamplots starting 88.6 seconds late 2013-11-12 22:47:09,989 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 22:47:09,994 INFO repeater task os75nb_beamplots ended after 5.9 seconds 2013-11-12 22:47:45,120 INFO repeater task wh300_lastensq starting 0.1 seconds late 2013-11-12 22:47:56,309 INFO repeater task wh300_lastensq ended after 11.2 seconds 2013-11-12 22:47:56,310 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 22:47:35 2013-11-12 22:49:46,670 INFO repeater task wh300_lastensq starting 1.7 seconds late 2013-11-12 22:49:57,878 INFO repeater task wh300_lastensq ended after 11.2 seconds 2013-11-12 22:49:57,879 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 22:49:35 2013-11-12 22:50:38,044 INFO repeater task wh300_quick starting 2.6 seconds late 2013-11-12 22:52:58,089 INFO repeater task wh300_quick ended after 140.0 seconds 2013-11-12 22:52:58,090 INFO repeater task wh300_3dayplots starting 142.7 seconds late 2013-11-12 22:54:03,371 INFO repeater task wh300_3dayplots ended after 65.3 seconds 2013-11-12 22:54:03,373 INFO repeater task os75bb_lastensq starting 198.4 seconds late 2013-11-12 22:54:15,253 INFO repeater task os75bb_lastensq ended after 11.9 seconds 2013-11-12 22:54:15,254 INFO repeater task os75bb_lastensq: Time from /home/data/kn213_03/proc/os75bb/load/wrote_ens_time: 2013/11/12 22:50:35 2013-11-12 22:54:15,255 INFO repeater task os75bb_quick starting 219.8 seconds late 2013-11-12 22:55:54,984 INFO repeater task os75bb_quick ended after 99.7 seconds 2013-11-12 22:55:54,995 INFO repeater task os75bb_3dayplots starting 319.6 seconds late 2013-11-12 22:57:19,622 INFO repeater task os75bb_3dayplots ended after 84.6 seconds 2013-11-12 22:57:19,623 INFO repeater task os75nb_lastensq starting 394.6 seconds late 2013-11-12 22:57:27,732 INFO repeater task os75nb_lastensq ended after 8.1 seconds 2013-11-12 22:57:27,733 INFO repeater task os75nb_lastensq: Time from /home/data/kn213_03/proc/os75nb/load/wrote_ens_time: 2013/11/12 22:55:35 2013-11-12 22:57:27,734 INFO repeater task os75nb_quick starting 412.3 seconds late 2013-11-12 22:58:47,010 INFO repeater task os75nb_quick ended after 79.3 seconds 2013-11-12 22:58:47,013 INFO repeater task os75nb_3dayplots starting 491.6 seconds late 2013-11-12 22:59:50,005 INFO repeater task os75nb_3dayplots ended after 63.0 seconds 2013-11-12 22:59:50,006 INFO repeater task wh300_beamplots starting 254.6 seconds late 2013-11-12 22:59:58,711 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 22:59:58,711 INFO repeater task wh300_beamplots ended after 8.7 seconds 2013-11-12 22:59:58,712 INFO repeater task wh300_beamplots starting 263.3 seconds late 2013-11-12 23:00:12,091 INFO repeater task wh300_beamplots output: Starting procsetup 2013-11-12 23:00:12,091 INFO repeater task wh300_beamplots ended after 13.4 seconds 2013-11-12 23:00:12,092 INFO repeater task os75bb_beamplots starting 276.7 seconds late 2013-11-12 23:00:20,492 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 23:00:20,492 INFO repeater task os75bb_beamplots ended after 8.4 seconds 2013-11-12 23:00:20,496 INFO repeater task os75bb_beamplots starting 285.1 seconds late 2013-11-12 23:00:28,781 INFO repeater task os75bb_beamplots output: Starting procsetup 2013-11-12 23:00:28,799 INFO repeater task os75bb_beamplots ended after 8.3 seconds 2013-11-12 23:00:28,800 INFO repeater task os75nb_beamplots starting 293.4 seconds late 2013-11-12 23:00:36,968 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 23:00:36,969 INFO repeater task os75nb_beamplots ended after 8.2 seconds 2013-11-12 23:00:36,974 INFO repeater task os75nb_beamplots starting 301.5 seconds late 2013-11-12 23:00:45,208 INFO repeater task os75nb_beamplots output: Starting procsetup 2013-11-12 23:00:45,208 INFO repeater task os75nb_beamplots ended after 8.2 seconds 2013-11-12 23:00:45,210 INFO repeater task phins_hcorrstats starting 609.8 seconds late 2013-11-12 23:00:54,870 INFO repeater task phins_hcorrstats ended after 9.7 seconds 2013-11-12 23:00:54,871 INFO repeater task phins_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 23:00:54,874 INFO repeater task posmv_hcorrstats starting 619.4 seconds late 2013-11-12 23:01:00,418 INFO repeater task posmv_hcorrstats ended after 5.5 seconds 2013-11-12 23:01:00,418 INFO repeater task posmv_hcorrstats: added 2 extra increments to time_to_run 2013-11-12 23:01:05,422 INFO repeater task wh300_lastensq starting 560.4 seconds late 2013-11-12 23:01:20,908 INFO repeater task wh300_lastensq ended after 15.5 seconds 2013-11-12 23:01:20,909 INFO repeater task wh300_lastensq: Time from /home/data/kn213_03/proc/wh300/load/wrote_ens_time: 2013/11/12 22:59:35