CMS Site Readiness Report of Th, 2020-May-28

 

 

T0_CH_CERN
GGUS Tickets: 146937, 146927, 146972
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 1 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 83%15min evaluations: 76 ok, 0 warning, 15 error, 5 unknown, 0 downtime (0h0m)
Hammer Cloud: No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available
FTS Status: 86%Transfer (from/to): 77541/81525 files, 171.571/10.323 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 1/54, trn_error: 823/117, dst_space: 0/34657 foreign: 5262/489
Links: 111/103 ok, 1/2 warning, 1/9 error, 1/2 unknown, 3/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
90%Transfer (from/to): 80697/37745 files, 131.436/11.128 TB ok
Errors: src_missing_file: 11/0, trn_timeout: 102/75, trn_user: 3591/111, trn_error: 209/99, dst_space: 0/16835 foreign: 7315/1387
Links: 107/104 ok, 1/0 warning, 3/9 error, 0/2 unknown, 3/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
92%Transfer (from/to): 83563/35003 files, 136.732/18.242 TB ok
Errors: src_missing_file: 26/0, src_error: 430/0, trn_timeout: 325/526, trn_user: 251/2044, trn_error: 724/76, dst_permission: 0/1, dst_space: 0/10155, dst_error: 0/17 foreign: 6687/11787
Links: 105/103 ok, 2/3 warning, 3/9 error, 1/2 unknown, 3/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
93%Transfer (from/to): 56956/38393 files, 41.760/4.522 TB ok
Errors: src_missing_file: 12/0, trn_timeout: 53/62, trn_user: 13393/0, trn_error: 87/21, dst_space: 0/412 foreign: 1611/60
Links: 109/112 ok, 2/1 warning, 3/0 error, 1/3 unknown, 3/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
93%Transfer (from/to): 41655/34967 files, 24.578/9.533 TB ok
Errors: src_missing_file: 20/0, src_error: 7/0, trn_timeout: 49/71, trn_user: 52142/776, trn_error: 113/195, dst_space: 0/96 foreign: 2144/3845
Links: 104/109 ok, 4/1 warning, 3/1 error, 1/2 unknown, 3/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
92%Transfer (from/to): 79084/36028 files, 43.647/12.827 TB ok
Errors: src_missing_file: 20/0, src_error: 1/0, trn_timeout: 85/63, trn_user: 11028/141, trn_error: 910/24, dst_space: 0/16 foreign: 4777/571
Links: 108/105 ok, 2/4 warning, 3/1 error, 2/2 unknown, 3/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
92%Transfer (from/to): 55189/14498 files, 46.448/11.682 TB ok
Errors: src_missing_file: 14/0, src_error: 25/0, trn_timeout: 148/25, trn_user: 1504/0, trn_error: 61/280, dst_space: 0/29, dst_error: 0/1 foreign: 3774/65
Links: 104/107 ok, 3/2 warning, 3/2 error, 2/2 unknown, 5/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
92%Transfer (from/to): 79976/33268 files, 117.087/15.598 TB ok
Errors: src_missing_file: 10/0, src_error: 1/0, trn_timeout: 148/74, trn_user: 136/0, trn_error: 556/120, dst_space: 0/4632 foreign: 558/634
Links: 111/106 ok, 1/0 warning, 2/4 error, 1/2 unknown, 5/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
95%Transfer (from/to): 101968/38396 files, 157.485/84.715 TB ok
Errors: src_missing_file: 7/0, src_error: 254/0, trn_timeout: 35/7, trn_user: 24/3, trn_error: 407/340, dst_space: 0/3104 foreign: 3964/504
Links: 110/108 ok, 3/1 warning, 2/1 error, 1/4 unknown, 7/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
85%Transfer (from/to): 62431/55278 files, 81.205/47.371 TB ok
Errors: src_missing_file: 6/0, trn_timeout: 276/4, trn_user: 4/1302, trn_error: 297/391, dst_space: 0/158, dst_error: 0/437 foreign: 8305/10833
Links: 110/100 ok, 1/0 warning, 3/10 error, 0/4 unknown, 7/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
82%Transfer (from/to): 53707/24382 files, 68.237/15.967 TB ok
Errors: src_missing_file: 5/0, src_error: 15/0, trn_timeout: 94/3, trn_user: 186/4451, trn_error: 322/61, dst_permission: 0/191, dst_path: 0/43, dst_error: 0/1659 foreign: 30639/26798
Links: 106/98 ok, 1/1 warning, 2/10 error, 1/4 unknown, 7/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
96%Transfer (from/to): 60526/23515 files, 85.083/5.543 TB ok
Errors: src_missing_file: 10/0, src_error: 1/0, trn_timeout: 2/6, trn_user: 0/3, trn_error: 329/3 foreign: 3370/144
Links: 103/108 ok, 2/0 warning, 2/0 error, 0/5 unknown, 7/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
96%Transfer (from/to): 43170/49876 files, 71.470/74.418 TB ok
Errors: src_missing_file: 8/0, src_error: 28/0, trn_timeout: 4/11, trn_error: 300/109 foreign: 1237/207
Links: 107/109 ok, 2/0 warning, 2/0 error, 0/6 unknown, 7/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
94%Transfer (from/to): 51686/27148 files, 117.032/50.386 TB ok
Errors: src_missing_file: 8/0, trn_timeout: 19/315, trn_user: 24/40, trn_error: 207/1115, dst_permission: 0/5, dst_space: 0/1168, dst_error: 0/16 foreign: 1668/1396
Links: 107/112 ok, 2/0 warning, 2/1 error, 0/7 unknown, 7/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
93%Transfer (from/to): 65199/14299 files, 73.806/14.722 TB ok
Errors: src_missing_file: 8/0, src_error: 64/0, trn_timeout: 8/16, trn_user: 10727/21, trn_error: 305/63, dst_space: 0/1230, dst_error: 0/573 foreign: 1539/384
Links: 106/103 ok, 3/1 warning, 2/5 error, 0/6 unknown, 7/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
96%Transfer (from/to): 34846/12203 files, 55.677/5.934 TB ok
Errors: src_missing_file: 14/0, src_error: 147/0, trn_timeout: 266/5, trn_user: 0/42, trn_error: 334/87, dst_space: 0/366, dst_error: 0/9 foreign: 1931/227
Links: 106/108 ok, 4/1 warning, 1/0 error, 1/8 unknown, 5/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
Site Readiness:
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 111/103 ok, 1/2 warning, 1/9 error, 1/2 unknown, 3/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 107/104 ok, 1/0 warning, 3/9 error, 0/2 unknown, 3/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 94 ok, 1 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 105/103 ok, 2/3 warning, 3/9 error, 1/2 unknown, 3/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 109/112 ok, 2/1 warning, 3/0 error, 1/3 unknown, 3/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 104/109 ok, 4/1 warning, 3/1 error, 1/2 unknown, 3/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 108/105 ok, 2/4 warning, 3/1 error, 2/2 unknown, 3/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 104/107 ok, 3/2 warning, 3/2 error, 2/2 unknown, 5/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 111/106 ok, 1/0 warning, 2/4 error, 1/2 unknown, 5/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 110/108 ok, 3/1 warning, 2/1 error, 1/4 unknown, 7/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 110/100 ok, 1/0 warning, 3/10 error, 0/4 unknown, 7/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 106/98 ok, 1/1 warning, 2/10 error, 1/4 unknown, 7/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 103/108 ok, 2/0 warning, 2/0 error, 0/5 unknown, 7/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 107/109 ok, 2/0 warning, 2/0 error, 0/6 unknown, 7/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 107/112 ok, 2/0 warning, 2/1 error, 0/7 unknown, 7/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 106/103 ok, 3/1 warning, 2/5 error, 0/6 unknown, 7/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: error (15min evaluations: 76 ok, 0 warning, 15 error, 5 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 106/108 ok, 4/1 warning, 1/0 error, 1/8 unknown, 5/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T1_DE_KIT
GGUS Tickets: 146953, 146951
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 52%15min evaluations: 50 ok, 0 warning, 46 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 61 ok, 0 warning, 0 error, 35 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 86%15min evaluations: 80 ok, 1 warning, 13 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 92 ok, 0 warning, 3 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%297 Success [crab3@vocms0198.cern.ch#48406752.0#1589240392 200511_053353:sciaba_crab_HC-101-T1_DE_KIT-89130-20200511072704 217 0]... 82%231 Success [crab3@vocms0194.cern.ch#52613828.0#1589326517 200512_173852:sciaba_crab_HC-101-T1_DE_KIT-89130-20200511072704 71 0]...
48 Failed, Removed due to wall clock limit [crab3@vocms0137.cern.ch#51297352.0#1589349568 200513_055228:sciaba_crab_HC-101-T1_DE_KIT-89204-20200513074528 1 0]...
2 Failed, ExitCode 8021 [crab3@vocms0137.cern.ch#51321125.0#1589380181 200513_055228:sciaba_crab_HC-101-T1_DE_KIT-89204-20200513074528 103 0]...
100%295 Success [crab3@vocms0137.cern.ch#51354684.0#1589413180 200513_055228:sciaba_crab_HC-101-T1_DE_KIT-89204-20200513074528 213 0]... 100%284 Success [crab3@vocms0119.cern.ch#53746854.0#1589499504 200514_180208:sciaba_crab_HC-101-T1_DE_KIT-89204-20200513074528 67 0]... 100%367 Success [crab3@vocms0122.cern.ch#57516742.0#1589585756 200515_224937:sciaba_crab_HC-101-T1_DE_KIT-89275-20200515064704 9 0]... 100%299 Success [crab3@vocms0119.cern.ch#53829878.0#1589671811 200516_103733:sciaba_crab_HC-101-T1_DE_KIT-89363-20200516122803 154 0]... 100%206 Success [crab3@vocms0198.cern.ch#48581990.0#1589758464 200517_223327:sciaba_crab_HC-101-T1_DE_KIT-89363-20200516122803 12 0]... 100%291 Success [crab3@vocms0197.cern.ch#52144253.0#1589844743 200518_134600:sciaba_crab_HC-101-T1_DE_KIT-89444-20200518154102 117 0]... 100%283 Success [crab3@vocms0199.cern.ch#13088535.0#1589931442 200519_074553:sciaba_crab_HC-101-T1_DE_KIT-89444-20200518154102 190 0]... 100%293 Success [crab3@vocms0119.cern.ch#54059023.0#1590017951 200520_175821:sciaba_crab_HC-101-T1_DE_KIT-89521-20200520195501 68 0]... 100%283 Success [crab3@vocms0194.cern.ch#52949759.0#1590104249 200521_115548:sciaba_crab_HC-101-T1_DE_KIT-89521-20200520195501 140 0]... 97%288 Success [crab3@vocms0137.cern.ch#51716689.0#1590190502 200522_201332:sciaba_crab_HC-101-T1_DE_KIT-89599-20200522220702 40 0]...
2 Failed, ExitCode 8021 [crab3@vocms0137.cern.ch#51735925.0#1590230412 200522_201332:sciaba_crab_HC-101-T1_DE_KIT-89599-20200522220702 173 0]...
7 Failed, Removed due to wall clock limit [crab3@vocms0137.cern.ch#51735602.0#1590229811 200522_201332:sciaba_crab_HC-101-T1_DE_KIT-89599-20200522220702 171 0]...
100%285 Success [crab3@vocms0120.cern.ch#53537203.0#1590277221 200523_140912:sciaba_crab_HC-101-T1_DE_KIT-89599-20200522220702 114 0]... 100%293 Success [crab3@vocms0122.cern.ch#57866612.0#1590363643 200524_204450:sciaba_crab_HC-101-T1_DE_KIT-89674-20200524223902 35 0]... 100%276 Success [crab3@vocms0144.cern.ch#55630494.0#1590450077 200525_144442:sciaba_crab_HC-101-T1_DE_KIT-89674-20200524223902 107 0]... 100%294 Success [crab3@vocms0120.cern.ch#53614330.0#1590536302 200526_163658:sciaba_crab_HC-101-T1_DE_KIT-89747-20200526183502 84 0]...
FTS Status: 98%Transfer (from/to): 9304/2463 files, 9.835/4.801 TB ok
Errors: src_permission: 8/0, trn_timeout: 42/125, trn_user: 0/55, trn_error: 9/10 foreign: 32/24
Links: 59/59 ok, 1/1 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
70%Transfer (from/to): 8554/3477 files, 15.185/6.698 TB ok
Errors: src_missing_file: 1/0, src_error: 1446/0, trn_timeout: 28/33, trn_error: 8/250, dst_permission: 0/607, dst_path: 0/59, dst_error: 0/1231 foreign: 383/85
Links: 21/33 ok, 29/15 warning, 10/13 error, 1/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
93%Transfer (from/to): 14438/7239 files, 28.190/15.785 TB ok
Errors: src_missing_file: 6/0, trn_timeout: 37/47, trn_error: 18/8, dst_permission: 0/1521, dst_error: 0/1 foreign: 726/70
Links: 62/49 ok, 0/3 warning, 0/8 error, 0/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
93%Transfer (from/to): 12830/8739 files, 28.149/19.362 TB ok
Errors: src_missing_file: 1/0, src_error: 8/0, trn_timeout: 63/122, trn_error: 61/7, dst_permission: 0/1521 foreign: 132/30
Links: 61/53 ok, 0/3 warning, 0/4 error, 0/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
98%Transfer (from/to): 8122/11455 files, 21.437/29.752 TB ok
Errors: trn_timeout: 5/132, trn_error: 11/3, dst_error: 0/2 foreign: 109/203
Links: 61/59 ok, 1/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
96%Transfer (from/to): 7834/17736 files, 27.571/45.662 TB ok
Errors: trn_timeout: 61/164, trn_error: 39/34, dst_permission: 0/3, dst_error: 0/2 foreign: 146/49
Links: 61/58 ok, 0/0 warning, 0/2 error, 0/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
100%Transfer (from/to): 16737/21481 files, 66.528/41.643 TB ok
Errors: src_error: 3/0, trn_timeout: 95/66, trn_error: 10/91, dst_permission: 0/2, dst_error: 0/1 foreign: 1090/146
Links: 59/59 ok, 0/0 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
98%Transfer (from/to): 14421/18409 files, 49.588/44.452 TB ok
Errors: src_error: 24/0, trn_timeout: 48/30, trn_error: 44/92, dst_error: 0/1 foreign: 985/148
Links: 59/58 ok, 0/0 warning, 0/1 error, 1/0 unknown, 2/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
100%Transfer (from/to): 15490/7678 files, 52.112/13.929 TB ok
Errors: trn_timeout: 60/24, trn_error: 110/0 foreign: 968/144
Links: 61/58 ok, 0/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
96%Transfer (from/to): 4117/4050 files, 15.906/8.598 TB ok
Errors: trn_timeout: 63/43, trn_user: 0/2, trn_error: 54/8, dst_permission: 0/48, dst_error: 0/576 foreign: 1717/128
Links: 60/56 ok, 0/0 warning, 0/2 error, 0/2 unknown, 3/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
98%Transfer (from/to): 10725/32735 files, 26.603/91.260 TB ok
Errors: src_error: 398/0, trn_timeout: 1/17, trn_error: 13/27, dst_permission: 0/199, dst_error: 0/339 foreign: 2965/367
Links: 57/58 ok, 1/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
96%Transfer (from/to): 8289/2344 files, 7.634/4.729 TB ok
Errors: src_missing_file: 294/0, src_error: 216/0, trn_timeout: 52/17, trn_user: 15/0, trn_error: 46/3, dst_permission: 0/41, dst_path: 0/107, dst_error: 0/93 foreign: 3073/107
Links: 54/54 ok, 0/1 warning, 1/1 error, 0/2 unknown, 3/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
100%Transfer (from/to): 9554/9693 files, 22.583/27.819 TB ok
Errors: src_error: 5/0, trn_timeout: 37/32, trn_error: 12/58, dst_path: 0/1, dst_error: 0/10 foreign: 3253/105
Links: 61/57 ok, 0/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
98%Transfer (from/to): 13459/11109 files, 36.589/27.093 TB ok
Errors: src_error: 454/0, trn_timeout: 6/112, trn_user: 0/150, trn_error: 7/44, dst_error: 0/2 foreign: 2805/831
Links: 57/59 ok, 1/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
98%Transfer (from/to): 16763/21892 files, 22.022/48.971 TB ok
Errors: src_missing_file: 68/0, src_error: 627/0, trn_timeout: 24/75, trn_error: 35/251, dst_permission: 0/131, dst_path: 0/84, dst_error: 0/434 foreign: 3083/116
Links: 57/60 ok, 1/0 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
100%Transfer (from/to): 3013/6256 files, 4.931/12.235 TB ok
Errors: src_error: 4/0, trn_timeout: 19/8, trn_error: 6/2, dst_permission: 0/10 foreign: 1291/69
Links: 59/60 ok, 0/0 warning, 0/0 error, 0/2 unknown, 2/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
Site Readiness:
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 59/59 ok, 1/1 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
45%SAM: error (15min evaluations: 50 ok, 0 warning, 46 error, 0 unknown, 0 downtime (0h0m)),
HC: error (231 Success ...; 48 Failed, Removed due to wall clock limit ...; 2 Failed, ExitCode 8021 ...),
FTS: ok (Links: 21/33 ok, 29/15 warning, 10/13 error, 1/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
99%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 62/49 ok, 0/3 warning, 0/8 error, 0/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
57%SAM: ok (15min evaluations: 61 ok, 0 warning, 0 error, 35 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 61/53 ok, 0/3 warning, 0/4 error, 0/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (367 Success ...),
FTS: ok (Links: 61/59 ok, 1/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
99%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (299 Success ...),
FTS: ok (Links: 61/58 ok, 0/0 warning, 0/2 error, 0/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
71%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (206 Success ...),
FTS: ok (Links: 59/59 ok, 0/0 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...),
FTS: ok (Links: 59/58 ok, 0/0 warning, 0/1 error, 1/0 unknown, 2/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
96%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...),
FTS: ok (Links: 61/58 ok, 0/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
99%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 60/56 ok, 0/0 warning, 0/2 error, 0/2 unknown, 3/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
92%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...),
FTS: ok (Links: 57/58 ok, 1/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
72%SAM: error (15min evaluations: 80 ok, 1 warning, 13 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (288 Success ...; 2 Failed, ExitCode 8021 ...; 7 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 54/54 ok, 0/1 warning, 1/1 error, 0/2 unknown, 3/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
96%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 61/57 ok, 0/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
100%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 57/59 ok, 1/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
92%SAM: ok (15min evaluations: 92 ok, 0 warning, 3 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (276 Success ...),
FTS: ok (Links: 57/60 ok, 1/0 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
67%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 59/60 ok, 0/0 warning, 0/0 error, 0/2 unknown, 2/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T1_ES_PIC
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 1 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 81 ok, 15 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 3 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%294 Success [crab3@vocms0199.cern.ch#12717358.0#1589240052 200511_053252:sciaba_crab_HC-101-T1_ES_PIC-89130-20200511072704 216 0]... 100%276 Success [crab3@vocms0137.cern.ch#51257999.0#1589326422 200512_173722:sciaba_crab_HC-101-T1_ES_PIC-89130-20200511072704 71 0]... 100%297 Success [crab3@vocms0199.cern.ch#12812423.0#1589411201 200513_054845:sciaba_crab_HC-101-T1_ES_PIC-89204-20200513074528 207 0]... 100%285 Success [crab3@vocms0121.cern.ch#53703200.0#1589499173 200514_175704:sciaba_crab_HC-101-T1_ES_PIC-89204-20200513074528 67 0]... 89%359 Success [crab3@vocms0119.cern.ch#53779449.0#1589585358 200515_224828:sciaba_crab_HC-101-T1_ES_PIC-89275-20200515064704 8 0]...
39 Failed, ExitCode 8021 [crab3@vocms0119.cern.ch#53798655.0#1589617166 200515_224828:sciaba_crab_HC-101-T1_ES_PIC-89275-20200515064704 114 0]...
2 Failed, ExitCode 8006 [crab3@vocms0119.cern.ch#53802606.0#1589624669 200515_224828:sciaba_crab_HC-101-T1_ES_PIC-89275-20200515064704 139 0]...
100%294 Success [crab3@vocms0199.cern.ch#12986848.0#1589672178 200516_103301:sciaba_crab_HC-101-T1_ES_PIC-89363-20200516122803 156 0]... 100%201 Success [crab3@vocms0122.cern.ch#57587485.0#1589758514 200517_223405:sciaba_crab_HC-101-T1_ES_PIC-89363-20200516122803 12 0]... 100%294 Success [crab3@vocms0137.cern.ch#51570623.0#1589844968 200518_134943:sciaba_crab_HC-101-T1_ES_PIC-89444-20200518154102 117 0]... 99%283 Success [crab3@vocms0195.cern.ch#51977314.0#1589931578 200519_074822:sciaba_crab_HC-101-T1_ES_PIC-89444-20200518154102 190 0]...
1 Failed, ExitCode 8021 [crab3@vocms0119.cern.ch#54033623.0#1589956486 200520_015325:sciaba_crab_HC-101-T1_ES_PIC-89444-20200518154102 56 0]...
100%293 Success [crab3@vocms0119.cern.ch#54059115.0#1590018084 200520_180022:sciaba_crab_HC-101-T1_ES_PIC-89521-20200520195501 68 0]... 100%279 Success [crab3@vocms0198.cern.ch#48763350.0#1590104893 200521_115638:sciaba_crab_HC-101-T1_ES_PIC-89521-20200520195501 142 0]... 100%291 Success [crab3@vocms0120.cern.ch#53504149.0#1590190645 200522_201556:sciaba_crab_HC-101-T1_ES_PIC-89599-20200522220702 40 0]... 100%282 Success [crab3@vocms0196.cern.ch#52655082.0#1590276010 200523_142352:sciaba_crab_HC-101-T1_ES_PIC-89599-20200522220702 107 0]... 100%293 Success [crab3@vocms0121.cern.ch#54131863.0#1590363484 200524_204649:sciaba_crab_HC-101-T1_ES_PIC-89674-20200524223902 34 0]... 100%284 Success [crab3@vocms0120.cern.ch#53583625.0#1590449926 200525_144643:sciaba_crab_HC-101-T1_ES_PIC-89674-20200524223902 106 0]... 100%295 Success [crab3@vocms0196.cern.ch#52754025.0#1590535469 200526_164325:sciaba_crab_HC-101-T1_ES_PIC-89747-20200526183502 80 0]...
FTS Status: 97%Transfer (from/to): 6896/13002 files, 14.815/32.493 TB ok
Errors: src_permission: 10/0, trn_timeout: 14/644, trn_user: 3/201, trn_error: 21/6, dst_permission: 0/2 foreign: 1382/54
Links: 59/58 ok, 2/2 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
srmcms.pic.es: ok/ok
100%Transfer (from/to): 5535/13828 files, 6.860/36.379 TB ok
Errors: trn_timeout: 12/461, trn_user: 0/82, trn_error: 26/25 foreign: 510/584
Links: 64/59 ok, 0/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
srmcms.pic.es: ok/ok
98%Transfer (from/to): 8804/15037 files, 18.037/59.829 TB ok
Errors: src_error: 44/0, trn_timeout: 20/157, trn_user: 0/72, trn_error: 20/77, dst_permission: 0/1, dst_error: 0/1 foreign: 986/218
Links: 63/58 ok, 0/1 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
srmcms.pic.es: ok/ok
55%Transfer (from/to): 5804/5539 files, 10.234/26.180 TB ok
Errors: src_error: 3826/0, trn_timeout: 3/65, trn_user: 0/133, trn_error: 41/12, dst_permission: 0/5, dst_space: 0/6206, dst_error: 0/1 foreign: 633/74
Links: 61/29 ok, 0/7 warning, 3/23 error, 0/1 unknown, 1/0 bad-endpoint
srmcms.pic.es: ok/ok
94%Transfer (from/to): 4260/9184 files, 8.566/34.630 TB ok
Errors: src_missing_file: 8/0, src_error: 1498/0, trn_timeout: 77/134, trn_user: 0/78, trn_error: 411/463, dst_permission: 0/1, dst_space: 0/3286, dst_error: 0/1 foreign: 348/1140
Links: 52/53 ok, 11/3 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint
srmcms.pic.es: ok/ok
98%Transfer (from/to): 10067/24567 files, 24.977/66.347 TB ok
Errors: src_permission: 3/0, src_missing_file: 4/0, trn_timeout: 44/172, trn_user: 0/57, trn_error: 85/164, dst_permission: 0/22 foreign: 572/67
Links: 61/57 ok, 0/0 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
srmcms.pic.es: ok/ok
85%Transfer (from/to): 15022/24675 files, 37.119/70.242 TB ok
Errors: src_permission: 1/0, src_error: 20/0, trn_timeout: 17/58, trn_user: 0/84, trn_error: 19/188, dst_permission: 0/13, dst_space: 0/6856 foreign: 426/89
Links: 61/42 ok, 1/10 warning, 0/7 error, 0/1 unknown, 2/0 bad-endpoint
srmcms.pic.es: ok/ok
39%Transfer (from/to): 13466/15225 files, 30.405/43.184 TB ok
Errors: src_error: 128/0, trn_timeout: 35/159, trn_user: 0/72, trn_error: 33/46, dst_permission: 0/2, dst_space: 0/17789 foreign: 220/194
Links: 61/12 ok, 0/3 warning, 1/43 error, 0/1 unknown, 2/1 bad-endpoint
srmcms.pic.es: ok/error
98%Transfer (from/to): 16513/28659 files, 26.574/74.352 TB ok
Errors: src_missing_file: 19/0, src_error: 1/0, trn_timeout: 47/442, trn_user: 0/49, trn_error: 66/37, dst_permission: 0/5, dst_space: 0/1 foreign: 943/195
Links: 61/57 ok, 1/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint
srmcms.pic.es: ok/ok
98%Transfer (from/to): 7673/27944 files, 15.442/69.671 TB ok
Errors: src_error: 8/0, trn_timeout: 182/44, trn_user: 0/80, trn_error: 11/125, dst_permission: 0/10, dst_error: 0/2 foreign: 1754/194
Links: 61/57 ok, 1/0 warning, 0/0 error, 0/3 unknown, 3/1 bad-endpoint
srmcms.pic.es: ok/ok
98%Transfer (from/to): 12404/17109 files, 25.462/42.172 TB ok
Errors: src_permission: 1/0, src_error: 6/0, trn_timeout: 82/336, trn_user: 0/50, trn_error: 14/99, dst_permission: 0/7, dst_space: 0/6, dst_error: 0/1 foreign: 3044/184
Links: 61/56 ok, 1/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint
srmcms.pic.es: ok/ok
75%Transfer (from/to): 6190/6145 files, 4.140/16.912 TB ok
Errors: src_permission: 3/0, trn_timeout: 208/3, trn_user: 5/99, trn_error: 48/0, dst_permission: 0/4 foreign: 2663/152
Links: 43/56 ok, 1/0 warning, 16/0 error, 0/2 unknown, 3/1 bad-endpoint
srmcms.pic.es: ok/ok
59%Transfer (from/to): 7112/24110 files, 3.061/63.607 TB ok
Errors: src_error: 468/0, trn_timeout: 940/107, trn_user: 39/40, trn_error: 65/16, dst_space: 0/1 foreign: 2198/166
Links: 36/58 ok, 2/0 warning, 27/0 error, 0/2 unknown, 3/1 bad-endpoint
srmcms.pic.es: ok/ok
77%Transfer (from/to): 20261/17154 files, 21.339/46.355 TB ok
Errors: src_permission: 21/0, src_error: 56/0, trn_timeout: 758/17, trn_user: 49/37, trn_error: 87/35 foreign: 3662/215
Links: 42/57 ok, 8/0 warning, 13/0 error, 0/2 unknown, 3/1 bad-endpoint
srmcms.pic.es: ok/ok
98%Transfer (from/to): 15892/3602 files, 35.727/6.792 TB ok
Errors: src_missing_file: 8/0, src_error: 9279/0, trn_timeout: 43/11, trn_user: 1/32, trn_error: 259/43 foreign: 2931/176
Links: 60/56 ok, 0/1 warning, 2/0 error, 3/2 unknown, 4/1 bad-endpoint
srmcms.pic.es: ok/ok
96%Transfer (from/to): 11539/6352 files, 23.183/17.185 TB ok
Errors: trn_timeout: 147/269, trn_user: 0/21, trn_error: 15/19 foreign: 1339/263
Links: 62/56 ok, 0/0 warning, 0/2 error, 0/2 unknown, 3/0 bad-endpoint
srmcms.pic.es: ok/ok
Site Readiness:
99%SAM: ok (15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 59/58 ok, 2/2 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; srmcms.pic.es: ok/ok)
96%SAM: ok (15min evaluations: 94 ok, 1 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (276 Success ...),
FTS: ok (Links: 64/59 ok, 0/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; srmcms.pic.es: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 63/58 ok, 0/1 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; srmcms.pic.es: ok/ok)
59%SAM: ok (15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 61/29 ok, 0/7 warning, 3/23 error, 0/1 unknown, 1/0 bad-endpoint; srmcms.pic.es: ok/ok)
78%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: error (359 Success ...; 39 Failed, ExitCode 8021 ...; 2 Failed, ExitCode 8006 ...),
FTS: ok (Links: 52/53 ok, 11/3 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint; srmcms.pic.es: ok/ok)
100%SAM: ok (15min evaluations: 81 ok, 15 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 61/57 ok, 0/0 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; srmcms.pic.es: ok/ok)
51%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (201 Success ...),
FTS: ok (Links: 61/42 ok, 1/10 warning, 0/7 error, 0/1 unknown, 2/0 bad-endpoint; srmcms.pic.es: ok/ok)
54%corrected: diskspace exceeded by CMS,
SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: error (Links: 61/12 ok, 0/3 warning, 1/43 error, 0/1 unknown, 2/1 bad-endpoint; srmcms.pic.es: ok/error)
96%SAM: ok (15min evaluations: 93 ok, 3 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 61/57 ok, 1/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint; srmcms.pic.es: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 61/57 ok, 1/0 warning, 0/0 error, 0/3 unknown, 3/1 bad-endpoint; srmcms.pic.es: ok/ok)
94%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 61/56 ok, 1/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint; srmcms.pic.es: ok/ok)
96%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...),
FTS: ok (Links: 43/56 ok, 1/0 warning, 16/0 error, 0/2 unknown, 3/1 bad-endpoint; srmcms.pic.es: ok/ok)
95%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 36/58 ok, 2/0 warning, 27/0 error, 0/2 unknown, 3/1 bad-endpoint; srmcms.pic.es: ok/ok)
99%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 42/57 ok, 8/0 warning, 13/0 error, 0/2 unknown, 3/1 bad-endpoint; srmcms.pic.es: ok/ok)
92%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 60/56 ok, 0/1 warning, 2/0 error, 3/2 unknown, 4/1 bad-endpoint; srmcms.pic.es: ok/ok)
71%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 62/56 ok, 0/0 warning, 0/2 error, 0/2 unknown, 3/0 bad-endpoint; srmcms.pic.es: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T1_FR_CCIN2P3
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%296 Success [crab3@vocms0107.cern.ch#54960541.0#1589240231 200511_053546:sciaba_crab_HC-101-T1_FR_CCIN2P3-89130-20200511072704 216 0]... 100%279 Success [crab3@vocms0196.cern.ch#52221023.0#1589326268 200512_174015:sciaba_crab_HC-101-T1_FR_CCIN2P3-89130-20200511072704 70 0]... 100%296 Success [crab3@vocms0199.cern.ch#12815146.0#1589413297 200513_054810:sciaba_crab_HC-101-T1_FR_CCIN2P3-89204-20200513074528 214 0]... 100%281 Success [crab3@vocms0137.cern.ch#51440425.0#1589498743 200514_175449:sciaba_crab_HC-101-T1_FR_CCIN2P3-89204-20200513074528 66 0]... 100%367 Success [crab3@vocms0196.cern.ch#52390461.0#1589585409 200515_224850:sciaba_crab_HC-101-T1_FR_CCIN2P3-89275-20200515064704 8 0]... 100%297 Success [crab3@vocms0196.cern.ch#52425071.0#1589671732 200516_103225:sciaba_crab_HC-101-T1_FR_CCIN2P3-89363-20200516122803 154 0]... 100%207 Success [crab3@vocms0195.cern.ch#51900879.0#1589758796 200517_225354:sciaba_crab_HC-101-T1_FR_CCIN2P3-89363-20200516122803 9 0]... 100%293 Success [crab3@vocms0144.cern.ch#55386967.0#1589845505 200518_134252:sciaba_crab_HC-101-T1_FR_CCIN2P3-89444-20200518154102 120 0]... 100%279 Success [crab3@vocms0144.cern.ch#55424847.0#1589931546 200519_074251:sciaba_crab_HC-101-T1_FR_CCIN2P3-89444-20200518154102 191 0]... 100%296 Success [crab3@vocms0107.cern.ch#55303153.0#1590017274 200520_180149:sciaba_crab_HC-101-T1_FR_CCIN2P3-89521-20200520195501 65 0]... 100%284 Success [crab3@vocms0137.cern.ch#51674540.0#1590104397 200521_115831:sciaba_crab_HC-101-T1_FR_CCIN2P3-89521-20200520195501 140 0]... 99%293 Success [crab3@vocms0119.cern.ch#54138647.0#1590190660 200522_201107:sciaba_crab_HC-101-T1_FR_CCIN2P3-89599-20200522220702 41 0]...
1 Failed, ExitCode 8021 [crab3@vocms0119.cern.ch#54139180.0#1590192763 200522_201107:sciaba_crab_HC-101-T1_FR_CCIN2P3-89599-20200522220702 48 0]...
100%283 Success [crab3@vocms0195.cern.ch#52094011.0#1590276824 200523_140731:sciaba_crab_HC-101-T1_FR_CCIN2P3-89599-20200522220702 113 0]... 100%294 Success [crab3@vocms0197.cern.ch#52380162.0#1590363546 200524_204241:sciaba_crab_HC-101-T1_FR_CCIN2P3-89674-20200524223902 35 0]... 100%281 Success [crab3@vocms0121.cern.ch#54160744.0#1590449521 200525_144051:sciaba_crab_HC-101-T1_FR_CCIN2P3-89674-20200524223902 106 0]... 100%294 Success [crab3@vocms0196.cern.ch#52754285.0#1590535881 200526_164014:sciaba_crab_HC-101-T1_FR_CCIN2P3-89747-20200526183502 82 0]...
FTS Status: 98%Transfer (from/to): 13639/24204 files, 14.119/66.727 TB ok
Errors: src_permission: 409/0, src_error: 284/0, trn_timeout: 2/284, trn_error: 5/165, dst_permission: 0/35 foreign: 7809/73
Links: 61/57 ok, 0/1 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 10448/6825 files, 8.388/15.909 TB ok
Errors: src_error: 484/0, trn_timeout: 251/479, trn_error: 10/195, dst_permission: 0/1, dst_space: 0/1 foreign: 1354/59
Links: 62/58 ok, 1/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
100%Transfer (from/to): 26973/6825 files, 26.493/20.730 TB ok
Errors: src_error: 8/0, trn_timeout: 21/510, trn_error: 346/12, dst_space: 0/2 foreign: 2851/93
Links: 63/58 ok, 0/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
100%Transfer (from/to): 21018/26474 files, 18.413/96.704 TB ok
Errors: src_error: 33/0, trn_timeout: 49/447, trn_error: 678/52, dst_permission: 0/37 foreign: 1481/61
Links: 63/58 ok, 0/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
96%Transfer (from/to): 28816/10801 files, 18.621/37.721 TB ok
Errors: src_error: 22113/0, trn_timeout: 104/154, trn_error: 10249/9, dst_permission: 0/2, dst_space: 0/12 foreign: 1920/792
Links: 62/59 ok, 1/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 12333/9003 files, 33.631/21.099 TB ok
Errors: trn_timeout: 26/231, trn_error: 58/146, dst_permission: 0/2, dst_space: 0/1 foreign: 1367/59
Links: 61/56 ok, 0/0 warning, 0/1 error, 0/2 unknown, 1/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 23451/23948 files, 62.135/60.057 TB ok
Errors: trn_timeout: 116/178, trn_error: 28/188 foreign: 1353/206
Links: 58/56 ok, 0/0 warning, 0/1 error, 0/2 unknown, 2/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 22041/26415 files, 60.185/70.241 TB ok
Errors: trn_timeout: 150/63, trn_error: 34/92, dst_space: 0/1 foreign: 1391/154
Links: 60/56 ok, 1/2 warning, 0/1 error, 0/0 unknown, 2/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
97%Transfer (from/to): 31418/11257 files, 94.654/30.779 TB ok
Errors: src_error: 24/0, trn_timeout: 1315/2, trn_error: 9678/2, dst_space: 0/2 foreign: 1407/158
Links: 60/58 ok, 0/0 warning, 2/0 error, 0/1 unknown, 3/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 21179/7857 files, 64.749/21.650 TB ok
Errors: src_error: 152/0, trn_timeout: 243/101, trn_error: 139/14, dst_space: 0/2 foreign: 3861/167
Links: 61/56 ok, 0/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 4267/6656 files, 8.120/15.562 TB ok
Errors: src_error: 52/0, trn_timeout: 9/28, trn_error: 133/10 foreign: 6080/207
Links: 62/55 ok, 0/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
96%Transfer (from/to): 11482/8063 files, 28.913/18.013 TB ok
Errors: src_missing_file: 25/0, trn_timeout: 121/93, trn_error: 7917/2, dst_permission: 0/1 foreign: 7842/218
Links: 57/55 ok, 0/0 warning, 3/0 error, 0/3 unknown, 3/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
100%Transfer (from/to): 22195/8640 files, 56.168/22.425 TB ok
Errors: trn_timeout: 27/63, trn_error: 316/19 foreign: 6866/196
Links: 62/56 ok, 0/0 warning, 0/0 error, 0/3 unknown, 3/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
100%Transfer (from/to): 15307/17903 files, 38.453/44.869 TB ok
Errors: src_error: 8/0, trn_timeout: 24/83, trn_error: 36/43 foreign: 4030/2009
Links: 61/57 ok, 0/0 warning, 0/0 error, 1/2 unknown, 3/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
99%Transfer (from/to): 9028/12307 files, 21.002/32.667 TB ok
Errors: src_error: 2665/0, trn_timeout: 2/52, trn_error: 15/8 foreign: 6562/5397
Links: 58/57 ok, 0/0 warning, 1/0 error, 1/2 unknown, 3/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 8532/10504 files, 18.229/26.890 TB ok
Errors: trn_timeout: 3/321, trn_error: 8/5, dst_permission: 0/2, dst_error: 0/1 foreign: 785/125
Links: 60/56 ok, 1/0 warning, 0/1 error, 0/3 unknown, 2/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
Site Readiness:
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 61/57 ok, 0/1 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
96%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 62/58 ok, 1/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
97%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 63/58 ok, 0/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
75%SAM: ok (15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 63/58 ok, 0/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
99%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (367 Success ...),
FTS: ok (Links: 62/59 ok, 1/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 61/56 ok, 0/0 warning, 0/1 error, 0/2 unknown, 1/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
71%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (207 Success ...),
FTS: ok (Links: 58/56 ok, 0/0 warning, 0/1 error, 0/2 unknown, 2/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
100%SAM: ok (15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 60/56 ok, 1/2 warning, 0/1 error, 0/0 unknown, 2/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
97%SAM: ok (15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 60/58 ok, 0/0 warning, 2/0 error, 0/1 unknown, 3/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
99%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 61/56 ok, 0/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
94%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 62/55 ok, 0/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
90%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 57/55 ok, 0/0 warning, 3/0 error, 0/3 unknown, 3/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
92%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...),
FTS: ok (Links: 62/56 ok, 0/0 warning, 0/0 error, 0/3 unknown, 3/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
100%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 61/57 ok, 0/0 warning, 0/0 error, 1/2 unknown, 3/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
96%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 58/57 ok, 0/0 warning, 1/0 error, 1/2 unknown, 3/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
67%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 60/56 ok, 1/0 warning, 0/1 error, 0/3 unknown, 2/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T1_IT_CNAF
GGUS Tickets:
Downtimes:
SAM Status: 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 94 ok, 0 warning, 1 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 87 ok, 9 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 3 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 90 ok, 0 warning, 0 error, 6 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%295 Success [crab3@vocms0107.cern.ch#54960528.0#1589240162 200511_233019:sciaba_crab_HC-101-T1_IT_CNAF-89130-20200511072704 1 0]... 100%277 Success [crab3@vocms0194.cern.ch#52613634.0#1589326072 200512_173643:sciaba_crab_HC-101-T1_IT_CNAF-89130-20200511072704 70 0]... 100%296 Success [crab3@vocms0122.cern.ch#57433971.0#1589412710 200513_055004:sciaba_crab_HC-101-T1_IT_CNAF-89204-20200513074528 212 0]... 100%283 Success [crab3@vocms0120.cern.ch#53099609.0#1589499220 200514_175736:sciaba_crab_HC-101-T1_IT_CNAF-89204-20200513074528 67 0]... 100%368 Success [crab3@vocms0120.cern.ch#53125559.0#1589585852 200515_225120:sciaba_crab_HC-101-T1_IT_CNAF-89275-20200515064704 9 0]... 100%302 Success [crab3@vocms0198.cern.ch#48549079.0#1589672067 200516_102849:sciaba_crab_HC-101-T1_IT_CNAF-89363-20200516122803 156 0]... 100%200 Success [crab3@vocms0122.cern.ch#57587333.0#1589758369 200517_221152:sciaba_crab_HC-101-T1_IT_CNAF-89363-20200516122803 16 0]... 100%293 Success [crab3@vocms0194.cern.ch#52873515.0#1589844809 200518_135146:sciaba_crab_HC-101-T1_IT_CNAF-89444-20200518154102 116 0]... 100%283 Success [crab3@vocms0120.cern.ch#53329936.0#1589931117 200519_074947:sciaba_crab_HC-101-T1_IT_CNAF-89444-20200518154102 188 0]... 100%293 Success [crab3@vocms0155.cern.ch#55478955.0#1590017709 200520_180340:sciaba_crab_HC-101-T1_IT_CNAF-89521-20200520195501 66 0]... 100%281 Success [crab3@vocms0137.cern.ch#51674011.0#1590103590 200521_120023:sciaba_crab_HC-101-T1_IT_CNAF-89521-20200520195501 137 0]... 100%294 Success [crab3@vocms0195.cern.ch#52059874.0#1590190252 200522_200938:sciaba_crab_HC-101-T1_IT_CNAF-89599-20200522220702 40 0]... 100%287 Success [crab3@vocms0119.cern.ch#54172449.0#1590276738 200523_140626:sciaba_crab_HC-101-T1_IT_CNAF-89599-20200522220702 113 0]... 100%294 Success [crab3@vocms0155.cern.ch#55636371.0#1590362903 200524_204221:sciaba_crab_HC-101-T1_IT_CNAF-89674-20200524223902 33 0]... 100%282 Success [crab3@vocms0199.cern.ch#13309339.0#1590449427 200525_143935:sciaba_crab_HC-101-T1_IT_CNAF-89674-20200524223902 106 0]... 100%297 Success [crab3@vocms0194.cern.ch#53088365.0#1590535675 200526_164127:sciaba_crab_HC-101-T1_IT_CNAF-89747-20200526183502 81 0]...
FTS Status: 98%Transfer (from/to): 10230/18167 files, 19.309/26.627 TB ok
Errors: src_error: 32/0, trn_timeout: 50/14, trn_error: 65/50, dst_path: 0/30, dst_error: 0/4 foreign: 292/132
Links: 61/58 ok, 0/1 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
99%Transfer (from/to): 15740/15084 files, 36.559/24.507 TB ok
Errors: src_error: 1451/0, trn_timeout: 74/63, trn_user: 1/0, trn_error: 15/9, dst_path: 0/33, dst_error: 0/3 foreign: 243/84
Links: 59/59 ok, 0/0 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
98%Transfer (from/to): 6140/15947 files, 6.660/20.422 TB ok
Errors: src_error: 3079/0, trn_timeout: 87/88, trn_error: 41/14, dst_path: 0/23, dst_error: 0/5 foreign: 1199/366
Links: 60/59 ok, 0/0 warning, 3/0 error, 0/1 unknown, 1/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
98%Transfer (from/to): 9758/12547 files, 22.675/25.035 TB ok
Errors: src_error: 386/0, trn_timeout: 15/69, trn_error: 36/1, dst_path: 0/22, dst_error: 0/5 foreign: 379/117
Links: 61/59 ok, 0/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
97%Transfer (from/to): 15392/15926 files, 31.390/33.526 TB ok
Errors: src_error: 3050/0, trn_timeout: 10/150, trn_error: 247/28, dst_path: 0/22, dst_error: 0/2 foreign: 340/1467
Links: 58/59 ok, 1/0 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
98%Transfer (from/to): 23338/43021 files, 68.863/125.756 TB ok
Errors: src_error: 407/0, trn_timeout: 10/210, trn_user: 99/0, trn_error: 126/88, dst_permission: 0/152, dst_path: 0/7, dst_error: 0/4 foreign: 350/276
Links: 61/58 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
96%Transfer (from/to): 36358/51868 files, 122.276/179.362 TB ok
Errors: src_error: 523/0, trn_timeout: 125/237, trn_user: 193/1, trn_error: 21/113, dst_permission: 0/103, dst_path: 0/7, dst_error: 0/1 foreign: 881/168
Links: 59/58 ok, 0/0 warning, 2/2 error, 1/0 unknown, 2/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
98%Transfer (from/to): 38205/86407 files, 126.655/278.105 TB ok
Errors: src_error: 60/0, trn_timeout: 43/51, trn_user: 138/0, trn_error: 71/48, dst_permission: 0/22, dst_error: 0/3 foreign: 2849/233
Links: 60/56 ok, 0/0 warning, 2/1 error, 0/1 unknown, 2/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
99%Transfer (from/to): 27952/83616 files, 93.023/279.201 TB ok
Errors: src_error: 5/0, trn_timeout: 26/3, trn_user: 184/0, trn_error: 19/0, dst_permission: 0/4, dst_error: 0/11 foreign: 1479/212
Links: 63/57 ok, 0/1 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
100%Transfer (from/to): 26357/28808 files, 56.860/96.577 TB ok
Errors: src_error: 289/0, trn_timeout: 84/9, trn_error: 31/10 foreign: 1630/157
Links: 63/57 ok, 0/0 warning, 0/0 error, 0/2 unknown, 2/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
99%Transfer (from/to): 9462/13352 files, 19.469/46.867 TB ok
Errors: src_error: 475/0, trn_timeout: 27/15, trn_error: 3/2, dst_error: 0/2 foreign: 744/145
Links: 62/56 ok, 0/0 warning, 2/0 error, 0/2 unknown, 3/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
96%Transfer (from/to): 23893/12337 files, 65.310/27.726 TB ok
Errors: trn_timeout: 11/21, trn_error: 71/5, dst_path: 0/2, dst_error: 0/1 foreign: 365/179
Links: 59/56 ok, 1/0 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
100%Transfer (from/to): 35747/19433 files, 98.817/34.466 TB ok
Errors: src_error: 36/0, trn_timeout: 7/31, trn_error: 8/29, dst_error: 0/2 foreign: 540/160
Links: 62/59 ok, 0/0 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
98%Transfer (from/to): 33937/23093 files, 86.379/44.349 TB ok
Errors: src_error: 630/0, trn_timeout: 11/4, trn_error: 11/20, dst_path: 0/1, dst_error: 0/7 foreign: 5970/186
Links: 60/59 ok, 0/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
99%Transfer (from/to): 29803/10418 files, 80.198/28.698 TB ok
Errors: src_error: 1359/0, trn_timeout: 3/3, trn_error: 229/5, dst_path: 0/1 foreign: 12035/186
Links: 59/57 ok, 0/0 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
98%Transfer (from/to): 20953/6384 files, 50.774/18.420 TB ok
Errors: src_error: 1/0, trn_timeout: 44/6, trn_error: 48/4, dst_error: 0/2 foreign: 3072/84
Links: 61/57 ok, 1/2 warning, 0/0 error, 1/2 unknown, 2/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
Site Readiness:
99%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 61/58 ok, 0/1 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
93%SAM: ok (15min evaluations: 94 ok, 0 warning, 1 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (277 Success ...),
FTS: ok (Links: 59/59 ok, 0/0 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 60/59 ok, 0/0 warning, 3/0 error, 0/1 unknown, 1/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
75%SAM: ok (15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...),
FTS: ok (Links: 61/59 ok, 0/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (368 Success ...),
FTS: ok (Links: 58/59 ok, 1/0 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (302 Success ...),
FTS: ok (Links: 61/58 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
68%SAM: ok (15min evaluations: 87 ok, 9 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (200 Success ...),
FTS: ok (Links: 59/58 ok, 0/0 warning, 2/2 error, 1/0 unknown, 2/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 60/56 ok, 0/0 warning, 2/1 error, 0/1 unknown, 2/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
97%SAM: ok (15min evaluations: 93 ok, 3 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...),
FTS: ok (Links: 63/57 ok, 0/1 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
99%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 63/57 ok, 0/0 warning, 0/0 error, 0/2 unknown, 2/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
96%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 62/56 ok, 0/0 warning, 2/0 error, 0/2 unknown, 3/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
95%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 59/56 ok, 1/0 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
94%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (287 Success ...),
FTS: ok (Links: 62/59 ok, 0/0 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
100%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 60/59 ok, 0/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
95%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 59/57 ok, 0/0 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
66%SAM: ok (15min evaluations: 90 ok, 0 warning, 0 error, 6 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 61/57 ok, 1/2 warning, 0/0 error, 1/2 unknown, 2/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T1_RU_JINR
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 92 ok, 1 warning, 3 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 4 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 95%15min evaluations: 70 ok, 0 warning, 3 error, 23 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%296 Success [crab3@vocms0196.cern.ch#52194748.0#1589240320 200511_053729:sciaba_crab_HC-101-T1_RU_JINR-89130-20200511072704 216 0]... 99%279 Success [crab3@vocms0195.cern.ch#51669459.0#1589326520 200512_174402:sciaba_crab_HC-101-T1_RU_JINR-89130-20200511072704 70 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0107.cern.ch#55026080.0#1589370049 200513_054640:sciaba_crab_HC-101-T1_RU_JINR-89204-20200513074528 70 0]...
98%289 Success [crab3@vocms0107.cern.ch#55045185.0#1589412960 200513_054640:sciaba_crab_HC-101-T1_RU_JINR-89204-20200513074528 213 0]...
1 Failed, ExitCode 8021 [crab3@vocms0107.cern.ch#55083341.0#1589467961 200513_234355:sciaba_crab_HC-101-T1_RU_JINR-89204-20200513074528 181 0]...
4 Failed, Removed due to wall clock limit [crab3@vocms0107.cern.ch#55079415.0#1589459255 200513_234355:sciaba_crab_HC-101-T1_RU_JINR-89204-20200513074528 152 0]...
100%285 Success [crab3@vocms0198.cern.ch#48494824.0#1589499551 200514_175236:sciaba_crab_HC-101-T1_RU_JINR-89204-20200513074528 69 0]... 100%368 Success [crab3@vocms0144.cern.ch#55281354.0#1589585943 200515_225245:sciaba_crab_HC-101-T1_RU_JINR-89275-20200515064704 9 0]... 100%294 Success [crab3@vocms0119.cern.ch#53830080.0#1589672333 200516_103328:sciaba_crab_HC-101-T1_RU_JINR-89363-20200516122803 156 0]... 100%206 Success [crab3@vocms0197.cern.ch#52100494.0#1589758547 200517_225449:sciaba_crab_HC-101-T1_RU_JINR-89363-20200516122803 8 0]... 100%292 Success [crab3@vocms0195.cern.ch#51945906.0#1589845183 200518_135256:sciaba_crab_HC-101-T1_RU_JINR-89444-20200518154102 117 0]... 100%284 Success [crab3@vocms0196.cern.ch#52515589.0#1589931240 200519_075102:sciaba_crab_HC-101-T1_RU_JINR-89444-20200518154102 188 0]... 100%294 Success [crab3@vocms0121.cern.ch#53983696.0#1590017797 200520_180520:sciaba_crab_HC-101-T1_RU_JINR-89521-20200520195501 66 0]... 100%284 Success [crab3@vocms0196.cern.ch#52563567.0#1590104238 200521_120057:sciaba_crab_HC-101-T1_RU_JINR-89521-20200520195501 139 0]... 100%293 Success [crab3@vocms0199.cern.ch#13210772.0#1590190671 200522_201208:sciaba_crab_HC-101-T1_RU_JINR-89599-20200522220702 41 0]... 100%285 Success [crab3@vocms0144.cern.ch#55566300.0#1590276870 200523_140816:sciaba_crab_HC-101-T1_RU_JINR-89599-20200522220702 113 0]... 100%292 Success [crab3@vocms0107.cern.ch#55411128.0#1590363637 200524_204422:sciaba_crab_HC-101-T1_RU_JINR-89674-20200524223902 35 0]... 100%284 Success [crab3@vocms0196.cern.ch#52725024.0#1590449914 200525_144227:sciaba_crab_HC-101-T1_RU_JINR-89674-20200524223902 107 0]... 100%293 Success [crab3@vocms0120.cern.ch#53614334.0#1590536441 200526_163906:sciaba_crab_HC-101-T1_RU_JINR-89747-20200526183502 84 0]...
FTS Status: 98%Transfer (from/to): 25323/16307 files, 39.000/7.104 TB ok
Errors: src_permission: 366/0, trn_timeout: 209/152, trn_user: 0/35, trn_error: 61/3, dst_path: 0/1 foreign: 265/9
Links: 104/106 ok, 3/2 warning, 0/0 error, 1/1 unknown, 1/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
100%Transfer (from/to): 28918/13673 files, 22.852/8.602 TB ok
Errors: src_missing_file: 1/0, src_error: 521/0, trn_timeout: 76/108, trn_error: 168/83, dst_permission: 0/1, dst_error: 0/2 foreign: 538/37
Links: 112/108 ok, 0/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
96%Transfer (from/to): 32362/16163 files, 39.839/5.478 TB ok
Errors: src_error: 2781/0, trn_timeout: 204/68, trn_user: 0/1, trn_error: 105/24, dst_permission: 0/6, dst_space: 0/1, dst_error: 0/59 foreign: 1638/368
Links: 109/104 ok, 1/4 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 45068/8875 files, 40.515/23.062 TB ok
Errors: src_error: 10440/0, trn_timeout: 48/146, trn_user: 0/64, trn_error: 1278/1, dst_error: 0/3 foreign: 1162/27
Links: 111/108 ok, 1/1 warning, 2/0 error, 1/1 unknown, 1/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
97%Transfer (from/to): 15550/5944 files, 24.244/17.379 TB ok
Errors: src_error: 198/0, trn_timeout: 150/374, trn_user: 0/3, trn_error: 85/9, dst_error: 0/2 foreign: 778/379
Links: 106/109 ok, 4/0 warning, 1/0 error, 1/1 unknown, 1/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
96%Transfer (from/to): 28686/6684 files, 120.413/16.001 TB ok
Errors: src_error: 256/0, trn_timeout: 64/258, trn_user: 183/0, trn_error: 96/123, dst_permission: 0/23 foreign: 548/11
Links: 110/104 ok, 3/2 warning, 0/3 error, 0/1 unknown, 1/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
96%Transfer (from/to): 32804/27902 files, 140.857/71.833 TB ok
Errors: src_error: 64/0, trn_timeout: 68/196, trn_user: 106/0, trn_error: 55/69, dst_permission: 0/13, dst_path: 0/1, dst_space: 0/1, dst_error: 0/6 foreign: 1633/10
Links: 102/105 ok, 4/3 warning, 0/2 error, 0/1 unknown, 3/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 32766/38269 files, 97.634/100.364 TB ok
Errors: src_error: 34/0, trn_timeout: 57/259, trn_user: 28/10, trn_error: 241/67, dst_permission: 0/51, dst_space: 0/2, dst_error: 0/4 foreign: 2070/62
Links: 107/107 ok, 2/1 warning, 1/0 error, 0/1 unknown, 3/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
97%Transfer (from/to): 24913/6902 files, 54.684/14.205 TB ok
Errors: src_error: 50/0, trn_timeout: 109/10, trn_error: 90/2, dst_error: 0/4 foreign: 1111/196
Links: 105/109 ok, 2/0 warning, 2/0 error, 0/2 unknown, 4/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
96%Transfer (from/to): 19450/9082 files, 25.805/23.426 TB ok
Errors: src_error: 548/0, trn_timeout: 145/57, trn_error: 116/9, dst_error: 0/1 foreign: 2510/119
Links: 107/108 ok, 2/0 warning, 1/0 error, 0/2 unknown, 5/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 45101/25572 files, 104.538/76.062 TB ok
Errors: src_error: 602/0, trn_timeout: 99/23, trn_error: 58/1, dst_error: 0/14 foreign: 2724/140
Links: 111/106 ok, 0/0 warning, 1/0 error, 0/2 unknown, 5/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 13518/8415 files, 27.179/13.598 TB ok
Errors: trn_timeout: 59/17, trn_error: 74/1, dst_error: 0/5 foreign: 2529/150
Links: 100/105 ok, 1/0 warning, 1/1 error, 0/2 unknown, 5/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 20093/26304 files, 33.244/45.776 TB ok
Errors: trn_timeout: 36/216, trn_error: 60/10, dst_permission: 0/1, dst_path: 0/1, dst_error: 0/13 foreign: 2229/204
Links: 106/106 ok, 2/0 warning, 0/2 error, 0/2 unknown, 5/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 22925/12338 files, 37.021/24.136 TB ok
Errors: src_missing_file: 7/0, src_error: 37/0, trn_timeout: 71/279, trn_user: 1/0, trn_error: 149/46, dst_permission: 0/12, dst_path: 0/2, dst_error: 0/6 foreign: 2434/114
Links: 109/108 ok, 0/1 warning, 0/0 error, 0/1 unknown, 5/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 15236/4570 files, 18.548/9.213 TB ok
Errors: src_error: 3174/0, trn_timeout: 22/39, trn_error: 56/1, dst_error: 0/3 foreign: 2082/178
Links: 104/107 ok, 0/0 warning, 3/0 error, 0/2 unknown, 5/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 15926/2922 files, 22.877/5.540 TB ok
Errors: src_error: 5/0, trn_timeout: 14/33, trn_error: 45/3 foreign: 691/98
Links: 104/106 ok, 6/1 warning, 0/0 error, 0/4 unknown, 3/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
Site Readiness:
37%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 104/106 ok, 3/2 warning, 0/0 error, 1/1 unknown, 1/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
54%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 112/108 ok, 0/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
53%SAM: ok (15min evaluations: 92 ok, 1 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...; 1 Failed, ExitCode 8021 ...; 4 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 109/104 ok, 1/4 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
35%SAM: ok (15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 111/108 ok, 1/1 warning, 2/0 error, 1/1 unknown, 1/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
54%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (368 Success ...),
FTS: ok (Links: 106/109 ok, 4/0 warning, 1/0 error, 1/1 unknown, 1/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
91%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 110/104 ok, 3/2 warning, 0/3 error, 0/1 unknown, 1/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
59%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (206 Success ...),
FTS: ok (Links: 102/105 ok, 4/3 warning, 0/2 error, 0/1 unknown, 3/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
54%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 107/107 ok, 2/1 warning, 1/0 error, 0/1 unknown, 3/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
55%SAM: ok (15min evaluations: 92 ok, 4 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 105/109 ok, 2/0 warning, 2/0 error, 0/2 unknown, 4/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
43%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 107/108 ok, 2/0 warning, 1/0 error, 0/2 unknown, 5/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
42%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 111/106 ok, 0/0 warning, 1/0 error, 0/2 unknown, 5/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
37%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 100/105 ok, 1/0 warning, 1/1 error, 0/2 unknown, 5/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
58%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 106/106 ok, 2/0 warning, 0/2 error, 0/2 unknown, 5/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
78%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 109/108 ok, 0/1 warning, 0/0 error, 0/1 unknown, 5/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
70%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 104/107 ok, 0/0 warning, 3/0 error, 0/2 unknown, 5/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
27%SAM: ok (15min evaluations: 70 ok, 0 warning, 3 error, 23 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 104/106 ok, 6/1 warning, 0/0 error, 0/4 unknown, 3/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T1_UK_RAL
GGUS Tickets: 146136 147080
Downtimes:
SAM Status: 85%15min evaluations: 77 ok, 0 warning, 13 error, 6 unknown, 0 downtime (0h0m) 97%15min evaluations: 93 ok, 0 warning, 2 error, 1 unknown, 0 downtime (0h0m) 87%15min evaluations: 84 ok, 0 warning, 12 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 61 ok, 0 warning, 0 error, 35 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 92 ok, 1 warning, 3 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 92 ok, 0 warning, 1 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 82 ok, 0 warning, 0 error, 14 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 79 ok, 0 warning, 0 error, 17 unknown, 0 downtime (0h0m) 74%15min evaluations: 64 ok, 0 warning, 22 error, 10 unknown, 0 downtime (0h0m)
Hammer Cloud: 93%293 Success [crab3@vocms0106.cern.ch#43071982.0#1589240001 200511_053640:sciaba_crab_HC-101-T1_UK_RAL-89130-20200511072704 215 0]...
18 Failed, ExitCode 8021 [crab3@vocms0106.cern.ch#43071178.0#1589238201 200511_053640:sciaba_crab_HC-101-T1_UK_RAL-89130-20200511072704 209 0]...
2 Failed, Removed due to wall clock limit [crab3@vocms0106.cern.ch#43066650.0#1589230099 200511_053640:sciaba_crab_HC-101-T1_UK_RAL-89130-20200511072704 182 0]...
97%277 Success [crab3@vocms0122.cern.ch#57357926.0#1589326420 200512_174209:sciaba_crab_HC-101-T1_UK_RAL-89130-20200511072704 70 0]...
8 Failed, ExitCode 8021 [crab3@vocms0122.cern.ch#57354984.0#1589324921 200512_174209:sciaba_crab_HC-101-T1_UK_RAL-89130-20200511072704 65 0]...
97%1 Failed, Removed due to wall clock limit [crab3@vocms0195.cern.ch#51724329.0#1589396289 200513_055113:sciaba_crab_HC-101-T1_UK_RAL-89204-20200513074528 157 0]...
291 Success [crab3@vocms0195.cern.ch#51738271.0#1589410992 200513_055113:sciaba_crab_HC-101-T1_UK_RAL-89204-20200513074528 206 0]...
1 Failed, ExitCode 8028 [crab3@vocms0196.cern.ch#52288812.0#1589436022 200513_234835:sciaba_crab_HC-101-T1_UK_RAL-89204-20200513074528 74 0]...
7 Failed, ExitCode 8021 [crab3@vocms0196.cern.ch#52291145.0#1589439620 200513_234835:sciaba_crab_HC-101-T1_UK_RAL-89204-20200513074528 86 0]...
98%496 Success [crab3@vocms0119.cern.ch#53746605.0#1589498963 200514_175819:sciaba_crab_HC-101-T1_UK_RAL-89204-20200513074528 66 0]...
7 Failed, ExitCode 8021 [crab3@vocms0119.cern.ch#53751649.0#1589512164 200514_175819:sciaba_crab_HC-101-T1_UK_RAL-89204-20200513074528 110 0]...
100%377 Success [crab3@vocms0196.cern.ch#52390279.0#1589585276 200515_051802:sciaba_crab_HC-101-T1_UK_RAL-89275-20200515064704 212 1]... 99%297 Success [crab3@vocms0155.cern.ch#55324914.0#1589672411 200516_103711:sciaba_crab_HC-101-T1_UK_RAL-89363-20200516122803 156 0]...
2 Failed, ExitCode 8021 [crab3@vocms0195.cern.ch#51900529.0#1589755546 200517_042928:sciaba_crab_HC-101-T1_UK_RAL-89363-20200516122803 219 0]...
100%208 Success [crab3@vocms0199.cern.ch#13026778.0#1589758303 200517_223603:sciaba_crab_HC-101-T1_UK_RAL-89363-20200516122803 11 0]... 99%294 Success [crab3@vocms0137.cern.ch#51570619.0#1589844907 200518_134826:sciaba_crab_HC-101-T1_UK_RAL-89444-20200518154102 117 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0196.cern.ch#52497610.0#1589875930 200519_074622:sciaba_crab_HC-101-T1_UK_RAL-89444-20200518154102 5 0]...
1 Failed, ExitCode 8021 [crab3@vocms0196.cern.ch#52504286.0#1589895434 200519_074622:sciaba_crab_HC-101-T1_UK_RAL-89444-20200518154102 70 0]...
99%281 Success [crab3@vocms0196.cern.ch#52515742.0#1589931742 200519_074622:sciaba_crab_HC-101-T1_UK_RAL-89444-20200518154102 191 0]...
2 Failed, ExitCode 8021 [crab3@vocms0144.cern.ch#55427004.0#1589947692 200520_015224:sciaba_crab_HC-101-T1_UK_RAL-89444-20200518154102 27 0]...
98%291 Success [crab3@vocms0106.cern.ch#43325382.0#1590017832 200520_180041:sciaba_crab_HC-101-T1_UK_RAL-89521-20200520195501 67 0]...
3 Failed, ExitCode 8021 [crab3@vocms0106.cern.ch#43330339.0#1590055037 200520_180041:sciaba_crab_HC-101-T1_UK_RAL-89521-20200520195501 191 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0106.cern.ch#43330293.0#1590052940 200520_180041:sciaba_crab_HC-101-T1_UK_RAL-89521-20200520195501 184 0]...
99%287 Success [crab3@vocms0120.cern.ch#53447820.0#1590103988 200521_115710:sciaba_crab_HC-101-T1_UK_RAL-89521-20200520195501 139 0]...
1 Failed, ExitCode 8021 [crab3@vocms0120.cern.ch#53455611.0#1590110892 200521_115710:sciaba_crab_HC-101-T1_UK_RAL-89521-20200520195501 162 0]...
98%295 Success [crab3@vocms0106.cern.ch#43370000.0#1590190603 200522_201528:sciaba_crab_HC-101-T1_UK_RAL-89599-20200522220702 40 0]...
6 Failed, ExitCode 8021 [crab3@vocms0106.cern.ch#43375040.0#1590198403 200522_201528:sciaba_crab_HC-101-T1_UK_RAL-89599-20200522220702 66 0]...
95%277 Success [crab3@vocms0121.cern.ch#54109090.0#1590277513 200523_140923:sciaba_crab_HC-101-T1_UK_RAL-89599-20200522220702 115 0]...
13 Failed, ExitCode 8021 [crab3@vocms0121.cern.ch#54113823.0#1590292519 200523_140923:sciaba_crab_HC-101-T1_UK_RAL-89599-20200522220702 165 0]...
97%291 Success [crab3@vocms0155.cern.ch#55636646.0#1590363268 200524_204817:sciaba_crab_HC-101-T1_UK_RAL-89674-20200524223902 30 1]...
8 Failed, ExitCode 8021 [crab3@vocms0155.cern.ch#55637196.0#1590365080 200524_204817:sciaba_crab_HC-101-T1_UK_RAL-89674-20200524223902 39 0]...
96%284 Success [crab3@vocms0199.cern.ch#13309369.0#1590449908 200525_145658:sciaba_crab_HC-101-T1_UK_RAL-89674-20200524223902 104 0]...
8 Failed, ExitCode 8021 [crab3@vocms0199.cern.ch#13310035.0#1590451112 200525_145658:sciaba_crab_HC-101-T1_UK_RAL-89674-20200524223902 108 0]...
1 Failed, ExitCode 8028 [crab3@vocms0199.cern.ch#13314862.0#1590479615 200525_145658:sciaba_crab_HC-101-T1_UK_RAL-89674-20200524223902 203 0]...
100%294 Success [crab3@vocms0122.cern.ch#57934080.0#1590536487 200526_164029:sciaba_crab_HC-101-T1_UK_RAL-89747-20200526183502 84 0]...
FTS Status: 77%Transfer (from/to): 14413/5145 files, 34.309/12.563 TB ok
Errors: src_error: 145/0, trn_timeout: 3/69, trn_user: 297/0, trn_error: 108/100, dst_permission: 0/16, dst_path: 0/7, dst_error: 0/13 foreign: 2095/12
Links: 96/76 ok, 4/3 warning, 12/1 error, 1/1 unknown, 1/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
79%Transfer (from/to): 14804/3681 files, 18.383/9.176 TB ok
Errors: src_error: 170/0, trn_timeout: 6/43, trn_user: 198/0, trn_error: 430/88, dst_permission: 0/15, dst_path: 0/7, dst_error: 0/14 foreign: 49/15
Links: 98/69 ok, 2/2 warning, 12/1 error, 0/1 unknown, 0/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
76%Transfer (from/to): 21162/1049 files, 33.552/1.776 TB ok
Errors: src_error: 225/0, trn_timeout: 38/9, trn_user: 34/0, trn_error: 459/43, dst_permission: 0/20, dst_path: 0/6, dst_error: 0/14 foreign: 1103/34
Links: 101/78 ok, 1/2 warning, 13/0 error, 0/1 unknown, 0/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
71%Transfer (from/to): 15190/7801 files, 42.272/53.716 TB ok
Errors: src_error: 204/0, trn_timeout: 8/43, trn_user: 233/3, trn_error: 368/103, dst_permission: 0/30, dst_path: 0/5, dst_error: 0/13 foreign: 779/109
Links: 95/80 ok, 2/3 warning, 16/2 error, 0/1 unknown, 0/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
73%Transfer (from/to): 18869/2224 files, 30.750/3.706 TB ok
Errors: src_error: 219/0, trn_timeout: 23/178, trn_error: 1042/66, dst_permission: 0/18, dst_path: 0/4, dst_error: 0/5 foreign: 1090/349
Links: 95/79 ok, 5/3 warning, 14/3 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
75%Transfer (from/to): 36686/7731 files, 72.398/18.501 TB ok
Errors: src_error: 196/0, trn_timeout: 25/299, trn_user: 69/0, trn_error: 6449/266, dst_permission: 0/24, dst_path: 0/5, dst_error: 0/5 foreign: 121/83
Links: 98/82 ok, 2/4 warning, 14/3 error, 1/0 unknown, 1/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
73%Transfer (from/to): 40705/8702 files, 90.885/22.206 TB ok
Errors: src_permission: 15/0, src_error: 267/0, trn_timeout: 87/402, trn_user: 69/0, trn_error: 6621/318, dst_permission: 0/60, dst_path: 0/8, dst_error: 0/11 foreign: 969/170
Links: 93/70 ok, 1/2 warning, 15/3 error, 0/1 unknown, 3/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
72%Transfer (from/to): 27132/14807 files, 65.087/36.775 TB ok
Errors: src_error: 222/0, trn_timeout: 49/285, trn_user: 24/0, trn_error: 2936/426, dst_permission: 0/50, dst_path: 0/3, dst_error: 0/10 foreign: 1971/146
Links: 95/84 ok, 2/0 warning, 15/3 error, 0/0 unknown, 3/2 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
70%Transfer (from/to): 17923/24175 files, 28.983/64.493 TB ok
Errors: src_missing_file: 15/0, src_error: 226/0, trn_timeout: 192/236, trn_error: 62/338, dst_permission: 0/20, dst_path: 0/4, dst_error: 0/22 foreign: 815/55
Links: 89/82 ok, 2/3 warning, 19/2 error, 0/1 unknown, 4/1 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
68%Transfer (from/to): 10811/21092 files, 13.989/59.916 TB ok
Errors: src_missing_file: 15/0, src_error: 249/0, trn_timeout: 30/185, trn_user: 96/0, trn_error: 42/258, dst_permission: 0/37, dst_path: 0/5, dst_error: 0/96 foreign: 1555/193
Links: 87/72 ok, 2/0 warning, 19/2 error, 0/1 unknown, 4/1 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
73%Transfer (from/to): 34672/10538 files, 75.144/26.088 TB ok
Errors: src_missing_file: 12/0, src_error: 291/0, trn_timeout: 41/583, trn_user: 47/0, trn_error: 173/153, dst_permission: 0/36, dst_path: 0/4, dst_error: 0/27 foreign: 1404/55
Links: 95/63 ok, 2/2 warning, 15/3 error, 0/1 unknown, 4/1 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
63%Transfer (from/to): 24732/21155 files, 35.580/50.793 TB ok
Errors: src_missing_file: 7/0, src_error: 276/0, trn_timeout: 11/450, trn_error: 84/206, dst_permission: 0/17, dst_path: 0/5, dst_error: 0/16 foreign: 1687/227
Links: 85/58 ok, 2/3 warning, 20/2 error, 0/1 unknown, 4/1 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
59%Transfer (from/to): 23617/19296 files, 56.605/54.302 TB ok
Errors: src_missing_file: 10/0, src_error: 318/0, trn_timeout: 41/181, trn_user: 1682/0, trn_error: 124/62, dst_permission: 0/52, dst_path: 0/2, dst_error: 0/24 foreign: 1789/95
Links: 85/62 ok, 1/0 warning, 25/3 error, 1/2 unknown, 5/1 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
70%Transfer (from/to): 26786/12364 files, 45.055/26.580 TB ok
Errors: src_missing_file: 6/0, src_error: 308/0, trn_timeout: 45/253, trn_user: 1/0, trn_error: 101/228, dst_permission: 0/214, dst_path: 0/4, dst_error: 0/28 foreign: 2223/1135
Links: 90/74 ok, 5/1 warning, 17/2 error, 2/1 unknown, 4/2 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
65%Transfer (from/to): 21899/8371 files, 43.197/19.934 TB ok
Errors: src_missing_file: 5/0, src_error: 233/0, trn_timeout: 16/123, trn_user: 1104/0, trn_error: 37/220, dst_permission: 0/38, dst_path: 0/7, dst_error: 0/30 foreign: 4550/1150
Links: 93/82 ok, 1/2 warning, 20/2 error, 2/2 unknown, 6/1 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
66%Transfer (from/to): 13728/3501 files, 20.739/7.175 TB ok
Errors: src_error: 160/0, trn_timeout: 155/54, trn_user: 3/0, trn_error: 127/68, dst_permission: 0/19, dst_path: 0/6, dst_error: 0/12 foreign: 890/72
Links: 94/62 ok, 0/2 warning, 19/2 error, 0/3 unknown, 5/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
Site Readiness:
18%SAM: error (15min evaluations: 77 ok, 0 warning, 13 error, 6 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...; 18 Failed, ExitCode 8021 ...; 2 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 96/76 ok, 4/3 warning, 12/1 error, 1/1 unknown, 1/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
14%SAM: ok (15min evaluations: 93 ok, 0 warning, 2 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (277 Success ...; 8 Failed, ExitCode 8021 ...),
FTS: ok (Links: 98/69 ok, 2/2 warning, 12/1 error, 0/1 unknown, 0/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
11%SAM: error (15min evaluations: 84 ok, 0 warning, 12 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (1 Failed, Removed due to wall clock limit ...; 291 Success ...; 1 Failed, ExitCode 8028 ...; 7 Failed, ExitCode 8021 ...),
FTS: ok (Links: 101/78 ok, 1/2 warning, 13/0 error, 0/1 unknown, 0/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
21%SAM: ok (15min evaluations: 61 ok, 0 warning, 0 error, 35 unknown, 0 downtime (0h0m)),
HC: ok (496 Success ...; 7 Failed, ExitCode 8021 ...),
FTS: ok (Links: 95/80 ok, 2/3 warning, 16/2 error, 0/1 unknown, 0/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
44%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (377 Success ...),
FTS: ok (Links: 95/79 ok, 5/3 warning, 14/3 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
55%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...; 2 Failed, ExitCode 8021 ...),
FTS: ok (Links: 98/82 ok, 2/4 warning, 14/3 error, 1/0 unknown, 1/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
28%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (208 Success ...),
FTS: ok (Links: 93/70 ok, 1/2 warning, 15/3 error, 0/1 unknown, 3/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
46%SAM: ok (15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...; 1 Failed, Removed due to wall clock limit ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 95/84 ok, 2/0 warning, 15/3 error, 0/0 unknown, 3/2 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
14%SAM: ok (15min evaluations: 92 ok, 1 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...; 2 Failed, ExitCode 8021 ...),
FTS: ok (Links: 89/82 ok, 2/3 warning, 19/2 error, 0/1 unknown, 4/1 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
44%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...; 3 Failed, ExitCode 8021 ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 87/72 ok, 2/0 warning, 19/2 error, 0/1 unknown, 4/1 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
14%SAM: ok (15min evaluations: 92 ok, 0 warning, 1 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (287 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 95/63 ok, 2/2 warning, 15/3 error, 0/1 unknown, 4/1 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
2%SAM: ok (15min evaluations: 82 ok, 0 warning, 0 error, 14 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...; 6 Failed, ExitCode 8021 ...),
FTS: ok (Links: 85/58 ok, 2/3 warning, 20/2 error, 0/1 unknown, 4/1 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
11%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (277 Success ...; 13 Failed, ExitCode 8021 ...),
FTS: ok (Links: 85/62 ok, 1/0 warning, 25/3 error, 1/2 unknown, 5/1 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
16%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...; 8 Failed, ExitCode 8021 ...),
FTS: ok (Links: 90/74 ok, 5/1 warning, 17/2 error, 2/1 unknown, 4/2 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
18%SAM: ok (15min evaluations: 79 ok, 0 warning, 0 error, 17 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...; 8 Failed, ExitCode 8021 ...; 1 Failed, ExitCode 8028 ...),
FTS: ok (Links: 93/82 ok, 1/2 warning, 20/2 error, 2/2 unknown, 6/1 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
0%SAM: error (15min evaluations: 64 ok, 0 warning, 22 error, 10 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 94/62 ok, 0/2 warning, 19/2 error, 0/3 unknown, 5/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T1_US_FNAL
GGUS Tickets: 145964 147020 147135
Downtimes: Pcmsosgce4.fnal.gov/CE Pcmsosgce4.fnal.gov/CE Pcmsosgce4.fnal.gov/CE
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m) 65%15min evaluations: 52 ok, 0 warning, 27 error, 17 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 4 warning, 0 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 94 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 75%15min evaluations: 70 ok, 0 warning, 23 error, 3 unknown, 0 downtime (0h0m)
Hammer Cloud: 99%292 Success [crab3@vocms0196.cern.ch#52194735.0#1589239567 200511_052925:sciaba_crab_HC-101-T1_US_FNAL-89130-20200511072704 215 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0106.cern.ch#43072294.0#1589241569 200511_232816:sciaba_crab_HC-101-T1_US_FNAL-89130-20200511072704 6 0]...
100%276 Success [crab3@vocms0106.cern.ch#43119772.0#1589326023 200512_173529:sciaba_crab_HC-101-T1_US_FNAL-89130-20200511072704 70 0]... 100%297 Success [crab3@vocms0121.cern.ch#53669700.0#1589411981 200513_055216:sciaba_crab_HC-101-T1_US_FNAL-89204-20200513074528 209 0]... 100%284 Success [crab3@vocms0137.cern.ch#51440196.0#1589498159 200514_180004:sciaba_crab_HC-101-T1_US_FNAL-89204-20200513074528 63 0]... 99%363 Success [crab3@vocms0195.cern.ch#51836740.0#1589584415 200515_224743:sciaba_crab_HC-101-T1_US_FNAL-89275-20200515064704 5 0]...
2 Failed, Removed due to wall clock limit [crab3@vocms0195.cern.ch#51837757.0#1589585318 200515_224743:sciaba_crab_HC-101-T1_US_FNAL-89275-20200515064704 8 0]...
100%304 Success [crab3@vocms0122.cern.ch#57552166.0#1589671854 200516_103040:sciaba_crab_HC-101-T1_US_FNAL-89363-20200516122803 155 0]... 100%205 Success [crab3@vocms0137.cern.ch#51546069.0#1589758413 200517_221245:sciaba_crab_HC-101-T1_US_FNAL-89363-20200516122803 16 0]... 99%291 Success [crab3@vocms0198.cern.ch#48644249.0#1589844374 200518_134454:sciaba_crab_HC-101-T1_US_FNAL-89444-20200518154102 116 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0106.cern.ch#43267446.0#1589894738 200519_074421:sciaba_crab_HC-101-T1_US_FNAL-89444-20200518154102 68 0]...
99%280 Success [crab3@vocms0106.cern.ch#43296456.0#1589931050 200519_074421:sciaba_crab_HC-101-T1_US_FNAL-89444-20200518154102 189 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0197.cern.ch#52209812.0#1589966142 200520_012916:sciaba_crab_HC-101-T1_US_FNAL-89444-20200518154102 93 0]...
99%288 Success [crab3@vocms0120.cern.ch#53400455.0#1590017648 200520_175751:sciaba_crab_HC-101-T1_US_FNAL-89521-20200520195501 67 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0120.cern.ch#53399115.0#1590010748 200520_175751:sciaba_crab_HC-101-T1_US_FNAL-89521-20200520195501 44 0]...
99%288 Success [crab3@vocms0119.cern.ch#54100338.0#1590103844 200521_115438:sciaba_crab_HC-101-T1_US_FNAL-89521-20200520195501 139 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0119.cern.ch#54098385.0#1590094844 200521_115438:sciaba_crab_HC-101-T1_US_FNAL-89521-20200520195501 109 0]...
100%292 Success [crab3@vocms0198.cern.ch#48800195.0#1590190147 200522_200800:sciaba_crab_HC-101-T1_US_FNAL-89599-20200522220702 40 0]... 100%280 Success [crab3@vocms0194.cern.ch#53017615.0#1590275789 200523_140533:sciaba_crab_HC-101-T1_US_FNAL-89599-20200522220702 110 0]... 100%292 Success [crab3@vocms0144.cern.ch#55587298.0#1590362516 200524_204031:sciaba_crab_HC-101-T1_US_FNAL-89674-20200524223902 32 0]... 100%288 Success [crab3@vocms0137.cern.ch#51821147.0#1590449384 200525_143808:sciaba_crab_HC-101-T1_US_FNAL-89674-20200524223902 106 0]... 100%293 Success [crab3@vocms0119.cern.ch#54244712.0#1590535059 200526_163628:sciaba_crab_HC-101-T1_US_FNAL-89747-20200526183502 80 0]...
FTS Status: 96%Transfer (from/to): 39618/42541 files, 116.833/145.418 TB ok
Errors: src_missing_file: 71/0, src_error: 28/0, trn_timeout: 274/37, trn_user: 54/73, trn_error: 1287/389, dst_permission: 0/9 foreign: 1049/71
Links: 119/101 ok, 2/0 warning, 2/0 error, 2/2 unknown, 3/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
98%Transfer (from/to): 41055/32252 files, 125.962/120.260 TB ok
Errors: src_missing_file: 2/0, src_error: 18/0, trn_timeout: 315/100, trn_user: 67/56, trn_error: 1228/197 foreign: 1793/218
Links: 119/70 ok, 0/0 warning, 2/0 error, 1/5 unknown, 3/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
98%Transfer (from/to): 41095/50507 files, 134.792/149.843 TB ok
Errors: src_missing_file: 114/0, src_error: 131/0, trn_timeout: 304/332, trn_user: 59/64, trn_error: 1547/207, dst_error: 0/10 foreign: 1755/577
Links: 121/73 ok, 2/0 warning, 2/0 error, 0/5 unknown, 3/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
96%Transfer (from/to): 35489/13974 files, 113.086/32.916 TB ok
Errors: src_missing_file: 156/0, src_error: 393/0, trn_timeout: 185/111, trn_user: 24/70, trn_error: 1810/77, dst_error: 0/2 foreign: 3853/115
Links: 119/70 ok, 0/1 warning, 4/0 error, 0/5 unknown, 3/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
71%Transfer (from/to): 26997/5488 files, 84.029/10.758 TB ok
Errors: src_missing_file: 3708/0, src_error: 5879/0, trn_timeout: 109/63, trn_user: 17/61, trn_error: 1413/43, dst_permission: 0/130, dst_path: 0/2, dst_error: 0/3787 foreign: 2336/297
Links: 89/46 ok, 18/20 warning, 18/10 error, 1/5 unknown, 3/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
92%Transfer (from/to): 55875/17435 files, 166.826/45.851 TB ok
Errors: src_missing_file: 156/0, src_error: 21/0, trn_timeout: 119/145, trn_user: 294/62, trn_error: 1145/71, dst_permission: 0/2 foreign: 1859/89
Links: 114/68 ok, 3/0 warning, 5/2 error, 3/5 unknown, 3/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
95%Transfer (from/to): 73934/17176 files, 226.344/37.036 TB ok
Errors: src_missing_file: 15/0, src_error: 87/0, trn_timeout: 237/72, trn_user: 360/73, trn_error: 754/37, dst_permission: 0/3, dst_error: 0/1 foreign: 2705/138
Links: 119/67 ok, 0/2 warning, 3/1 error, 2/5 unknown, 5/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
97%Transfer (from/to): 108184/44965 files, 357.010/120.954 TB ok
Errors: src_missing_file: 11/0, src_error: 47/0, trn_timeout: 244/74, trn_user: 228/70, trn_error: 631/162, dst_permission: 0/3, dst_error: 0/6 foreign: 2345/327
Links: 119/69 ok, 1/0 warning, 2/0 error, 2/4 unknown, 5/2 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
95%Transfer (from/to): 117190/11364 files, 391.948/43.621 TB ok
Errors: src_error: 7/0, trn_timeout: 176/20, trn_user: 285/65, trn_error: 545/38, dst_error: 0/1 foreign: 1551/196
Links: 118/65 ok, 1/2 warning, 4/0 error, 1/6 unknown, 7/2 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
87%Transfer (from/to): 59713/8413 files, 268.761/21.876 TB ok
Errors: trn_timeout: 97/79, trn_user: 397/65, trn_error: 629/134, dst_permission: 0/6, dst_space: 0/1, dst_error: 0/11 foreign: 2099/292
Links: 114/65 ok, 3/1 warning, 4/1 error, 1/6 unknown, 7/2 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
95%Transfer (from/to): 69086/23519 files, 229.327/62.762 TB ok
Errors: src_missing_file: 16/0, src_error: 192/0, trn_timeout: 300/25, trn_user: 420/68, trn_error: 730/61, dst_error: 0/25 foreign: 5062/230
Links: 116/96 ok, 0/0 warning, 5/1 error, 0/4 unknown, 7/2 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
93%Transfer (from/to): 70703/45551 files, 211.165/155.157 TB ok
Errors: src_missing_file: 16/0, trn_timeout: 195/71, trn_user: 258/84, trn_error: 581/121, dst_space: 0/1 foreign: 5089/283
Links: 108/95 ok, 2/0 warning, 5/0 error, 0/4 unknown, 7/2 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
94%Transfer (from/to): 58951/38037 files, 188.616/124.707 TB ok
Errors: src_missing_file: 175/0, src_error: 1/0, trn_timeout: 67/15, trn_user: 356/71, trn_error: 640/66, dst_space: 0/1, dst_error: 0/1 foreign: 5673/280
Links: 113/78 ok, 1/0 warning, 4/0 error, 0/5 unknown, 7/2 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
96%Transfer (from/to): 70271/38427 files, 201.646/134.854 TB ok
Errors: src_error: 105/0, trn_timeout: 191/11, trn_user: 77/67, trn_error: 700/97 foreign: 4759/440
Links: 118/85 ok, 0/1 warning, 4/0 error, 1/5 unknown, 7/2 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
96%Transfer (from/to): 48391/30426 files, 160.889/107.331 TB ok
Errors: trn_timeout: 66/3, trn_user: 72/21, trn_error: 543/85, dst_space: 0/1 foreign: 2473/447
Links: 114/78 ok, 0/0 warning, 4/0 error, 2/6 unknown, 7/2 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
96%Transfer (from/to): 34356/35362 files, 97.454/62.865 TB ok
Errors: trn_timeout: 452/21, trn_user: 7/16, trn_error: 447/178 foreign: 2939/159
Links: 116/102 ok, 1/0 warning, 4/0 error, 1/5 unknown, 7/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
Site Readiness:
75%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 119/101 ok, 2/0 warning, 2/0 error, 2/2 unknown, 3/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
49%SAM: ok (15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (276 Success ...),
FTS: ok (Links: 119/70 ok, 0/0 warning, 2/0 error, 1/5 unknown, 3/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
56%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 121/73 ok, 2/0 warning, 2/0 error, 0/5 unknown, 3/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
41%SAM: ok (15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 119/70 ok, 0/1 warning, 4/0 error, 0/5 unknown, 3/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
29%SAM: error (15min evaluations: 52 ok, 0 warning, 27 error, 17 unknown, 0 downtime (0h0m)),
HC: ok (363 Success ...; 2 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 89/46 ok, 18/20 warning, 18/10 error, 1/5 unknown, 3/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
58%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (304 Success ...),
FTS: ok (Links: 114/68 ok, 3/0 warning, 5/2 error, 3/5 unknown, 3/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
41%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (205 Success ...),
FTS: ok (Links: 119/67 ok, 0/2 warning, 3/1 error, 2/5 unknown, 5/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
51%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 119/69 ok, 1/0 warning, 2/0 error, 2/4 unknown, 5/2 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
51%SAM: ok (15min evaluations: 92 ok, 4 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 118/65 ok, 1/2 warning, 4/0 error, 1/6 unknown, 7/2 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
53%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (288 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 114/65 ok, 3/1 warning, 4/1 error, 1/6 unknown, 7/2 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
55%SAM: ok (15min evaluations: 94 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (288 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 116/96 ok, 0/0 warning, 5/1 error, 0/4 unknown, 7/2 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
86%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 108/95 ok, 2/0 warning, 5/0 error, 0/4 unknown, 7/2 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
84%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 113/78 ok, 1/0 warning, 4/0 error, 0/5 unknown, 7/2 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
90%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 118/85 ok, 0/1 warning, 4/0 error, 1/5 unknown, 7/2 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
85%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (288 Success ...),
FTS: ok (Links: 114/78 ok, 0/0 warning, 4/0 error, 2/6 unknown, 7/2 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
37%SAM: error (15min evaluations: 70 ok, 0 warning, 23 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 116/102 ok, 1/0 warning, 4/0 error, 1/5 unknown, 7/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_AT_Vienna
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 73 ok, 0 warning, 0 error, 23 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 5 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 94 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 93 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 98%15min evaluations: 67 ok, 0 warning, 1 error, 28 unknown, 0 downtime (0h0m)
Hammer Cloud: 99%284 Success [crab3@vocms0137.cern.ch#51188977.0#1589240175 200511_090017:sciaba_crab_HC-98-T2_AT_Vienna-89104-20200510164704 175 0]...
1 Failed, ExitCode 128 [crab3@vocms0155.cern.ch#55061148.0#1589308113 200512_142611:sciaba_crab_HC-98-T2_AT_Vienna-89177-20200512162105 48 0]...
100%294 Success [crab3@vocms0155.cern.ch#55089517.0#1589326715 200512_142611:sciaba_crab_HC-98-T2_AT_Vienna-89177-20200512162105 110 0]... 100%284 Success [crab3@vocms0194.cern.ch#52663948.0#1589413139 200513_082225:sciaba_crab_HC-98-T2_AT_Vienna-89177-20200512162105 183 0]... 100%294 Success [crab3@vocms0199.cern.ch#12866526.0#1589499274 200514_161305:sciaba_crab_HC-98-T2_AT_Vienna-89258-20200514180904 88 0]... 100%438 Success [crab3@vocms0107.cern.ch#55127150.0#1589585908 200515_101136:sciaba_crab_HC-98-T2_AT_Vienna-89258-20200514180904 161 0]... 100%295 Success [crab3@vocms0194.cern.ch#52814092.0#1589672512 200516_103042:sciaba_crab_HC-98-T2_AT_Vienna-89366-20200516122702 157 0]... 98%82 Success [crab3@vocms0198.cern.ch#48582132.0#1589758812 200517_224927:sciaba_crab_HC-98-T2_AT_Vienna-89366-20200516122702 10 0]...
1 Failed, ExitCode 8021 [crab3@vocms0198.cern.ch#48598514.0#1589785291 200518_055433:sciaba_crab_HC-98-T2_AT_Vienna-89427-20200518075103 13 0]...
99%280 Success [crab3@vocms0198.cern.ch#48645657.0#1589847202 200519_000646:sciaba_crab_HC-98-T2_AT_Vienna-89427-20200518075103 1 0]...
1 Failed, ExitCode 65 [crab3@vocms0198.cern.ch#48658866.0#1589891313 200519_000646:sciaba_crab_HC-98-T2_AT_Vienna-89427-20200518075103 148 0]...
99%279 Success [crab3@vocms0197.cern.ch#52203310.0#1589931534 200519_181212:sciaba_crab_HC-98-T2_AT_Vienna-89427-20200518075103 65 0]...
1 Failed, ExitCode 10040 [crab3@vocms0197.cern.ch#52206247.0#1589945037 200519_181212:sciaba_crab_HC-98-T2_AT_Vienna-89427-20200518075103 110 0]...
1 Failed, ExitCode 65 [crab3@vocms0197.cern.ch#52209494.0#1589961542 200519_181212:sciaba_crab_HC-98-T2_AT_Vienna-89427-20200518075103 165 0]...
100%297 Success [crab3@vocms0194.cern.ch#52926287.0#1590017843 200520_103041:sciaba_crab_HC-98-T2_AT_Vienna-89513-20200520122503 157 0]... 100%279 Success [crab3@vocms0155.cern.ch#55519510.0#1590104224 200521_223051:sciaba_crab_HC-98-T2_AT_Vienna-89513-20200520122503 13 0]... 100%299 Success [crab3@vocms0196.cern.ch#52601390.0#1590190564 200522_095501:sciaba_crab_HC-98-T2_AT_Vienna-89587-20200522114903 164 0]... 100%280 Success [crab3@vocms0194.cern.ch#53017821.0#1590277301 200523_215541:sciaba_crab_HC-98-T2_AT_Vienna-89587-20200522114903 21 0]... 100%299 Success [crab3@vocms0155.cern.ch#55636874.0#1590363625 200524_074414:sciaba_crab_HC-98-T2_AT_Vienna-89660-20200524093703 191 0]... 100%284 Success [crab3@vocms0107.cern.ch#55446130.0#1590450156 200525_194636:sciaba_crab_HC-98-T2_AT_Vienna-89660-20200524093703 47 0]... 100%290 Success [crab3@vocms0144.cern.ch#55663556.0#1590536525 200526_052600:sciaba_crab_HC-98-T2_AT_Vienna-89730-20200526071903 219 0]...
FTS Status: 97%Transfer (from/to): 3678/1610 files, 8.374/0.698 TB ok
Errors: src_error: 9/0, trn_timeout: 25/2, trn_error: 13/5, dst_permission: 0/8, dst_path: 0/1 foreign: 35/14
Links: 52/52 ok, 1/1 warning, 1/0 error, 0/2 unknown, 1/0 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
98%Transfer (from/to): 4444/1155 files, 12.617/0.596 TB ok
Errors: src_error: 1/0, trn_timeout: 1/13, trn_error: 20/2, dst_permission: 0/3 foreign: 11/20
Links: 50/50 ok, 0/2 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
98%Transfer (from/to): 1633/288 files, 0.892/0.023 TB ok
Errors: trn_timeout: 14/0, trn_error: 23/0 foreign: 15/0
Links: 50/5 ok, 0/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
98%Transfer (from/to): 834/2002 files, 0.609/0.180 TB ok
Errors: trn_timeout: 3/0, trn_error: 15/0 foreign: 16/0
Links: 51/8 ok, 0/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
0%Transfer (from/to): 2109/0 files, 2.579/0.000 TB ok
Errors: trn_timeout: 10/0, trn_error: 41/0 foreign: 218/0
Links: 52/0 ok, 1/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
hephyse.oeaw.ac.at: ok/unknown
96%Transfer (from/to): 2105/1490 files, 2.287/0.674 TB ok
Errors: src_error: 4/0, trn_timeout: 11/1, trn_error: 29/1 foreign: 40/2
Links: 51/28 ok, 1/0 warning, 1/0 error, 1/0 unknown, 1/0 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
0%Transfer (from/to): 1586/0 files, 1.200/0.000 TB ok
Errors: src_error: 128/0, trn_timeout: 16/0, trn_user: 0/2352, trn_error: 38/0 foreign: 42/5131
Links: 52/0 ok, 0/0 warning, 2/0 error, 1/36 unknown, 2/0 bad-endpoint
hephyse.oeaw.ac.at: ok/unknown
96%Transfer (from/to): 1582/17633 files, 1.719/9.112 TB ok
Errors: src_error: 43/0, trn_timeout: 5/81, trn_user: 0/467, trn_error: 43/1025, dst_error: 0/473 foreign: 120/1918
Links: 50/47 ok, 4/0 warning, 2/0 error, 0/1 unknown, 2/0 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
94%Transfer (from/to): 982/1791 files, 1.571/0.973 TB ok
Errors: src_error: 18/0, trn_timeout: 196/0, trn_error: 102/0 foreign: 30/102
Links: 50/45 ok, 1/0 warning, 2/0 error, 0/0 unknown, 3/0 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
95%Transfer (from/to): 1122/470 files, 0.748/0.063 TB ok
Errors: trn_timeout: 85/0, trn_error: 133/0 foreign: 1782/26
Links: 47/22 ok, 0/0 warning, 2/0 error, 0/0 unknown, 2/0 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
96%Transfer (from/to): 1591/70 files, 1.827/0.008 TB ok
Errors: trn_timeout: 5/0, trn_error: 183/0 foreign: 4621/0
Links: 51/12 ok, 0/0 warning, 2/0 error, 0/0 unknown, 3/0 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
96%Transfer (from/to): 914/333 files, 1.378/0.536 TB ok
Errors: trn_timeout: 1/0, trn_error: 53/0, dst_path: 0/1 foreign: 2371/5
Links: 48/38 ok, 2/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
98%Transfer (from/to): 2351/6653 files, 1.336/17.118 TB ok
Errors: trn_timeout: 1/0, trn_error: 54/4, dst_permission: 0/7 foreign: 1109/35
Links: 53/49 ok, 0/2 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
98%Transfer (from/to): 2955/5237 files, 2.030/15.190 TB ok
Errors: trn_timeout: 5/0, trn_error: 31/4, dst_permission: 0/10, dst_error: 0/1 foreign: 858/47
Links: 51/37 ok, 2/5 warning, 1/0 error, 0/5 unknown, 3/1 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
96%Transfer (from/to): 1956/5745 files, 1.905/14.747 TB ok
Errors: src_error: 769/0, trn_timeout: 4/0, trn_error: 23/5, dst_permission: 0/6, dst_path: 0/1 foreign: 1126/52
Links: 48/41 ok, 1/2 warning, 2/0 error, 0/5 unknown, 3/1 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
97%Transfer (from/to): 1303/3448 files, 1.053/10.283 TB ok
Errors: trn_timeout: 5/0, trn_error: 17/5, dst_permission: 0/7 foreign: 518/26
Links: 48/37 ok, 2/5 warning, 1/0 error, 0/5 unknown, 2/0 bad-endpoint
hephyse.oeaw.ac.at: ok/ok
Site Readiness:
87%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...; 1 Failed, ExitCode 128 ...),
FTS: ok (Links: 52/52 ok, 1/1 warning, 1/0 error, 0/2 unknown, 1/0 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
83%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 50/50 ok, 0/2 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
55%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 50/5 ok, 0/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
47%SAM: ok (15min evaluations: 73 ok, 0 warning, 0 error, 23 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 51/8 ok, 0/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (438 Success ...),
FTS: unknown (Links: 52/0 ok, 1/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; hephyse.oeaw.ac.at: ok/unknown)
74%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 51/28 ok, 1/0 warning, 1/0 error, 1/0 unknown, 1/0 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
0%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (82 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 52/0 ok, 0/0 warning, 2/0 error, 1/36 unknown, 2/0 bad-endpoint; hephyse.oeaw.ac.at: ok/unknown)
86%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...; 1 Failed, ExitCode 65 ...),
FTS: ok (Links: 50/47 ok, 4/0 warning, 2/0 error, 0/1 unknown, 2/0 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
94%SAM: ok (15min evaluations: 91 ok, 5 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...; 1 Failed, ExitCode 10040 ...; 1 Failed, ExitCode 65 ...),
FTS: ok (Links: 50/45 ok, 1/0 warning, 2/0 error, 0/0 unknown, 3/0 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
84%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 47/22 ok, 0/0 warning, 2/0 error, 0/0 unknown, 2/0 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
21%SAM: ok (15min evaluations: 94 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 51/12 ok, 0/0 warning, 2/0 error, 0/0 unknown, 3/0 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
10%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (299 Success ...),
FTS: ok (Links: 48/38 ok, 2/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
95%SAM: ok (15min evaluations: 93 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 53/49 ok, 0/2 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
100%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (299 Success ...),
FTS: ok (Links: 51/37 ok, 2/5 warning, 1/0 error, 0/5 unknown, 3/1 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
96%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 48/41 ok, 1/2 warning, 2/0 error, 0/5 unknown, 3/1 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
41%SAM: ok (15min evaluations: 67 ok, 0 warning, 1 error, 28 unknown, 0 downtime (0h0m)),
HC: ok (290 Success ...),
FTS: ok (Links: 48/37 ok, 2/5 warning, 1/0 error, 0/5 unknown, 2/0 bad-endpoint; hephyse.oeaw.ac.at: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_BE_IIHE
GGUS Tickets: 146851
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 33 ok, 0 warning, 0 error, 63 unknown, 0 downtime (0h0m) 100%15min evaluations: 51 ok, 0 warning, 0 error, 45 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 94%15min evaluations: 86 ok, 4 warning, 5 error, 1 unknown, 0 downtime (0h0m) 98%15min evaluations: 94 ok, 0 warning, 1 error, 1 unknown, 0 downtime (0h0m) 96%15min evaluations: 54 ok, 0 warning, 2 error, 40 unknown, 0 downtime (0h0m) 100%15min evaluations: 83 ok, 0 warning, 0 error, 12 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 69 ok, 0 warning, 0 error, 27 unknown, 0 downtime (0h0m)
Hammer Cloud: 99%277 Success [crab3@vocms0120.cern.ch#52861708.0#1589238938 200511_141914:sciaba_crab_HC-100-T2_BE_IIHE-89108-20200510221704 107 0]...
2 Failed, ExitCode 1 [crab3@vocms0106.cern.ch#43097249.0#1589291571 200512_082629:sciaba_crab_HC-100-T2_BE_IIHE-89108-20200510221704 65 0]...
100%291 Success [crab3@vocms0120.cern.ch#52960767.0#1589326447 200512_201741:sciaba_crab_HC-100-T2_BE_IIHE-89186-20200512220905 39 0]... 100%292 Success [crab3@vocms0195.cern.ch#51738910.0#1589411848 200513_141957:sciaba_crab_HC-100-T2_BE_IIHE-89186-20200512220905 107 0]... 100%277 Success [crab3@vocms0107.cern.ch#55099544.0#1589498254 200514_082509:sciaba_crab_HC-100-T2_BE_IIHE-89186-20200512220905 178 0]... 100%321 Success [crab3@vocms0119.cern.ch#53777867.0#1589583207 200515_183541:sciaba_crab_HC-100-T2_BE_IIHE-89269-20200515022704 51 0]... 100%297 Success [crab3@vocms0196.cern.ch#52424661.0#1589671476 200516_103158:sciaba_crab_HC-100-T2_BE_IIHE-89364-20200516122803 154 0]... 100%82 Success [crab3@vocms0199.cern.ch#13026592.0#1589757656 200517_223431:sciaba_crab_HC-100-T2_BE_IIHE-89364-20200516122803 9 0]... 100%281 Success [crab3@vocms0121.cern.ch#53931218.0#1589846438 200518_235438:sciaba_crab_HC-100-T2_BE_IIHE-89428-20200518075303 1 0]... 100%280 Success [crab3@vocms0119.cern.ch#54024360.0#1589930257 200519_180109:sciaba_crab_HC-100-T2_BE_IIHE-89428-20200518075303 63 0]... 100%294 Success [crab3@vocms0198.cern.ch#48711897.0#1590017225 200520_053544:sciaba_crab_HC-100-T2_BE_IIHE-89505-20200520073502 214 0]... 100%279 Success [crab3@vocms0121.cern.ch#54039294.0#1590103121 200521_174743:sciaba_crab_HC-100-T2_BE_IIHE-89505-20200520073502 66 0]... 99%296 Success [crab3@vocms0199.cern.ch#13210636.0#1590189402 200522_215525:sciaba_crab_HC-100-T2_BE_IIHE-89578-20200522055502 16 0]...
1 Failed, ExitCode 8002 [crab3@vocms0199.cern.ch#13227495.0#1590204105 200522_215525:sciaba_crab_HC-100-T2_BE_IIHE-89578-20200522055502 65 0]...
100%282 Success [crab3@vocms0119.cern.ch#54173147.0#1590280322 200524_002031:sciaba_crab_HC-100-T2_BE_IIHE-89640-20200524021103 2 0]... 100%290 Success [crab3@vocms0106.cern.ch#43428157.0#1590361638 200524_181627:sciaba_crab_HC-100-T2_BE_IIHE-89640-20200524021103 58 0]... 100%282 Success [crab3@vocms0122.cern.ch#57897605.0#1590449267 200525_122647:sciaba_crab_HC-100-T2_BE_IIHE-89640-20200524021103 132 0]... 100%193 Success [crab3@vocms0122.cern.ch#57933559.0#1590535587 200526_210016:sciaba_crab_HC-100-T2_BE_IIHE-89727-20200526050103 29 0]...
FTS Status: 98%Transfer (from/to): 4815/24462 files, 3.897/6.491 TB ok
Errors: src_permission: 5/0, src_missing_file: 21/0, src_error: 84/0, trn_timeout: 0/62, trn_user: 0/666, trn_error: 77/6 foreign: 6/1244
Links: 45/57 ok, 1/0 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
maite.iihe.ac.be: ok/ok
97%Transfer (from/to): 6884/60427 files, 1.831/9.256 TB ok
Errors: src_missing_file: 20/0, src_error: 1572/0, trn_timeout: 5/63, trn_user: 0/3425, trn_error: 2/12 foreign: 24/7049
Links: 31/55 ok, 1/0 warning, 1/0 error, 0/2 unknown, 0/0 bad-endpoint
maite.iihe.ac.be: ok/ok
97%Transfer (from/to): 8607/18477 files, 4.580/13.269 TB ok
Errors: src_missing_file: 26/0, src_error: 400/0, trn_timeout: 56/23, trn_user: 0/89, trn_error: 496/1 foreign: 138/900
Links: 36/54 ok, 0/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
maite.iihe.ac.be: ok/ok
97%Transfer (from/to): 17500/20036 files, 3.793/14.846 TB ok
Errors: src_missing_file: 24/0, src_error: 56/0, trn_timeout: 14/9, trn_user: 0/15660, trn_error: 68/0 foreign: 72/65983
Links: 42/50 ok, 0/2 warning, 1/0 error, 0/3 unknown, 1/0 bad-endpoint
maite.iihe.ac.be: ok/ok
94%Transfer (from/to): 10537/15551 files, 5.168/9.673 TB ok
Errors: src_missing_file: 17/0, src_error: 1668/0, trn_timeout: 66/9, trn_user: 0/34559, trn_error: 13784/4 foreign: 174/88288
Links: 44/50 ok, 1/0 warning, 3/1 error, 0/3 unknown, 1/0 bad-endpoint
maite.iihe.ac.be: ok/ok
97%Transfer (from/to): 7407/25629 files, 13.665/19.628 TB ok
Errors: src_missing_file: 11/0, trn_timeout: 47/7, trn_user: 0/2, trn_error: 101/1 foreign: 97/135
Links: 50/50 ok, 0/1 warning, 1/1 error, 0/2 unknown, 1/0 bad-endpoint
maite.iihe.ac.be: ok/ok
97%Transfer (from/to): 9249/9630 files, 17.560/18.014 TB ok
Errors: src_missing_file: 23/0, src_error: 530/0, trn_timeout: 34/9, trn_error: 197/2 foreign: 6476/50
Links: 47/51 ok, 0/2 warning, 1/0 error, 1/3 unknown, 2/0 bad-endpoint
maite.iihe.ac.be: ok/ok
97%Transfer (from/to): 14945/14196 files, 13.781/6.404 TB ok
Errors: src_missing_file: 13/0, src_error: 96/0, trn_timeout: 0/148, trn_user: 0/861, trn_error: 15/0 foreign: 3626/498
Links: 47/50 ok, 1/1 warning, 0/1 error, 0/2 unknown, 2/1 bad-endpoint
maite.iihe.ac.be: ok/ok
98%Transfer (from/to): 11238/28932 files, 11.203/15.589 TB ok
Errors: src_missing_file: 173/0, src_error: 4/0, trn_timeout: 499/6, trn_user: 0/352, trn_error: 142/3, dst_error: 0/2 foreign: 126/476
Links: 46/52 ok, 0/0 warning, 1/1 error, 0/3 unknown, 3/1 bad-endpoint
maite.iihe.ac.be: ok/ok
96%Transfer (from/to): 9848/15630 files, 5.698/22.794 TB ok
Errors: src_missing_file: 39/0, trn_timeout: 220/19, trn_error: 82/17 foreign: 2283/188
Links: 37/53 ok, 1/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint
maite.iihe.ac.be: ok/ok
97%Transfer (from/to): 10394/25181 files, 21.094/27.746 TB ok
Errors: src_missing_file: 36/0, trn_timeout: 12/6, trn_user: 0/2, trn_error: 130/1 foreign: 2609/322
Links: 35/49 ok, 0/1 warning, 1/1 error, 0/2 unknown, 3/1 bad-endpoint
maite.iihe.ac.be: ok/ok
93%Transfer (from/to): 1942/1724 files, 1.972/2.992 TB ok
Errors: src_missing_file: 32/0, trn_timeout: 90/14, trn_error: 2034/0, dst_error: 0/1 foreign: 2986/36
Links: 38/47 ok, 1/1 warning, 2/2 error, 0/2 unknown, 3/1 bad-endpoint
maite.iihe.ac.be: ok/ok
96%Transfer (from/to): 7763/2672 files, 17.557/6.706 TB ok
Errors: src_missing_file: 25/0, trn_timeout: 25/16, trn_error: 16/0 foreign: 4387/30
Links: 43/48 ok, 0/0 warning, 0/2 error, 0/2 unknown, 3/1 bad-endpoint
maite.iihe.ac.be: ok/ok
98%Transfer (from/to): 9376/26118 files, 16.934/16.958 TB ok
Errors: src_missing_file: 25/0, trn_timeout: 2/16, trn_user: 1/0, trn_error: 12/1, dst_permission: 0/1 foreign: 1124/38
Links: 42/51 ok, 0/0 warning, 0/1 error, 1/2 unknown, 3/1 bad-endpoint
maite.iihe.ac.be: ok/ok
88%Transfer (from/to): 5109/30304 files, 2.814/5.316 TB ok
Errors: src_missing_file: 23/0, src_error: 2967/0, trn_timeout: 2/6, trn_user: 0/420, trn_error: 10/4, dst_permission: 0/338 foreign: 676/1153
Links: 38/39 ok, 0/12 warning, 1/4 error, 0/2 unknown, 3/1 bad-endpoint
maite.iihe.ac.be: ok/ok
67%Transfer (from/to): 1864/18293 files, 0.898/6.968 TB ok
Errors: src_error: 1178/0, trn_timeout: 0/6, trn_user: 0/2, trn_error: 3/62, dst_permission: 0/625 foreign: 8/203
Links: 23/23 ok, 0/17 warning, 1/12 error, 0/2 unknown, 2/0 bad-endpoint
maite.iihe.ac.be: ok/ok
Site Readiness:
90%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (277 Success ...; 2 Failed, ExitCode 1 ...),
FTS: ok (Links: 45/57 ok, 1/0 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
95%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...),
FTS: ok (Links: 31/55 ok, 1/0 warning, 1/0 error, 0/2 unknown, 0/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
33%SAM: unknown (15min evaluations: 33 ok, 0 warning, 0 error, 63 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 36/54 ok, 0/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
52%SAM: ok (15min evaluations: 51 ok, 0 warning, 0 error, 45 unknown, 0 downtime (0h0m)),
HC: ok (277 Success ...),
FTS: ok (Links: 42/50 ok, 0/2 warning, 1/0 error, 0/3 unknown, 1/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
99%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (321 Success ...),
FTS: ok (Links: 44/50 ok, 1/0 warning, 3/1 error, 0/3 unknown, 1/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
97%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 50/50 ok, 0/1 warning, 1/1 error, 0/2 unknown, 1/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
27%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (82 Success ...),
FTS: ok (Links: 47/51 ok, 0/2 warning, 1/0 error, 1/3 unknown, 2/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
92%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 47/50 ok, 1/1 warning, 0/1 error, 0/2 unknown, 2/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
90%SAM: ok (15min evaluations: 86 ok, 4 warning, 5 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 46/52 ok, 0/0 warning, 1/1 error, 0/3 unknown, 3/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
95%SAM: ok (15min evaluations: 94 ok, 0 warning, 1 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 37/53 ok, 1/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
52%SAM: ok (15min evaluations: 54 ok, 0 warning, 2 error, 40 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 35/49 ok, 0/1 warning, 1/1 error, 0/2 unknown, 3/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
84%SAM: ok (15min evaluations: 83 ok, 0 warning, 0 error, 12 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...; 1 Failed, ExitCode 8002 ...),
FTS: ok (Links: 38/47 ok, 1/1 warning, 2/2 error, 0/2 unknown, 3/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
94%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 43/48 ok, 0/0 warning, 0/2 error, 0/2 unknown, 3/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
97%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (290 Success ...),
FTS: ok (Links: 42/51 ok, 0/0 warning, 0/1 error, 1/2 unknown, 3/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
91%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 38/39 ok, 0/12 warning, 1/4 error, 0/2 unknown, 3/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
40%SAM: ok (15min evaluations: 69 ok, 0 warning, 0 error, 27 unknown, 0 downtime (0h0m)),
HC: ok (193 Success ...),
FTS: ok (Links: 23/23 ok, 0/17 warning, 1/12 error, 0/2 unknown, 2/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_BE_UCL
GGUS Tickets: 146558, 146616
Downtimes:
SAM Status: 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 87%15min evaluations: 84 ok, 0 warning, 12 error, 0 unknown, 0 downtime (0h0m) 80%15min evaluations: 77 ok, 0 warning, 19 error, 0 unknown, 0 downtime (0h0m) 83%15min evaluations: 62 ok, 0 warning, 12 error, 22 unknown, 0 downtime (0h0m) 67%15min evaluations: 63 ok, 0 warning, 31 error, 2 unknown, 0 downtime (0h0m) 15%15min evaluations: 15 ok, 0 warning, 81 error, 0 unknown, 0 downtime (0h0m) 25%15min evaluations: 24 ok, 0 warning, 72 error, 0 unknown, 0 downtime (0h0m) 53%15min evaluations: 51 ok, 0 warning, 45 error, 0 unknown, 0 downtime (0h0m) 93%15min evaluations: 84 ok, 6 warning, 6 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 91%15min evaluations: 83 ok, 2 warning, 8 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 95%15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 71 ok, 0 warning, 1 error, 24 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%279 Success [crab3@vocms0198.cern.ch#48406732.0#1589239390 200511_142134:sciaba_crab_HC-100-T2_BE_UCL-89108-20200510221704 108 0]... 100%294 Success [crab3@vocms0197.cern.ch#51852957.0#1589326227 200512_201933:sciaba_crab_HC-100-T2_BE_UCL-89186-20200512220905 38 0]... 100%290 Success [crab3@vocms0144.cern.ch#55215244.0#1589413645 200513_142048:sciaba_crab_HC-100-T2_BE_UCL-89186-20200512220905 113 0]... 100%285 Success [crab3@vocms0199.cern.ch#12866485.0#1589498906 200514_082719:sciaba_crab_HC-100-T2_BE_UCL-89186-20200512220905 180 0]... 99%314 Success [crab3@vocms0107.cern.ch#55127160.0#1589586245 200515_183214:sciaba_crab_HC-100-T2_BE_UCL-89269-20200515022704 62 0]...
2 Failed, Removed due to wall clock limit [crab3@vocms0107.cern.ch#55150648.0#1589635918 200516_102945:sciaba_crab_HC-100-T2_BE_UCL-89364-20200516122803 36 0]...
99%296 Success [crab3@vocms0107.cern.ch#55178017.0#1589671927 200516_102945:sciaba_crab_HC-100-T2_BE_UCL-89364-20200516122803 156 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0107.cern.ch#55168236.0#1589658127 200516_102945:sciaba_crab_HC-100-T2_BE_UCL-89364-20200516122803 110 0]...
100%83 Success [crab3@vocms0199.cern.ch#13026546.0#1589757417 200517_223035:sciaba_crab_HC-100-T2_BE_UCL-89364-20200516122803 9 0]... 94%280 Success [crab3@vocms0119.cern.ch#53970459.0#1589846381 200518_235316:sciaba_crab_HC-100-T2_BE_UCL-89428-20200518075303 1 0]...
9 Failed, ExitCode 8001 [crab3@vocms0119.cern.ch#53984516.0#1589858085 200518_235316:sciaba_crab_HC-100-T2_BE_UCL-89428-20200518075303 40 0]...
4 Failed, ExitCode 56 [crab3@vocms0119.cern.ch#54005111.0#1589883593 200518_235316:sciaba_crab_HC-100-T2_BE_UCL-89428-20200518075303 125 0]...
1 Failed, ExitCode 59 [crab3@vocms0119.cern.ch#54007251.0#1589886289 200518_235316:sciaba_crab_HC-100-T2_BE_UCL-89428-20200518075303 134 0]...
1 Failed, ExitCode 10040 [crab3@vocms0119.cern.ch#54007723.0#1589887789 200518_235316:sciaba_crab_HC-100-T2_BE_UCL-89428-20200518075303 139 0]...
2 Failed, ExitCode 1 [crab3@vocms0119.cern.ch#54015497.0#1589901594 200518_235316:sciaba_crab_HC-100-T2_BE_UCL-89428-20200518075303 185 0]...
1 Failed, ExitCode 50115 [crab3@vocms0119.cern.ch#54017211.0#1589903992 200518_235316:sciaba_crab_HC-100-T2_BE_UCL-89428-20200518075303 193 0]...
100%277 Success [crab3@vocms0194.cern.ch#52905798.0#1589932228 200519_173918:sciaba_crab_HC-100-T2_BE_UCL-89428-20200518075303 74 0]... 100%301 Success [crab3@vocms0198.cern.ch#48711902.0#1590017313 200520_053716:sciaba_crab_HC-100-T2_BE_UCL-89505-20200520073502 214 0]... 100%276 Success [crab3@vocms0120.cern.ch#53447821.0#1590103990 200521_172659:sciaba_crab_HC-100-T2_BE_UCL-89505-20200520073502 73 0]... 100%293 Success [crab3@vocms0144.cern.ch#55530023.0#1590190296 200522_220537:sciaba_crab_HC-100-T2_BE_UCL-89578-20200522055502 17 0]... 100%283 Success [crab3@vocms0106.cern.ch#43405050.0#1590276504 200523_160732:sciaba_crab_HC-100-T2_BE_UCL-89578-20200522055502 88 0]... 100%292 Success [crab3@vocms0155.cern.ch#55636294.0#1590362697 200524_181357:sciaba_crab_HC-100-T2_BE_UCL-89640-20200524021103 62 0]... 98%286 Success [crab3@vocms0107.cern.ch#55445936.0#1590449283 200525_122137:sciaba_crab_HC-100-T2_BE_UCL-89640-20200524021103 133 0]...
3 Failed, ExitCode 56 [crab3@vocms0120.cern.ch#53602125.0#1590509074 200526_030318:sciaba_crab_HC-100-T2_BE_UCL-89727-20200526050103 156 0]...
1 Failed, ExitCode 10034 [crab3@vocms0120.cern.ch#53603176.0#1590512377 200526_030318:sciaba_crab_HC-100-T2_BE_UCL-89727-20200526050103 167 0]...
100%192 Success [crab3@vocms0107.cern.ch#55463803.0#1590535677 200526_210140:sciaba_crab_HC-100-T2_BE_UCL-89727-20200526050103 29 0]...
FTS Status: 97%Transfer (from/to): 3652/885 files, 13.028/2.932 TB ok
Errors: src_missing_file: 2/0, src_error: 114/0, trn_timeout: 210/0, trn_user: 396/0, trn_error: 424/43, dst_path: 0/15, dst_error: 0/19 foreign: 19/10
Links: 48/42 ok, 0/7 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
81%Transfer (from/to): 5575/4611 files, 13.120/19.572 TB ok
Errors: src_error: 1/0, trn_timeout: 326/45, trn_error: 189/114, dst_path: 0/4, dst_error: 0/98 foreign: 48/15
Links: 50/35 ok, 0/1 warning, 0/7 error, 0/1 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
83%Transfer (from/to): 4818/8050 files, 14.514/22.028 TB ok
Errors: trn_timeout: 616/72, trn_user: 1/0, trn_error: 19/110, dst_path: 0/15, dst_error: 0/12 foreign: 56/13
Links: 51/39 ok, 1/1 warning, 0/7 error, 1/1 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
81%Transfer (from/to): 5078/3409 files, 22.296/10.629 TB ok
Errors: src_error: 2/0, trn_timeout: 161/28, trn_error: 54/97, dst_path: 0/1, dst_error: 0/24 foreign: 20/12
Links: 53/40 ok, 0/1 warning, 0/8 error, 0/1 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
47%Transfer (from/to): 3269/2322 files, 10.928/5.317 TB ok
Errors: trn_timeout: 409/126, trn_user: 1/0, trn_error: 53/2482, dst_path: 0/59, dst_error: 0/98 foreign: 488/82
Links: 48/17 ok, 3/18 warning, 0/19 error, 0/0 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/warning
39%Transfer (from/to): 873/1775 files, 1.892/3.676 TB ok
Errors: src_error: 200/0, trn_timeout: 687/27, trn_user: 7/0, trn_error: 613/1395, dst_path: 0/33, dst_error: 0/1346 foreign: 177/9
Links: 20/10 ok, 10/12 warning, 21/35 error, 0/0 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: warning/error
43%Transfer (from/to): 882/2552 files, 1.788/6.274 TB ok
Errors: src_error: 229/0, trn_timeout: 830/23, trn_user: 1/0, trn_error: 441/387, dst_path: 0/4, dst_error: 0/2074 foreign: 150/30
Links: 16/32 ok, 10/4 warning, 26/17 error, 1/0 unknown, 2/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: error/ok
78%Transfer (from/to): 1954/5202 files, 3.360/14.854 TB ok
Errors: src_error: 101/0, trn_timeout: 467/18, trn_user: 1/0, trn_error: 284/225, dst_path: 0/7, dst_error: 0/1006 foreign: 118/77
Links: 26/40 ok, 18/2 warning, 6/6 error, 0/1 unknown, 2/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
87%Transfer (from/to): 886/7558 files, 1.451/20.954 TB ok
Errors: trn_timeout: 0/71, trn_error: 7/94, dst_path: 0/18, dst_error: 0/13 foreign: 21/48
Links: 51/42 ok, 0/0 warning, 0/6 error, 0/2 unknown, 3/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
87%Transfer (from/to): 952/7558 files, 1.965/20.622 TB ok
Errors: src_error: 14/0, trn_timeout: 82/46, trn_error: 6/170, dst_permission: 0/4, dst_path: 0/4, dst_error: 0/17 foreign: 31/35
Links: 45/42 ok, 0/0 warning, 0/6 error, 0/2 unknown, 3/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
85%Transfer (from/to): 3209/4378 files, 7.486/12.192 TB ok
Errors: trn_timeout: 21/47, trn_error: 14/238, dst_error: 0/13 foreign: 32/20
Links: 50/41 ok, 0/1 warning, 0/6 error, 0/2 unknown, 3/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
86%Transfer (from/to): 1853/6318 files, 3.945/17.740 TB ok
Errors: trn_timeout: 50/162, trn_error: 13/551, dst_permission: 0/1, dst_error: 0/12 foreign: 236/120
Links: 45/39 ok, 0/3 warning, 1/6 error, 0/2 unknown, 3/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
86%Transfer (from/to): 1327/7665 files, 2.598/20.778 TB ok
Errors: trn_timeout: 1/43, trn_error: 7/149, dst_path: 0/3, dst_error: 0/14 foreign: 259/34
Links: 51/42 ok, 1/0 warning, 0/7 error, 0/2 unknown, 3/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
85%Transfer (from/to): 1464/7587 files, 2.349/20.785 TB ok
Errors: src_error: 24/0, trn_timeout: 39/43, trn_error: 4/95, dst_path: 0/10, dst_error: 0/62 foreign: 202/50
Links: 49/42 ok, 1/2 warning, 0/6 error, 0/2 unknown, 3/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
85%Transfer (from/to): 2695/7051 files, 2.473/20.278 TB ok
Errors: trn_timeout: 1/61, trn_error: 5/109, dst_path: 0/3, dst_error: 0/25 foreign: 243/213
Links: 49/41 ok, 0/0 warning, 0/7 error, 0/2 unknown, 3/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
82%Transfer (from/to): 2411/2747 files, 4.162/8.421 TB ok
Errors: trn_timeout: 306/12, trn_error: 36/67, dst_permission: 0/2, dst_path: 0/8, dst_error: 0/4 foreign: 210/1314
Links: 47/36 ok, 1/2 warning, 3/7 error, 1/3 unknown, 2/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
Site Readiness:
78%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 48/42 ok, 0/7 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
82%SAM: warning (15min evaluations: 84 ok, 0 warning, 12 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 50/35 ok, 0/1 warning, 0/7 error, 0/1 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
77%SAM: warning (15min evaluations: 77 ok, 0 warning, 19 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (290 Success ...),
FTS: ok (Links: 51/39 ok, 1/1 warning, 0/7 error, 1/1 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
55%SAM: warning (15min evaluations: 62 ok, 0 warning, 12 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 53/40 ok, 0/1 warning, 0/8 error, 0/1 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
45%SAM: error (15min evaluations: 63 ok, 0 warning, 31 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (314 Success ...; 2 Failed, Removed due to wall clock limit ...),
FTS: warning (Links: 48/17 ok, 3/18 warning, 0/19 error, 0/0 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/warning)
10%SAM: error (15min evaluations: 15 ok, 0 warning, 81 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: error (Links: 20/10 ok, 10/12 warning, 21/35 error, 0/0 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: warning/error)
12%SAM: error (15min evaluations: 24 ok, 0 warning, 72 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (83 Success ...),
FTS: error (Links: 16/32 ok, 10/4 warning, 26/17 error, 1/0 unknown, 2/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: error/ok)
45%SAM: error (15min evaluations: 51 ok, 0 warning, 45 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...; 9 Failed, ExitCode 8001 ...; 4 Failed, ExitCode 56 ...; 1 Failed, ExitCode 59 ...; 1 Failed, ExitCode 10040 ...; 2 Failed, ExitCode 1 ...; 1 Failed, ExitCode 50115 ...),
FTS: ok (Links: 26/40 ok, 18/2 warning, 6/6 error, 0/1 unknown, 2/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
70%SAM: ok (15min evaluations: 84 ok, 6 warning, 6 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (277 Success ...),
FTS: ok (Links: 51/42 ok, 0/0 warning, 0/6 error, 0/2 unknown, 3/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
79%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (301 Success ...),
FTS: ok (Links: 45/42 ok, 0/0 warning, 0/6 error, 0/2 unknown, 3/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
52%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (276 Success ...),
FTS: ok (Links: 50/41 ok, 0/1 warning, 0/6 error, 0/2 unknown, 3/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
65%SAM: ok (15min evaluations: 83 ok, 2 warning, 8 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 45/39 ok, 0/3 warning, 1/6 error, 0/2 unknown, 3/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
78%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...),
FTS: ok (Links: 51/42 ok, 1/0 warning, 0/7 error, 0/2 unknown, 3/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
92%SAM: ok (15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 49/42 ok, 1/2 warning, 0/6 error, 0/2 unknown, 3/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
94%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (286 Success ...; 3 Failed, ExitCode 56 ...; 1 Failed, ExitCode 10034 ...),
FTS: ok (Links: 49/41 ok, 0/0 warning, 0/7 error, 0/2 unknown, 3/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
38%SAM: ok (15min evaluations: 71 ok, 0 warning, 1 error, 24 unknown, 0 downtime (0h0m)),
HC: ok (192 Success ...),
FTS: ok (Links: 47/36 ok, 1/2 warning, 3/7 error, 1/3 unknown, 2/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_BR_SPRACE
GGUS Tickets:
Downtimes:
SAM Status: 99%15min evaluations: 93 ok, 2 warning, 1 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 91 ok, 1 warning, 3 error, 1 unknown, 0 downtime (0h0m) 92%15min evaluations: 85 ok, 2 warning, 7 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 73 ok, 1 warning, 0 error, 22 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 93 ok, 0 warning, 1 error, 2 unknown, 0 downtime (0h0m) 83%15min evaluations: 77 ok, 2 warning, 16 error, 1 unknown, 0 downtime (0h0m) 71%15min evaluations: 67 ok, 2 warning, 27 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%292 Success [crab3@vocms0120.cern.ch#52862110.0#1589239986 200511_203114:sciaba_crab_HC-95-T2_BR_SPRACE-89153-20200511221705 36 0]... 100%284 Success [crab3@vocms0119.cern.ch#53634327.0#1589326388 200512_144000:sciaba_crab_HC-95-T2_BR_SPRACE-89153-20200511221705 106 0]... 100%289 Success [crab3@vocms0122.cern.ch#57433987.0#1589412880 200513_184344:sciaba_crab_HC-95-T2_BR_SPRACE-89222-20200513203904 58 0]... 100%284 Success [crab3@vocms0137.cern.ch#51440532.0#1589498957 200514_125303:sciaba_crab_HC-95-T2_BR_SPRACE-89222-20200513203904 127 0]... 100%354 Success [crab3@vocms0120.cern.ch#53125478.0#1589585501 200515_215034:sciaba_crab_HC-95-T2_BR_SPRACE-89322-20200515233706 20 0]... 100%294 Success [crab3@vocms0195.cern.ch#51859392.0#1589672225 200516_103842:sciaba_crab_HC-95-T2_BR_SPRACE-89369-20200516122702 155 0]... 100%275 Success [crab3@vocms0144.cern.ch#55346204.0#1589758056 200517_225142:sciaba_crab_HC-95-T2_BR_SPRACE-89369-20200516122702 7 0]... 100%293 Success [crab3@vocms0197.cern.ch#52144258.0#1589844873 200518_081255:sciaba_crab_HC-95-T2_BR_SPRACE-89434-20200518100103 184 0]... 100%285 Success [crab3@vocms0155.cern.ch#55442990.0#1589931313 200519_202848:sciaba_crab_HC-95-T2_BR_SPRACE-89434-20200518100103 37 0]... 100%293 Success [crab3@vocms0196.cern.ch#52538363.0#1590017390 200520_220324:sciaba_crab_HC-95-T2_BR_SPRACE-89501-20200520055103 17 0]... 100%282 Success [crab3@vocms0120.cern.ch#53447107.0#1590103036 200521_155613:sciaba_crab_HC-95-T2_BR_SPRACE-89501-20200520055103 88 0]... 100%294 Success [crab3@vocms0194.cern.ch#52987957.0#1590190298 200522_190528:sciaba_crab_HC-95-T2_BR_SPRACE-89565-20200522025102 53 0]... 100%289 Success [crab3@vocms0120.cern.ch#53537198.0#1590276879 200523_125855:sciaba_crab_HC-95-T2_BR_SPRACE-89565-20200522025102 127 0]... 100%293 Success [crab3@vocms0197.cern.ch#52380161.0#1590363541 200524_213319:sciaba_crab_HC-95-T2_BR_SPRACE-89650-20200524053903 25 0]... 100%279 Success [crab3@vocms0122.cern.ch#57897654.0#1590449552 200525_152633:sciaba_crab_HC-95-T2_BR_SPRACE-89650-20200524053903 97 0]... 100%256 Success [crab3@vocms0196.cern.ch#52754027.0#1590535492 200526_074840:sciaba_crab_HC-95-T2_BR_SPRACE-89734-20200526094704 187 0]...
FTS Status: 98%Transfer (from/to): 6546/3718 files, 1.058/9.948 TB ok
Errors: src_permission: 54/0, trn_timeout: 14/0, trn_user: 1/0, trn_error: 7/1, dst_error: 0/3 foreign: 14/40
Links: 47/46 ok, 2/0 warning, 1/0 error, 0/3 unknown, 1/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
98%Transfer (from/to): 31445/577 files, 1.446/1.165 TB ok
Errors: src_error: 757/0, trn_timeout: 3/0, trn_user: 3/0, trn_error: 5/3, dst_error: 0/3 foreign: 2457/47
Links: 49/44 ok, 0/1 warning, 2/0 error, 0/4 unknown, 1/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
98%Transfer (from/to): 37449/380 files, 0.907/0.783 TB ok
Errors: src_error: 9778/0, trn_timeout: 44/0, trn_error: 495/5, dst_permission: 0/1, dst_error: 0/1 foreign: 771/41
Links: 46/46 ok, 1/0 warning, 1/1 error, 0/2 unknown, 1/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
97%Transfer (from/to): 26073/343 files, 0.792/0.698 TB ok
Errors: src_error: 12049/0, trn_timeout: 3/0, trn_error: 16/3, dst_permission: 0/1 foreign: 36/24
Links: 46/47 ok, 0/1 warning, 2/0 error, 0/2 unknown, 1/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
95%Transfer (from/to): 6599/1492 files, 2.027/2.620 TB ok
Errors: src_error: 43717/0, trn_timeout: 39/0, trn_error: 28/6, dst_error: 0/2 foreign: 21/176
Links: 45/49 ok, 1/1 warning, 3/0 error, 1/3 unknown, 1/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
96%Transfer (from/to): 7272/6198 files, 1.881/13.654 TB ok
Errors: src_error: 40/0, trn_timeout: 9/8, trn_error: 116/4 foreign: 38/33
Links: 53/52 ok, 1/2 warning, 1/0 error, 0/3 unknown, 1/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
96%Transfer (from/to): 5221/2298 files, 8.254/3.866 TB ok
Errors: src_error: 1184/0, trn_timeout: 21/2, trn_error: 21/4 foreign: 98/47
Links: 49/54 ok, 1/1 warning, 2/0 error, 1/3 unknown, 2/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
96%Transfer (from/to): 12099/4838 files, 16.969/9.217 TB ok
Errors: src_missing_file: 1/0, src_error: 124/0, trn_timeout: 64/6, trn_user: 1/0, trn_error: 28/2, dst_error: 0/2 foreign: 2585/34
Links: 49/54 ok, 1/3 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
97%Transfer (from/to): 11117/1017 files, 6.887/2.477 TB ok
Errors: src_error: 46/0, trn_timeout: 6/0, trn_error: 16/0 foreign: 277/44
Links: 51/54 ok, 1/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
97%Transfer (from/to): 10371/358 files, 4.680/0.703 TB ok
Errors: src_error: 2100/0, trn_timeout: 3/0, trn_error: 15/0 foreign: 258/35
Links: 45/47 ok, 0/0 warning, 2/0 error, 1/3 unknown, 3/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
98%Transfer (from/to): 21937/2928 files, 11.023/5.315 TB ok
Errors: src_error: 49/0, trn_timeout: 33/9, trn_error: 4/0, dst_error: 0/1 foreign: 135/44
Links: 50/48 ok, 0/0 warning, 1/0 error, 1/3 unknown, 2/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
98%Transfer (from/to): 23320/2016 files, 5.788/3.732 TB ok
Errors: trn_timeout: 9/5, trn_error: 13/3, dst_permission: 0/2, dst_error: 0/8 foreign: 497/39
Links: 52/50 ok, 0/1 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
98%Transfer (from/to): 2958/1930 files, 1.738/4.874 TB ok
Errors: trn_timeout: 2/2, trn_error: 15/6 foreign: 560/43
Links: 52/50 ok, 0/0 warning, 0/1 error, 0/2 unknown, 3/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
98%Transfer (from/to): 11280/10324 files, 6.290/22.267 TB ok
Errors: src_missing_file: 360/0, trn_timeout: 2/12, trn_error: 28/18, dst_permission: 0/1, dst_error: 0/5 foreign: 433/45
Links: 54/50 ok, 0/2 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
99%Transfer (from/to): 3929/2612 files, 2.244/4.522 TB ok
Errors: src_error: 10071/0, trn_timeout: 1/0, trn_error: 13/0, dst_error: 0/1 foreign: 215/45
Links: 51/47 ok, 0/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
100%Transfer (from/to): 3740/1033 files, 2.331/2.054 TB ok
Errors: trn_error: 1/0 foreign: 147/10
Links: 47/50 ok, 0/0 warning, 0/0 error, 0/3 unknown, 2/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
Site Readiness:
75%SAM: ok (15min evaluations: 93 ok, 2 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 47/46 ok, 2/0 warning, 1/0 error, 0/3 unknown, 1/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
65%SAM: ok (15min evaluations: 91 ok, 1 warning, 3 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 49/44 ok, 0/1 warning, 2/0 error, 0/4 unknown, 1/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
62%SAM: ok (15min evaluations: 85 ok, 2 warning, 7 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...),
FTS: ok (Links: 46/46 ok, 1/0 warning, 1/1 error, 0/2 unknown, 1/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
54%SAM: ok (15min evaluations: 73 ok, 1 warning, 0 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 46/47 ok, 0/1 warning, 2/0 error, 0/2 unknown, 1/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
86%SAM: ok (15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (354 Success ...),
FTS: ok (Links: 45/49 ok, 1/1 warning, 3/0 error, 1/3 unknown, 1/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
93%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 53/52 ok, 1/2 warning, 1/0 error, 0/3 unknown, 1/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
83%SAM: ok (15min evaluations: 93 ok, 0 warning, 1 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (275 Success ...),
FTS: ok (Links: 49/54 ok, 1/1 warning, 2/0 error, 1/3 unknown, 2/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
76%SAM: warning (15min evaluations: 77 ok, 2 warning, 16 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 49/54 ok, 1/3 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
49%SAM: error (15min evaluations: 67 ok, 2 warning, 27 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 51/54 ok, 1/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
74%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 45/47 ok, 0/0 warning, 2/0 error, 1/3 unknown, 3/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
82%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 50/48 ok, 0/0 warning, 1/0 error, 1/3 unknown, 2/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
88%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 52/50 ok, 0/1 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
81%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...),
FTS: ok (Links: 52/50 ok, 0/0 warning, 0/1 error, 0/2 unknown, 3/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
94%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 54/50 ok, 0/2 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
76%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 51/47 ok, 0/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
19%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (256 Success ...),
FTS: ok (Links: 47/50 ok, 0/0 warning, 0/0 error, 0/3 unknown, 2/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_BR_UERJ
GGUS Tickets: 146864 147131
Downtimes:
SAM Status: 97%15min evaluations: 86 ok, 1 warning, 2 error, 7 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 73 ok, 0 warning, 1 error, 22 unknown, 0 downtime (0h0m) 99%15min evaluations: 94 ok, 1 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 89 ok, 3 warning, 0 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 3 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 97%15min evaluations: 90 ok, 4 warning, 2 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 93 ok, 0 warning, 2 error, 1 unknown, 0 downtime (0h0m) 95%15min evaluations: 90 ok, 0 warning, 4 error, 1 unknown, 0 downtime (0h0m) 97%15min evaluations: 86 ok, 5 warning, 2 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 81%15min evaluations: 72 ok, 3 warning, 17 error, 3 unknown, 0 downtime (0h0m) 47%15min evaluations: 26 ok, 0 warning, 29 error, 41 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%295 Success [crab3@vocms0197.cern.ch#51792869.0#1589236659 200511_202625:sciaba_crab_HC-95-T2_BR_UERJ-89153-20200511221705 26 0]... 100%217 Success [crab3@vocms0195.cern.ch#51668898.0#1589323478 200512_143305:sciaba_crab_HC-95-T2_BR_UERJ-89153-20200511221705 98 0]... 99%243 Success [crab3@vocms0199.cern.ch#12803992.0#1589401870 200513_184452:sciaba_crab_HC-95-T2_BR_UERJ-89222-20200513203904 21 0]...
2 Failed, ExitCode 8021 [crab3@vocms0199.cern.ch#12816800.0#1589418075 200513_184452:sciaba_crab_HC-95-T2_BR_UERJ-89222-20200513203904 75 0]...
100%235 Success [crab3@vocms0122.cern.ch#57472395.0#1589497874 200514_195946:sciaba_crab_HC-95-T2_BR_UERJ-89222-20200513203904 38 0]... 100%96 Success [crab3@vocms0137.cern.ch#51491179.0#1589582843 200515_214555:sciaba_crab_HC-95-T2_BR_UERJ-89322-20200515233706 12 0]... 100%234 Success [crab3@vocms0137.cern.ch#51498115.0#1589611048 200515_214555:sciaba_crab_HC-95-T2_BR_UERJ-89322-20200515233706 106 0]... 95%186 Success [crab3@vocms0195.cern.ch#51850853.0#1589661728 200516_103505:sciaba_crab_HC-95-T2_BR_UERJ-89369-20200516122702 121 0]...
8 Failed, ExitCode 8028 [crab3@vocms0195.cern.ch#51844297.0#1589625718 200516_103505:sciaba_crab_HC-95-T2_BR_UERJ-89369-20200516122702 1 0]...
98%189 Success [crab3@vocms0144.cern.ch#55374929.0#1589817208 200518_081051:sciaba_crab_HC-95-T2_BR_UERJ-89434-20200518100103 92 0]...
2 Failed, ExitCode 8021 [crab3@vocms0144.cern.ch#55380655.0#1589828941 200518_081051:sciaba_crab_HC-95-T2_BR_UERJ-89434-20200518100103 131 0]...
1 Failed, ExitCode 8028 [crab3@vocms0106.cern.ch#43288123.0#1589921082 200519_184410:sciaba_crab_HC-95-T2_BR_UERJ-89434-20200518100103 20 1]...
100%211 Success [crab3@vocms0106.cern.ch#43296384.0#1589930741 200519_184410:sciaba_crab_HC-95-T2_BR_UERJ-89434-20200518100103 56 0]... 99%320 Success [crab3@vocms0155.cern.ch#55474119.0#1590002490 200520_040011:sciaba_crab_HC-95-T2_BR_UERJ-89501-20200520055103 184 0]...
2 Failed, ExitCode 8021 [crab3@vocms0107.cern.ch#55315352.0#1590072113 200521_004541:sciaba_crab_HC-95-T2_BR_UERJ-89501-20200520055103 167 0]...
99%284 Success [crab3@vocms0155.cern.ch#55516372.0#1590099312 200521_183854:sciaba_crab_HC-95-T2_BR_UERJ-89501-20200520055103 43 0]...
3 Failed, ExitCode 8021 [crab3@vocms0194.cern.ch#52968921.0#1590142111 200522_005214:sciaba_crab_HC-95-T2_BR_UERJ-89565-20200522025102 111 0]...
100%276 Success [crab3@vocms0194.cern.ch#52987927.0#1590189330 200522_184909:sciaba_crab_HC-95-T2_BR_UERJ-89565-20200522025102 53 0]... 100%80 Success [crab3@vocms0194.cern.ch#53017433.0#1590271989 200523_125708:sciaba_crab_HC-95-T2_BR_UERJ-89565-20200522025102 111 0]... 99%383 Success [crab3@vocms0107.cern.ch#55389130.0#1590306349 200524_034413:sciaba_crab_HC-95-T2_BR_UERJ-89650-20200524053903 48 0]...
1 Failed, ExitCode 8021 [crab3@vocms0107.cern.ch#55390451.0#1590309051 200524_034413:sciaba_crab_HC-95-T2_BR_UERJ-89650-20200524053903 57 0]...
100%281 Success [crab3@vocms0194.cern.ch#53056760.0#1590448538 200525_055906:sciaba_crab_HC-95-T2_BR_UERJ-89650-20200524053903 207 0]... 98%262 Success [crab3@vocms0121.cern.ch#54194294.0#1590531256 200526_080259:sciaba_crab_HC-95-T2_BR_UERJ-89734-20200526094704 170 0]...
3 Failed, ExitCode 8021 [crab3@vocms0137.cern.ch#51862623.0#1590580003 200527_022018:sciaba_crab_HC-95-T2_BR_UERJ-89734-20200526094704 113 0]...
FTS Status: 99%Transfer (from/to): 290/159 files, 0.368/0.341 TB ok
Errors: src_permission: 4/0, trn_timeout: 3/0 foreign: 3/0
Links: 42/18 ok, 2/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
97%Transfer (from/to): 350/379 files, 0.410/0.537 TB ok
Errors: trn_timeout: 1/1, trn_user: 9/0, trn_error: 0/1 foreign: 53/6
Links: 44/22 ok, 0/1 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
98%Transfer (from/to): 620/458 files, 0.358/0.477 TB ok
Errors: trn_timeout: 2/1, trn_user: 65/0, trn_error: 0/1 foreign: 25/1
Links: 46/26 ok, 1/1 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
99%Transfer (from/to): 306/211 files, 0.418/0.451 TB ok
Errors: src_error: 1/0, trn_timeout: 1/0, trn_user: 6/0, trn_error: 1/0, dst_error: 0/9 foreign: 15/1
Links: 44/18 ok, 1/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
97%Transfer (from/to): 518/215 files, 0.410/0.458 TB ok
Errors: src_error: 1/0, trn_timeout: 4/3, trn_user: 6/0, trn_error: 0/1, dst_error: 0/1 foreign: 12/4
Links: 41/17 ok, 3/1 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
98%Transfer (from/to): 267/215 files, 0.425/0.460 TB ok
Errors: trn_timeout: 4/0, dst_error: 0/2
Links: 48/18 ok, 1/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
98%Transfer (from/to): 285/218 files, 0.411/0.465 TB ok
Errors: src_error: 4/0, trn_timeout: 4/0, trn_user: 6/0, trn_error: 1/0, dst_error: 0/1 foreign: 17/0
Links: 44/18 ok, 1/0 warning, 0/0 error, 1/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
96%Transfer (from/to): 220/196 files, 0.394/0.417 TB ok
Errors: src_error: 2/0, trn_timeout: 7/0, trn_user: 1/0, dst_error: 0/4 foreign: 24/1
Links: 44/17 ok, 2/1 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
100%Transfer (from/to): 257/7568 files, 0.423/0.464 TB ok
Errors: src_error: 4/0, trn_timeout: 3/0, trn_error: 0/447, dst_permission: 0/63, dst_error: 0/1 foreign: 9/26
Links: 45/22 ok, 5/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
98%Transfer (from/to): 379/21203 files, 0.415/0.486 TB ok
Errors: trn_timeout: 7/0, trn_user: 7/0, trn_error: 1/142, dst_permission: 0/35, dst_error: 0/4 foreign: 10/17
Links: 46/23 ok, 3/1 warning, 0/0 error, 1/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
98%Transfer (from/to): 741/222 files, 0.450/0.474 TB ok
Errors: trn_timeout: 2/0, trn_user: 3/0, trn_error: 0/2 foreign: 21/0
Links: 49/18 ok, 1/0 warning, 0/0 error, 1/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
95%Transfer (from/to): 7095/433 files, 16.717/0.455 TB ok
Errors: src_error: 5/0, trn_timeout: 1/0, trn_error: 8/1, dst_error: 0/9 foreign: 7/2
Links: 43/20 ok, 1/3 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
96%Transfer (from/to): 287/201 files, 0.467/0.411 TB ok
Errors: trn_timeout: 3/0, dst_error: 0/5 foreign: 10/0
Links: 46/19 ok, 1/0 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
97%Transfer (from/to): 4971/179 files, 14.512/0.381 TB ok
Errors: src_error: 1936/0, trn_timeout: 5/2, trn_error: 0/1, dst_error: 0/28 foreign: 6/0
Links: 42/10 ok, 1/9 warning, 2/0 error, 0/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
99%Transfer (from/to): 7929/180 files, 23.700/0.388 TB ok
Errors: src_error: 5627/0, trn_timeout: 3/0, trn_error: 7/1, dst_error: 0/87 foreign: 18/1
Links: 25/5 ok, 23/14 warning, 2/0 error, 0/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
100%Transfer (from/to): 2684/588 files, 8.053/0.412 TB ok
Errors: src_error: 3/0, trn_timeout: 1/0, trn_error: 0/13, dst_error: 0/1 foreign: 10/34
Links: 44/23 ok, 3/0 warning, 0/0 error, 1/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
Site Readiness:
34%SAM: ok (15min evaluations: 86 ok, 1 warning, 2 error, 7 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 42/18 ok, 2/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
45%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (217 Success ...),
FTS: ok (Links: 44/22 ok, 0/1 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
45%SAM: ok (15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (243 Success ...; 2 Failed, ExitCode 8021 ...),
FTS: ok (Links: 46/26 ok, 1/1 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
28%SAM: ok (15min evaluations: 73 ok, 0 warning, 1 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (235 Success ...),
FTS: ok (Links: 44/18 ok, 1/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
27%SAM: ok (15min evaluations: 94 ok, 1 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (96 Success ...),
FTS: ok (Links: 41/17 ok, 3/1 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
44%SAM: ok (15min evaluations: 89 ok, 3 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (234 Success ...),
FTS: ok (Links: 48/18 ok, 1/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
43%SAM: ok (15min evaluations: 92 ok, 3 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (186 Success ...; 8 Failed, ExitCode 8028 ...),
FTS: ok (Links: 44/18 ok, 1/0 warning, 0/0 error, 1/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
38%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (189 Success ...; 2 Failed, ExitCode 8021 ...; 1 Failed, ExitCode 8028 ...),
FTS: ok (Links: 44/17 ok, 2/1 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
40%SAM: ok (15min evaluations: 90 ok, 4 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (211 Success ...),
FTS: ok (Links: 45/22 ok, 5/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
54%SAM: ok (15min evaluations: 93 ok, 0 warning, 2 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (320 Success ...; 2 Failed, ExitCode 8021 ...),
FTS: ok (Links: 46/23 ok, 3/1 warning, 0/0 error, 1/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
56%SAM: ok (15min evaluations: 90 ok, 0 warning, 4 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...; 3 Failed, ExitCode 8021 ...),
FTS: ok (Links: 49/18 ok, 1/0 warning, 0/0 error, 1/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
87%SAM: ok (15min evaluations: 86 ok, 5 warning, 2 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (276 Success ...),
FTS: ok (Links: 43/20 ok, 1/3 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
31%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (80 Success ...),
FTS: ok (Links: 46/19 ok, 1/0 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
46%SAM: warning (15min evaluations: 72 ok, 3 warning, 17 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (383 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 42/10 ok, 1/9 warning, 2/0 error, 0/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
15%SAM: error (15min evaluations: 26 ok, 0 warning, 29 error, 41 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 25/5 ok, 23/14 warning, 2/0 error, 0/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
50%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (262 Success ...; 3 Failed, ExitCode 8021 ...),
FTS: ok (Links: 44/23 ok, 3/0 warning, 0/0 error, 1/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_CH_CERN
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%273 Success, no Chirp ExitCode [crab3@vocms0195.cern.ch#51630420.0#1589240357 200511_203822:sciaba_crab_HC-94-T2_CH_CERN-89122-20200511044105 36 0]...
22 Success [crab3@vocms0195.cern.ch#51637015.0#1589261661 200511_203822:sciaba_crab_HC-94-T2_CH_CERN-89122-20200511044105 107 0]...
100%30 Success, no Chirp ExitCode [crab3@vocms0196.cern.ch#52221046.0#1589326512 200512_142749:sciaba_crab_HC-94-T2_CH_CERN-89122-20200511044105 109 0]...
248 Success [crab3@vocms0196.cern.ch#52221549.0#1589328013 200512_142749:sciaba_crab_HC-94-T2_CH_CERN-89122-20200511044105 114 0]...
99%289 Success [crab3@vocms0120.cern.ch#53043688.0#1589413169 200513_071313:sciaba_crab_HC-94-T2_CH_CERN-89206-20200513090506 197 0]...
1 Failed, ExitCode 8006 [crab3@vocms0137.cern.ch#51379216.0#1589433221 200514_011230:sciaba_crab_HC-94-T2_CH_CERN-89206-20200513090506 48 0]...
99%280 Success [crab3@vocms0194.cern.ch#52719089.0#1589498711 200514_191755:sciaba_crab_HC-94-T2_CH_CERN-89206-20200513090506 48 0]...
1 Failed, Removed due to memory use [crab3@vocms0119.cern.ch#53767105.0#1589556184 200515_113128:sciaba_crab_HC-94-T2_CH_CERN-89288-20200515132505 46 0]...
100%469 Success [crab3@vocms0119.cern.ch#53779611.0#1589586186 200515_113128:sciaba_crab_HC-94-T2_CH_CERN-89288-20200515132505 146 0]... 100%300 Success [crab3@vocms0196.cern.ch#52425183.0#1589672154 200516_053211:sciaba_crab_HC-94-T2_CH_CERN-89288-20200515132505 216 0]... 100%87 Success [crab3@vocms0120.cern.ch#53251078.0#1589758130 200517_202210:sciaba_crab_HC-94-T2_CH_CERN-89351-20200516101520 37 0]... 100%289 Success [crab3@vocms0120.cern.ch#53286282.0#1589844075 200518_225647:sciaba_crab_HC-94-T2_CH_CERN-89426-20200518065302 4 0]... 100%287 Success [crab3@vocms0106.cern.ch#43296458.0#1589931122 200519_172509:sciaba_crab_HC-94-T2_CH_CERN-89426-20200518065302 73 0]... 100%289 Success [crab3@vocms0144.cern.ch#55459645.0#1590017612 200520_202748:sciaba_crab_HC-94-T2_CH_CERN-89494-20200520042103 37 0]... 99%281 Success [crab3@vocms0144.cern.ch#55495358.0#1590103672 200521_143558:sciaba_crab_HC-94-T2_CH_CERN-89494-20200520042103 106 0]...
1 Failed, Removed due to memory use [crab3@vocms0121.cern.ch#54061138.0#1590132989 200522_011508:sciaba_crab_HC-94-T2_CH_CERN-89569-20200522031102 76 0]...
1 Failed, ExitCode 8021 [crab3@vocms0121.cern.ch#54078702.0#1590160295 200522_011508:sciaba_crab_HC-94-T2_CH_CERN-89569-20200522031102 167 0]...
99%294 Success [crab3@vocms0107.cern.ch#55352152.0#1590189998 200522_191535:sciaba_crab_HC-94-T2_CH_CERN-89569-20200522031102 50 0]...
1 Failed, ExitCode 8021 [crab3@vocms0194.cern.ch#53009375.0#1590248209 200523_132038:sciaba_crab_HC-94-T2_CH_CERN-89569-20200522031102 27 0]...
99%274 Success [crab3@vocms0194.cern.ch#53017823.0#1590277314 200523_132038:sciaba_crab_HC-94-T2_CH_CERN-89569-20200522031102 124 0]...
2 Failed, Removed due to memory use [crab3@vocms0194.cern.ch#53021421.0#1590291117 200523_132038:sciaba_crab_HC-94-T2_CH_CERN-89569-20200522031102 170 0]...
99%292 Success [crab3@vocms0122.cern.ch#57866523.0#1590363021 200524_054854:sciaba_crab_HC-94-T2_CH_CERN-89657-20200524073703 212 0]...
1 Failed, Removed due to memory use [crab3@vocms0137.cern.ch#51800402.0#1590403391 200524_234707:sciaba_crab_HC-94-T2_CH_CERN-89657-20200524073703 131 0]...
99%286 Success [crab3@vocms0195.cern.ch#52133252.0#1590449017 200525_175720:sciaba_crab_HC-94-T2_CH_CERN-89657-20200524073703 65 0]...
1 Failed, Removed due to memory use [crab3@vocms0194.cern.ch#53087659.0#1590534240 200526_195727:sciaba_crab_HC-94-T2_CH_CERN-89725-20200526035903 37 0]...
100%292 Success [crab3@vocms0194.cern.ch#53088367.0#1590535743 200526_195727:sciaba_crab_HC-94-T2_CH_CERN-89725-20200526035903 42 0]...
FTS Status: 86%Transfer (from/to): 77312/81096 files, 170.926/9.367 TB ok
Errors: src_missing_file: 10/0, trn_timeout: 1/23, trn_error: 822/112, dst_space: 0/34657 foreign: 5250/481
Links: 61/49 ok, 0/0 warning, 0/9 error, 0/1 unknown, 2/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
90%Transfer (from/to): 80454/37270 files, 130.707/10.064 TB ok
Errors: trn_timeout: 99/41, trn_user: 3591/111, trn_error: 200/96, dst_space: 0/16835 foreign: 7305/1368
Links: 58/49 ok, 0/0 warning, 0/9 error, 0/1 unknown, 2/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
92%Transfer (from/to): 79079/34567 files, 123.290/17.270 TB ok
Errors: src_error: 430/0, trn_timeout: 259/510, trn_user: 251/2044, trn_error: 711/73, dst_permission: 0/1, dst_space: 0/10155, dst_error: 0/17 foreign: 6631/11761
Links: 57/49 ok, 1/2 warning, 0/9 error, 0/1 unknown, 2/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
100%Transfer (from/to): 53776/37956 files, 26.183/3.545 TB ok
Errors: trn_timeout: 50/9, trn_user: 13393/0, trn_error: 75/20, dst_space: 0/412 foreign: 1580/52
Links: 60/58 ok, 0/0 warning, 0/0 error, 0/2 unknown, 2/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 38297/34509 files, 11.155/8.507 TB ok
Errors: src_error: 7/0, trn_timeout: 29/13, trn_user: 52142/776, trn_error: 92/193, dst_space: 0/96 foreign: 1891/3833
Links: 54/55 ok, 3/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 69838/35575 files, 14.876/11.808 TB ok
Errors: trn_timeout: 28/9, trn_user: 11028/141, trn_error: 885/17, dst_space: 0/16 foreign: 4723/561
Links: 58/53 ok, 1/1 warning, 0/1 error, 1/1 unknown, 2/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
94%Transfer (from/to): 51824/13995 files, 36.417/10.547 TB ok
Errors: src_error: 23/0, trn_timeout: 16/12, trn_user: 1504/0, trn_error: 40/277, dst_space: 0/29, dst_error: 0/1 foreign: 3694/56
Links: 56/53 ok, 1/1 warning, 0/2 error, 1/1 unknown, 3/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
92%Transfer (from/to): 67108/32793 files, 78.707/14.534 TB ok
Errors: src_error: 1/0, trn_timeout: 22/71, trn_user: 136/0, trn_error: 475/113, dst_space: 0/4632 foreign: 473/605
Links: 60/52 ok, 1/0 warning, 0/4 error, 1/1 unknown, 3/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 97330/37889 files, 143.347/83.578 TB ok
Errors: src_error: 254/0, trn_timeout: 34/6, trn_user: 24/3, trn_error: 397/336, dst_space: 0/3104 foreign: 3934/475
Links: 62/55 ok, 0/0 warning, 0/1 error, 1/2 unknown, 4/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 57144/54894 files, 64.501/46.520 TB ok
Errors: trn_timeout: 227/4, trn_user: 4/1302, trn_error: 286/390, dst_space: 0/158 foreign: 8276/10810
Links: 60/56 ok, 0/0 warning, 1/0 error, 0/2 unknown, 4/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 42529/23847 files, 32.054/14.516 TB ok
Errors: src_error: 15/0, trn_timeout: 92/1, trn_user: 186/4451, trn_error: 306/60, dst_permission: 0/5, dst_path: 0/1, dst_error: 0/1 foreign: 30564/26521
Links: 57/56 ok, 0/0 warning, 1/0 error, 1/2 unknown, 4/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
97%Transfer (from/to): 52905/23147 files, 60.207/4.747 TB ok
Errors: trn_timeout: 1/5, trn_user: 0/3, trn_error: 317/3 foreign: 3258/104
Links: 54/56 ok, 1/0 warning, 1/0 error, 0/2 unknown, 4/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
100%Transfer (from/to): 39486/49395 files, 57.858/73.337 TB ok
Errors: src_error: 28/0, trn_timeout: 2/11, trn_error: 285/102 foreign: 1124/163
Links: 56/56 ok, 0/0 warning, 0/0 error, 0/3 unknown, 4/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 40956/16722 files, 83.354/18.016 TB ok
Errors: trn_timeout: 15/34, trn_user: 24/27, trn_error: 193/42, dst_permission: 0/5, dst_space: 0/1168 foreign: 1546/206
Links: 57/56 ok, 1/0 warning, 0/0 error, 0/3 unknown, 4/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 62217/13747 files, 61.334/13.399 TB ok
Errors: src_error: 64/0, trn_timeout: 5/3, trn_user: 10727/19, trn_error: 298/63, dst_space: 0/1230 foreign: 1400/343
Links: 57/54 ok, 1/0 warning, 0/2 error, 0/3 unknown, 4/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 30460/11901 files, 33.569/5.256 TB ok
Errors: trn_timeout: 18/2, trn_user: 0/41, trn_error: 177/84, dst_space: 0/366 foreign: 1669/189
Links: 56/56 ok, 2/0 warning, 0/0 error, 0/4 unknown, 3/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
Site Readiness:
78%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (273 Success, no Chirp ExitCode ...; 22 Success ...),
FTS: ok (Links: 61/49 ok, 0/0 warning, 0/9 error, 0/1 unknown, 2/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
87%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (30 Success, no Chirp ExitCode ...; 248 Success ...),
FTS: ok (Links: 58/49 ok, 0/0 warning, 0/9 error, 0/1 unknown, 2/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
94%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...; 1 Failed, ExitCode 8006 ...),
FTS: ok (Links: 57/49 ok, 1/2 warning, 0/9 error, 0/1 unknown, 2/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
74%SAM: ok (15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...; 1 Failed, Removed due to memory use ...),
FTS: ok (Links: 60/58 ok, 0/0 warning, 0/0 error, 0/2 unknown, 2/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (469 Success ...),
FTS: ok (Links: 54/55 ok, 3/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
97%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (300 Success ...),
FTS: ok (Links: 58/53 ok, 1/1 warning, 0/1 error, 1/1 unknown, 2/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
31%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (87 Success ...),
FTS: ok (Links: 56/53 ok, 1/1 warning, 0/2 error, 1/1 unknown, 3/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
99%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...),
FTS: ok (Links: 60/52 ok, 1/0 warning, 0/4 error, 1/1 unknown, 3/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
94%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (287 Success ...),
FTS: ok (Links: 62/55 ok, 0/0 warning, 0/1 error, 1/2 unknown, 4/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
99%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...),
FTS: ok (Links: 60/56 ok, 0/0 warning, 1/0 error, 0/2 unknown, 4/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
93%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...; 1 Failed, Removed due to memory use ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 57/56 ok, 0/0 warning, 1/0 error, 1/2 unknown, 4/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
99%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 54/56 ok, 1/0 warning, 1/0 error, 0/2 unknown, 4/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
95%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (274 Success ...; 2 Failed, Removed due to memory use ...),
FTS: ok (Links: 56/56 ok, 0/0 warning, 0/0 error, 0/3 unknown, 4/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
97%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...; 1 Failed, Removed due to memory use ...),
FTS: ok (Links: 57/56 ok, 1/0 warning, 0/0 error, 0/3 unknown, 4/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
95%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (286 Success ...; 1 Failed, Removed due to memory use ...),
FTS: ok (Links: 57/54 ok, 1/0 warning, 0/2 error, 0/3 unknown, 4/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
68%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 56/56 ok, 2/0 warning, 0/0 error, 0/4 unknown, 3/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_CH_CERN_HLT
GGUS Tickets:
Downtimes:
Site Readiness:
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_CH_CSCS
GGUS Tickets:
Downtimes: Dstorage01.lcg.cscs.ch/SE, storage01.lcg.cscs.ch/SE, all CEs (arc04.lcg.cscs.ch, arc05.lcg.cscs.ch) Dstorage01.lcg.cscs.ch/SE, storage01.lcg.cscs.ch/SE, all CEs (arc04.lcg.cscs.ch, arc05.lcg.cscs.ch) Ustorage01.lcg.cscs.ch/SE, storage01.lcg.cscs.ch/SE, arc04.lcg.cscs.ch/CE, arc05.lcg.cscs.ch/CE Dstorage01.lcg.cscs.ch/SE, storage01.lcg.cscs.ch/SE, all CEs (arc04.lcg.cscs.ch, arc05.lcg.cscs.ch) Dstorage01.lcg.cscs.ch/SE, storage01.lcg.cscs.ch/SE, all CEs (arc04.lcg.cscs.ch, arc05.lcg.cscs.ch) Dstorage01.lcg.cscs.ch/SE, storage01.lcg.cscs.ch/SE, all CEs (arc04.lcg.cscs.ch, arc05.lcg.cscs.ch) Dstorage01.lcg.cscs.ch/SE, storage01.lcg.cscs.ch/SE, all CEs (arc04.lcg.cscs.ch, arc05.lcg.cscs.ch) Dstorage01.lcg.cscs.ch/SE, storage01.lcg.cscs.ch/SE, all CEs (arc04.lcg.cscs.ch, arc05.lcg.cscs.ch) Dstorage01.lcg.cscs.ch/SE, storage01.lcg.cscs.ch/SE, all CEs (arc04.lcg.cscs.ch, arc05.lcg.cscs.ch)
SAM Status: 95%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (18h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (19h30m) 30%15min evaluations: 29 ok, 0 warning, 66 error, 1 unknown, 0 downtime (0h0m) 0%15min evaluations: 0 ok, 0 warning, 23 error, 8 unknown, 65 downtime (16h15m) n/a15min evaluations: 0 ok, 0 warning, 0 error, 0 unknown, 96 downtime (24h0m) n/a15min evaluations: 0 ok, 0 warning, 0 error, 0 unknown, 96 downtime (24h0m) n/a15min evaluations: 0 ok, 0 warning, 0 error, 0 unknown, 96 downtime (24h0m) n/a15min evaluations: 0 ok, 0 warning, 0 error, 0 unknown, 96 downtime (24h0m) 0%15min evaluations: 29 ok, 0 warning, 2 error, 41 unknown, 24 downtime (13h15m) 100%15min evaluations: 77 ok, 0 warning, 0 error, 19 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 78%15min evaluations: 75 ok, 0 warning, 20 error, 0 unknown, 0 downtime (0h0m) 95%15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 69%15min evaluations: 66 ok, 0 warning, 29 error, 1 unknown, 0 downtime (0h0m) 85%15min evaluations: 77 ok, 0 warning, 13 error, 6 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%78 Success [crab3@vocms0106.cern.ch#43072160.0#1589240461 200511_084417:sciaba_crab_HC-98-T2_CH_CSCS-89104-20200510164704 179 0]... 100%472 Success [crab3@vocms0120.cern.ch#52907406.0#1589300798 200512_143001:sciaba_crab_HC-98-T2_CH_CSCS-89177-20200512162105 23 0]... 98%93 Success [crab3@vocms0106.cern.ch#43177920.0#1589412437 200513_204544:sciaba_crab_HC-98-T2_CH_CSCS-89177-20200512162105 32 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0120.cern.ch#52963043.0#1589329306 200512_143001:sciaba_crab_HC-98-T2_CH_CSCS-89177-20200512162105 118 0]...
? ? ? ? ? 100%155 Success [crab3@vocms0198.cern.ch#48688240.0#1589982182 200520_103151:sciaba_crab_HC-98-T2_CH_CSCS-89513-20200520122503 38 0]... 99%290 Success [crab3@vocms0198.cern.ch#48711935.0#1590017592 200520_103151:sciaba_crab_HC-98-T2_CH_CSCS-89513-20200520122503 156 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0122.cern.ch#57724749.0#1590053648 200521_044240:sciaba_crab_HC-98-T2_CH_CSCS-89513-20200520122503 58 0]...
100%277 Success [crab3@vocms0155.cern.ch#55519472.0#1590104070 200521_224843:sciaba_crab_HC-98-T2_CH_CSCS-89513-20200520122503 9 0]... 100%298 Success [crab3@vocms0194.cern.ch#52987949.0#1590190038 200522_095127:sciaba_crab_HC-98-T2_CH_CSCS-89587-20200522114903 163 0]... 100%281 Success [crab3@vocms0121.cern.ch#54108769.0#1590276476 200523_215150:sciaba_crab_HC-98-T2_CH_CSCS-89587-20200522114903 19 0]... 100%297 Success [crab3@vocms0197.cern.ch#52380129.0#1590363235 200524_074237:sciaba_crab_HC-98-T2_CH_CSCS-89660-20200524093703 190 0]... 96%279 Success [crab3@vocms0198.cern.ch#48887656.0#1590449513 200525_194538:sciaba_crab_HC-98-T2_CH_CSCS-89660-20200524093703 45 0]...
9 Failed, ExitCode 8021 [crab3@vocms0197.cern.ch#52478211.0#1590500970 200526_052257:sciaba_crab_HC-98-T2_CH_CSCS-89730-20200526071903 101 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0197.cern.ch#52481701.0#1590512377 200526_052257:sciaba_crab_HC-98-T2_CH_CSCS-89730-20200526071903 139 0]...
100%292 Success [crab3@vocms0197.cern.ch#52487337.0#1590535777 200526_052257:sciaba_crab_HC-98-T2_CH_CSCS-89730-20200526071903 217 0]...
FTS Status: 98%Transfer (from/to): 4365/459 files, 2.278/0.935 TB ok
Errors: src_permission: 6/0, trn_timeout: 2/30, trn_error: 759/0, dst_permission: 0/1, dst_path: 0/1 foreign: 2421/10
Links: 45/48 ok, 1/2 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
100%Transfer (from/to): 933/11803 files, 0.655/32.208 TB ok
Errors: src_error: 88/0, trn_timeout: 12/122, trn_error: 5/13, dst_permission: 0/6 foreign: 4/131
Links: 44/49 ok, 0/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
99%Transfer (from/to): 2776/576 files, 0.585/1.302 TB ok
Errors: src_error: 305/0, trn_timeout: 16/14, trn_error: 32/0 foreign: 394/1
Links: 46/47 ok, 1/0 warning, 1/0 error, 1/1 unknown, 1/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
100%Transfer (from/to): 3/1 files, 0.002/0.000 TB ok
Errors: trn_error: 8/0
Links: 3/1 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
storage01.lcg.cscs.ch: ok/warning
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 5/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
storage01.lcg.cscs.ch: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 5/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
storage01.lcg.cscs.ch: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 5/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
storage01.lcg.cscs.ch: unknown/unknown
91%Transfer (from/to): 5/104 files, 0.004/0.063 TB ok
Errors: trn_error: 7/37
Links: 3/12 ok, 1/0 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint
storage01.lcg.cscs.ch: warning/ok
96%Transfer (from/to): 2554/29436 files, 1.189/74.902 TB ok
Errors: trn_timeout: 0/46, trn_error: 22/276, dst_permission: 0/105, dst_error: 0/1 foreign: 29/95
Links: 49/52 ok, 2/2 warning, 0/1 error, 0/2 unknown, 3/1 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
98%Transfer (from/to): 8220/2163 files, 1.353/43.694 TB ok
Errors: src_error: 1364/0, trn_timeout: 0/31, trn_user: 0/2, trn_error: 18/0, dst_permission: 0/22, dst_path: 0/2 foreign: 2404/26
Links: 50/49 ok, 0/0 warning, 1/1 error, 0/2 unknown, 3/1 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
96%Transfer (from/to): 10422/9177 files, 1.088/17.906 TB ok
Errors: src_permission: 2/0, src_error: 14/0, trn_timeout: 1/35, trn_error: 9/13, dst_permission: 0/10, dst_path: 0/1 foreign: 1622/36
Links: 48/47 ok, 2/1 warning, 0/1 error, 1/2 unknown, 3/1 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
96%Transfer (from/to): 10254/11722 files, 1.070/25.991 TB ok
Errors: src_error: 4/0, trn_timeout: 0/10, trn_error: 12/345, dst_permission: 0/12, dst_path: 0/1 foreign: 2308/53
Links: 46/49 ok, 0/2 warning, 1/2 error, 0/1 unknown, 3/1 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
98%Transfer (from/to): 29511/4154 files, 27.033/15.765 TB ok
Errors: trn_timeout: 0/36, trn_error: 1156/4, dst_permission: 0/12 foreign: 6053/26
Links: 53/48 ok, 0/0 warning, 1/1 error, 0/2 unknown, 3/1 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
98%Transfer (from/to): 10106/3122 files, 7.282/8.501 TB ok
Errors: trn_timeout: 8/29, trn_error: 20/14, dst_permission: 0/18 foreign: 344/38
Links: 49/49 ok, 1/0 warning, 0/1 error, 0/2 unknown, 3/1 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
97%Transfer (from/to): 21768/1283 files, 5.881/3.985 TB ok
Errors: src_error: 1324/0, trn_timeout: 0/16, trn_error: 68/2, dst_path: 0/2 foreign: 1561/42
Links: 48/43 ok, 0/0 warning, 2/1 error, 0/3 unknown, 3/1 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
97%Transfer (from/to): 11017/727 files, 1.943/2.205 TB ok
Errors: trn_timeout: 1/16, trn_error: 73/6, dst_path: 0/2 foreign: 813/24
Links: 56/45 ok, 0/0 warning, 0/1 error, 1/3 unknown, 3/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
Site Readiness:
20%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (18h0m)),
HC: ok (78 Success ...),
FTS: ok (Links: 45/48 ok, 1/2 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
12%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (19h30m)),
HC: ok (472 Success ...),
FTS: ok (Links: 44/49 ok, 0/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
29%SAM: error (15min evaluations: 29 ok, 0 warning, 66 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (93 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 46/47 ok, 1/0 warning, 1/0 error, 1/1 unknown, 1/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok),
downtime: no scheduled downtime
0%SAM: downtime (15min evaluations: 0 ok, 0 warning, 23 error, 8 unknown, 65 downtime (16h15m)),
HC: unknown,
FTS: warning (Links: 3/1 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; storage01.lcg.cscs.ch: ok/warning)
0%SAM: downtime (15min evaluations: 0 ok, 0 warning, 0 error, 0 unknown, 96 downtime (24h0m)),
HC: unknown,
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; storage01.lcg.cscs.ch: unknown/unknown)
0%SAM: downtime (15min evaluations: 0 ok, 0 warning, 0 error, 0 unknown, 96 downtime (24h0m)),
HC: unknown,
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; storage01.lcg.cscs.ch: unknown/unknown)
0%SAM: downtime (15min evaluations: 0 ok, 0 warning, 0 error, 0 unknown, 96 downtime (24h0m)),
HC: unknown,
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; storage01.lcg.cscs.ch: unknown/unknown)
0%SAM: downtime (15min evaluations: 0 ok, 0 warning, 0 error, 0 unknown, 96 downtime (24h0m)),
HC: unknown,
FTS: warning (Links: 3/12 ok, 1/0 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint; storage01.lcg.cscs.ch: warning/ok)
0%SAM: downtime (15min evaluations: 29 ok, 0 warning, 2 error, 41 unknown, 24 downtime (13h15m)),
HC: ok (155 Success ...),
FTS: ok (Links: 49/52 ok, 2/2 warning, 0/1 error, 0/2 unknown, 3/1 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
69%SAM: ok (15min evaluations: 77 ok, 0 warning, 0 error, 19 unknown, 0 downtime (0h0m)),
HC: ok (290 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 50/49 ok, 0/0 warning, 1/1 error, 0/2 unknown, 3/1 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
95%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (277 Success ...),
FTS: ok (Links: 48/47 ok, 2/1 warning, 0/1 error, 1/2 unknown, 3/1 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
78%SAM: error (15min evaluations: 75 ok, 0 warning, 20 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (298 Success ...),
FTS: ok (Links: 46/49 ok, 0/2 warning, 1/2 error, 0/1 unknown, 3/1 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
93%SAM: ok (15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 53/48 ok, 0/0 warning, 1/1 error, 0/2 unknown, 3/1 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
99%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 49/49 ok, 1/0 warning, 0/1 error, 0/2 unknown, 3/1 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
57%SAM: error (15min evaluations: 66 ok, 0 warning, 29 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...; 9 Failed, ExitCode 8021 ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 48/43 ok, 0/0 warning, 2/1 error, 0/3 unknown, 3/1 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
43%SAM: warning (15min evaluations: 77 ok, 0 warning, 13 error, 6 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 56/45 ok, 0/0 warning, 0/1 error, 1/3 unknown, 3/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_CN_Beijing
GGUS Tickets: 146986
Downtimes: Dsrm.ihep.ac.cn/SE, all CEs (cce.ihep.ac.cn)
SAM Status: 97%15min evaluations: 79 ok, 0 warning, 1 error, 0 unknown, 16 downtime (12h0m) 100%15min evaluations: 79 ok, 0 warning, 0 error, 17 unknown, 0 downtime (0h0m) 100%15min evaluations: 80 ok, 0 warning, 0 error, 16 unknown, 0 downtime (0h0m) 98%15min evaluations: 64 ok, 0 warning, 1 error, 31 unknown, 0 downtime (0h0m) 96%15min evaluations: 81 ok, 0 warning, 3 error, 12 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 2 warning, 0 error, 2 unknown, 0 downtime (0h0m) 95%15min evaluations: 71 ok, 0 warning, 3 error, 22 unknown, 0 downtime (0h0m) 100%15min evaluations: 75 ok, 0 warning, 0 error, 21 unknown, 0 downtime (0h0m) 95%15min evaluations: 76 ok, 3 warning, 4 error, 13 unknown, 0 downtime (0h0m) 100%15min evaluations: 85 ok, 0 warning, 0 error, 11 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 85 ok, 2 warning, 1 error, 7 unknown, 0 downtime (0h0m) 94%15min evaluations: 50 ok, 0 warning, 3 error, 43 unknown, 0 downtime (0h0m) 98%15min evaluations: 70 ok, 0 warning, 1 error, 24 unknown, 0 downtime (0h0m) 100%15min evaluations: 62 ok, 0 warning, 0 error, 34 unknown, 0 downtime (0h0m) 100%15min evaluations: 61 ok, 0 warning, 0 error, 35 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%332 Success [crab3@vocms0120.cern.ch#52850450.0#1589208542 200510_202229:sciaba_crab_HC-100-T2_CN_Beijing-89108-20200510221704 221 0]... 100%301 Success [crab3@vocms0119.cern.ch#53631277.0#1589315929 200512_201305:sciaba_crab_HC-100-T2_CN_Beijing-89186-20200512220905 5 0]... 100%291 Success [crab3@vocms0195.cern.ch#51739987.0#1589413281 200513_141456:sciaba_crab_HC-100-T2_CN_Beijing-89186-20200512220905 113 0]... 100%283 Success [crab3@vocms0107.cern.ch#55100225.0#1589499798 200514_082208:sciaba_crab_HC-100-T2_CN_Beijing-89186-20200512220905 184 0]... 100%312 Success [crab3@vocms0121.cern.ch#53745279.0#1589586065 200515_183321:sciaba_crab_HC-100-T2_CN_Beijing-89269-20200515022704 61 0]... 100%295 Success [crab3@vocms0199.cern.ch#12986903.0#1589672489 200516_103359:sciaba_crab_HC-100-T2_CN_Beijing-89364-20200516122803 157 0]... 100%84 Success [crab3@vocms0122.cern.ch#57587524.0#1589759064 200517_223311:sciaba_crab_HC-100-T2_CN_Beijing-89364-20200516122803 14 0]... 100%288 Success [crab3@vocms0196.cern.ch#52489585.0#1589846833 200518_235614:sciaba_crab_HC-100-T2_CN_Beijing-89428-20200518075303 2 0]... 100%277 Success [crab3@vocms0144.cern.ch#55424889.0#1589931816 200519_180205:sciaba_crab_HC-100-T2_CN_Beijing-89428-20200518075303 68 0]... 100%296 Success [crab3@vocms0137.cern.ch#51626184.0#1590018094 200520_054012:sciaba_crab_HC-100-T2_CN_Beijing-89505-20200520073502 216 0]... 100%285 Success [crab3@vocms0196.cern.ch#52563574.0#1590104503 200521_175058:sciaba_crab_HC-100-T2_CN_Beijing-89505-20200520073502 70 0]... 100%292 Success [crab3@vocms0144.cern.ch#55530172.0#1590190984 200522_220721:sciaba_crab_HC-100-T2_CN_Beijing-89578-20200522055502 19 0]... 100%286 Success [crab3@vocms0137.cern.ch#51753549.0#1590277237 200523_160935:sciaba_crab_HC-100-T2_CN_Beijing-89578-20200522055502 90 0]... 100%291 Success [crab3@vocms0120.cern.ch#53557642.0#1590363740 200524_181611:sciaba_crab_HC-100-T2_CN_Beijing-89640-20200524021103 65 0]... 100%285 Success [crab3@vocms0121.cern.ch#54160855.0#1590450119 200525_122522:sciaba_crab_HC-100-T2_CN_Beijing-89640-20200524021103 135 0]... 100%192 Success [crab3@vocms0194.cern.ch#53088454.0#1590536549 200526_210622:sciaba_crab_HC-100-T2_CN_Beijing-89727-20200526050103 31 0]...
FTS Status: 84%Transfer (from/to): 538/9500 files, 0.082/2.666 TB ok
Errors: src_missing_file: 1/0, src_error: 4/0, trn_timeout: 12/7, trn_user: 2/8, trn_error: 7/131, dst_space: 0/42, dst_error: 0/1898 foreign: 0/62
Links: 9/12 ok, 7/2 warning, 2/1 error, 0/2 unknown, 1/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
81%Transfer (from/to): 379/11667 files, 0.017/2.324 TB ok
Errors: src_error: 1524/0, trn_timeout: 82/83, trn_user: 0/2, trn_error: 13/56, dst_error: 0/1964 foreign: 0/35
Links: 5/10 ok, 1/0 warning, 1/2 error, 1/0 unknown, 1/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
72%Transfer (from/to): 2137/5357 files, 0.126/0.736 TB ok
Errors: src_error: 570/0, trn_timeout: 411/106, trn_error: 1361/1995, dst_error: 0/1147 foreign: 153/39
Links: 7/10 ok, 0/0 warning, 4/4 error, 0/0 unknown, 1/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
81%Transfer (from/to): 578/16467 files, 0.995/2.676 TB ok
Errors: trn_timeout: 21/131, trn_user: 9/0, trn_error: 49/6685, dst_error: 0/678 foreign: 25/90
Links: 40/35 ok, 5/3 warning, 3/7 error, 0/3 unknown, 1/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
82%Transfer (from/to): 2319/2447 files, 2.901/0.795 TB ok
Errors: trn_timeout: 72/67, trn_user: 30/0, trn_error: 114/1733, dst_error: 0/18 foreign: 113/128
Links: 43/37 ok, 3/1 warning, 6/7 error, 0/2 unknown, 1/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
81%Transfer (from/to): 2281/245 files, 5.428/0.487 TB ok
Errors: trn_timeout: 174/46, trn_user: 36/0, trn_error: 225/557 foreign: 26/23
Links: 38/36 ok, 2/4 warning, 9/8 error, 1/2 unknown, 1/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
81%Transfer (from/to): 2259/3350 files, 4.799/1.438 TB ok
Errors: src_error: 72/0, trn_timeout: 65/234, trn_user: 24/0, trn_error: 96/2379, dst_permission: 0/1, dst_error: 0/1 foreign: 177/43
Links: 41/40 ok, 1/3 warning, 6/8 error, 1/2 unknown, 2/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
84%Transfer (from/to): 3915/1060 files, 9.008/0.731 TB ok
Errors: src_permission: 1/0, src_error: 24/0, trn_timeout: 75/16, trn_user: 22/0, trn_error: 104/550, dst_error: 0/1 foreign: 359/35
Links: 44/43 ok, 1/1 warning, 8/8 error, 0/1 unknown, 2/1 bad-endpoint
srm.ihep.ac.cn: ok/ok
82%Transfer (from/to): 2642/392 files, 5.589/0.637 TB ok
Errors: trn_timeout: 92/20, trn_user: 42/0, trn_error: 122/418 foreign: 324/28
Links: 45/35 ok, 1/2 warning, 8/7 error, 0/2 unknown, 3/1 bad-endpoint
srm.ihep.ac.cn: ok/ok
84%Transfer (from/to): 3316/290 files, 4.962/0.620 TB ok
Errors: src_error: 265/0, trn_timeout: 97/23, trn_user: 36/666, trn_error: 121/529 foreign: 499/999
Links: 43/36 ok, 0/1 warning, 8/6 error, 0/2 unknown, 2/1 bad-endpoint
srm.ihep.ac.cn: ok/ok
85%Transfer (from/to): 4634/2325 files, 10.861/0.530 TB ok
Errors: src_error: 112/0, trn_timeout: 65/35, trn_user: 69/38, trn_error: 140/2160, dst_error: 0/1 foreign: 448/58
Links: 43/36 ok, 1/2 warning, 7/5 error, 1/2 unknown, 3/1 bad-endpoint
srm.ihep.ac.cn: ok/ok
79%Transfer (from/to): 2218/700 files, 4.918/0.215 TB ok
Errors: trn_timeout: 49/9, trn_user: 4/0, trn_error: 615/307, dst_error: 0/1 foreign: 176/12
Links: 36/12 ok, 0/1 warning, 9/3 error, 1/1 unknown, 3/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
76%Transfer (from/to): 3623/505 files, 8.429/0.197 TB ok
Errors: trn_timeout: 80/24, trn_user: 37/0, trn_error: 995/421 foreign: 277/10
Links: 43/11 ok, 0/2 warning, 7/3 error, 1/1 unknown, 3/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
77%Transfer (from/to): 1426/146 files, 2.697/0.453 TB ok
Errors: trn_timeout: 48/6, trn_user: 30/0, trn_error: 534/506 foreign: 238/6
Links: 41/12 ok, 2/1 warning, 8/3 error, 0/1 unknown, 3/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
77%Transfer (from/to): 1133/1055 files, 1.387/1.815 TB ok
Errors: trn_timeout: 47/2, trn_user: 33/0, trn_error: 936/455 foreign: 169/10
Links: 42/14 ok, 0/0 warning, 8/4 error, 1/1 unknown, 3/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
83%Transfer (from/to): 861/1775 files, 0.715/0.356 TB ok
Errors: trn_timeout: 27/11, trn_user: 31/0, trn_error: 16/280, dst_error: 0/2 foreign: 108/11
Links: 44/12 ok, 4/1 warning, 6/2 error, 1/1 unknown, 2/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
Site Readiness:
12%SAM: ok (15min evaluations: 79 ok, 0 warning, 1 error, 0 unknown, 16 downtime (12h0m)),
HC: ok (332 Success ...),
FTS: ok (Links: 9/12 ok, 7/2 warning, 2/1 error, 0/2 unknown, 1/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
32%SAM: ok (15min evaluations: 79 ok, 0 warning, 0 error, 17 unknown, 0 downtime (0h0m)),
HC: ok (301 Success ...),
FTS: ok (Links: 5/10 ok, 1/0 warning, 1/2 error, 1/0 unknown, 1/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
62%SAM: ok (15min evaluations: 80 ok, 0 warning, 0 error, 16 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...),
FTS: ok (Links: 7/10 ok, 0/0 warning, 4/4 error, 0/0 unknown, 1/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
42%SAM: ok (15min evaluations: 64 ok, 0 warning, 1 error, 31 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...),
FTS: ok (Links: 40/35 ok, 5/3 warning, 3/7 error, 0/3 unknown, 1/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
72%SAM: ok (15min evaluations: 81 ok, 0 warning, 3 error, 12 unknown, 0 downtime (0h0m)),
HC: ok (312 Success ...),
FTS: ok (Links: 43/37 ok, 3/1 warning, 6/7 error, 0/2 unknown, 1/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
87%SAM: ok (15min evaluations: 92 ok, 2 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 38/36 ok, 2/4 warning, 9/8 error, 1/2 unknown, 1/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
26%SAM: ok (15min evaluations: 71 ok, 0 warning, 3 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (84 Success ...),
FTS: ok (Links: 41/40 ok, 1/3 warning, 6/8 error, 1/2 unknown, 2/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
75%SAM: ok (15min evaluations: 75 ok, 0 warning, 0 error, 21 unknown, 0 downtime (0h0m)),
HC: ok (288 Success ...),
FTS: ok (Links: 44/43 ok, 1/1 warning, 8/8 error, 0/1 unknown, 2/1 bad-endpoint; srm.ihep.ac.cn: ok/ok)
71%SAM: ok (15min evaluations: 76 ok, 3 warning, 4 error, 13 unknown, 0 downtime (0h0m)),
HC: ok (277 Success ...),
FTS: ok (Links: 45/35 ok, 1/2 warning, 8/7 error, 0/2 unknown, 3/1 bad-endpoint; srm.ihep.ac.cn: ok/ok)
74%SAM: ok (15min evaluations: 85 ok, 0 warning, 0 error, 11 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 43/36 ok, 0/1 warning, 8/6 error, 0/2 unknown, 2/1 bad-endpoint; srm.ihep.ac.cn: ok/ok)
94%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 43/36 ok, 1/2 warning, 7/5 error, 1/2 unknown, 3/1 bad-endpoint; srm.ihep.ac.cn: ok/ok)
80%SAM: ok (15min evaluations: 85 ok, 2 warning, 1 error, 7 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 36/12 ok, 0/1 warning, 9/3 error, 1/1 unknown, 3/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
36%SAM: ok (15min evaluations: 50 ok, 0 warning, 3 error, 43 unknown, 0 downtime (0h0m)),
HC: ok (286 Success ...),
FTS: ok (Links: 43/11 ok, 0/2 warning, 7/3 error, 1/1 unknown, 3/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
59%SAM: ok (15min evaluations: 70 ok, 0 warning, 1 error, 24 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...),
FTS: ok (Links: 41/12 ok, 2/1 warning, 8/3 error, 0/1 unknown, 3/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
56%SAM: ok (15min evaluations: 62 ok, 0 warning, 0 error, 34 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 42/14 ok, 0/0 warning, 8/4 error, 1/1 unknown, 3/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
33%SAM: ok (15min evaluations: 61 ok, 0 warning, 0 error, 35 unknown, 0 downtime (0h0m)),
HC: ok (192 Success ...),
FTS: ok (Links: 44/12 ok, 4/1 warning, 6/2 error, 1/1 unknown, 2/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_DE_DESY
GGUS Tickets: 146283
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 60 ok, 0 warning, 0 error, 36 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 83 ok, 0 warning, 0 error, 13 unknown, 0 downtime (0h0m) 100%15min evaluations: 90 ok, 1 warning, 0 error, 5 unknown, 0 downtime (0h0m) 100%15min evaluations: 79 ok, 0 warning, 0 error, 17 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 70 ok, 0 warning, 0 error, 24 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 62 ok, 0 warning, 0 error, 34 unknown, 0 downtime (0h0m) 100%15min evaluations: 85 ok, 0 warning, 0 error, 11 unknown, 0 downtime (0h0m) 100%15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%282 Success [crab3@vocms0155.cern.ch#55007675.0#1589238468 200511_084110:sciaba_crab_HC-98-T2_DE_DESY-89104-20200510164704 173 0]... 100%292 Success [crab3@vocms0196.cern.ch#52221047.0#1589326513 200512_142719:sciaba_crab_HC-98-T2_DE_DESY-89177-20200512162105 109 0]... 100%280 Success [crab3@vocms0120.cern.ch#53043472.0#1589412284 200513_082338:sciaba_crab_HC-98-T2_DE_DESY-89177-20200512162105 180 0]... 100%294 Success [crab3@vocms0197.cern.ch#51966677.0#1589498324 200514_161234:sciaba_crab_HC-98-T2_DE_DESY-89258-20200514180904 85 0]... 100%435 Success [crab3@vocms0122.cern.ch#57516763.0#1589586128 200515_100959:sciaba_crab_HC-98-T2_DE_DESY-89258-20200514180904 162 0]... 100%296 Success [crab3@vocms0199.cern.ch#12986779.0#1589671788 200516_103144:sciaba_crab_HC-98-T2_DE_DESY-89366-20200516122702 155 0]... 100%82 Success [crab3@vocms0196.cern.ch#52451778.0#1589758310 200517_225032:sciaba_crab_HC-98-T2_DE_DESY-89366-20200516122702 8 0]... 100%286 Success [crab3@vocms0122.cern.ch#57623540.0#1589846157 200518_234604:sciaba_crab_HC-98-T2_DE_DESY-89427-20200518075103 1 0]... 100%278 Success [crab3@vocms0194.cern.ch#52905562.0#1589930900 200519_175221:sciaba_crab_HC-98-T2_DE_DESY-89427-20200518075103 67 0]... 100%297 Success [crab3@vocms0198.cern.ch#48712001.0#1590018038 200520_102916:sciaba_crab_HC-98-T2_DE_DESY-89513-20200520122503 158 0]... 100%275 Success [crab3@vocms0155.cern.ch#55519210.0#1590103429 200521_222730:sciaba_crab_HC-98-T2_DE_DESY-89513-20200520122503 11 0]... 100%128 Success [crab3@vocms0195.cern.ch#52059870.0#1590190006 200522_095543:sciaba_crab_HC-98-T2_DE_DESY-89587-20200522114903 162 0]... 100%297 Success [crab3@vocms0137.cern.ch#51734645.0#1590227465 200523_040507:sciaba_crab_HC-98-T2_DE_DESY-89587-20200522114903 69 0]... 100%299 Success [crab3@vocms0198.cern.ch#48862689.0#1590362559 200524_074610:sciaba_crab_HC-98-T2_DE_DESY-89660-20200524093703 187 0]... 100%282 Success [crab3@vocms0199.cern.ch#13309349.0#1590449613 200525_194713:sciaba_crab_HC-98-T2_DE_DESY-89660-20200524093703 45 0]... 100%291 Success [crab3@vocms0137.cern.ch#51852173.0#1590535645 200526_052114:sciaba_crab_HC-98-T2_DE_DESY-89730-20200526071903 217 0]...
FTS Status: 97%Transfer (from/to): 4918/12164 files, 1.840/12.643 TB ok
Errors: src_permission: 4/0, src_error: 8/0, trn_timeout: 0/2, trn_user: 197/0, trn_error: 14/29, dst_error: 0/2 foreign: 18/66
Links: 33/29 ok, 1/1 warning, 1/0 error, 1/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
97%Transfer (from/to): 6440/11954 files, 1.703/6.373 TB ok
Errors: trn_timeout: 0/1, trn_user: 147/0, trn_error: 3/146 foreign: 62/23
Links: 31/29 ok, 0/0 warning, 0/1 error, 1/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
97%Transfer (from/to): 3731/29441 files, 4.703/12.080 TB ok
Errors: src_error: 36/0, trn_timeout: 40/9, trn_user: 165/0, trn_error: 47/226 foreign: 65/97
Links: 46/41 ok, 1/0 warning, 0/0 error, 2/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
98%Transfer (from/to): 4167/69205 files, 12.534/11.176 TB ok
Errors: trn_timeout: 6/2, trn_user: 291/0, trn_error: 4/89, dst_error: 0/2 foreign: 69/149
Links: 39/48 ok, 1/0 warning, 0/1 error, 2/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
95%Transfer (from/to): 14516/97478 files, 14.629/8.608 TB ok
Errors: src_error: 219/0, trn_timeout: 7/6, trn_user: 192/0, trn_error: 48/31, dst_permission: 0/1 foreign: 567/430
Links: 45/47 ok, 2/1 warning, 1/1 error, 1/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
96%Transfer (from/to): 6259/47640 files, 11.697/28.667 TB ok
Errors: src_error: 3218/0, trn_timeout: 113/10, trn_user: 149/296, trn_error: 61/33, dst_permission: 0/1, dst_error: 0/6 foreign: 307/1092
Links: 45/44 ok, 1/0 warning, 2/1 error, 1/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
98%Transfer (from/to): 11214/33377 files, 10.226/51.841 TB ok
Errors: src_error: 175/0, trn_timeout: 90/68, trn_user: 184/0, trn_error: 25/23, dst_error: 0/13 foreign: 55/869
Links: 50/49 ok, 0/1 warning, 0/0 error, 3/0 unknown, 2/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
96%Transfer (from/to): 16718/28142 files, 27.505/58.625 TB ok
Errors: src_error: 72594/0, trn_timeout: 44/2, trn_user: 191/0, trn_error: 179/9, dst_error: 0/9 foreign: 1769/718
Links: 49/46 ok, 1/0 warning, 1/0 error, 1/0 unknown, 2/1 bad-endpoint
dcache-se-cms.desy.de: ok/ok
100%Transfer (from/to): 16506/17502 files, 13.123/31.824 TB ok
Errors: src_error: 34/0, trn_timeout: 17/1, trn_user: 153/0, trn_error: 123/1, dst_error: 0/5 foreign: 249/642
Links: 49/47 ok, 0/0 warning, 0/0 error, 2/0 unknown, 3/1 bad-endpoint
dcache-se-cms.desy.de: ok/ok
97%Transfer (from/to): 7013/9005 files, 16.430/14.370 TB ok
Errors: src_error: 67/0, trn_timeout: 19/0, trn_user: 153/0, trn_error: 66/13, dst_error: 0/3 foreign: 602/41
Links: 38/45 ok, 1/0 warning, 0/0 error, 2/0 unknown, 3/1 bad-endpoint
dcache-se-cms.desy.de: ok/ok
97%Transfer (from/to): 11480/27094 files, 21.997/38.802 TB ok
Errors: trn_timeout: 89/13, trn_user: 118/0, trn_error: 76/15, dst_error: 0/13 foreign: 1626/49
Links: 44/50 ok, 0/0 warning, 1/0 error, 1/0 unknown, 3/1 bad-endpoint
dcache-se-cms.desy.de: ok/ok
97%Transfer (from/to): 8792/17564 files, 18.348/5.109 TB ok
Errors: src_error: 17/0, trn_timeout: 44/9, trn_user: 178/12, trn_error: 153/18, dst_error: 0/3 foreign: 1453/269
Links: 35/43 ok, 1/0 warning, 0/1 error, 2/0 unknown, 3/1 bad-endpoint
dcache-se-cms.desy.de: ok/ok
100%Transfer (from/to): 7537/27986 files, 16.784/35.649 TB ok
Errors: src_error: 203/0, trn_timeout: 197/26, trn_user: 75/0, trn_error: 128/39, dst_error: 0/30 foreign: 1206/164
Links: 44/50 ok, 0/0 warning, 0/0 error, 2/0 unknown, 3/1 bad-endpoint
dcache-se-cms.desy.de: ok/ok
100%Transfer (from/to): 13936/26482 files, 31.341/48.134 TB ok
Errors: src_error: 143/0, trn_timeout: 215/18, trn_user: 79/0, trn_error: 7/68, dst_error: 0/4 foreign: 1690/300
Links: 43/49 ok, 0/0 warning, 0/0 error, 1/0 unknown, 3/1 bad-endpoint
dcache-se-cms.desy.de: ok/ok
97%Transfer (from/to): 4748/27313 files, 11.249/26.870 TB ok
Errors: src_missing_file: 5/0, trn_timeout: 68/11, trn_user: 60/0, trn_error: 20/162, dst_error: 0/3 foreign: 1223/404
Links: 35/52 ok, 0/0 warning, 1/0 error, 5/0 unknown, 3/1 bad-endpoint
dcache-se-cms.desy.de: ok/ok
97%Transfer (from/to): 2660/12760 files, 5.436/6.456 TB ok
Errors: trn_timeout: 46/14, trn_user: 38/0, trn_error: 4/20, dst_error: 0/1 foreign: 991/84
Links: 37/52 ok, 0/0 warning, 1/0 error, 2/0 unknown, 2/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
Site Readiness:
97%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 33/29 ok, 1/1 warning, 1/0 error, 1/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
88%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 31/29 ok, 0/0 warning, 0/1 error, 1/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
93%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 46/41 ok, 1/0 warning, 0/0 error, 2/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
62%SAM: ok (15min evaluations: 60 ok, 0 warning, 0 error, 36 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 39/48 ok, 1/0 warning, 0/1 error, 2/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
97%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (435 Success ...),
FTS: ok (Links: 45/47 ok, 2/1 warning, 1/1 error, 1/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 45/44 ok, 1/0 warning, 2/1 error, 1/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
26%SAM: ok (15min evaluations: 83 ok, 0 warning, 0 error, 13 unknown, 0 downtime (0h0m)),
HC: ok (82 Success ...),
FTS: ok (Links: 50/49 ok, 0/1 warning, 0/0 error, 3/0 unknown, 2/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
91%SAM: ok (15min evaluations: 90 ok, 1 warning, 0 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (286 Success ...),
FTS: ok (Links: 49/46 ok, 1/0 warning, 1/0 error, 1/0 unknown, 2/1 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
79%SAM: ok (15min evaluations: 79 ok, 0 warning, 0 error, 17 unknown, 0 downtime (0h0m)),
HC: ok (278 Success ...),
FTS: ok (Links: 49/47 ok, 0/0 warning, 0/0 error, 2/0 unknown, 3/1 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
95%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 38/45 ok, 1/0 warning, 0/0 error, 2/0 unknown, 3/1 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
94%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (275 Success ...),
FTS: ok (Links: 44/50 ok, 0/0 warning, 1/0 error, 1/0 unknown, 3/1 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
37%SAM: ok (15min evaluations: 70 ok, 0 warning, 0 error, 24 unknown, 0 downtime (0h0m)),
HC: ok (128 Success ...),
FTS: ok (Links: 35/43 ok, 1/0 warning, 0/1 error, 2/0 unknown, 3/1 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
72%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 44/50 ok, 0/0 warning, 0/0 error, 2/0 unknown, 3/1 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
61%SAM: ok (15min evaluations: 62 ok, 0 warning, 0 error, 34 unknown, 0 downtime (0h0m)),
HC: ok (299 Success ...),
FTS: ok (Links: 43/49 ok, 0/0 warning, 0/0 error, 1/0 unknown, 3/1 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
86%SAM: ok (15min evaluations: 85 ok, 0 warning, 0 error, 11 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 35/52 ok, 0/0 warning, 1/0 error, 5/0 unknown, 3/1 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
58%SAM: ok (15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...),
FTS: ok (Links: 37/52 ok, 0/0 warning, 1/0 error, 2/0 unknown, 2/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_DE_RWTH
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 3 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 85%15min evaluations: 81 ok, 0 warning, 14 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)
Hammer Cloud: 99%278 Success [crab3@vocms0137.cern.ch#51188747.0#1589240062 200511_084258:sciaba_crab_HC-98-T2_DE_RWTH-89104-20200510164704 178 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0137.cern.ch#51192933.0#1589244862 200511_084258:sciaba_crab_HC-98-T2_DE_RWTH-89104-20200510164704 194 0]...
1 Failed, ExitCode 8002 [crab3@vocms0144.cern.ch#55128587.0#1589283885 200512_024810:sciaba_crab_HC-98-T2_DE_RWTH-89104-20200510164704 107 0]...
100%293 Success [crab3@vocms0120.cern.ch#52960891.0#1589326608 200512_142415:sciaba_crab_HC-98-T2_DE_RWTH-89177-20200512162105 110 0]... 100%284 Success [crab3@vocms0144.cern.ch#55214798.0#1589412133 200513_082030:sciaba_crab_HC-98-T2_DE_RWTH-89177-20200512162105 180 0]... 100%294 Success [crab3@vocms0137.cern.ch#51439977.0#1589497340 200514_161108:sciaba_crab_HC-98-T2_DE_RWTH-89258-20200514180904 82 0]... 99%431 Success [crab3@vocms0199.cern.ch#12906114.0#1589585999 200515_100810:sciaba_crab_HC-98-T2_DE_RWTH-89258-20200514180904 162 0]...
3 Failed, ExitCode 8002 [crab3@vocms0122.cern.ch#57540463.0#1589634009 200516_041250:sciaba_crab_HC-98-T2_DE_RWTH-89258-20200514180904 105 0]...
100%298 Success [crab3@vocms0122.cern.ch#57552113.0#1589671713 200516_102931:sciaba_crab_HC-98-T2_DE_RWTH-89366-20200516122702 154 0]... 100%85 Success [crab3@vocms0195.cern.ch#51900859.0#1589758214 200517_222932:sciaba_crab_HC-98-T2_DE_RWTH-89366-20200516122702 12 0]... 100%287 Success [crab3@vocms0198.cern.ch#48644911.0#1589845857 200518_234506:sciaba_crab_HC-98-T2_DE_RWTH-89427-20200518075103 1 0]... 98%275 Success [crab3@vocms0106.cern.ch#43296144.0#1589929663 200519_175141:sciaba_crab_HC-98-T2_DE_RWTH-89427-20200518075103 63 0]...
2 Failed, ExitCode 8021 [crab3@vocms0107.cern.ch#55289196.0#1589980690 200520_102706:sciaba_crab_HC-98-T2_DE_RWTH-89513-20200520122503 34 0]...
2 Failed, ExitCode 8002 [crab3@vocms0107.cern.ch#55301366.0#1590005896 200520_102706:sciaba_crab_HC-98-T2_DE_RWTH-89513-20200520122503 118 0]...
100%298 Success [crab3@vocms0107.cern.ch#55303155.0#1590017295 200520_102706:sciaba_crab_HC-98-T2_DE_RWTH-89513-20200520122503 156 0]... 98%275 Success [crab3@vocms0119.cern.ch#54100030.0#1590103165 200521_220840:sciaba_crab_HC-98-T2_DE_RWTH-89513-20200520122503 14 0]...
3 Failed, ExitCode 8002 [crab3@vocms0119.cern.ch#54112570.0#1590133174 200521_220840:sciaba_crab_HC-98-T2_DE_RWTH-89513-20200520122503 114 0]...
99%294 Success [crab3@vocms0107.cern.ch#55352167.0#1590190339 200522_095059:sciaba_crab_HC-98-T2_DE_RWTH-89587-20200522114903 164 0]...
2 Failed, ExitCode 8002 [crab3@vocms0107.cern.ch#55356462.0#1590198140 200522_095059:sciaba_crab_HC-98-T2_DE_RWTH-89587-20200522114903 190 0]...
100%279 Success [crab3@vocms0119.cern.ch#54172448.0#1590276726 200523_215110:sciaba_crab_HC-98-T2_DE_RWTH-89587-20200522114903 20 0]... 99%294 Success [crab3@vocms0199.cern.ch#13283766.0#1590363585 200524_074351:sciaba_crab_HC-98-T2_DE_RWTH-89660-20200524093703 191 0]...
1 Failed, ExitCode 8002 [crab3@vocms0198.cern.ch#48863557.0#1590371141 200525_013929:sciaba_crab_HC-98-T2_DE_RWTH-89660-20200524093703 1 0]...
100%274 Success [crab3@vocms0195.cern.ch#52133328.0#1590449557 200525_194619:sciaba_crab_HC-98-T2_DE_RWTH-89660-20200524093703 45 0]... 100%295 Success [crab3@vocms0137.cern.ch#51851975.0#1590535324 200526_052551:sciaba_crab_HC-98-T2_DE_RWTH-89730-20200526071903 215 0]...
FTS Status: 99%Transfer (from/to): 3464/4869 files, 1.512/11.149 TB ok
Errors: src_permission: 95/0, trn_timeout: 1/28, trn_error: 4/1, dst_error: 0/1 foreign: 2/1
Links: 39/36 ok, 0/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
99%Transfer (from/to): 4274/13024 files, 1.956/7.397 TB ok
Errors: trn_timeout: 0/15, trn_error: 9/4 foreign: 238/7
Links: 38/47 ok, 1/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
100%Transfer (from/to): 6980/2296 files, 2.927/2.775 TB ok
Errors: trn_timeout: 11/8, trn_error: 44/3 foreign: 640/10
Links: 45/39 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
99%Transfer (from/to): 17614/1390 files, 12.044/1.233 TB ok
Errors: src_error: 616/0, trn_timeout: 4/9, trn_error: 6/4, dst_error: 0/1 foreign: 50/0
Links: 41/40 ok, 0/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
98%Transfer (from/to): 17225/6013 files, 6.456/14.270 TB ok
Errors: src_error: 2806/0, trn_timeout: 5/15, trn_user: 2/0, trn_error: 4/2, dst_error: 0/1 foreign: 85/1
Links: 37/31 ok, 0/0 warning, 1/0 error, 1/0 unknown, 1/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
98%Transfer (from/to): 17788/7251 files, 8.142/21.230 TB ok
Errors: src_error: 663/0, trn_timeout: 6/17, trn_error: 23/5, dst_error: 0/2 foreign: 90/2
Links: 43/30 ok, 1/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
97%Transfer (from/to): 10070/7579 files, 11.966/21.415 TB ok
Errors: src_error: 518/0, trn_timeout: 24/0, trn_error: 41/3, dst_error: 0/1 foreign: 136/1
Links: 45/23 ok, 0/1 warning, 0/0 error, 2/0 unknown, 2/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
99%Transfer (from/to): 4931/7161 files, 12.622/20.713 TB ok
Errors: src_error: 132/0, trn_error: 12/0, dst_error: 0/2 foreign: 196/14
Links: 47/23 ok, 0/0 warning, 1/0 error, 0/0 unknown, 2/1 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
100%Transfer (from/to): 5046/7151 files, 9.597/20.786 TB ok
Errors: src_error: 8/0, trn_timeout: 2/0, trn_error: 18/2, dst_error: 0/8 foreign: 273/31
Links: 47/32 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
97%Transfer (from/to): 6241/7476 files, 11.899/21.211 TB ok
Errors: trn_timeout: 177/0, trn_user: 0/8, trn_error: 14/0 foreign: 1030/9
Links: 37/31 ok, 1/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
100%Transfer (from/to): 8686/5677 files, 12.941/14.797 TB ok
Errors: trn_timeout: 155/1, trn_error: 10/0 foreign: 1343/9
Links: 35/26 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
98%Transfer (from/to): 4208/7046 files, 1.291/20.574 TB ok
Errors: src_missing_file: 13/0, trn_timeout: 0/14, trn_error: 10/0 foreign: 882/8
Links: 29/17 ok, 2/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
96%Transfer (from/to): 4507/7012 files, 8.193/20.357 TB ok
Errors: trn_timeout: 22/38, trn_error: 4/1, dst_error: 0/1 foreign: 735/9
Links: 28/28 ok, 1/0 warning, 0/1 error, 0/0 unknown, 3/1 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
99%Transfer (from/to): 4471/7000 files, 1.746/18.272 TB ok
Errors: src_error: 24/0, trn_timeout: 0/37, trn_error: 3/5, dst_permission: 0/15, dst_error: 0/1 foreign: 1066/11
Links: 34/35 ok, 0/0 warning, 1/0 error, 0/0 unknown, 3/1 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
100%Transfer (from/to): 1135/7041 files, 0.507/19.273 TB ok
Errors: trn_timeout: 0/2, trn_error: 8/5 foreign: 1172/11
Links: 34/26 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
96%Transfer (from/to): 5087/4440 files, 0.671/11.820 TB ok
Errors: trn_timeout: 1/7, trn_error: 8/0, dst_error: 0/1 foreign: 130/155
Links: 24/29 ok, 1/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
Site Readiness:
92%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (278 Success ...; 1 Failed, Removed due to wall clock limit ...; 1 Failed, ExitCode 8002 ...),
FTS: ok (Links: 39/36 ok, 0/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
97%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 38/47 ok, 1/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
91%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 45/39 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
71%SAM: ok (15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 41/40 ok, 0/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
93%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (431 Success ...; 3 Failed, ExitCode 8002 ...),
FTS: ok (Links: 37/31 ok, 0/0 warning, 1/0 error, 1/0 unknown, 1/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
99%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (298 Success ...),
FTS: ok (Links: 43/30 ok, 1/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
28%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (85 Success ...),
FTS: ok (Links: 45/23 ok, 0/1 warning, 0/0 error, 2/0 unknown, 2/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
94%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (287 Success ...),
FTS: ok (Links: 47/23 ok, 0/0 warning, 1/0 error, 0/0 unknown, 2/1 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
91%SAM: ok (15min evaluations: 93 ok, 3 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (275 Success ...; 2 Failed, ExitCode 8021 ...; 2 Failed, ExitCode 8002 ...),
FTS: ok (Links: 47/32 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
91%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (298 Success ...),
FTS: ok (Links: 37/31 ok, 1/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
88%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (275 Success ...; 3 Failed, ExitCode 8002 ...),
FTS: ok (Links: 35/26 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
96%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...; 2 Failed, ExitCode 8002 ...),
FTS: ok (Links: 29/17 ok, 2/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
96%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 28/28 ok, 1/0 warning, 0/1 error, 0/0 unknown, 3/1 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
97%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...; 1 Failed, ExitCode 8002 ...),
FTS: ok (Links: 34/35 ok, 0/0 warning, 1/0 error, 0/0 unknown, 3/1 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
68%SAM: warning (15min evaluations: 81 ok, 0 warning, 14 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (274 Success ...),
FTS: ok (Links: 34/26 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
59%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 24/29 ok, 1/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_EE_Estonia
GGUS Tickets: 146559
Downtimes:
SAM Status: 94%15min evaluations: 91 ok, 0 warning, 5 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 61 ok, 0 warning, 0 error, 35 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 4 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 85 ok, 0 warning, 0 error, 11 unknown, 0 downtime (0h0m) 100%15min evaluations: 67 ok, 0 warning, 0 error, 29 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 83%15min evaluations: 78 ok, 0 warning, 15 error, 3 unknown, 0 downtime (0h0m)
Hammer Cloud: 98%284 Success [crab3@vocms0106.cern.ch#43071981.0#1589239921 200511_101050:sciaba_crab_HC-96-T2_EE_Estonia-89105-20200510180704 160 0]...
5 Failed, ExitCode 8021 [crab3@vocms0107.cern.ch#54966550.0#1589268678 200512_041957:sciaba_crab_HC-96-T2_EE_Estonia-89105-20200510180704 38 0]...
100%291 Success [crab3@vocms0199.cern.ch#12758331.0#1589326831 200512_201421:sciaba_crab_HC-96-T2_EE_Estonia-89185-20200512220704 41 0]... 100%286 Success [crab3@vocms0195.cern.ch#51739683.0#1589412681 200513_141447:sciaba_crab_HC-96-T2_EE_Estonia-89185-20200512220704 111 0]... 100%293 Success [crab3@vocms0107.cern.ch#55100224.0#1589499790 200514_193546:sciaba_crab_HC-96-T2_EE_Estonia-89262-20200514213103 49 0]... 100%448 Success [crab3@vocms0120.cern.ch#53124966.0#1589585168 200515_133454:sciaba_crab_HC-96-T2_EE_Estonia-89262-20200514213103 118 0]... 100%327 Success [crab3@vocms0196.cern.ch#52425202.0#1589672301 200516_074155:sciaba_crab_HC-96-T2_EE_Estonia-89262-20200514213103 191 0]... 100%236 Success [crab3@vocms0199.cern.ch#13026828.0#1589758566 200517_223000:sciaba_crab_HC-96-T2_EE_Estonia-89368-20200516122702 13 0]... 100%293 Success [crab3@vocms0197.cern.ch#52144251.0#1589844726 200518_112024:sciaba_crab_HC-96-T2_EE_Estonia-89439-20200518131702 146 0]... 100%280 Success [crab3@vocms0199.cern.ch#13088581.0#1589931944 200519_051855:sciaba_crab_HC-96-T2_EE_Estonia-89439-20200518131702 221 0]... 100%296 Success [crab3@vocms0121.cern.ch#53983607.0#1590016832 200520_143337:sciaba_crab_HC-96-T2_EE_Estonia-89519-20200520163301 105 0]... 100%267 Success [crab3@vocms0198.cern.ch#48762679.0#1590103589 200521_083008:sciaba_crab_HC-96-T2_EE_Estonia-89519-20200520163301 179 0]... 100%293 Success [crab3@vocms0137.cern.ch#51716735.0#1590190762 200522_153745:sciaba_crab_HC-96-T2_EE_Estonia-89594-20200522173103 96 0]... 100%284 Success [crab3@vocms0195.cern.ch#52093969.0#1590276272 200523_093336:sciaba_crab_HC-96-T2_EE_Estonia-89594-20200522173103 166 0]... 100%291 Success [crab3@vocms0199.cern.ch#13283778.0#1590363849 200524_194751:sciaba_crab_HC-96-T2_EE_Estonia-89673-20200524213903 47 0]... 100%283 Success [crab3@vocms0199.cern.ch#13309331.0#1590449310 200525_134718:sciaba_crab_HC-96-T2_EE_Estonia-89673-20200524213903 116 0]... 100%295 Success [crab3@vocms0119.cern.ch#54244728.0#1590535696 200526_200656:sciaba_crab_HC-96-T2_EE_Estonia-89750-20200526215903 40 0]...
FTS Status: 95%Transfer (from/to): 19348/2309 files, 1.502/6.355 TB ok
Errors: src_permission: 5/0, src_missing_file: 42/0, src_error: 2/0, trn_timeout: 2/1, trn_error: 50/1, dst_permission: 0/163, dst_path: 0/34, dst_error: 0/407 foreign: 1/9
Links: 48/41 ok, 3/6 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
97%Transfer (from/to): 23873/1771 files, 0.881/4.852 TB ok
Errors: src_missing_file: 5/0, src_error: 2/0, trn_timeout: 5/2, trn_user: 573/0, trn_error: 10/5, dst_permission: 0/391, dst_path: 0/1, dst_error: 0/933 foreign: 19/15
Links: 52/42 ok, 1/4 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
97%Transfer (from/to): 54846/1212 files, 11.320/3.295 TB ok
Errors: src_permission: 65/0, src_error: 5/0, trn_timeout: 44/1, trn_user: 507/0, trn_error: 281/2, dst_permission: 0/225, dst_error: 0/676 foreign: 1871/21
Links: 52/44 ok, 1/3 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
97%Transfer (from/to): 40766/1627 files, 2.987/4.713 TB ok
Errors: src_permission: 119/0, src_error: 11/0, trn_timeout: 38/6, trn_user: 2/0, trn_error: 1769/4, dst_permission: 0/394, dst_path: 0/2, dst_error: 0/599 foreign: 62/13
Links: 52/45 ok, 2/2 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
91%Transfer (from/to): 19150/2416 files, 4.063/5.328 TB ok
Errors: src_error: 1/0, trn_timeout: 6/4, trn_user: 4359/0, trn_error: 23/18, dst_permission: 0/542, dst_path: 0/16, dst_error: 0/1384 foreign: 35/500
Links: 50/44 ok, 2/6 warning, 0/4 error, 0/2 unknown, 1/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
95%Transfer (from/to): 11253/5050 files, 5.054/12.025 TB ok
Errors: src_error: 2/0, trn_timeout: 5/4, trn_user: 0/3, trn_error: 91/24, dst_permission: 0/1168, dst_path: 0/13, dst_error: 0/2095 foreign: 6/26
Links: 52/47 ok, 2/6 warning, 0/1 error, 0/2 unknown, 1/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
86%Transfer (from/to): 11418/3745 files, 5.362/8.027 TB ok
Errors: src_error: 3/0, trn_timeout: 26/4, trn_user: 802/0, trn_error: 22/13, dst_permission: 0/963, dst_path: 0/24, dst_error: 0/1728 foreign: 45/20
Links: 52/41 ok, 0/8 warning, 1/6 error, 1/1 unknown, 2/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
83%Transfer (from/to): 15764/5765 files, 16.162/13.860 TB ok
Errors: src_permission: 1/0, src_missing_file: 2/0, src_error: 15/0, trn_timeout: 117/4, trn_user: 159/1, trn_error: 96/13, dst_permission: 0/2477, dst_path: 0/24, dst_error: 0/3445 foreign: 161/45
Links: 53/39 ok, 1/7 warning, 0/8 error, 0/1 unknown, 2/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
99%Transfer (from/to): 16677/1841 files, 10.441/4.734 TB ok
Errors: trn_timeout: 13/0, trn_error: 136/1, dst_permission: 0/201, dst_path: 0/5, dst_error: 0/538 foreign: 390/46
Links: 51/47 ok, 2/5 warning, 0/0 error, 0/3 unknown, 3/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
97%Transfer (from/to): 11496/1232 files, 7.084/3.518 TB ok
Errors: trn_timeout: 10/0, trn_user: 263/0, trn_error: 89/1, dst_permission: 0/456, dst_error: 0/800 foreign: 775/39
Links: 50/46 ok, 1/0 warning, 0/1 error, 0/3 unknown, 3/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
92%Transfer (from/to): 22539/3437 files, 4.333/8.604 TB ok
Errors: src_error: 2/0, trn_timeout: 125/1, trn_user: 212/0, trn_error: 80/2, dst_permission: 0/983, dst_path: 0/9, dst_error: 0/1982 foreign: 1563/40
Links: 50/39 ok, 0/5 warning, 0/2 error, 1/2 unknown, 3/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
95%Transfer (from/to): 56646/7833 files, 7.838/18.001 TB ok
Errors: src_permission: 9/0, src_error: 8/0, trn_timeout: 4/3, trn_error: 71/7, dst_permission: 0/2068, dst_path: 0/37, dst_error: 0/2349 foreign: 2489/42
Links: 51/44 ok, 0/1 warning, 1/1 error, 0/3 unknown, 3/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
89%Transfer (from/to): 18486/5606 files, 13.545/17.793 TB ok
Errors: src_permission: 3/0, trn_timeout: 26/1, trn_error: 51/3, dst_permission: 0/2057, dst_path: 0/7, dst_error: 0/2282 foreign: 2160/276
Links: 52/44 ok, 1/1 warning, 0/4 error, 0/1 unknown, 3/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
93%Transfer (from/to): 22680/8661 files, 12.084/26.589 TB ok
Errors: src_error: 6/0, trn_timeout: 3/1, trn_user: 2/0, trn_error: 67/14, dst_permission: 0/3700, dst_path: 0/10, dst_error: 0/4530 foreign: 1873/41
Links: 53/43 ok, 1/0 warning, 0/3 error, 0/2 unknown, 3/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
99%Transfer (from/to): 13831/12139 files, 14.363/39.743 TB ok
Errors: src_permission: 2/0, src_missing_file: 2/0, src_error: 3/0, trn_timeout: 5/0, trn_user: 1795/0, trn_error: 64/138, dst_permission: 0/4955, dst_path: 0/13, dst_error: 0/4941 foreign: 1985/51
Links: 48/42 ok, 2/0 warning, 0/0 error, 0/3 unknown, 3/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
95%Transfer (from/to): 10242/2582 files, 2.409/8.323 TB ok
Errors: trn_timeout: 0/5, trn_error: 5/7, dst_permission: 0/874, dst_path: 0/7, dst_error: 0/1007 foreign: 835/28
Links: 53/40 ok, 1/1 warning, 0/1 error, 0/3 unknown, 2/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
Site Readiness:
64%SAM: ok (15min evaluations: 91 ok, 0 warning, 5 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...; 5 Failed, ExitCode 8021 ...),
FTS: ok (Links: 48/41 ok, 3/6 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
72%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...),
FTS: ok (Links: 52/42 ok, 1/4 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
85%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (286 Success ...),
FTS: ok (Links: 52/44 ok, 1/3 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
54%SAM: ok (15min evaluations: 61 ok, 0 warning, 0 error, 35 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 52/45 ok, 2/2 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
89%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (448 Success ...),
FTS: ok (Links: 50/44 ok, 2/6 warning, 0/4 error, 0/2 unknown, 1/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
90%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (327 Success ...),
FTS: ok (Links: 52/47 ok, 2/6 warning, 0/1 error, 0/2 unknown, 1/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
76%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (236 Success ...),
FTS: ok (Links: 52/41 ok, 0/8 warning, 1/6 error, 1/1 unknown, 2/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
91%SAM: ok (15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 53/39 ok, 1/7 warning, 0/8 error, 0/1 unknown, 2/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
86%SAM: ok (15min evaluations: 92 ok, 4 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 51/47 ok, 2/5 warning, 0/0 error, 0/3 unknown, 3/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
66%SAM: ok (15min evaluations: 85 ok, 0 warning, 0 error, 11 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 50/46 ok, 1/0 warning, 0/1 error, 0/3 unknown, 3/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
52%SAM: ok (15min evaluations: 67 ok, 0 warning, 0 error, 29 unknown, 0 downtime (0h0m)),
HC: ok (267 Success ...),
FTS: ok (Links: 50/39 ok, 0/5 warning, 0/2 error, 1/2 unknown, 3/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
94%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 51/44 ok, 0/1 warning, 1/1 error, 0/3 unknown, 3/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
89%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 52/44 ok, 1/1 warning, 0/4 error, 0/1 unknown, 3/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
96%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...),
FTS: ok (Links: 53/43 ok, 1/0 warning, 0/3 error, 0/2 unknown, 3/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
81%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...),
FTS: ok (Links: 48/42 ok, 2/0 warning, 0/0 error, 0/3 unknown, 3/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
37%SAM: warning (15min evaluations: 78 ok, 0 warning, 15 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 53/40 ok, 1/1 warning, 0/1 error, 0/3 unknown, 2/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_ES_CIEMAT
GGUS Tickets:
Downtimes:
SAM Status: 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 73 ok, 0 warning, 0 error, 23 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 93%15min evaluations: 88 ok, 2 warning, 6 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 3 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 70 ok, 0 warning, 0 error, 26 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%281 Success [crab3@vocms0137.cern.ch#51188976.0#1589240162 200511_220955:sciaba_crab_HC-97-T2_ES_CIEMAT-89095-20200510115504 17 0]... 100%294 Success [crab3@vocms0197.cern.ch#51853284.0#1589326690 200512_125643:sciaba_crab_HC-97-T2_ES_CIEMAT-89174-20200512145505 128 0]... 100%285 Success [crab3@vocms0194.cern.ch#52663846.0#1589413030 200513_064544:sciaba_crab_HC-97-T2_ES_CIEMAT-89174-20200512145505 202 0]... 100%298 Success [crab3@vocms0197.cern.ch#51967307.0#1589499321 200514_092134:sciaba_crab_HC-97-T2_ES_CIEMAT-89248-20200514111904 170 0]... 99%436 Success [crab3@vocms0196.cern.ch#52390902.0#1589585910 200515_211450:sciaba_crab_HC-97-T2_ES_CIEMAT-89248-20200514111904 28 0]...
1 Failed, ExitCode 8021 [crab3@vocms0121.cern.ch#53772264.0#1589622049 200516_052441:sciaba_crab_HC-97-T2_ES_CIEMAT-89347-20200516072104 51 0]...
100%299 Success [crab3@vocms0121.cern.ch#53806772.0#1589672459 200516_052441:sciaba_crab_HC-97-T2_ES_CIEMAT-89347-20200516072104 219 0]... 100%273 Success [crab3@vocms0120.cern.ch#53251527.0#1589759230 200517_224604:sciaba_crab_HC-97-T2_ES_CIEMAT-89367-20200516122702 12 0]... 100%286 Success [crab3@vocms0137.cern.ch#51570744.0#1589845173 200518_081259:sciaba_crab_HC-97-T2_ES_CIEMAT-89436-20200518101102 185 0]... 100%283 Success [crab3@vocms0120.cern.ch#53329955.0#1589931526 200519_210759:sciaba_crab_HC-97-T2_ES_CIEMAT-89436-20200518101102 30 0]... 100%295 Success [crab3@vocms0199.cern.ch#13141880.0#1590018046 200520_092440:sciaba_crab_HC-97-T2_ES_CIEMAT-89509-20200520112303 171 0]... 100%279 Success [crab3@vocms0137.cern.ch#51674490.0#1590104139 200521_213416:sciaba_crab_HC-97-T2_ES_CIEMAT-89509-20200520112303 24 0]... 100%299 Success [crab3@vocms0195.cern.ch#52060038.0#1590190607 200522_061038:sciaba_crab_HC-97-T2_ES_CIEMAT-89583-20200522080703 209 0]... 100%281 Success [crab3@vocms0196.cern.ch#52656433.0#1590277080 200523_180048:sciaba_crab_HC-97-T2_ES_CIEMAT-89583-20200522080703 67 0]... 100%300 Success [crab3@vocms0199.cern.ch#13283756.0#1590363358 200524_085450:sciaba_crab_HC-97-T2_ES_CIEMAT-89662-20200524105303 176 0]... 100%280 Success [crab3@vocms0144.cern.ch#55630489.0#1590449912 200525_204657:sciaba_crab_HC-97-T2_ES_CIEMAT-89662-20200524105303 34 0]... 100%295 Success [crab3@vocms0144.cern.ch#55663596.0#1590536651 200526_134241:sciaba_crab_HC-97-T2_ES_CIEMAT-89745-20200526153903 120 0]...
FTS Status: 98%Transfer (from/to): 3099/10990 files, 1.771/15.472 TB ok
Errors: src_permission: 88/0, src_error: 15/0, trn_timeout: 95/307, trn_user: 16/0, trn_error: 27/70 foreign: 336/2
Links: 49/49 ok, 2/6 warning, 1/1 error, 1/0 unknown, 1/0 bad-endpoint
srm.ciemat.es: ok/ok
97%Transfer (from/to): 7097/2230 files, 4.163/5.355 TB ok
Errors: src_permission: 1/0, src_error: 94/0, trn_timeout: 183/86, trn_user: 2/0, trn_error: 31/6, dst_error: 0/1 foreign: 148/9
Links: 52/44 ok, 1/1 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
srm.ciemat.es: ok/ok
97%Transfer (from/to): 6082/2207 files, 6.161/5.774 TB ok
Errors: src_error: 1698/0, trn_timeout: 165/93, trn_user: 4/1, trn_error: 17/9, dst_error: 0/1 foreign: 227/19
Links: 52/48 ok, 1/4 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
srm.ciemat.es: ok/ok
98%Transfer (from/to): 18382/9129 files, 6.977/7.610 TB ok
Errors: src_permission: 2/0, src_error: 4914/0, trn_timeout: 4/164, trn_user: 4/0, trn_error: 737/4 foreign: 219/22
Links: 53/48 ok, 0/6 warning, 2/1 error, 0/0 unknown, 1/0 bad-endpoint
srm.ciemat.es: ok/ok
98%Transfer (from/to): 7123/3608 files, 11.953/4.986 TB ok
Errors: src_error: 244/0, trn_timeout: 6/128, trn_user: 1/0, trn_error: 20/9 foreign: 259/282
Links: 48/50 ok, 2/5 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
srm.ciemat.es: ok/ok
95%Transfer (from/to): 4772/2806 files, 4.010/16.749 TB ok
Errors: src_permission: 1/0, trn_timeout: 250/258, trn_user: 2/99, trn_error: 37/9, dst_permission: 0/9, dst_space: 0/1 foreign: 147/2
Links: 55/42 ok, 1/11 warning, 0/2 error, 0/0 unknown, 1/0 bad-endpoint
srm.ciemat.es: ok/ok
95%Transfer (from/to): 6417/20374 files, 5.737/28.560 TB ok
Errors: src_permission: 7/0, src_error: 270/0, trn_timeout: 45/166, trn_user: 2/193, trn_error: 10/11, dst_error: 0/1 foreign: 110/36
Links: 51/44 ok, 0/8 warning, 1/2 error, 2/0 unknown, 2/0 bad-endpoint
srm.ciemat.es: ok/ok
99%Transfer (from/to): 6532/2104 files, 4.958/29.425 TB ok
Errors: src_error: 262/0, trn_timeout: 23/112, trn_user: 4/138, trn_error: 14/13, dst_permission: 0/1 foreign: 170/26
Links: 54/34 ok, 0/15 warning, 2/0 error, 0/0 unknown, 2/1 bad-endpoint
srm.ciemat.es: ok/ok
98%Transfer (from/to): 5872/2976 files, 5.036/27.710 TB ok
Errors: trn_timeout: 2/115, trn_user: 6/184, trn_error: 42/2, dst_error: 0/1 foreign: 66/38
Links: 53/46 ok, 1/2 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
srm.ciemat.es: ok/ok
100%Transfer (from/to): 2398/5238 files, 4.516/18.423 TB ok
Errors: src_error: 9/0, trn_timeout: 2/76, trn_user: 1/0, trn_error: 10/4 foreign: 402/31
Links: 48/46 ok, 2/2 warning, 0/0 error, 1/2 unknown, 3/1 bad-endpoint
srm.ciemat.es: ok/ok
98%Transfer (from/to): 5624/5162 files, 9.526/13.231 TB ok
Errors: trn_timeout: 13/49, trn_error: 9/6, dst_permission: 0/1 foreign: 334/31
Links: 50/45 ok, 0/1 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint
srm.ciemat.es: ok/ok
97%Transfer (from/to): 2432/7950 files, 3.417/16.268 TB ok
Errors: src_missing_file: 23/0, trn_timeout: 0/21, trn_error: 12/104, dst_error: 0/1 foreign: 30/34
Links: 43/51 ok, 1/2 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
srm.ciemat.es: ok/ok
100%Transfer (from/to): 8730/4003 files, 21.584/11.890 TB ok
Errors: trn_timeout: 86/212, trn_error: 11/15, dst_permission: 0/4 foreign: 222/36
Links: 49/48 ok, 0/5 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint
srm.ciemat.es: ok/ok
100%Transfer (from/to): 3338/11968 files, 4.537/29.912 TB ok
Errors: trn_timeout: 9/393, trn_error: 14/10 foreign: 649/45
Links: 50/48 ok, 0/5 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint
srm.ciemat.es: ok/ok
99%Transfer (from/to): 3634/5485 files, 6.674/15.937 TB ok
Errors: src_error: 1584/0, trn_timeout: 13/84, trn_user: 1/0, trn_error: 12/5, dst_permission: 0/14 foreign: 529/68
Links: 52/44 ok, 1/5 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
srm.ciemat.es: ok/ok
100%Transfer (from/to): 832/7399 files, 1.558/22.927 TB ok
Errors: trn_timeout: 24/228, trn_user: 1/0, trn_error: 8/6 foreign: 22/1763
Links: 48/40 ok, 0/8 warning, 0/0 error, 1/3 unknown, 2/0 bad-endpoint
srm.ciemat.es: ok/ok
Site Readiness:
94%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 49/49 ok, 2/6 warning, 1/1 error, 1/0 unknown, 1/0 bad-endpoint; srm.ciemat.es: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 52/44 ok, 1/1 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; srm.ciemat.es: ok/ok)
94%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 52/48 ok, 1/4 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; srm.ciemat.es: ok/ok)
76%SAM: ok (15min evaluations: 73 ok, 0 warning, 0 error, 23 unknown, 0 downtime (0h0m)),
HC: ok (298 Success ...),
FTS: ok (Links: 53/48 ok, 0/6 warning, 2/1 error, 0/0 unknown, 1/0 bad-endpoint; srm.ciemat.es: ok/ok)
96%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (436 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 48/50 ok, 2/5 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; srm.ciemat.es: ok/ok)
93%SAM: ok (15min evaluations: 88 ok, 2 warning, 6 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (299 Success ...),
FTS: ok (Links: 55/42 ok, 1/11 warning, 0/2 error, 0/0 unknown, 1/0 bad-endpoint; srm.ciemat.es: ok/ok)
95%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (273 Success ...),
FTS: ok (Links: 51/44 ok, 0/8 warning, 1/2 error, 2/0 unknown, 2/0 bad-endpoint; srm.ciemat.es: ok/ok)
96%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (286 Success ...),
FTS: ok (Links: 54/34 ok, 0/15 warning, 2/0 error, 0/0 unknown, 2/1 bad-endpoint; srm.ciemat.es: ok/ok)
97%SAM: ok (15min evaluations: 93 ok, 3 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...),
FTS: ok (Links: 53/46 ok, 1/2 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; srm.ciemat.es: ok/ok)
93%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 48/46 ok, 2/2 warning, 0/0 error, 1/2 unknown, 3/1 bad-endpoint; srm.ciemat.es: ok/ok)
83%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 50/45 ok, 0/1 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint; srm.ciemat.es: ok/ok)
88%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (299 Success ...),
FTS: ok (Links: 43/51 ok, 1/2 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; srm.ciemat.es: ok/ok)
90%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 49/48 ok, 0/5 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint; srm.ciemat.es: ok/ok)
97%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (300 Success ...),
FTS: ok (Links: 50/48 ok, 0/5 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint; srm.ciemat.es: ok/ok)
90%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 52/44 ok, 1/5 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; srm.ciemat.es: ok/ok)
42%SAM: ok (15min evaluations: 70 ok, 0 warning, 0 error, 26 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 48/40 ok, 0/8 warning, 0/0 error, 1/3 unknown, 2/0 bad-endpoint; srm.ciemat.es: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_ES_IFCA
GGUS Tickets:
Downtimes: Ustorm.ifca.es/SE, arcce01.ifca.es/CE, arcce02.ifca.es/CE Dstorm.ifca.es/SE, all CEs (arcce01.ifca.es, arcce02.ifca.es)
SAM Status: 87%15min evaluations: 28 ok, 0 warning, 4 error, 64 unknown, 0 downtime (0h0m) 100%15min evaluations: 86 ok, 0 warning, 0 error, 10 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 60 ok, 0 warning, 0 error, 36 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 55%corrected due to Singularity being out-of-sync, 15min evaluations: 52 ok, 0 warning, 42 error, 2 unknown, 0 downtime (0h0m) 45%corrected due to Singularity being out-of-sync, 15min evaluations: 40 ok, 0 warning, 48 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 91%15min evaluations: 71 ok, 0 warning, 7 error, 18 unknown, 0 downtime (0h0m) 0%15min evaluations: 0 ok, 0 warning, 77 error, 19 unknown, 0 downtime (0h0m) 79%15min evaluations: 9 ok, 30 warning, 10 error, 46 unknown, 0 downtime (0h0m) 98%15min evaluations: 54 ok, 0 warning, 1 error, 40 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 97%15min evaluations: 89 ok, 0 warning, 2 error, 5 unknown, 0 downtime (0h0m)
Hammer Cloud: 89%280 Success [crab3@vocms0137.cern.ch#51185594.0#1589237934 200511_134725:sciaba_crab_HC-97-T2_ES_IFCA-89095-20200510115504 110 0]...
28 Failed, ExitCode 137 [crab3@vocms0137.cern.ch#51190568.0#1589240931 200511_134725:sciaba_crab_HC-97-T2_ES_IFCA-89095-20200510115504 120 0]...
1 Failed, ExitCode 8022 [crab3@vocms0137.cern.ch#51199866.0#1589256835 200511_134725:sciaba_crab_HC-97-T2_ES_IFCA-89095-20200510115504 173 0]...
3 Failed, Removed due to wall clock limit [crab3@vocms0137.cern.ch#51194546.0#1589248435 200511_134725:sciaba_crab_HC-97-T2_ES_IFCA-89095-20200510115504 145 0]...
1 Failed, ExitCode 10034 [crab3@vocms0106.cern.ch#43095796.0#1589286805 200512_075203:sciaba_crab_HC-97-T2_ES_IFCA-89095-20200510115504 56 0]...
98%295 Success [crab3@vocms0137.cern.ch#51258032.0#1589326468 200512_125748:sciaba_crab_HC-97-T2_ES_IFCA-89174-20200512145505 127 0]...
6 Failed, ExitCode 137 [crab3@vocms0137.cern.ch#51257327.0#1589325566 200512_125748:sciaba_crab_HC-97-T2_ES_IFCA-89174-20200512145505 124 0]...
99%278 Success [crab3@vocms0106.cern.ch#43178031.0#1589413373 200513_064631:sciaba_crab_HC-97-T2_ES_IFCA-89174-20200512145505 203 0]...
2 Failed, ExitCode 137 [crab3@vocms0197.cern.ch#51947740.0#1589467830 200514_092328:sciaba_crab_HC-97-T2_ES_IFCA-89248-20200514111904 65 0]...
100%296 Success [crab3@vocms0197.cern.ch#51966936.0#1589498732 200514_092328:sciaba_crab_HC-97-T2_ES_IFCA-89248-20200514111904 168 0]... 91%424 Success [crab3@vocms0194.cern.ch#52771947.0#1589585639 200515_213726:sciaba_crab_HC-97-T2_ES_IFCA-89248-20200514111904 23 0]...
36 Failed, ExitCode 137 [crab3@vocms0137.cern.ch#51498957.0#1589616290 200516_052321:sciaba_crab_HC-97-T2_ES_IFCA-89347-20200516072104 32 0]...
1 Failed, ExitCode 139 [crab3@vocms0137.cern.ch#51499391.0#1589619293 200516_052321:sciaba_crab_HC-97-T2_ES_IFCA-89347-20200516072104 42 0]...
1 Failed, ExitCode 8001 [crab3@vocms0197.cern.ch#52025943.0#1589626539 200516_103021:sciaba_crab_HC-97-T2_ES_IFCA-89367-20200516122702 4 0]...
86%289 Success [crab3@vocms0197.cern.ch#52059399.0#1589671551 200516_103021:sciaba_crab_HC-97-T2_ES_IFCA-89367-20200516122702 154 0]...
44 Failed, ExitCode 137 [crab3@vocms0120.cern.ch#53217495.0#1589699325 200517_043739:sciaba_crab_HC-97-T2_ES_IFCA-89367-20200516122702 30 0]...
1 Failed, ExitCode 139 [crab3@vocms0120.cern.ch#53225756.0#1589714029 200517_043739:sciaba_crab_HC-97-T2_ES_IFCA-89367-20200516122702 79 0]...
94%268 Success [crab3@vocms0195.cern.ch#51900819.0#1589757316 200517_224415:sciaba_crab_HC-97-T2_ES_IFCA-89367-20200516122702 6 0]...
10 Failed, GlobalPool periodic cleanup [crab3@vocms0119.cern.ch#53939643.0#1589803062 200518_081446:sciaba_crab_HC-97-T2_ES_IFCA-89436-20200518101102 44 0]...
5 Failed, ExitCode 8002 [crab3@vocms0119.cern.ch#53946841.0#1589819903 200518_081446:sciaba_crab_HC-97-T2_ES_IFCA-89436-20200518101102 100 0]...
96%294 Success [crab3@vocms0119.cern.ch#53968848.0#1589845070 200518_081446:sciaba_crab_HC-97-T2_ES_IFCA-89436-20200518101102 184 0]...
12 Failed, ExitCode 137 [crab3@vocms0197.cern.ch#52172855.0#1589907888 200519_020313:sciaba_crab_HC-97-T2_ES_IFCA-89436-20200518101102 180 0]...
94%15 Failed, ExitCode 137 [crab3@vocms0107.cern.ch#55282329.0#1589931688 200519_200540:sciaba_crab_HC-97-T2_ES_IFCA-89436-20200518101102 43 0]...
278 Success [crab3@vocms0107.cern.ch#55282273.0#1589931090 200519_200540:sciaba_crab_HC-97-T2_ES_IFCA-89436-20200518101102 41 0]...
89%297 Success [crab3@vocms0119.cern.ch#54058759.0#1590016801 200520_092359:sciaba_crab_HC-97-T2_ES_IFCA-89509-20200520112303 167 0]...
33 Failed, ExitCode 137 [crab3@vocms0119.cern.ch#54061654.0#1590027003 200520_092359:sciaba_crab_HC-97-T2_ES_IFCA-89509-20200520112303 201 0]...
2 Failed, ExitCode 8001 [crab3@vocms0198.cern.ch#48752083.0#1590079731 200521_031232:sciaba_crab_HC-97-T2_ES_IFCA-89509-20200520112303 163 0]...
94%257 Success [crab3@vocms0194.cern.ch#52949526.0#1590103498 200521_211352:sciaba_crab_HC-97-T2_ES_IFCA-89509-20200520112303 26 0]...
2 Failed, ExitCode 8021 [crab3@vocms0194.cern.ch#52954713.0#1590112201 200521_211352:sciaba_crab_HC-97-T2_ES_IFCA-89509-20200520112303 55 0]...
12 Failed, ExitCode 137 [crab3@vocms0194.cern.ch#52955237.0#1590113699 200521_211352:sciaba_crab_HC-97-T2_ES_IFCA-89509-20200520112303 60 0]...
? 76%52 Failed, ExitCode 137 [crab3@vocms0198.cern.ch#48851596.0#1590313934 200524_085607:sciaba_crab_HC-97-T2_ES_IFCA-89662-20200524105303 11 0]...
168 Success [crab3@vocms0198.cern.ch#48851135.0#1590311234 200524_085607:sciaba_crab_HC-97-T2_ES_IFCA-89662-20200524105303 2 0]...
94%296 Success [crab3@vocms0198.cern.ch#48862716.0#1590363143 200524_085607:sciaba_crab_HC-97-T2_ES_IFCA-89662-20200524105303 175 0]...
16 Failed, ExitCode 137 [crab3@vocms0198.cern.ch#48863308.0#1590366744 200524_085607:sciaba_crab_HC-97-T2_ES_IFCA-89662-20200524105303 187 0]...
82%258 Success [crab3@vocms0199.cern.ch#13309276.0#1590448404 200525_204713:sciaba_crab_HC-97-T2_ES_IFCA-89662-20200524105303 29 0]...
1 Failed, ExitCode 4 [crab3@vocms0199.cern.ch#13317329.0#1590489516 200525_204713:sciaba_crab_HC-97-T2_ES_IFCA-89662-20200524105303 166 0]...
48 Failed, ExitCode 137 [crab3@vocms0199.cern.ch#13322569.0#1590496414 200525_204713:sciaba_crab_HC-97-T2_ES_IFCA-89662-20200524105303 189 0]...
1 Failed, ExitCode 8022 [crab3@vocms0196.cern.ch#52745350.0#1590511348 200526_134200:sciaba_crab_HC-97-T2_ES_IFCA-89745-20200526153903 13 1]...
1 Failed, ExitCode 134 [crab3@vocms0196.cern.ch#52745429.0#1590511928 200526_134200:sciaba_crab_HC-97-T2_ES_IFCA-89745-20200526153903 31 1]...
1 Failed, ExitCode 8001 [crab3@vocms0196.cern.ch#52749012.0#1590521287 200526_134200:sciaba_crab_HC-97-T2_ES_IFCA-89745-20200526153903 69 0]...
2 Failed, Removed due to wall clock limit [crab3@vocms0196.cern.ch#52746954.0#1590514471 200526_134200:sciaba_crab_HC-97-T2_ES_IFCA-89745-20200526153903 18 1]...
76%285 Success [crab3@vocms0196.cern.ch#52753842.0#1590535092 200526_134200:sciaba_crab_HC-97-T2_ES_IFCA-89745-20200526153903 115 0]...
79 Failed, ExitCode 137 [crab3@vocms0196.cern.ch#52754898.0#1590537029 200526_134200:sciaba_crab_HC-97-T2_ES_IFCA-89745-20200526153903 110 1]...
2 Failed, Removed due to wall clock limit [crab3@vocms0196.cern.ch#52751869.0#1590529213 200526_134200:sciaba_crab_HC-97-T2_ES_IFCA-89745-20200526153903 43 1]...
4 Failed, ExitCode 8022 [crab3@vocms0196.cern.ch#52763546.0#1590548293 200526_134200:sciaba_crab_HC-97-T2_ES_IFCA-89745-20200526153903 159 0]...
1 Failed, ExitCode 7002 [crab3@vocms0196.cern.ch#52772632.0#1590562999 200526_134200:sciaba_crab_HC-97-T2_ES_IFCA-89745-20200526153903 208 0]...
2 Failed, ExitCode 139 [crab3@vocms0120.cern.ch#53627844.0#1590575074 200527_074834:sciaba_crab_HC-97-T2_ES_IFCA-89745-20200526153903 31 0]...
1 Failed, ExitCode 8001 [crab3@vocms0120.cern.ch#53632546.0#1590582275 200527_074834:sciaba_crab_HC-97-T2_ES_IFCA-89745-20200526153903 55 0]...
FTS Status: 0%Transfer (from/to): 4772/0 files, 8.234/0.000 TB ok
Errors: src_error: 11136/0, trn_timeout: 1/0, trn_error: 27/0 foreign: 1/0
Links: 13/0 ok, 3/0 warning, 5/0 error, 0/0 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/unknown
0%Transfer (from/to): 803/0 files, 0.330/0.000 TB ok
Errors: src_error: 3577/0, trn_timeout: 3/0, trn_error: 10/0 foreign: 3/0
Links: 14/0 ok, 0/0 warning, 7/0 error, 0/0 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/unknown
89%Transfer (from/to): 2696/1458 files, 9.179/4.195 TB ok
Errors: src_error: 509/0, trn_timeout: 1/491, trn_error: 5/25, dst_permission: 0/4, dst_path: 0/54, dst_error: 0/4 foreign: 4/19
Links: 17/43 ok, 2/8 warning, 3/0 error, 0/1 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/ok
88%Transfer (from/to): 5382/1044 files, 17.568/2.942 TB ok
Errors: src_missing_file: 21/0, src_error: 1696/0, trn_timeout: 20/164, trn_user: 0/9, trn_error: 26/15, dst_permission: 0/6, dst_path: 0/26 foreign: 5/6
Links: 19/42 ok, 0/6 warning, 3/0 error, 0/1 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/ok
95%Transfer (from/to): 4575/1726 files, 15.201/2.835 TB ok
Errors: src_error: 360/0, trn_timeout: 2/148, trn_user: 0/30, trn_error: 7/12 foreign: 114/266
Links: 20/48 ok, 4/5 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/ok
86%Transfer (from/to): 6911/2456 files, 10.602/4.422 TB ok
Errors: src_error: 12938/0, trn_timeout: 0/227, trn_user: 0/37, trn_error: 27/14, dst_permission: 0/1, dst_error: 0/2 foreign: 75/12
Links: 26/50 ok, 0/3 warning, 5/1 error, 1/1 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/ok
77%Transfer (from/to): 5018/1607 files, 12.970/3.139 TB ok
Errors: src_error: 4814/0, trn_timeout: 39/840, trn_user: 0/24, trn_error: 5/26, dst_permission: 0/1, dst_path: 0/1, dst_error: 0/12 foreign: 20/14
Links: 20/37 ok, 1/18 warning, 8/3 error, 2/0 unknown, 2/0 bad-endpoint
storm.ifca.es: ok/ok
81%Transfer (from/to): 1738/5119 files, 5.558/13.202 TB ok
Errors: src_error: 1480/0, trn_timeout: 40/641, trn_user: 0/22, trn_error: 42/53, dst_permission: 0/1, dst_path: 0/3, dst_error: 0/3 foreign: 20/24
Links: 24/41 ok, 0/8 warning, 8/5 error, 0/1 unknown, 2/1 bad-endpoint
storm.ifca.es: ok/ok
71%Transfer (from/to): 953/4726 files, 0.990/13.888 TB ok
Errors: src_error: 2683/0, trn_timeout: 0/150, trn_user: 0/42, trn_error: 8/5, dst_permission: 0/1, dst_path: 0/4 foreign: 25/30
Links: 17/48 ok, 1/1 warning, 10/1 error, 0/2 unknown, 3/1 bad-endpoint
storm.ifca.es: ok/ok
76%Transfer (from/to): 846/2142 files, 0.350/6.542 TB ok
Errors: src_error: 1182/0, trn_timeout: 1/116, trn_user: 0/36, trn_error: 18/5, dst_permission: 0/1, dst_path: 0/4 foreign: 19/26
Links: 16/38 ok, 3/5 warning, 7/1 error, 0/2 unknown, 3/1 bad-endpoint
storm.ifca.es: ok/ok
85%Transfer (from/to): 1826/4165 files, 0.913/9.779 TB ok
Errors: src_error: 1515/0, trn_timeout: 3/188, trn_user: 0/69, trn_error: 20/24, dst_error: 0/39 foreign: 39/29
Links: 19/43 ok, 4/1 warning, 3/1 error, 0/2 unknown, 3/1 bad-endpoint
storm.ifca.es: ok/ok
96%Transfer (from/to): 760/686 files, 2.826/1.624 TB ok
Errors: src_error: 4/0, trn_timeout: 1/30, trn_user: 0/4, dst_permission: 0/7, dst_error: 0/1 foreign: 4/1
Links: 16/27 ok, 1/1 warning, 0/0 error, 0/2 unknown, 3/0 bad-endpoint
storm.ifca.es: ok/ok
95%Transfer (from/to): 5817/2943 files, 20.542/7.840 TB ok
Errors: src_error: 207/0, trn_timeout: 1/302, trn_user: 0/37, trn_error: 55/3, dst_permission: 0/1, dst_path: 0/1, dst_error: 0/12 foreign: 46/31
Links: 21/45 ok, 0/4 warning, 0/1 error, 1/2 unknown, 3/1 bad-endpoint
storm.ifca.es: ok/ok
95%Transfer (from/to): 6029/2564 files, 17.565/7.410 TB ok
Errors: src_error: 894/0, trn_timeout: 236/425, trn_user: 0/30, trn_error: 206/11, dst_permission: 0/2, dst_path: 0/1 foreign: 38/59
Links: 27/42 ok, 1/3 warning, 0/2 error, 2/2 unknown, 3/1 bad-endpoint
storm.ifca.es: ok/ok
92%Transfer (from/to): 5068/2471 files, 15.163/6.680 TB ok
Errors: src_error: 489/0, trn_timeout: 51/349, trn_user: 0/33, trn_error: 128/16, dst_permission: 0/6, dst_path: 0/1, dst_error: 0/1 foreign: 137/46
Links: 21/39 ok, 2/7 warning, 0/2 error, 0/2 unknown, 3/1 bad-endpoint
storm.ifca.es: ok/ok
95%Transfer (from/to): 3180/2510 files, 9.319/7.587 TB ok
Errors: src_error: 413/0, trn_timeout: 63/363, trn_user: 0/31, trn_error: 77/15 foreign: 45/56
Links: 30/44 ok, 2/4 warning, 0/2 error, 1/2 unknown, 2/0 bad-endpoint
storm.ifca.es: ok/ok
Site Readiness:
0%SAM: unknown (15min evaluations: 28 ok, 0 warning, 4 error, 64 unknown, 0 downtime (0h0m)),
HC: warning (280 Success ...; 28 Failed, ExitCode 137 ...; 1 Failed, ExitCode 8022 ...; 3 Failed, Removed due to wall clock limit ...; 1 Failed, ExitCode 10034 ...),
FTS: unknown (Links: 13/0 ok, 3/0 warning, 5/0 error, 0/0 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/unknown)
0%SAM: ok (15min evaluations: 86 ok, 0 warning, 0 error, 10 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...; 6 Failed, ExitCode 137 ...),
FTS: unknown (Links: 14/0 ok, 0/0 warning, 7/0 error, 0/0 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/unknown)
65%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (278 Success ...; 2 Failed, ExitCode 137 ...),
FTS: ok (Links: 17/43 ok, 2/8 warning, 3/0 error, 0/1 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/ok)
60%SAM: ok (15min evaluations: 60 ok, 0 warning, 0 error, 36 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 19/42 ok, 0/6 warning, 3/0 error, 0/1 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/ok)
61%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (424 Success ...; 36 Failed, ExitCode 137 ...; 1 Failed, ExitCode 139 ...; 1 Failed, ExitCode 8001 ...),
FTS: ok (Links: 20/48 ok, 4/5 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/ok)
72%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: warning (289 Success ...; 44 Failed, ExitCode 137 ...; 1 Failed, ExitCode 139 ...),
FTS: ok (Links: 26/50 ok, 0/3 warning, 5/1 error, 1/1 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/ok)
47%corrected due to SAM Singularity being out-of-sync,
SAM: error (15min evaluations: 52 ok, 0 warning, 42 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (268 Success ...; 10 Failed, GlobalPool periodic cleanup ...; 5 Failed, ExitCode 8002 ...),
FTS: ok (Links: 20/37 ok, 1/18 warning, 8/3 error, 2/0 unknown, 2/0 bad-endpoint; storm.ifca.es: ok/ok)
30%corrected due to SAM Singularity being out-of-sync,
SAM: error (15min evaluations: 40 ok, 0 warning, 48 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...; 12 Failed, ExitCode 137 ...),
FTS: ok (Links: 24/41 ok, 0/8 warning, 8/5 error, 0/1 unknown, 2/1 bad-endpoint; storm.ifca.es: ok/ok)
59%SAM: ok (15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (15 Failed, ExitCode 137 ...; 278 Success ...),
FTS: ok (Links: 17/48 ok, 1/1 warning, 10/1 error, 0/2 unknown, 3/1 bad-endpoint; storm.ifca.es: ok/ok)
54%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: warning (297 Success ...; 33 Failed, ExitCode 137 ...; 2 Failed, ExitCode 8001 ...),
FTS: ok (Links: 16/38 ok, 3/5 warning, 7/1 error, 0/2 unknown, 3/1 bad-endpoint; storm.ifca.es: ok/ok)
64%SAM: ok (15min evaluations: 71 ok, 0 warning, 7 error, 18 unknown, 0 downtime (0h0m)),
HC: ok (257 Success ...; 2 Failed, ExitCode 8021 ...; 12 Failed, ExitCode 137 ...),
FTS: ok (Links: 19/43 ok, 4/1 warning, 3/1 error, 0/2 unknown, 3/1 bad-endpoint; storm.ifca.es: ok/ok)
0%SAM: error (15min evaluations: 0 ok, 0 warning, 77 error, 19 unknown, 0 downtime (0h0m)),
HC: unknown,
FTS: ok (Links: 16/27 ok, 1/1 warning, 0/0 error, 0/2 unknown, 3/0 bad-endpoint; storm.ifca.es: ok/ok),
downtime: no scheduled downtime
1%SAM: error (15min evaluations: 9 ok, 30 warning, 10 error, 46 unknown, 0 downtime (0h0m)),
HC: error (52 Failed, ExitCode 137 ...; 168 Success ...),
FTS: ok (Links: 21/45 ok, 0/4 warning, 0/1 error, 1/2 unknown, 3/1 bad-endpoint; storm.ifca.es: ok/ok)
53%SAM: ok (15min evaluations: 54 ok, 0 warning, 1 error, 40 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...; 16 Failed, ExitCode 137 ...),
FTS: ok (Links: 27/42 ok, 1/3 warning, 0/2 error, 2/2 unknown, 3/1 bad-endpoint; storm.ifca.es: ok/ok)
66%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: warning (258 Success ...; 1 Failed, ExitCode 4 ...; 48 Failed, ExitCode 137 ...; 1 Failed, ExitCode 8022 ...; 1 Failed, ExitCode 134 ...; 1 Failed, ExitCode 8001 ...; 2 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 21/39 ok, 2/7 warning, 0/2 error, 0/2 unknown, 3/1 bad-endpoint; storm.ifca.es: ok/ok)
33%SAM: ok (15min evaluations: 89 ok, 0 warning, 2 error, 5 unknown, 0 downtime (0h0m)),
HC: error (285 Success ...; 79 Failed, ExitCode 137 ...; 2 Failed, Removed due to wall clock limit ...; 4 Failed, ExitCode 8022 ...; 1 Failed, ExitCode 7002 ...; 2 Failed, ExitCode 139 ...; 1 Failed, ExitCode 8001 ...),
FTS: ok (Links: 30/44 ok, 2/4 warning, 0/2 error, 1/2 unknown, 2/0 bad-endpoint; storm.ifca.es: ok/ok)
Life Status: WR WR WR WR WR WR WR
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_FI_HIP
GGUS Tickets: 145479
Downtimes:
SAM Status: 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 2 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 2 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 59 ok, 2 warning, 0 error, 35 unknown, 0 downtime (0h0m) 98%15min evaluations: 89 ok, 1 warning, 1 error, 5 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 97%15min evaluations: 92 ok, 1 warning, 2 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 86 ok, 0 warning, 0 error, 10 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 90 ok, 0 warning, 0 error, 6 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 86 ok, 0 warning, 0 error, 10 unknown, 0 downtime (0h0m) 100%15min evaluations: 79 ok, 2 warning, 0 error, 14 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 94%15min evaluations: 54 ok, 0 warning, 3 error, 39 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%283 Success [crab3@vocms0119.cern.ch#53601857.0#1589240097 200511_100801:sciaba_crab_HC-96-T2_FI_HIP-89105-20200510180704 161 0]... 100%294 Success [crab3@vocms0196.cern.ch#52221019.0#1589326235 200512_200934:sciaba_crab_HC-96-T2_FI_HIP-89185-20200512220704 40 0]... 100%280 Success [crab3@vocms0144.cern.ch#55215159.0#1589412992 200513_140838:sciaba_crab_HC-96-T2_FI_HIP-89185-20200512220704 113 0]... 100%292 Success [crab3@vocms0197.cern.ch#51966919.0#1589498715 200514_194237:sciaba_crab_HC-96-T2_FI_HIP-89262-20200514213103 44 0]... 100%448 Success [crab3@vocms0197.cern.ch#52009397.0#1589585732 200515_135853:sciaba_crab_HC-96-T2_FI_HIP-89262-20200514213103 115 0]... 100%332 Success [crab3@vocms0121.cern.ch#53806655.0#1589672121 200516_080326:sciaba_crab_HC-96-T2_FI_HIP-89262-20200514213103 186 0]... 100%234 Success [crab3@vocms0195.cern.ch#51900864.0#1589758317 200517_223052:sciaba_crab_HC-96-T2_FI_HIP-89368-20200516122702 12 0]... 100%295 Success [crab3@vocms0137.cern.ch#51570596.0#1589844380 200518_112513:sciaba_crab_HC-96-T2_FI_HIP-89439-20200518131702 144 0]... 100%284 Success [crab3@vocms0120.cern.ch#53329944.0#1589931269 200519_232617:sciaba_crab_HC-96-T2_FI_HIP-89439-20200518131702 1 0]... 100%291 Success [crab3@vocms0122.cern.ch#57710756.0#1590017685 200520_143816:sciaba_crab_HC-96-T2_FI_HIP-89519-20200520163301 107 0]... 100%286 Success [crab3@vocms0198.cern.ch#48762561.0#1590103139 200521_083234:sciaba_crab_HC-96-T2_FI_HIP-89519-20200520163301 177 0]... 100%290 Success [crab3@vocms0196.cern.ch#52601360.0#1590190484 200522_153326:sciaba_crab_HC-96-T2_FI_HIP-89594-20200522173103 96 0]... 100%279 Success [crab3@vocms0197.cern.ch#52366556.0#1590273686 200523_093030:sciaba_crab_HC-96-T2_FI_HIP-89594-20200522173103 158 0]... 100%300 Success [crab3@vocms0120.cern.ch#53557450.0#1590361656 200524_194104:sciaba_crab_HC-96-T2_FI_HIP-89673-20200524213903 41 0]... 100%277 Success [crab3@vocms0197.cern.ch#52427448.0#1590450037 200525_133941:sciaba_crab_HC-96-T2_FI_HIP-89673-20200524213903 120 0]... 100%299 Success [crab3@vocms0106.cern.ch#43473796.0#1590534479 200526_200113:sciaba_crab_HC-96-T2_FI_HIP-89750-20200526215903 37 0]...
FTS Status: 98%Transfer (from/to): 1439/287 files, 0.547/0.628 TB ok
Errors: trn_timeout: 1/1, trn_user: 0/1, trn_error: 5/1, dst_permission: 0/9 foreign: 648/18
Links: 46/38 ok, 1/6 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint
madhatter.csc.fi: ok/ok
97%Transfer (from/to): 2733/939 files, 0.586/1.968 TB ok
Errors: src_error: 198/0, trn_timeout: 3/0, trn_error: 3/3, dst_permission: 0/10 foreign: 326/16
Links: 46/42 ok, 0/1 warning, 1/0 error, 0/2 unknown, 1/0 bad-endpoint
madhatter.csc.fi: ok/ok
97%Transfer (from/to): 7451/618 files, 0.506/1.217 TB ok
Errors: src_error: 363/0, trn_timeout: 2/0, trn_error: 239/7, dst_permission: 0/7 foreign: 8/18
Links: 43/43 ok, 1/1 warning, 1/0 error, 0/2 unknown, 1/0 bad-endpoint
madhatter.csc.fi: ok/ok
97%Transfer (from/to): 2008/377 files, 0.431/0.697 TB ok
Errors: src_permission: 6/0, src_error: 2143/0, trn_timeout: 4/6, trn_error: 65/3, dst_permission: 0/13, dst_error: 0/2 foreign: 57/9
Links: 43/38 ok, 3/6 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
madhatter.csc.fi: ok/ok
98%Transfer (from/to): 4612/1083 files, 8.959/2.233 TB ok
Errors: src_permission: 5/0, src_error: 1868/0, trn_timeout: 4/2, trn_error: 20/4, dst_permission: 0/3, dst_error: 0/1 foreign: 511/137
Links: 45/47 ok, 2/0 warning, 1/0 error, 0/2 unknown, 1/0 bad-endpoint
madhatter.csc.fi: ok/ok
97%Transfer (from/to): 9737/1066 files, 25.221/2.205 TB ok
Errors: src_error: 253/0, trn_timeout: 6/2, trn_error: 68/0, dst_permission: 0/14 foreign: 74/23
Links: 47/51 ok, 2/3 warning, 1/0 error, 1/2 unknown, 1/0 bad-endpoint
madhatter.csc.fi: ok/ok
98%Transfer (from/to): 7798/341 files, 20.699/0.618 TB ok
Errors: trn_timeout: 10/0, trn_error: 11/6, dst_permission: 0/5 foreign: 353/27
Links: 46/47 ok, 2/3 warning, 0/0 error, 0/3 unknown, 2/0 bad-endpoint
madhatter.csc.fi: ok/ok
94%Transfer (from/to): 3192/299 files, 4.414/0.614 TB ok
Errors: trn_timeout: 5/4, trn_error: 50/7, dst_permission: 0/9 foreign: 701/32
Links: 47/43 ok, 3/1 warning, 0/2 error, 0/1 unknown, 2/1 bad-endpoint
madhatter.csc.fi: ok/ok
100%Transfer (from/to): 8486/273 files, 21.702/0.580 TB ok
Errors: trn_error: 109/0, dst_permission: 0/7 foreign: 54/29
Links: 47/44 ok, 0/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint
madhatter.csc.fi: ok/ok
97%Transfer (from/to): 7075/295 files, 0.623/0.634 TB ok
Errors: src_error: 702/0, trn_error: 5/1, dst_permission: 0/15 foreign: 53/26
Links: 47/41 ok, 0/1 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
madhatter.csc.fi: ok/ok
100%Transfer (from/to): 19618/310 files, 43.994/0.668 TB ok
Errors: src_error: 738/0, trn_timeout: 1/1, trn_error: 7/1, dst_permission: 0/14 foreign: 116/24
Links: 46/39 ok, 0/4 warning, 0/0 error, 2/2 unknown, 3/1 bad-endpoint
madhatter.csc.fi: ok/ok
95%Transfer (from/to): 14119/277 files, 19.354/0.591 TB ok
Errors: src_error: 1051/0, trn_timeout: 0/7, trn_error: 19/0, dst_permission: 0/12 foreign: 452/35
Links: 47/39 ok, 0/1 warning, 2/1 error, 0/3 unknown, 3/1 bad-endpoint
madhatter.csc.fi: ok/ok
97%Transfer (from/to): 26889/293 files, 30.252/0.632 TB ok
Errors: trn_timeout: 2/10, trn_error: 25/0, dst_permission: 0/11 foreign: 190/29
Links: 49/40 ok, 0/0 warning, 0/1 error, 0/3 unknown, 3/1 bad-endpoint
madhatter.csc.fi: ok/ok
97%Transfer (from/to): 15124/289 files, 14.971/0.622 TB ok
Errors: trn_timeout: 6/8, trn_user: 1/0, trn_error: 11/0, dst_permission: 0/7, dst_error: 0/1 foreign: 1065/34
Links: 51/39 ok, 1/2 warning, 0/1 error, 0/3 unknown, 3/1 bad-endpoint
madhatter.csc.fi: ok/ok
100%Transfer (from/to): 4347/274 files, 6.373/0.585 TB ok
Errors: trn_error: 8/0, dst_permission: 0/26 foreign: 36/43
Links: 52/36 ok, 0/5 warning, 0/0 error, 0/4 unknown, 3/1 bad-endpoint
madhatter.csc.fi: ok/ok
100%Transfer (from/to): 1120/213 files, 0.824/0.462 TB ok
Errors: trn_timeout: 1/0, trn_error: 6/0, dst_permission: 0/7 foreign: 31/28
Links: 53/35 ok, 0/6 warning, 0/0 error, 0/4 unknown, 2/0 bad-endpoint
madhatter.csc.fi: ok/ok
Site Readiness:
57%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...),
FTS: ok (Links: 46/38 ok, 1/6 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint; madhatter.csc.fi: ok/ok)
69%SAM: ok (15min evaluations: 92 ok, 2 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 46/42 ok, 0/1 warning, 1/0 error, 0/2 unknown, 1/0 bad-endpoint; madhatter.csc.fi: ok/ok)
62%SAM: ok (15min evaluations: 91 ok, 2 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 43/43 ok, 1/1 warning, 1/0 error, 0/2 unknown, 1/0 bad-endpoint; madhatter.csc.fi: ok/ok)
40%SAM: ok (15min evaluations: 59 ok, 2 warning, 0 error, 35 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 43/38 ok, 3/6 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; madhatter.csc.fi: ok/ok)
77%SAM: ok (15min evaluations: 89 ok, 1 warning, 1 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (448 Success ...),
FTS: ok (Links: 45/47 ok, 2/0 warning, 1/0 error, 0/2 unknown, 1/0 bad-endpoint; madhatter.csc.fi: ok/ok)
84%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (332 Success ...),
FTS: ok (Links: 47/51 ok, 2/3 warning, 1/0 error, 1/2 unknown, 1/0 bad-endpoint; madhatter.csc.fi: ok/ok)
44%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (234 Success ...),
FTS: ok (Links: 46/47 ok, 2/3 warning, 0/0 error, 0/3 unknown, 2/0 bad-endpoint; madhatter.csc.fi: ok/ok)
67%SAM: ok (15min evaluations: 92 ok, 1 warning, 2 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 47/43 ok, 3/1 warning, 0/2 error, 0/1 unknown, 2/1 bad-endpoint; madhatter.csc.fi: ok/ok)
50%SAM: ok (15min evaluations: 86 ok, 0 warning, 0 error, 10 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 47/44 ok, 0/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint; madhatter.csc.fi: ok/ok)
56%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...),
FTS: ok (Links: 47/41 ok, 0/1 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; madhatter.csc.fi: ok/ok)
62%SAM: ok (15min evaluations: 90 ok, 0 warning, 0 error, 6 unknown, 0 downtime (0h0m)),
HC: ok (286 Success ...),
FTS: ok (Links: 46/39 ok, 0/4 warning, 0/0 error, 2/2 unknown, 3/1 bad-endpoint; madhatter.csc.fi: ok/ok)
60%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (290 Success ...),
FTS: ok (Links: 47/39 ok, 0/1 warning, 2/1 error, 0/3 unknown, 3/1 bad-endpoint; madhatter.csc.fi: ok/ok)
55%SAM: ok (15min evaluations: 86 ok, 0 warning, 0 error, 10 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 49/40 ok, 0/0 warning, 0/1 error, 0/3 unknown, 3/1 bad-endpoint; madhatter.csc.fi: ok/ok)
49%SAM: ok (15min evaluations: 79 ok, 2 warning, 0 error, 14 unknown, 0 downtime (0h0m)),
HC: ok (300 Success ...),
FTS: ok (Links: 51/39 ok, 1/2 warning, 0/1 error, 0/3 unknown, 3/1 bad-endpoint; madhatter.csc.fi: ok/ok)
54%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (277 Success ...),
FTS: ok (Links: 52/36 ok, 0/5 warning, 0/0 error, 0/4 unknown, 3/1 bad-endpoint; madhatter.csc.fi: ok/ok)
25%SAM: ok (15min evaluations: 54 ok, 0 warning, 3 error, 39 unknown, 0 downtime (0h0m)),
HC: ok (299 Success ...),
FTS: ok (Links: 53/35 ok, 0/6 warning, 0/0 error, 0/4 unknown, 2/0 bad-endpoint; madhatter.csc.fi: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_FR_CCIN2P3
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 73 ok, 0 warning, 1 error, 22 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 94 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 92 ok, 0 warning, 1 error, 3 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%281 Success [crab3@vocms0199.cern.ch#12716611.0#1589239777 200511_142324:sciaba_crab_HC-100-T2_FR_CCIN2P3-89108-20200510221704 109 0]... 100%292 Success [crab3@vocms0137.cern.ch#51257927.0#1589326340 200512_201612:sciaba_crab_HC-100-T2_FR_CCIN2P3-89186-20200512220905 39 0]... 100%290 Success [crab3@vocms0144.cern.ch#55215141.0#1589412890 200513_141803:sciaba_crab_HC-100-T2_FR_CCIN2P3-89186-20200512220905 111 0]... 100%284 Success [crab3@vocms0199.cern.ch#12866476.0#1589498785 200514_082444:sciaba_crab_HC-100-T2_FR_CCIN2P3-89186-20200512220905 180 0]... 100%318 Success [crab3@vocms0199.cern.ch#12905810.0#1589585606 200515_183453:sciaba_crab_HC-100-T2_FR_CCIN2P3-89269-20200515022704 59 0]... 100%301 Success [crab3@vocms0121.cern.ch#53806514.0#1589671993 200516_103119:sciaba_crab_HC-100-T2_FR_CCIN2P3-89364-20200516122803 156 0]... 100%83 Success [crab3@vocms0137.cern.ch#51546066.0#1589758223 200517_220938:sciaba_crab_HC-100-T2_FR_CCIN2P3-89364-20200516122803 16 0]... 100%285 Success [crab3@vocms0144.cern.ch#55387505.0#1589846834 200518_235626:sciaba_crab_HC-100-T2_FR_CCIN2P3-89428-20200518075303 2 0]... 100%279 Success [crab3@vocms0107.cern.ch#55282269.0#1589930976 200519_180309:sciaba_crab_HC-100-T2_FR_CCIN2P3-89428-20200518075303 65 0]... 100%300 Success [crab3@vocms0155.cern.ch#55478764.0#1590017359 200520_053749:sciaba_crab_HC-100-T2_FR_CCIN2P3-89505-20200520073502 214 0]... 100%286 Success [crab3@vocms0107.cern.ch#55323903.0#1590104384 200521_172839:sciaba_crab_HC-100-T2_FR_CCIN2P3-89505-20200520073502 74 0]... 100%293 Success [crab3@vocms0122.cern.ch#57785936.0#1590190662 200522_220149:sciaba_crab_HC-100-T2_FR_CCIN2P3-89578-20200522055502 19 0]... 100%281 Success [crab3@vocms0195.cern.ch#52094014.0#1590276922 200523_160357:sciaba_crab_HC-100-T2_FR_CCIN2P3-89578-20200522055502 90 0]... 100%293 Success [crab3@vocms0121.cern.ch#54131756.0#1590362494 200524_181530:sciaba_crab_HC-100-T2_FR_CCIN2P3-89640-20200524021103 61 0]... 100%285 Success [crab3@vocms0122.cern.ch#57897747.0#1590449927 200525_122231:sciaba_crab_HC-100-T2_FR_CCIN2P3-89640-20200524021103 135 0]... 100%193 Success [crab3@vocms0197.cern.ch#52487321.0#1590535301 200526_210521:sciaba_crab_HC-100-T2_FR_CCIN2P3-89727-20200526050103 27 0]...
FTS Status: 97%Transfer (from/to): 1211/289 files, 1.100/0.622 TB ok
Errors: src_permission: 4/0, src_error: 88/0, trn_timeout: 0/21, trn_error: 12/1 foreign: 376/6
Links: 41/41 ok, 3/2 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
96%Transfer (from/to): 1074/477 files, 0.429/1.155 TB ok
Errors: src_error: 181/0, trn_timeout: 2/16, trn_error: 4/13 foreign: 46/11
Links: 36/43 ok, 1/0 warning, 3/0 error, 1/1 unknown, 1/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
99%Transfer (from/to): 838/427 files, 0.839/0.991 TB ok
Errors: src_error: 168/0, trn_timeout: 2/0, trn_error: 5/0 foreign: 15/11
Links: 45/43 ok, 0/0 warning, 1/0 error, 2/1 unknown, 1/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
96%Transfer (from/to): 5081/356 files, 0.829/0.812 TB ok
Errors: src_missing_file: 15/0, src_error: 131/0, trn_timeout: 2/31, trn_error: 6/2 foreign: 15/9
Links: 40/42 ok, 0/1 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
95%Transfer (from/to): 2543/467 files, 1.054/1.128 TB ok
Errors: src_error: 126/0, trn_timeout: 5/3, trn_error: 13/1, dst_error: 0/1 foreign: 45/12
Links: 38/44 ok, 3/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
97%Transfer (from/to): 1773/370 files, 1.832/0.847 TB ok
Errors: src_error: 118/0, trn_timeout: 4/2, trn_error: 13/2 foreign: 9/8
Links: 44/41 ok, 2/2 warning, 2/0 error, 1/1 unknown, 1/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
98%Transfer (from/to): 1795/371 files, 1.230/0.850 TB ok
Errors: src_error: 359/0, trn_timeout: 5/4, trn_error: 8/8 foreign: 23/8
Links: 42/39 ok, 1/4 warning, 2/0 error, 2/1 unknown, 2/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
97%Transfer (from/to): 1280/313 files, 0.534/0.680 TB ok
Errors: src_error: 108/0, trn_timeout: 4/3, trn_error: 13/0 foreign: 30/24
Links: 44/41 ok, 1/1 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
99%Transfer (from/to): 2307/328 files, 0.889/0.728 TB ok
Errors: src_error: 108/0, trn_timeout: 2/0, trn_error: 6/1 foreign: 156/31
Links: 48/42 ok, 0/0 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
97%Transfer (from/to): 649/347 files, 0.537/0.792 TB ok
Errors: src_error: 66/0, trn_timeout: 1/2, trn_error: 2/1 foreign: 16/25
Links: 37/42 ok, 0/0 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
97%Transfer (from/to): 1274/340 files, 0.606/0.767 TB ok
Errors: src_error: 72/0, trn_timeout: 2/13, trn_error: 5/3 foreign: 39/29
Links: 38/41 ok, 0/1 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
95%Transfer (from/to): 400/326 files, 0.809/0.697 TB ok
Errors: src_error: 79/0, trn_timeout: 0/4, trn_error: 7/0 foreign: 1616/27
Links: 29/40 ok, 1/1 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
95%Transfer (from/to): 500/320 files, 0.949/0.685 TB ok
Errors: src_error: 108/0, trn_timeout: 2/8, trn_error: 5/0 foreign: 1857/25
Links: 30/40 ok, 1/0 warning, 1/1 error, 0/2 unknown, 3/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
96%Transfer (from/to): 199/7807 files, 0.386/25.542 TB ok
Errors: src_error: 72/0, trn_timeout: 0/8, trn_error: 6/0 foreign: 1599/37
Links: 29/41 ok, 1/0 warning, 1/1 error, 0/2 unknown, 3/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
95%Transfer (from/to): 313/345 files, 0.467/0.779 TB ok
Errors: src_error: 127/0, trn_timeout: 1/0, trn_error: 7/1 foreign: 1750/50
Links: 30/40 ok, 0/0 warning, 2/0 error, 0/3 unknown, 3/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
96%Transfer (from/to): 278/217 files, 0.261/0.469 TB ok
Errors: src_error: 72/0, trn_timeout: 1/4, trn_error: 6/4 foreign: 738/37
Links: 29/38 ok, 1/0 warning, 1/1 error, 0/5 unknown, 2/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
Site Readiness:
59%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 41/41 ok, 3/2 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
68%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 36/43 ok, 1/0 warning, 3/0 error, 1/1 unknown, 1/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
55%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (290 Success ...),
FTS: ok (Links: 45/43 ok, 0/0 warning, 1/0 error, 2/1 unknown, 1/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
46%SAM: ok (15min evaluations: 73 ok, 0 warning, 1 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 40/42 ok, 0/1 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
62%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (318 Success ...),
FTS: ok (Links: 38/44 ok, 3/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
65%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (301 Success ...),
FTS: ok (Links: 44/41 ok, 2/2 warning, 2/0 error, 1/1 unknown, 1/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
20%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (83 Success ...),
FTS: ok (Links: 42/39 ok, 1/4 warning, 2/0 error, 2/1 unknown, 2/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
62%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 44/41 ok, 1/1 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
59%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 48/42 ok, 0/0 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
49%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (300 Success ...),
FTS: ok (Links: 37/42 ok, 0/0 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
60%SAM: ok (15min evaluations: 94 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (286 Success ...),
FTS: ok (Links: 38/41 ok, 0/1 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
42%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 29/40 ok, 1/1 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
36%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 30/40 ok, 1/0 warning, 1/1 error, 0/2 unknown, 3/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
51%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 29/41 ok, 1/0 warning, 1/1 error, 0/2 unknown, 3/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
43%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 30/40 ok, 0/0 warning, 2/0 error, 0/3 unknown, 3/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
31%SAM: ok (15min evaluations: 92 ok, 0 warning, 1 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (193 Success ...),
FTS: ok (Links: 29/38 ok, 1/0 warning, 1/1 error, 0/5 unknown, 2/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_FR_GRIF_IRFU
GGUS Tickets:
Downtimes: Ulpnhe-cream.in2p3.fr/CE Ulpnhe-cream.in2p3.fr/CE Ulpnhe-cream.in2p3.fr/CE Ulpnhe-cream.in2p3.fr/CE Ulpnhe-cream.in2p3.fr/CE
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 73 ok, 0 warning, 0 error, 23 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 58 ok, 0 warning, 0 error, 37 unknown, 0 downtime (0h0m) 83%15min evaluations: 80 ok, 0 warning, 16 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%280 Success [crab3@vocms0120.cern.ch#52861866.0#1589239380 200511_143623:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89108-20200510221704 105 0]... 100%293 Success [crab3@vocms0197.cern.ch#51852624.0#1589325785 200512_201202:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89186-20200512220905 38 0]... 100%291 Success [crab3@vocms0119.cern.ch#53687056.0#1589412318 200513_141354:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89186-20200512220905 110 0]... 100%279 Success [crab3@vocms0107.cern.ch#55099808.0#1589498546 200514_082051:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89186-20200512220905 180 0]... 100%313 Success [crab3@vocms0121.cern.ch#53744578.0#1589584975 200515_183945:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89269-20200515022704 56 0]... 100%293 Success [crab3@vocms0137.cern.ch#51519067.0#1589671415 200516_102904:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89364-20200516122803 153 0]... 87%75 Success [crab3@vocms0198.cern.ch#48581757.0#1589757710 200517_225056:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89364-20200516122803 6 0]...
11 Failed, ExitCode 8028 [crab3@vocms0137.cern.ch#51548357.0#1589783844 200518_060051:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89428-20200518075303 7 0]...
99%275 Success [crab3@vocms0197.cern.ch#52144490.0#1589846577 200518_235642:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89428-20200518075303 1 0]...
1 Failed, ExitCode 8021 [crab3@vocms0197.cern.ch#52168420.0#1589900589 200518_235642:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89428-20200518075303 181 0]...
100%278 Success [crab3@vocms0198.cern.ch#48671508.0#1589930404 200519_180344:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89428-20200518075303 63 0]... 100%296 Success [crab3@vocms0197.cern.ch#52249024.0#1590017454 200520_053956:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89505-20200520073502 214 0]... 100%281 Success [crab3@vocms0198.cern.ch#48762682.0#1590103620 200521_175015:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89505-20200520073502 67 0]... 99%293 Success [crab3@vocms0121.cern.ch#54086448.0#1590189941 200522_220449:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89578-20200522055502 16 0]...
1 Success, no Chirp ExitCode [crab3@vocms0121.cern.ch#54097914.0#1590236448 200522_220449:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89578-20200522055502 171 0]...
1 Failed, ExitCode 237 [crab3@vocms0121.cern.ch#54097921.0#1590236749 200522_220449:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89578-20200522055502 172 0]...
100%281 Success [crab3@vocms0199.cern.ch#13271129.0#1590279869 200524_001301:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89640-20200524021103 2 0]... 100%290 Success [crab3@vocms0144.cern.ch#55587596.0#1590363763 200524_181147:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89640-20200524021103 66 0]... 98%275 Success [crab3@vocms0197.cern.ch#52427099.0#1590448848 200525_121912:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89640-20200524021103 132 0]...
3 Success, no Chirp ExitCode [crab3@vocms0198.cern.ch#48901866.0#1590491306 200526_030714:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89727-20200526050103 96 0]...
3 Failed, ExitCode 237 [crab3@vocms0198.cern.ch#48902164.0#1590493111 200526_030714:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89727-20200526050103 102 0]...
1 Failed, ExitCode 255 [crab3@vocms0198.cern.ch#48902243.0#1590493404 200526_030714:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89727-20200526050103 103 0]...
100%204 Success [crab3@vocms0194.cern.ch#53088320.0#1590534714 200526_212029:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-89727-20200526050103 22 0]...
FTS Status: 99%Transfer (from/to): 599/1766 files, 1.271/8.268 TB ok
Errors: src_permission: 3/0, src_missing_file: 10/0, trn_timeout: 1/0, trn_user: 3/0, trn_error: 7/13, dst_error: 0/1 foreign: 23/14
Links: 45/44 ok, 2/0 warning, 0/0 error, 1/1 unknown, 1/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
100%Transfer (from/to): 315/2340 files, 0.502/11.178 TB ok
Errors: src_missing_file: 14/0, trn_timeout: 0/1, trn_user: 3/0, trn_error: 9/4, dst_error: 0/5 foreign: 119/9
Links: 49/43 ok, 0/0 warning, 0/0 error, 1/1 unknown, 1/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
98%Transfer (from/to): 578/1763 files, 1.376/8.071 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 5/1, trn_user: 2/0, trn_error: 9/2, dst_error: 0/5 foreign: 5/16
Links: 49/43 ok, 1/0 warning, 0/0 error, 1/1 unknown, 1/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
99%Transfer (from/to): 4141/2099 files, 17.176/9.776 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 3/2, trn_user: 18/0, trn_error: 16/0, dst_error: 0/4 foreign: 20/10
Links: 48/42 ok, 3/1 warning, 0/0 error, 1/1 unknown, 1/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
97%Transfer (from/to): 2753/1528 files, 7.246/6.663 TB ok
Errors: src_missing_file: 12/0, trn_timeout: 32/0, trn_error: 238/0, dst_error: 0/6 foreign: 94/551
Links: 51/47 ok, 1/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
97%Transfer (from/to): 2397/2253 files, 5.279/10.672 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 5/4, trn_error: 71/4, dst_error: 0/8 foreign: 80/12
Links: 51/47 ok, 0/1 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
96%Transfer (from/to): 1049/2268 files, 1.533/10.826 TB ok
Errors: src_missing_file: 16/0, trn_timeout: 36/6, trn_error: 26/5, dst_error: 0/2 foreign: 92/12
Links: 50/47 ok, 0/1 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
98%Transfer (from/to): 3684/616 files, 10.409/2.254 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 27/3, trn_error: 59/1, dst_error: 0/1 foreign: 77/27
Links: 52/43 ok, 0/1 warning, 2/0 error, 0/1 unknown, 2/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
97%Transfer (from/to): 2308/8382 files, 5.003/80.804 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 2/2, trn_error: 27/8, dst_permission: 0/1, dst_error: 0/10 foreign: 16/529
Links: 52/50 ok, 0/0 warning, 2/0 error, 0/2 unknown, 3/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
98%Transfer (from/to): 287/2108 files, 0.513/16.041 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 1/0, trn_error: 3/4, dst_permission: 0/1, dst_error: 0/4 foreign: 34/412
Links: 45/47 ok, 1/0 warning, 0/0 error, 1/3 unknown, 3/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
98%Transfer (from/to): 635/2216 files, 0.465/7.164 TB ok
Errors: src_missing_file: 12/0, trn_timeout: 0/1, trn_error: 16/1, dst_permission: 0/2, dst_error: 0/4 foreign: 85/300
Links: 46/45 ok, 0/1 warning, 2/0 error, 0/2 unknown, 3/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
98%Transfer (from/to): 331/326 files, 0.436/0.708 TB ok
Errors: src_missing_file: 12/0, trn_timeout: 1/0, trn_error: 10/0 foreign: 103/314
Links: 45/42 ok, 2/0 warning, 0/0 error, 1/3 unknown, 3/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
99%Transfer (from/to): 929/313 files, 2.031/0.673 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 1/0, trn_error: 9/0, dst_permission: 0/1, dst_error: 0/1 foreign: 95/227
Links: 47/40 ok, 0/1 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
98%Transfer (from/to): 789/364 files, 1.639/0.952 TB ok
Errors: src_missing_file: 12/0, src_error: 2/0, trn_timeout: 3/0, trn_error: 18/1, dst_error: 0/2 foreign: 119/141
Links: 43/43 ok, 2/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
98%Transfer (from/to): 2140/724 files, 2.280/5.152 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 4/1, trn_error: 12/1 foreign: 113/89
Links: 40/43 ok, 3/1 warning, 0/0 error, 1/4 unknown, 3/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
99%Transfer (from/to): 1033/908 files, 2.846/8.039 TB ok
Errors: src_missing_file: 12/0, trn_timeout: 2/0, trn_user: 32/0, trn_error: 5/0 foreign: 33/30
Links: 42/44 ok, 2/0 warning, 0/0 error, 2/3 unknown, 2/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
Site Readiness:
64%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 45/44 ok, 2/0 warning, 0/0 error, 1/1 unknown, 1/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
64%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 49/43 ok, 0/0 warning, 0/0 error, 1/1 unknown, 1/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
74%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...),
FTS: ok (Links: 49/43 ok, 1/0 warning, 0/0 error, 1/1 unknown, 1/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
62%SAM: ok (15min evaluations: 73 ok, 0 warning, 0 error, 23 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 48/42 ok, 3/1 warning, 0/0 error, 1/1 unknown, 1/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
83%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (313 Success ...),
FTS: ok (Links: 51/47 ok, 1/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
99%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 51/47 ok, 0/1 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
19%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: warning (75 Success ...; 11 Failed, ExitCode 8028 ...),
FTS: ok (Links: 50/47 ok, 0/1 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
75%SAM: ok (15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (275 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 52/43 ok, 0/1 warning, 2/0 error, 0/1 unknown, 2/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
91%SAM: ok (15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (278 Success ...),
FTS: ok (Links: 52/50 ok, 0/0 warning, 2/0 error, 0/2 unknown, 3/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
52%SAM: ok (15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 45/47 ok, 1/0 warning, 0/0 error, 1/3 unknown, 3/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
53%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 46/45 ok, 0/1 warning, 2/0 error, 0/2 unknown, 3/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
32%SAM: ok (15min evaluations: 58 ok, 0 warning, 0 error, 37 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...; 1 Success, no Chirp ExitCode ...; 1 Failed, ExitCode 237 ...),
FTS: ok (Links: 45/42 ok, 2/0 warning, 0/0 error, 1/3 unknown, 3/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
36%SAM: warning (15min evaluations: 80 ok, 0 warning, 16 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 47/40 ok, 0/1 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
61%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (290 Success ...),
FTS: ok (Links: 43/43 ok, 2/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
46%SAM: ok (15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (275 Success ...; 3 Success, no Chirp ExitCode ...; 3 Failed, ExitCode 237 ...; 1 Failed, ExitCode 255 ...),
FTS: ok (Links: 40/43 ok, 3/1 warning, 0/0 error, 1/4 unknown, 3/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
37%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (204 Success ...),
FTS: ok (Links: 42/44 ok, 2/0 warning, 0/0 error, 2/3 unknown, 2/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_FR_GRIF_LLR
GGUS Tickets:
Downtimes:
SAM Status: 98%15min evaluations: 90 ok, 0 warning, 1 error, 5 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 97%15min evaluations: 82 ok, 0 warning, 2 error, 12 unknown, 0 downtime (0h0m) 98%15min evaluations: 71 ok, 0 warning, 1 error, 24 unknown, 0 downtime (0h0m) 92%15min evaluations: 89 ok, 0 warning, 7 error, 0 unknown, 0 downtime (0h0m) 63%15min evaluations: 58 ok, 0 warning, 33 error, 5 unknown, 0 downtime (0h0m) 94%15min evaluations: 90 ok, 0 warning, 5 error, 1 unknown, 0 downtime (0h0m) 97%15min evaluations: 87 ok, 0 warning, 2 error, 7 unknown, 0 downtime (0h0m) 87%15min evaluations: 80 ok, 2 warning, 12 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 90 ok, 0 warning, 0 error, 6 unknown, 0 downtime (0h0m) 100%15min evaluations: 55 ok, 0 warning, 0 error, 41 unknown, 0 downtime (0h0m) 97%15min evaluations: 64 ok, 0 warning, 2 error, 30 unknown, 0 downtime (0h0m) 97%15min evaluations: 72 ok, 0 warning, 2 error, 21 unknown, 0 downtime (0h0m) 100%15min evaluations: 86 ok, 0 warning, 0 error, 9 unknown, 0 downtime (0h0m) 98%15min evaluations: 73 ok, 0 warning, 1 error, 22 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%282 Success [crab3@vocms0199.cern.ch#12716519.0#1589239741 200511_141800:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89108-20200510221704 110 0]... 100%294 Success [crab3@vocms0122.cern.ch#57357417.0#1589325942 200512_201441:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89186-20200512220905 38 0]... 100%282 Success [crab3@vocms0137.cern.ch#51354576.0#1589413061 200513_141620:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89186-20200512220905 112 0]... 99%284 Success [crab3@vocms0106.cern.ch#43205913.0#1589498945 200514_082238:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89186-20200512220905 181 0]...
1 Failed, ExitCode 10040 [crab3@vocms0107.cern.ch#55106958.0#1589522447 200515_002926:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89269-20200515022704 66 0]...
100%318 Success [crab3@vocms0199.cern.ch#12906058.0#1589585880 200515_183127:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89269-20200515022704 61 0]... 100%299 Success [crab3@vocms0119.cern.ch#53830198.0#1589672675 200516_103251:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89364-20200516122803 158 0]... 98%79 Success [crab3@vocms0199.cern.ch#13026910.0#1589758964 200517_223135:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89364-20200516122803 14 0]...
1 Failed, ExitCode 8028 [crab3@vocms0144.cern.ch#55353584.0#1589784858 200518_060149:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89428-20200518075303 10 0]...
98%270 Success [crab3@vocms0144.cern.ch#55387371.0#1589846677 200518_235825:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89428-20200518075303 1 0]...
1 Failed, ExitCode 8021 [crab3@vocms0144.cern.ch#55410829.0#1589900394 200518_235825:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89428-20200518075303 180 0]...
4 Failed, Removed due to wall clock limit [crab3@vocms0144.cern.ch#55417138.0#1589910292 200518_235825:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89428-20200518075303 213 0]...
98%276 Success [crab3@vocms0107.cern.ch#55281433.0#1589921456 200519_180426:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89428-20200518075303 33 0]...
5 Failed, Removed due to wall clock limit [crab3@vocms0107.cern.ch#55279725.0#1589918157 200519_180426:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89428-20200518075303 22 0]...
100%298 Success [crab3@vocms0144.cern.ch#55459548.0#1590017450 200520_053926:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89505-20200520073502 214 0]... 100%281 Success [crab3@vocms0120.cern.ch#53447672.0#1590103763 200521_174817:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89505-20200520073502 68 0]... 100%293 Success [crab3@vocms0198.cern.ch#48800610.0#1590190458 200522_220256:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89578-20200522055502 18 0]... 100%284 Success [crab3@vocms0195.cern.ch#52094008.0#1590276669 200523_160523:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89578-20200522055502 89 0]... 100%290 Success [crab3@vocms0197.cern.ch#52380133.0#1590363278 200524_181832:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89640-20200524021103 63 0]... 100%283 Success [crab3@vocms0196.cern.ch#52724970.0#1590448737 200525_122731:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89640-20200524021103 130 0]... 100%295 Success [crab3@vocms0196.cern.ch#52754234.0#1590535811 200526_210428:sciaba_crab_HC-100-T2_FR_GRIF_LLR-89727-20200526050103 29 0]...
FTS Status: 99%Transfer (from/to): 2014/148 files, 1.059/0.254 TB ok
Errors: src_permission: 5/0, src_missing_file: 1/0, src_error: 2/0, trn_error: 10/0 foreign: 1027/0
Links: 46/31 ok, 1/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
100%Transfer (from/to): 2573/483 files, 2.407/0.915 TB ok
Errors: trn_user: 27/0, trn_error: 7/0, dst_permission: 0/2, dst_error: 0/2 foreign: 1596/5
Links: 40/33 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
100%Transfer (from/to): 1692/214 files, 0.553/0.396 TB ok
Errors: trn_timeout: 7/1, trn_user: 165/0, trn_error: 5/0, dst_error: 0/2 foreign: 42/4
Links: 33/30 ok, 0/0 warning, 0/0 error, 2/0 unknown, 1/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
98%Transfer (from/to): 13235/123 files, 1.975/0.257 TB ok
Errors: src_error: 9/0, trn_timeout: 2/0, trn_user: 106/0, trn_error: 728/0 foreign: 36/0
Links: 47/31 ok, 1/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
97%Transfer (from/to): 4795/2347 files, 1.727/4.810 TB ok
Errors: trn_timeout: 6/3, trn_user: 33/0, trn_error: 20/9, dst_permission: 0/4, dst_error: 0/5 foreign: 67/402
Links: 34/41 ok, 2/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
96%Transfer (from/to): 4045/4989 files, 6.253/10.240 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 6/9, trn_user: 2/0, trn_error: 39/12, dst_permission: 0/12, dst_error: 0/21 foreign: 98/11
Links: 47/42 ok, 1/0 warning, 0/2 error, 0/0 unknown, 1/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
100%Transfer (from/to): 8511/6143 files, 6.796/10.109 TB ok
Errors: src_error: 10/0, trn_timeout: 4/0, trn_user: 316/0, trn_error: 43/16, dst_permission: 0/18, dst_error: 0/19 foreign: 310/11
Links: 42/39 ok, 0/3 warning, 0/0 error, 1/0 unknown, 2/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
100%Transfer (from/to): 7813/5600 files, 10.772/7.641 TB ok
Errors: trn_timeout: 58/2, trn_user: 26/0, trn_error: 65/10, dst_permission: 0/17, dst_error: 0/21 foreign: 145/13
Links: 46/44 ok, 0/0 warning, 0/0 error, 1/0 unknown, 2/1 bad-endpoint
polgrid4.in2p3.fr: ok/ok
98%Transfer (from/to): 4540/1971 files, 5.399/0.904 TB ok
Errors: src_error: 2/0, trn_timeout: 2/1, trn_error: 47/3, dst_error: 0/7 foreign: 61/10
Links: 45/41 ok, 1/0 warning, 0/0 error, 1/0 unknown, 3/1 bad-endpoint
polgrid4.in2p3.fr: ok/ok
100%Transfer (from/to): 1206/372 files, 1.792/0.444 TB ok
Errors: trn_error: 31/4, dst_error: 0/1 foreign: 189/7
Links: 29/29 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint
polgrid4.in2p3.fr: ok/ok
100%Transfer (from/to): 9837/4582 files, 27.868/7.987 TB ok
Errors: src_error: 1/0, trn_timeout: 2/1, trn_error: 28/8, dst_permission: 0/15, dst_error: 0/7 foreign: 4996/5
Links: 34/36 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint
polgrid4.in2p3.fr: ok/ok
98%Transfer (from/to): 3257/4066 files, 7.408/8.309 TB ok
Errors: trn_timeout: 1/3, trn_error: 25/5, dst_permission: 0/4, dst_error: 0/13 foreign: 58/7
Links: 32/39 ok, 1/1 warning, 0/0 error, 1/1 unknown, 3/1 bad-endpoint
polgrid4.in2p3.fr: ok/ok
89%Transfer (from/to): 5677/2019 files, 14.421/3.139 TB ok
Errors: trn_timeout: 69/1, trn_error: 201/5, dst_permission: 0/17, dst_error: 0/3 foreign: 42/9
Links: 30/43 ok, 1/0 warning, 3/0 error, 0/0 unknown, 3/1 bad-endpoint
polgrid4.in2p3.fr: ok/ok
96%Transfer (from/to): 11903/13134 files, 31.319/32.669 TB ok
Errors: src_error: 2/0, trn_timeout: 6/8, trn_user: 1/0, trn_error: 269/36, dst_permission: 0/17, dst_error: 0/41 foreign: 103/44
Links: 31/48 ok, 0/0 warning, 1/0 error, 0/0 unknown, 3/1 bad-endpoint
polgrid4.in2p3.fr: ok/ok
100%Transfer (from/to): 3720/5550 files, 5.353/11.770 TB ok
Errors: src_error: 4/0, trn_timeout: 4/0, trn_error: 12/9, dst_permission: 0/6, dst_error: 0/13 foreign: 68/23
Links: 26/39 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint
polgrid4.in2p3.fr: ok/ok
100%Transfer (from/to): 839/3324 files, 1.508/2.588 TB ok
Errors: trn_timeout: 1/1, trn_error: 5/2, dst_error: 0/5 foreign: 23/12
Links: 32/39 ok, 0/0 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
Site Readiness:
26%SAM: ok (15min evaluations: 90 ok, 0 warning, 1 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 46/31 ok, 1/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
49%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 40/33 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
36%SAM: ok (15min evaluations: 82 ok, 0 warning, 2 error, 12 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 33/30 ok, 0/0 warning, 0/0 error, 2/0 unknown, 1/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
21%SAM: ok (15min evaluations: 71 ok, 0 warning, 1 error, 24 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...; 1 Failed, ExitCode 10040 ...),
FTS: ok (Links: 47/31 ok, 1/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
69%SAM: ok (15min evaluations: 89 ok, 0 warning, 7 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (318 Success ...),
FTS: ok (Links: 34/41 ok, 2/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
52%SAM: error (15min evaluations: 58 ok, 0 warning, 33 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (299 Success ...),
FTS: ok (Links: 47/42 ok, 1/0 warning, 0/2 error, 0/0 unknown, 1/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
20%SAM: ok (15min evaluations: 90 ok, 0 warning, 5 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (79 Success ...; 1 Failed, ExitCode 8028 ...),
FTS: ok (Links: 42/39 ok, 0/3 warning, 0/0 error, 1/0 unknown, 2/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
78%SAM: ok (15min evaluations: 87 ok, 0 warning, 2 error, 7 unknown, 0 downtime (0h0m)),
HC: ok (270 Success ...; 1 Failed, ExitCode 8021 ...; 4 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 46/44 ok, 0/0 warning, 0/0 error, 1/0 unknown, 2/1 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
62%SAM: warning (15min evaluations: 80 ok, 2 warning, 12 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (276 Success ...; 5 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 45/41 ok, 1/0 warning, 0/0 error, 1/0 unknown, 3/1 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
70%SAM: ok (15min evaluations: 90 ok, 0 warning, 0 error, 6 unknown, 0 downtime (0h0m)),
HC: ok (298 Success ...),
FTS: ok (Links: 29/29 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
42%SAM: ok (15min evaluations: 55 ok, 0 warning, 0 error, 41 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 34/36 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
58%SAM: ok (15min evaluations: 64 ok, 0 warning, 2 error, 30 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 32/39 ok, 1/1 warning, 0/0 error, 1/1 unknown, 3/1 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
38%SAM: ok (15min evaluations: 72 ok, 0 warning, 2 error, 21 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 30/43 ok, 1/0 warning, 3/0 error, 0/0 unknown, 3/1 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
89%SAM: ok (15min evaluations: 86 ok, 0 warning, 0 error, 9 unknown, 0 downtime (0h0m)),
HC: ok (290 Success ...),
FTS: ok (Links: 31/48 ok, 0/0 warning, 1/0 error, 0/0 unknown, 3/1 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
60%SAM: ok (15min evaluations: 73 ok, 0 warning, 1 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...),
FTS: ok (Links: 26/39 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
50%SAM: ok (15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 32/39 ok, 0/0 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_FR_IPHC
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 71 ok, 0 warning, 1 error, 24 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 5 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 93 ok, 0 warning, 1 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 69 ok, 0 warning, 0 error, 27 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%285 Success [crab3@vocms0199.cern.ch#12715768.0#1589239432 200511_142244:sciaba_crab_HC-100-T2_FR_IPHC-89108-20200510221704 108 0]... 100%293 Success [crab3@vocms0195.cern.ch#51669529.0#1589326933 200512_200948:sciaba_crab_HC-100-T2_FR_IPHC-89186-20200512220905 42 0]... 100%289 Success [crab3@vocms0137.cern.ch#51353667.0#1589411874 200513_141110:sciaba_crab_HC-100-T2_FR_IPHC-89186-20200512220905 109 0]... 100%284 Success [crab3@vocms0107.cern.ch#55099648.0#1589498359 200514_081815:sciaba_crab_HC-100-T2_FR_IPHC-89186-20200512220905 180 0]... 100%314 Success [crab3@vocms0119.cern.ch#53779576.0#1589586010 200515_183823:sciaba_crab_HC-100-T2_FR_IPHC-89269-20200515022704 60 0]...
1 Success, no Chirp ExitCode [crab3@vocms0196.cern.ch#52422770.0#1589666150 200516_103303:sciaba_crab_HC-100-T2_FR_IPHC-89364-20200516122803 136 0]...
99%300 Success [crab3@vocms0196.cern.ch#52424629.0#1589671253 200516_103303:sciaba_crab_HC-100-T2_FR_IPHC-89364-20200516122803 153 0]...
1 Failed, ExitCode 137 [crab3@vocms0196.cern.ch#52429764.0#1589688955 200516_103303:sciaba_crab_HC-100-T2_FR_IPHC-89364-20200516122803 212 0]...
98%80 Success [crab3@vocms0121.cern.ch#53880587.0#1589758348 200517_223624:sciaba_crab_HC-100-T2_FR_IPHC-89364-20200516122803 11 0]...
1 Failed, ExitCode 8028 [crab3@vocms0198.cern.ch#48598397.0#1589784961 200518_060312:sciaba_crab_HC-100-T2_FR_IPHC-89428-20200518075303 10 0]...
100%281 Success [crab3@vocms0107.cern.ch#55257096.0#1589847608 200519_001352:sciaba_crab_HC-100-T2_FR_IPHC-89428-20200518075303 1 0]... 100%278 Success [crab3@vocms0144.cern.ch#55424654.0#1589930131 200519_181931:sciaba_crab_HC-100-T2_FR_IPHC-89428-20200518075303 59 0]... 100%298 Success [crab3@vocms0122.cern.ch#57711342.0#1590018022 200520_054400:sciaba_crab_HC-100-T2_FR_IPHC-89505-20200520073502 215 0]... 100%282 Success [crab3@vocms0197.cern.ch#52299709.0#1590104386 200521_175341:sciaba_crab_HC-100-T2_FR_IPHC-89505-20200520073502 69 0]... 100%293 Success [crab3@vocms0155.cern.ch#55567936.0#1590190233 200522_215928:sciaba_crab_HC-100-T2_FR_IPHC-89578-20200522055502 18 0]... 100%281 Success [crab3@vocms0198.cern.ch#48841957.0#1590279874 200524_001837:sciaba_crab_HC-100-T2_FR_IPHC-89640-20200524021103 1 0]... 100%285 Success [crab3@vocms0199.cern.ch#13283761.0#1590363502 200524_183216:sciaba_crab_HC-100-T2_FR_IPHC-89640-20200524021103 61 0]... 100%286 Success [crab3@vocms0120.cern.ch#53583616.0#1590449211 200525_130040:sciaba_crab_HC-100-T2_FR_IPHC-89640-20200524021103 125 0]... 100%260 Success [crab3@vocms0194.cern.ch#53088386.0#1590536344 200526_210234:sciaba_crab_HC-100-T2_FR_IPHC-89727-20200526050103 31 0]...
FTS Status: 98%Transfer (from/to): 2618/10402 files, 1.700/16.604 TB ok
Errors: src_missing_file: 39/0, src_error: 3/0, trn_timeout: 2/3, trn_error: 48/25, dst_permission: 0/4, dst_path: 0/3, dst_error: 0/10 foreign: 99/7319
Links: 53/48 ok, 2/3 warning, 0/0 error, 1/2 unknown, 1/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
97%Transfer (from/to): 2411/6860 files, 2.374/12.516 TB ok
Errors: src_missing_file: 50/0, trn_timeout: 1/5, trn_error: 12/6, dst_permission: 0/3, dst_path: 0/2, dst_error: 0/6 foreign: 276/1114
Links: 54/47 ok, 1/1 warning, 0/0 error, 1/2 unknown, 1/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
98%Transfer (from/to): 1442/4961 files, 1.414/11.928 TB ok
Errors: src_missing_file: 60/0, src_error: 16/0, trn_timeout: 14/0, trn_error: 5/0, dst_permission: 0/2, dst_error: 0/7 foreign: 880/24
Links: 48/48 ok, 1/0 warning, 2/0 error, 0/2 unknown, 1/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
96%Transfer (from/to): 1778/677 files, 2.259/1.240 TB ok
Errors: src_missing_file: 60/0, trn_timeout: 4/5, trn_error: 9/1, dst_error: 0/10 foreign: 25/22
Links: 48/48 ok, 2/1 warning, 0/1 error, 2/2 unknown, 1/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
96%Transfer (from/to): 5580/6977 files, 8.799/11.391 TB ok
Errors: src_missing_file: 48/0, src_error: 44/0, trn_timeout: 5/0, trn_error: 55/2, dst_permission: 0/2, dst_path: 0/5, dst_error: 0/10 foreign: 382/292
Links: 47/50 ok, 2/1 warning, 1/0 error, 1/2 unknown, 1/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
96%Transfer (from/to): 1853/13139 files, 3.485/22.064 TB ok
Errors: src_missing_file: 57/0, src_error: 1359/0, trn_timeout: 2/5, trn_error: 18/5, dst_permission: 0/2, dst_path: 0/5, dst_error: 0/4 foreign: 7/18
Links: 49/55 ok, 1/0 warning, 3/0 error, 1/2 unknown, 1/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
98%Transfer (from/to): 3616/17281 files, 5.409/17.562 TB ok
Errors: src_missing_file: 54/0, src_error: 1185/0, trn_timeout: 19/70, trn_error: 47/26, dst_permission: 0/4, dst_path: 0/5, dst_error: 0/11 foreign: 73/19
Links: 49/51 ok, 1/3 warning, 2/0 error, 1/2 unknown, 2/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
97%Transfer (from/to): 4140/6653 files, 9.678/14.542 TB ok
Errors: src_missing_file: 63/0, src_error: 1904/0, trn_timeout: 114/5, trn_error: 79/22, dst_path: 0/5, dst_error: 0/13 foreign: 77/35
Links: 48/51 ok, 4/2 warning, 3/0 error, 1/1 unknown, 2/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
99%Transfer (from/to): 3917/1075 files, 5.258/2.315 TB ok
Errors: src_missing_file: 63/0, src_error: 38/0, trn_timeout: 46/0, trn_error: 31/1, dst_permission: 0/2, dst_path: 0/1, dst_error: 0/3 foreign: 22/34
Links: 55/51 ok, 0/0 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
100%Transfer (from/to): 2634/326 files, 3.326/0.663 TB ok
Errors: src_missing_file: 57/0, trn_timeout: 1/0, trn_error: 16/2, dst_permission: 0/1, dst_error: 0/5 foreign: 21/26
Links: 48/48 ok, 0/0 warning, 0/0 error, 1/2 unknown, 3/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
98%Transfer (from/to): 2570/6866 files, 1.713/18.989 TB ok
Errors: src_missing_file: 43/0, trn_timeout: 2/2, trn_error: 18/2, dst_permission: 0/2, dst_path: 0/5, dst_error: 0/5 foreign: 90/28
Links: 49/44 ok, 0/2 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
96%Transfer (from/to): 8171/5306 files, 25.602/9.046 TB ok
Errors: src_missing_file: 39/0, src_error: 4/0, trn_timeout: 2/10, trn_error: 19/1, dst_permission: 0/5, dst_path: 0/4, dst_error: 0/7 foreign: 72/28
Links: 44/46 ok, 0/1 warning, 1/1 error, 1/2 unknown, 3/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
97%Transfer (from/to): 987/3315 files, 1.462/9.877 TB ok
Errors: src_missing_file: 60/0, trn_timeout: 1/8, trn_error: 16/4, dst_permission: 0/7, dst_path: 0/2, dst_error: 0/5 foreign: 57/23
Links: 45/45 ok, 1/2 warning, 1/1 error, 1/2 unknown, 3/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
98%Transfer (from/to): 1699/9767 files, 2.831/21.022 TB ok
Errors: src_missing_file: 45/0, trn_timeout: 2/8, trn_error: 30/7, dst_permission: 0/4, dst_path: 0/8, dst_error: 0/7 foreign: 79/33
Links: 47/49 ok, 1/1 warning, 0/0 error, 1/1 unknown, 3/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
97%Transfer (from/to): 2313/1664 files, 2.988/3.542 TB ok
Errors: src_missing_file: 61/0, trn_timeout: 1/0, trn_error: 29/3, dst_error: 0/9 foreign: 76/36
Links: 45/44 ok, 0/1 warning, 2/0 error, 0/2 unknown, 3/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
97%Transfer (from/to): 8219/4394 files, 25.416/11.536 TB ok
Errors: src_missing_file: 42/0, src_error: 136/0, trn_timeout: 3/4, trn_error: 8/5, dst_permission: 0/1, dst_error: 0/5 foreign: 36/26
Links: 47/43 ok, 2/2 warning, 1/0 error, 1/3 unknown, 2/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
Site Readiness:
96%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 53/48 ok, 2/3 warning, 0/0 error, 1/2 unknown, 1/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
88%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 54/47 ok, 1/1 warning, 0/0 error, 1/2 unknown, 1/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
79%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...),
FTS: ok (Links: 48/48 ok, 1/0 warning, 2/0 error, 0/2 unknown, 1/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
57%SAM: ok (15min evaluations: 71 ok, 0 warning, 1 error, 24 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 48/48 ok, 2/1 warning, 0/1 error, 2/2 unknown, 1/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
88%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (314 Success ...; 1 Success, no Chirp ExitCode ...),
FTS: ok (Links: 47/50 ok, 2/1 warning, 1/0 error, 1/2 unknown, 1/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
99%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (300 Success ...; 1 Failed, ExitCode 137 ...),
FTS: ok (Links: 49/55 ok, 1/0 warning, 3/0 error, 1/2 unknown, 1/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
29%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (80 Success ...; 1 Failed, ExitCode 8028 ...),
FTS: ok (Links: 49/51 ok, 1/3 warning, 2/0 error, 1/2 unknown, 2/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
91%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 48/51 ok, 4/2 warning, 3/0 error, 1/1 unknown, 2/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
74%SAM: ok (15min evaluations: 91 ok, 5 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (278 Success ...),
FTS: ok (Links: 55/51 ok, 0/0 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
53%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (298 Success ...),
FTS: ok (Links: 48/48 ok, 0/0 warning, 0/0 error, 1/2 unknown, 3/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
82%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 49/44 ok, 0/2 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
69%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 44/46 ok, 0/1 warning, 1/1 error, 1/2 unknown, 3/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
54%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 45/45 ok, 1/2 warning, 1/1 error, 1/2 unknown, 3/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
89%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 47/49 ok, 1/1 warning, 0/0 error, 1/1 unknown, 3/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
62%SAM: ok (15min evaluations: 93 ok, 0 warning, 1 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (286 Success ...),
FTS: ok (Links: 45/44 ok, 0/1 warning, 2/0 error, 0/2 unknown, 3/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
36%SAM: ok (15min evaluations: 69 ok, 0 warning, 0 error, 27 unknown, 0 downtime (0h0m)),
HC: ok (260 Success ...),
FTS: ok (Links: 47/43 ok, 2/2 warning, 1/0 error, 1/3 unknown, 2/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_GR_Ioannina
GGUS Tickets: 146617
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 73 ok, 0 warning, 0 error, 23 unknown, 0 downtime (0h0m) 96%15min evaluations: 92 ok, 1 warning, 3 error, 0 unknown, 0 downtime (0h0m) 95%15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m) 95%15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 4 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 94 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 69 ok, 0 warning, 0 error, 27 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%298 Success [crab3@vocms0194.cern.ch#52597432.0#1589240017 200511_105648:sciaba_crab_HC-93-T2_GR_Ioannina-89134-20200511125303 151 0]... 99%279 Success [crab3@vocms0144.cern.ch#55159984.0#1589326589 200512_225715:sciaba_crab_HC-93-T2_GR_Ioannina-89134-20200511125303 7 0]...
2 Failed, ExitCode 47 [crab3@vocms0144.cern.ch#55163601.0#1589337695 200512_225715:sciaba_crab_HC-93-T2_GR_Ioannina-89134-20200511125303 44 0]...
99%291 Success [crab3@vocms0137.cern.ch#51354425.0#1589412759 200513_150634:sciaba_crab_HC-93-T2_GR_Ioannina-89216-20200513170104 101 0]...
1 Failed, ExitCode 8021 [crab3@vocms0197.cern.ch#51951711.0#1589475608 200514_090339:sciaba_crab_HC-93-T2_GR_Ioannina-89216-20200513170104 95 0]...
100%286 Success [crab3@vocms0197.cern.ch#51967301.0#1589499314 200514_090339:sciaba_crab_HC-93-T2_GR_Ioannina-89216-20200513170104 174 0]... 100%313 Success [crab3@vocms0194.cern.ch#52773176.0#1589586057 200515_184413:sciaba_crab_HC-93-T2_GR_Ioannina-89297-20200515204104 59 0]... 100%300 Success [crab3@vocms0137.cern.ch#51519376.0#1589672014 200516_103104:sciaba_crab_HC-93-T2_GR_Ioannina-89370-20200516122702 155 0]... 100%228 Success [crab3@vocms0198.cern.ch#48582089.0#1589758566 200517_222954:sciaba_crab_HC-93-T2_GR_Ioannina-89370-20200516122702 13 0]... 99%291 Success [crab3@vocms0137.cern.ch#51570743.0#1589845145 200518_120250:sciaba_crab_HC-93-T2_GR_Ioannina-89440-20200518135503 139 0]...
3 Failed, ExitCode 8021 [crab3@vocms0137.cern.ch#51573047.0#1589856850 200518_120250:sciaba_crab_HC-93-T2_GR_Ioannina-89440-20200518135503 178 0]...
99%282 Success [crab3@vocms0121.cern.ch#53956761.0#1589931248 200519_061207:sciaba_crab_HC-93-T2_GR_Ioannina-89440-20200518135503 208 0]...
1 Failed, ExitCode 47 [crab3@vocms0119.cern.ch#54026663.0#1589940833 200520_001750:sciaba_crab_HC-93-T2_GR_Ioannina-89440-20200518135503 23 0]...
99%294 Success [crab3@vocms0155.cern.ch#55478765.0#1590017406 200520_142330:sciaba_crab_HC-93-T2_GR_Ioannina-89518-20200520162103 109 0]...
2 Failed, ExitCode 8021 [crab3@vocms0155.cern.ch#55484820.0#1590037813 200520_142330:sciaba_crab_HC-93-T2_GR_Ioannina-89518-20200520162103 177 0]...
100%285 Success [crab3@vocms0107.cern.ch#55323893.0#1590104042 200521_082315:sciaba_crab_HC-93-T2_GR_Ioannina-89518-20200520162103 182 0]... 99%289 Success [crab3@vocms0197.cern.ch#52336149.0#1590190792 200522_161344:sciaba_crab_HC-93-T2_GR_Ioannina-89596-20200522180703 89 0]...
1 Failed, ExitCode 8001 [crab3@vocms0107.cern.ch#55378443.0#1590265536 200523_102454:sciaba_crab_HC-93-T2_GR_Ioannina-89596-20200522180703 120 0]...
99%288 Success [crab3@vocms0107.cern.ch#55383942.0#1590276941 200523_102454:sciaba_crab_HC-93-T2_GR_Ioannina-89596-20200522180703 158 0]...
1 Failed, ExitCode 135 [crab3@vocms0107.cern.ch#55388549.0#1590302413 200524_040836:sciaba_crab_HC-93-T2_GR_Ioannina-89596-20200522180703 30 0]...
1 Failed, ExitCode 47 [crab3@vocms0107.cern.ch#55388564.0#1590303312 200524_040836:sciaba_crab_HC-93-T2_GR_Ioannina-89596-20200522180703 33 0]...
100%293 Success [crab3@vocms0194.cern.ch#53032264.0#1590363560 200524_124750:sciaba_crab_HC-93-T2_GR_Ioannina-89669-20200524144303 130 0]... 100%281 Success [crab3@vocms0144.cern.ch#55630482.0#1590449734 200525_063857:sciaba_crab_HC-93-T2_GR_Ioannina-89669-20200524144303 203 0]... 100%275 Success [crab3@vocms0120.cern.ch#53614261.0#1590535936 200526_092553:sciaba_crab_HC-93-T2_GR_Ioannina-89740-20200526112103 169 0]...
FTS Status: 99%Transfer (from/to): 556/523 files, 0.473/1.125 TB ok
Errors: src_error: 5/0, trn_timeout: 0/22, trn_error: 9/3, dst_permission: 0/2, dst_error: 0/4 foreign: 1/34
Links: 46/51 ok, 1/2 warning, 0/0 error, 0/3 unknown, 1/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
100%Transfer (from/to): 586/1608 files, 0.498/3.403 TB ok
Errors: src_error: 3/0, trn_timeout: 2/9, trn_error: 4/9, dst_permission: 0/1, dst_error: 0/10 foreign: 3/27
Links: 46/52 ok, 0/0 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
98%Transfer (from/to): 342/870 files, 0.416/1.791 TB ok
Errors: src_error: 72/0, trn_timeout: 1/8, trn_error: 19/63, dst_error: 0/15 foreign: 23/26
Links: 40/51 ok, 4/1 warning, 1/0 error, 1/2 unknown, 1/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
98%Transfer (from/to): 339/493 files, 0.437/1.257 TB ok
Errors: src_error: 406/0, trn_timeout: 3/17, trn_error: 8/4, dst_permission: 0/1, dst_error: 0/4 foreign: 23/15
Links: 45/53 ok, 0/1 warning, 1/0 error, 1/1 unknown, 1/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
95%Transfer (from/to): 346/1185 files, 0.734/4.070 TB ok
Errors: src_error: 668/0, trn_timeout: 4/16, trn_error: 44/18, dst_path: 0/1, dst_error: 0/10 foreign: 96/239
Links: 37/51 ok, 7/3 warning, 2/0 error, 2/1 unknown, 1/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
72%Transfer (from/to): 678/1890 files, 0.436/3.483 TB ok
Errors: trn_timeout: 4/30, trn_error: 148/92, dst_error: 0/8 foreign: 17/12
Links: 31/46 ok, 5/7 warning, 12/1 error, 1/2 unknown, 0/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
98%Transfer (from/to): 418/3406 files, 0.450/8.079 TB ok
Errors: trn_timeout: 7/5, trn_error: 80/71, dst_permission: 0/3, dst_path: 0/1, dst_error: 0/30 foreign: 26/28
Links: 30/50 ok, 18/1 warning, 0/0 error, 1/3 unknown, 2/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
95%Transfer (from/to): 438/1400 files, 0.586/2.425 TB ok
Errors: src_error: 8/0, trn_timeout: 27/5, trn_error: 35/4, dst_path: 0/1, dst_error: 0/26 foreign: 24/33
Links: 41/51 ok, 7/1 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint
grid02.physics.uoi.gr: ok/ok
100%Transfer (from/to): 313/629 files, 0.586/1.205 TB ok
Errors: trn_error: 4/2, dst_permission: 0/3, dst_error: 0/4 foreign: 14/54
Links: 46/54 ok, 0/0 warning, 0/0 error, 0/2 unknown, 2/1 bad-endpoint
grid02.physics.uoi.gr: ok/ok
99%Transfer (from/to): 307/377 files, 0.450/0.922 TB ok
Errors: src_error: 44/0, trn_timeout: 0/2, trn_error: 4/0, dst_error: 0/2 foreign: 25/21
Links: 45/52 ok, 0/1 warning, 2/0 error, 0/2 unknown, 2/1 bad-endpoint
grid02.physics.uoi.gr: ok/ok
99%Transfer (from/to): 421/891 files, 0.465/1.868 TB ok
Errors: src_error: 581/0, trn_timeout: 1/1, trn_error: 4/0, dst_permission: 0/1, dst_error: 0/9 foreign: 49/40
Links: 45/53 ok, 1/0 warning, 1/0 error, 1/2 unknown, 2/1 bad-endpoint
grid02.physics.uoi.gr: ok/ok
97%Transfer (from/to): 2070/2527 files, 4.818/6.919 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 40/32, trn_error: 5/13, dst_permission: 0/4, dst_path: 0/3, dst_error: 0/29 foreign: 84/56
Links: 43/47 ok, 1/3 warning, 0/0 error, 0/4 unknown, 2/1 bad-endpoint
grid02.physics.uoi.gr: ok/ok
100%Transfer (from/to): 621/2756 files, 0.749/8.170 TB ok
Errors: trn_timeout: 2/5, trn_error: 8/12, dst_path: 0/1, dst_error: 0/36 foreign: 59/52
Links: 47/53 ok, 0/0 warning, 0/0 error, 0/4 unknown, 2/1 bad-endpoint
grid02.physics.uoi.gr: ok/ok
98%Transfer (from/to): 1590/2330 files, 2.738/4.067 TB ok
Errors: trn_timeout: 5/42, trn_error: 0/4, dst_permission: 0/2, dst_path: 0/4, dst_error: 0/23 foreign: 103/64
Links: 46/53 ok, 1/1 warning, 0/0 error, 0/3 unknown, 1/1 bad-endpoint
grid02.physics.uoi.gr: ok/ok
100%Transfer (from/to): 3509/571 files, 0.653/1.163 TB ok
Errors: trn_timeout: 3/0, trn_error: 3/0, dst_path: 0/1, dst_error: 0/5 foreign: 85/0
Links: 46/23 ok, 2/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
97%Transfer (from/to): 1242/901 files, 0.370/1.834 TB ok
Errors: trn_error: 0/1, dst_error: 0/12 foreign: 19/2
Links: 49/34 ok, 0/5 warning, 0/1 error, 0/2 unknown, 0/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
Site Readiness:
72%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (298 Success ...),
FTS: ok (Links: 46/51 ok, 1/2 warning, 0/0 error, 0/3 unknown, 1/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
54%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...; 2 Failed, ExitCode 47 ...),
FTS: ok (Links: 46/52 ok, 0/0 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
61%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 40/51 ok, 4/1 warning, 1/0 error, 1/2 unknown, 1/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
30%SAM: ok (15min evaluations: 73 ok, 0 warning, 0 error, 23 unknown, 0 downtime (0h0m)),
HC: ok (286 Success ...),
FTS: ok (Links: 45/53 ok, 0/1 warning, 1/0 error, 1/1 unknown, 1/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
57%SAM: ok (15min evaluations: 92 ok, 1 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (313 Success ...),
FTS: ok (Links: 37/51 ok, 7/3 warning, 2/0 error, 2/1 unknown, 1/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
84%SAM: ok (15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (300 Success ...),
FTS: ok (Links: 31/46 ok, 5/7 warning, 12/1 error, 1/2 unknown, 0/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
66%SAM: ok (15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (228 Success ...),
FTS: ok (Links: 30/50 ok, 18/1 warning, 0/0 error, 1/3 unknown, 2/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
78%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...; 3 Failed, ExitCode 8021 ...),
FTS: ok (Links: 41/51 ok, 7/1 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
54%SAM: ok (15min evaluations: 92 ok, 4 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...; 1 Failed, ExitCode 47 ...),
FTS: ok (Links: 46/54 ok, 0/0 warning, 0/0 error, 0/2 unknown, 2/1 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
52%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...; 2 Failed, ExitCode 8021 ...),
FTS: ok (Links: 45/52 ok, 0/1 warning, 2/0 error, 0/2 unknown, 2/1 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
51%SAM: ok (15min evaluations: 94 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...),
FTS: ok (Links: 45/53 ok, 1/0 warning, 1/0 error, 1/2 unknown, 2/1 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
89%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...; 1 Failed, ExitCode 8001 ...),
FTS: ok (Links: 43/47 ok, 1/3 warning, 0/0 error, 0/4 unknown, 2/1 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
90%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (288 Success ...; 1 Failed, ExitCode 135 ...; 1 Failed, ExitCode 47 ...),
FTS: ok (Links: 47/53 ok, 0/0 warning, 0/0 error, 0/4 unknown, 2/1 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
93%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 46/53 ok, 1/1 warning, 0/0 error, 0/3 unknown, 1/1 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
31%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 46/23 ok, 2/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
22%SAM: ok (15min evaluations: 69 ok, 0 warning, 0 error, 27 unknown, 0 downtime (0h0m)),
HC: ok (275 Success ...),
FTS: ok (Links: 49/34 ok, 0/5 warning, 0/1 error, 0/2 unknown, 0/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_HU_Budapest
GGUS Tickets:
Downtimes:
SAM Status: 96%15min evaluations: 82 ok, 0 warning, 3 error, 11 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m) 82%15min evaluations: 63 ok, 1 warning, 14 error, 18 unknown, 0 downtime (0h0m) 89%15min evaluations: 58 ok, 0 warning, 7 error, 31 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 94%15min evaluations: 91 ok, 0 warning, 5 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 65 ok, 0 warning, 0 error, 31 unknown, 0 downtime (0h0m)
Hammer Cloud: 99%292 Success [crab3@vocms0155.cern.ch#55011294.0#1589240153 200511_203940:sciaba_crab_HC-94-T2_HU_Budapest-89122-20200511044105 35 0]...
1 Failed, ExitCode 8021 [crab3@vocms0155.cern.ch#55036899.0#1589286364 200511_203940:sciaba_crab_HC-94-T2_HU_Budapest-89122-20200511044105 189 0]...
100%277 Success [crab3@vocms0196.cern.ch#52221286.0#1589326758 200512_144702:sciaba_crab_HC-94-T2_HU_Budapest-89122-20200511044105 106 0]... 100%297 Success [crab3@vocms0155.cern.ch#55163668.0#1589413029 200513_071027:sciaba_crab_HC-94-T2_HU_Budapest-89206-20200513090506 197 0]... 96%279 Success [crab3@vocms0120.cern.ch#53099701.0#1589499907 200514_191546:sciaba_crab_HC-94-T2_HU_Budapest-89206-20200513090506 52 0]...
9 Failed, ExitCode 47 [crab3@vocms0196.cern.ch#52366966.0#1589550298 200515_112916:sciaba_crab_HC-94-T2_HU_Budapest-89288-20200515132505 26 0]...
73%346 Success [crab3@vocms0196.cern.ch#52391040.0#1589585995 200515_112916:sciaba_crab_HC-94-T2_HU_Budapest-89288-20200515132505 145 0]...
7 Failed, ExitCode 47 [crab3@vocms0196.cern.ch#52392957.0#1589590793 200515_112916:sciaba_crab_HC-94-T2_HU_Budapest-89288-20200515132505 161 0]...
51 Failed, ExitCode 8021 [crab3@vocms0196.cern.ch#52396782.0#1589620100 200516_081706:sciaba_crab_HC-94-T2_HU_Budapest-89351-20200516101520 10 0]...
3 Failed, ExitCode 8002 [crab3@vocms0121.cern.ch#53779034.0#1589634496 200516_053052:sciaba_crab_HC-94-T2_HU_Budapest-89288-20200515132505 91 0]...
5 Failed, ExitCode 10034 [crab3@vocms0121.cern.ch#53780559.0#1589635998 200516_053052:sciaba_crab_HC-94-T2_HU_Budapest-89288-20200515132505 96 0]...
59 Failed, Removed due to wall clock limit [crab3@vocms0121.cern.ch#53778844.0#1589634275 200516_053052:sciaba_crab_HC-94-T2_HU_Budapest-89288-20200515132505 86 1]...
48%66 Failed, ExitCode 8021 [crab3@vocms0121.cern.ch#53805827.0#1589671102 200516_053052:sciaba_crab_HC-94-T2_HU_Budapest-89288-20200515132505 213 0]...
181 Success [crab3@vocms0121.cern.ch#53805753.0#1589670881 200516_053052:sciaba_crab_HC-94-T2_HU_Budapest-89288-20200515132505 191 1]...
122 Failed, Removed due to wall clock limit [crab3@vocms0196.cern.ch#52418526.0#1589656451 200516_081706:sciaba_crab_HC-94-T2_HU_Budapest-89351-20200516101520 115 1]...
1 Failed, ExitCode 8002 [crab3@vocms0196.cern.ch#52425050.0#1589671712 200516_081706:sciaba_crab_HC-94-T2_HU_Budapest-89351-20200516101520 182 0]...
1 Failed, ExitCode 8006 [crab3@vocms0196.cern.ch#52430066.0#1589697342 200516_081706:sciaba_crab_HC-94-T2_HU_Budapest-89351-20200516101520 214 1]...
83%93 Success [crab3@vocms0144.cern.ch#55346220.0#1589758796 200517_053349:sciaba_crab_HC-94-T2_HU_Budapest-89351-20200516101520 217 0]...
9 Failed, Removed due to wall clock limit [crab3@vocms0144.cern.ch#55345073.0#1589742592 200517_053349:sciaba_crab_HC-94-T2_HU_Budapest-89351-20200516101520 163 0]...
6 Failed, ExitCode 8021 [crab3@vocms0144.cern.ch#55345493.0#1589746195 200517_053349:sciaba_crab_HC-94-T2_HU_Budapest-89351-20200516101520 175 0]...
1 Failed, ExitCode 139 [crab3@vocms0144.cern.ch#55345771.0#1589749794 200517_053349:sciaba_crab_HC-94-T2_HU_Budapest-89351-20200516101520 187 0]...
1 Failed, ExitCode 8001 [crab3@vocms0144.cern.ch#55346197.0#1589757894 200517_053349:sciaba_crab_HC-94-T2_HU_Budapest-89351-20200516101520 214 0]...
2 Failed, ExitCode 47 [crab3@vocms0198.cern.ch#48590631.0#1589775103 200517_232039:sciaba_crab_HC-94-T2_HU_Budapest-89351-20200516101520 58 0]...
98%288 Success [crab3@vocms0197.cern.ch#52144450.0#1589846147 200518_225500:sciaba_crab_HC-94-T2_HU_Budapest-89426-20200518065302 6 1]...
4 Failed, ExitCode 47 [crab3@vocms0197.cern.ch#52150970.0#1589865078 200518_225500:sciaba_crab_HC-94-T2_HU_Budapest-89426-20200518065302 70 0]...
99%285 Success [crab3@vocms0196.cern.ch#52515747.0#1589931906 200519_172410:sciaba_crab_HC-94-T2_HU_Budapest-89426-20200518065302 76 0]...
2 Failed, ExitCode 47 [crab3@vocms0196.cern.ch#52515821.0#1589934609 200519_172410:sciaba_crab_HC-94-T2_HU_Budapest-89426-20200518065302 85 0]...
1 Failed, ExitCode 8021 [crab3@vocms0121.cern.ch#53958749.0#1589944339 200520_023107:sciaba_crab_HC-94-T2_HU_Budapest-89494-20200520042103 8 0]...
99%289 Success [crab3@vocms0121.cern.ch#53983756.0#1590018039 200520_202855:sciaba_crab_HC-94-T2_HU_Budapest-89494-20200520042103 38 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0119.cern.ch#54088401.0#1590073858 200521_143749:sciaba_crab_HC-94-T2_HU_Budapest-89494-20200520042103 6 0]...
100%281 Success [crab3@vocms0119.cern.ch#54100494.0#1590104164 200521_143749:sciaba_crab_HC-94-T2_HU_Budapest-89494-20200520042103 107 0]... 100%292 Success [crab3@vocms0144.cern.ch#55530106.0#1590190638 200522_193057:sciaba_crab_HC-94-T2_HU_Budapest-89569-20200522031102 49 0]... 100%277 Success [crab3@vocms0106.cern.ch#43405168.0#1590277149 200523_133806:sciaba_crab_HC-94-T2_HU_Budapest-89569-20200522031102 120 0]... 99%295 Success [crab3@vocms0197.cern.ch#52380160.0#1590363540 200524_054725:sciaba_crab_HC-94-T2_HU_Budapest-89657-20200524073703 214 0]...
1 Failed, ExitCode 8021 [crab3@vocms0194.cern.ch#53056645.0#1590446195 200525_175507:sciaba_crab_HC-94-T2_HU_Budapest-89657-20200524073703 56 0]...
98%288 Success [crab3@vocms0194.cern.ch#53056817.0#1590449794 200525_175507:sciaba_crab_HC-94-T2_HU_Budapest-89657-20200524073703 68 0]...
4 Failed, ExitCode 8021 [crab3@vocms0194.cern.ch#53068026.0#1590461869 200526_020625:sciaba_crab_HC-94-T2_HU_Budapest-89725-20200526035903 10 0]...
100%292 Success [crab3@vocms0137.cern.ch#51852255.0#1590536842 200526_200038:sciaba_crab_HC-94-T2_HU_Budapest-89725-20200526035903 45 0]...
FTS Status: 100%Transfer (from/to): 882/514 files, 0.609/1.038 TB ok
Errors: trn_timeout: 1/42, trn_error: 404/2 foreign: 2473/4
Links: 44/22 ok, 0/20 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint
grid143.kfki.hu: ok/ok
99%Transfer (from/to): 8787/366 files, 0.521/0.650 TB ok
Errors: src_error: 2511/0, trn_timeout: 6/6, trn_error: 16/0 foreign: 1901/11
Links: 43/40 ok, 0/4 warning, 1/0 error, 1/1 unknown, 1/0 bad-endpoint
grid143.kfki.hu: ok/ok
99%Transfer (from/to): 3103/1087 files, 1.436/0.694 TB ok
Errors: src_error: 1143/0, trn_timeout: 7/109, trn_error: 27/4, dst_permission: 0/1, dst_error: 0/24 foreign: 1408/7
Links: 41/42 ok, 1/5 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
grid143.kfki.hu: ok/ok
100%Transfer (from/to): 1964/873 files, 4.898/1.013 TB ok
Errors: trn_timeout: 10/51, trn_error: 7/2 foreign: 164/7
Links: 44/39 ok, 0/3 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
grid143.kfki.hu: ok/ok
97%Transfer (from/to): 802/387 files, 2.346/0.556 TB ok
Errors: src_error: 9/0, trn_timeout: 0/133, trn_error: 7/4 foreign: 765/9
Links: 46/27 ok, 0/15 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
grid143.kfki.hu: ok/ok
94%Transfer (from/to): 693/367 files, 1.287/0.772 TB ok
Errors: trn_timeout: 2/27, trn_error: 8/3, dst_error: 0/9 foreign: 1996/5
Links: 46/32 ok, 2/8 warning, 0/2 error, 1/1 unknown, 1/0 bad-endpoint
grid143.kfki.hu: ok/ok
93%Transfer (from/to): 912/3111 files, 0.499/7.223 TB ok
Errors: trn_timeout: 3/123, trn_error: 14/3, dst_error: 0/1 foreign: 785/14
Links: 45/29 ok, 1/13 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint
grid143.kfki.hu: ok/ok
96%Transfer (from/to): 4905/1690 files, 12.343/3.781 TB ok
Errors: src_error: 16/0, trn_timeout: 4/207, trn_error: 75/7, dst_error: 0/2 foreign: 28/54
Links: 43/29 ok, 1/12 warning, 0/1 error, 1/1 unknown, 1/1 bad-endpoint
grid143.kfki.hu: ok/ok
96%Transfer (from/to): 1398/4696 files, 0.996/10.826 TB ok
Errors: trn_timeout: 0/165, trn_error: 5/11, dst_path: 0/5, dst_error: 0/4 foreign: 1064/21
Links: 45/27 ok, 0/14 warning, 0/1 error, 1/2 unknown, 2/1 bad-endpoint
grid143.kfki.hu: ok/ok
96%Transfer (from/to): 1447/6397 files, 0.470/15.682 TB ok
Errors: src_error: 219/0, trn_timeout: 0/164, trn_error: 5/1, dst_error: 0/3 foreign: 2220/19
Links: 44/25 ok, 1/16 warning, 0/1 error, 1/2 unknown, 2/1 bad-endpoint
grid143.kfki.hu: ok/ok
96%Transfer (from/to): 4359/1053 files, 9.996/2.391 TB ok
Errors: src_error: 78/0, trn_timeout: 9/8, trn_error: 6/1, dst_path: 0/1 foreign: 1180/28
Links: 46/39 ok, 0/1 warning, 0/1 error, 1/2 unknown, 3/1 bad-endpoint
grid143.kfki.hu: ok/ok
96%Transfer (from/to): 11041/1744 files, 3.443/1.997 TB ok
Errors: src_error: 2/0, trn_timeout: 0/14, trn_error: 26/0 foreign: 1469/29
Links: 47/39 ok, 1/1 warning, 0/1 error, 0/2 unknown, 3/1 bad-endpoint
grid143.kfki.hu: ok/ok
95%Transfer (from/to): 2512/323 files, 1.881/0.701 TB ok
Errors: trn_timeout: 1/16, trn_error: 134/0 foreign: 693/30
Links: 50/38 ok, 0/0 warning, 1/2 error, 0/2 unknown, 3/1 bad-endpoint
grid143.kfki.hu: ok/ok
88%Transfer (from/to): 3761/260 files, 2.147/0.498 TB ok
Errors: src_error: 2/0, trn_timeout: 3/100, trn_error: 2/0 foreign: 386/16
Links: 48/24 ok, 1/16 warning, 0/3 error, 1/2 unknown, 3/1 bad-endpoint
grid143.kfki.hu: ok/ok
93%Transfer (from/to): 3691/297 files, 1.271/0.679 TB ok
Errors: trn_timeout: 0/114, trn_error: 10/2 foreign: 120/18
Links: 45/28 ok, 1/14 warning, 0/2 error, 0/2 unknown, 3/1 bad-endpoint
grid143.kfki.hu: ok/ok
97%Transfer (from/to): 1999/330 files, 1.800/0.693 TB ok
Errors: src_error: 1/0, trn_timeout: 1/2, trn_error: 4/2 foreign: 34/19
Links: 49/40 ok, 1/1 warning, 0/0 error, 0/3 unknown, 2/0 bad-endpoint
grid143.kfki.hu: ok/ok
Site Readiness:
43%SAM: ok (15min evaluations: 82 ok, 0 warning, 3 error, 11 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 44/22 ok, 0/20 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint; grid143.kfki.hu: ok/ok)
62%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (277 Success ...),
FTS: ok (Links: 43/40 ok, 0/4 warning, 1/0 error, 1/1 unknown, 1/0 bad-endpoint; grid143.kfki.hu: ok/ok)
89%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 41/42 ok, 1/5 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; grid143.kfki.hu: ok/ok)
60%SAM: ok (15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...; 9 Failed, ExitCode 47 ...),
FTS: ok (Links: 44/39 ok, 0/3 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; grid143.kfki.hu: ok/ok)
27%SAM: warning (15min evaluations: 63 ok, 1 warning, 14 error, 18 unknown, 0 downtime (0h0m)),
HC: error (346 Success ...; 7 Failed, ExitCode 47 ...; 51 Failed, ExitCode 8021 ...; 3 Failed, ExitCode 8002 ...; 5 Failed, ExitCode 10034 ...; 59 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 46/27 ok, 0/15 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; grid143.kfki.hu: ok/ok)
7%SAM: warning (15min evaluations: 58 ok, 0 warning, 7 error, 31 unknown, 0 downtime (0h0m)),
HC: error (66 Failed, ExitCode 8021 ...; 181 Success ...; 122 Failed, Removed due to wall clock limit ...; 1 Failed, ExitCode 8002 ...; 1 Failed, ExitCode 8006 ...),
FTS: ok (Links: 46/32 ok, 2/8 warning, 0/2 error, 1/1 unknown, 1/0 bad-endpoint; grid143.kfki.hu: ok/ok)
7%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: warning (93 Success ...; 9 Failed, Removed due to wall clock limit ...; 6 Failed, ExitCode 8021 ...; 1 Failed, ExitCode 139 ...; 1 Failed, ExitCode 8001 ...; 2 Failed, ExitCode 47 ...),
FTS: ok (Links: 45/29 ok, 1/13 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint; grid143.kfki.hu: ok/ok)
93%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (288 Success ...; 4 Failed, ExitCode 47 ...),
FTS: ok (Links: 43/29 ok, 1/12 warning, 0/1 error, 1/1 unknown, 1/1 bad-endpoint; grid143.kfki.hu: ok/ok)
81%SAM: ok (15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (285 Success ...; 2 Failed, ExitCode 47 ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 45/27 ok, 0/14 warning, 0/1 error, 1/2 unknown, 2/1 bad-endpoint; grid143.kfki.hu: ok/ok)
74%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 44/25 ok, 1/16 warning, 0/1 error, 1/2 unknown, 2/1 bad-endpoint; grid143.kfki.hu: ok/ok)
72%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 46/39 ok, 0/1 warning, 0/1 error, 1/2 unknown, 3/1 bad-endpoint; grid143.kfki.hu: ok/ok)
77%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 47/39 ok, 1/1 warning, 0/1 error, 0/2 unknown, 3/1 bad-endpoint; grid143.kfki.hu: ok/ok)
71%SAM: ok (15min evaluations: 91 ok, 0 warning, 5 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (277 Success ...),
FTS: ok (Links: 50/38 ok, 0/0 warning, 1/2 error, 0/2 unknown, 3/1 bad-endpoint; grid143.kfki.hu: ok/ok)
66%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 48/24 ok, 1/16 warning, 0/3 error, 1/2 unknown, 3/1 bad-endpoint; grid143.kfki.hu: ok/ok)
74%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (288 Success ...; 4 Failed, ExitCode 8021 ...),
FTS: ok (Links: 45/28 ok, 1/14 warning, 0/2 error, 0/2 unknown, 3/1 bad-endpoint; grid143.kfki.hu: ok/ok)
28%SAM: ok (15min evaluations: 65 ok, 0 warning, 0 error, 31 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 49/40 ok, 1/1 warning, 0/0 error, 0/3 unknown, 2/0 bad-endpoint; grid143.kfki.hu: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_IN_TIFR
GGUS Tickets:
Downtimes:
SAM Status: 98%15min evaluations: 93 ok, 0 warning, 1 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 96%15min evaluations: 92 ok, 0 warning, 3 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 72 ok, 0 warning, 0 error, 24 unknown, 0 downtime (0h0m) 70%15min evaluations: 67 ok, 0 warning, 28 error, 1 unknown, 0 downtime (0h0m) 47%15min evaluations: 45 ok, 0 warning, 50 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 5 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 91 ok, 1 warning, 2 error, 2 unknown, 0 downtime (0h0m) 96%15min evaluations: 91 ok, 1 warning, 3 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 93 ok, 0 warning, 1 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 98%15min evaluations: 66 ok, 0 warning, 1 error, 29 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%274 Success [crab3@vocms0144.cern.ch#55058338.0#1589240121 200511_181428:sciaba_crab_HC-99-T2_IN_TIFR-89092-20200510081104 64 0]... 100%298 Success [crab3@vocms0137.cern.ch#51257639.0#1589325959 200512_075955:sciaba_crab_HC-99-T2_IN_TIFR-89169-20200512095704 185 0]... 100%283 Success [crab3@vocms0199.cern.ch#12815036.0#1589413038 200513_200455:sciaba_crab_HC-99-T2_IN_TIFR-89169-20200512095704 42 0]... 100%289 Success [crab3@vocms0137.cern.ch#51440616.0#1589499514 200514_110144:sciaba_crab_HC-99-T2_IN_TIFR-89252-20200514125904 151 0]... 100%378 Success [crab3@vocms0121.cern.ch#53744779.0#1589585369 200515_051803:sciaba_crab_HC-99-T2_IN_TIFR-89252-20200514125904 218 0]... 100%293 Success [crab3@vocms0144.cern.ch#55313940.0#1589672374 200516_103220:sciaba_crab_HC-99-T2_IN_TIFR-89365-20200516122702 157 0]... 98%273 Success [crab3@vocms0199.cern.ch#13026655.0#1589757969 200517_223011:sciaba_crab_HC-99-T2_IN_TIFR-89365-20200516122702 11 0]...
1 Failed, ExitCode 8021 [crab3@vocms0199.cern.ch#13035956.0#1589776271 200517_223011:sciaba_crab_HC-99-T2_IN_TIFR-89365-20200516122702 72 0]...
2 Failed, ExitCode 8028 [crab3@vocms0199.cern.ch#13039128.0#1589782876 200517_223011:sciaba_crab_HC-99-T2_IN_TIFR-89365-20200516122702 94 0]...
100%301 Success [crab3@vocms0119.cern.ch#53968275.0#1589844679 200518_081751:sciaba_crab_HC-99-T2_IN_TIFR-89437-20200518101503 182 0]... 100%275 Success [crab3@vocms0194.cern.ch#52905609.0#1589931103 200519_200053:sciaba_crab_HC-99-T2_IN_TIFR-89437-20200518101503 42 0]... 100%303 Success [crab3@vocms0197.cern.ch#52249444.0#1590017901 200520_062206:sciaba_crab_HC-99-T2_IN_TIFR-89506-20200520081902 207 0]... 100%286 Success [crab3@vocms0155.cern.ch#55519433.0#1590103931 200521_180605:sciaba_crab_HC-99-T2_IN_TIFR-89506-20200520081902 65 0]... 100%296 Success [crab3@vocms0199.cern.ch#13210776.0#1590190845 200522_195425:sciaba_crab_HC-99-T2_IN_TIFR-89571-20200522035702 45 0]... 100%284 Success [crab3@vocms0120.cern.ch#53537196.0#1590276639 200523_133937:sciaba_crab_HC-99-T2_IN_TIFR-89571-20200522035702 118 0]... 100%289 Success [crab3@vocms0137.cern.ch#51773350.0#1590363562 200524_224827:sciaba_crab_HC-99-T2_IN_TIFR-89653-20200524062903 10 0]... 100%288 Success [crab3@vocms0155.cern.ch#55691045.0#1590449646 200525_163746:sciaba_crab_HC-99-T2_IN_TIFR-89653-20200524062903 83 0]... 100%272 Success [crab3@vocms0196.cern.ch#52754335.0#1590536078 200526_215814:sciaba_crab_HC-99-T2_IN_TIFR-89728-20200526055903 19 0]...
FTS Status: 81%Transfer (from/to): 7385/10459 files, 25.049/6.936 TB ok
Errors: src_error: 48/0, trn_timeout: 2108/1, trn_user: 0/112, trn_error: 129/27, dst_path: 0/2, dst_error: 0/1 foreign: 7/92
Links: 22/46 ok, 0/1 warning, 5/1 error, 0/1 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
86%Transfer (from/to): 7054/44635 files, 24.099/29.258 TB ok
Errors: src_error: 13/0, trn_timeout: 1979/410, trn_user: 0/108, trn_error: 203/158, dst_permission: 0/1, dst_path: 0/3, dst_error: 0/105 foreign: 174/264
Links: 26/46 ok, 1/0 warning, 3/1 error, 0/0 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
92%Transfer (from/to): 5594/27624 files, 12.506/24.081 TB ok
Errors: src_error: 517/0, trn_timeout: 537/9, trn_user: 1/118, trn_error: 173/1401, dst_error: 0/1830 foreign: 414/95
Links: 25/37 ok, 2/0 warning, 1/1 error, 0/2 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
88%Transfer (from/to): 3623/21495 files, 9.030/21.566 TB ok
Errors: trn_timeout: 1068/50, trn_user: 0/62, trn_error: 129/238, dst_error: 0/64 foreign: 165/1
Links: 23/38 ok, 3/1 warning, 3/1 error, 0/1 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
90%Transfer (from/to): 3627/40741 files, 7.965/10.380 TB ok
Errors: src_missing_file: 105/0, trn_timeout: 1597/11, trn_user: 0/78, trn_error: 161/2870, dst_path: 0/3, dst_error: 0/1673 foreign: 193/105
Links: 30/49 ok, 4/0 warning, 3/1 error, 0/0 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
77%Transfer (from/to): 6010/24224 files, 9.786/21.106 TB ok
Errors: src_missing_file: 105/0, trn_timeout: 1959/62, trn_user: 0/89, trn_error: 153/457, dst_path: 0/9, dst_error: 0/273 foreign: 60/87
Links: 28/46 ok, 1/1 warning, 7/1 error, 0/0 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
88%Transfer (from/to): 8720/13009 files, 20.067/19.959 TB ok
Errors: src_missing_file: 54/0, src_error: 170/0, trn_timeout: 1053/129, trn_user: 0/76, trn_error: 208/39, dst_path: 0/2, dst_error: 0/10 foreign: 154/39
Links: 31/38 ok, 1/4 warning, 3/1 error, 1/2 unknown, 2/0 bad-endpoint
se01.indiacms.res.in: ok/ok
93%Transfer (from/to): 6970/18714 files, 15.689/11.816 TB ok
Errors: src_error: 891/0, trn_timeout: 243/99, trn_user: 0/62, trn_error: 395/22, dst_path: 0/3, dst_error: 0/16 foreign: 387/268
Links: 40/45 ok, 0/2 warning, 3/2 error, 1/0 unknown, 2/1 bad-endpoint
se01.indiacms.res.in: ok/ok
97%Transfer (from/to): 5262/37757 files, 11.706/14.465 TB ok
Errors: trn_timeout: 310/4, trn_user: 0/84, trn_error: 144/516, dst_error: 0/289 foreign: 372/46
Links: 33/48 ok, 0/1 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint
se01.indiacms.res.in: ok/ok
96%Transfer (from/to): 2857/19257 files, 3.583/3.986 TB ok
Errors: trn_timeout: 18/2, trn_user: 0/47, trn_error: 40/39, dst_error: 0/15 foreign: 68/7
Links: 28/35 ok, 0/0 warning, 1/1 error, 0/3 unknown, 3/1 bad-endpoint
se01.indiacms.res.in: ok/ok
96%Transfer (from/to): 1957/17880 files, 0.315/0.227 TB ok
Errors: trn_error: 3/397, dst_error: 0/511 foreign: 0/2
Links: 5/27 ok, 0/0 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
97%Transfer (from/to): 3694/29923 files, 0.040/0.592 TB ok
Errors: trn_timeout: 0/6, trn_error: 6/403, dst_error: 0/374 foreign: 0/2
Links: 5/32 ok, 0/0 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
94%Transfer (from/to): 15119/30345 files, 31.832/20.464 TB ok
Errors: src_error: 69/0, trn_timeout: 448/61, trn_user: 0/42, trn_error: 358/236, dst_path: 0/4, dst_error: 0/62 foreign: 419/47
Links: 33/46 ok, 0/0 warning, 2/1 error, 0/1 unknown, 3/1 bad-endpoint
se01.indiacms.res.in: ok/ok
94%Transfer (from/to): 23076/30417 files, 38.235/12.923 TB ok
Errors: src_error: 694/0, trn_timeout: 1493/53, trn_user: 3/106, trn_error: 429/3753, dst_permission: 0/8, dst_error: 0/2606 foreign: 515/809
Links: 33/48 ok, 0/1 warning, 2/1 error, 0/1 unknown, 3/1 bad-endpoint
se01.indiacms.res.in: ok/ok
89%Transfer (from/to): 20211/19205 files, 35.000/2.231 TB ok
Errors: src_error: 8/0, trn_timeout: 593/18, trn_user: 2/55, trn_error: 124/4380, dst_path: 0/1, dst_error: 0/3342 foreign: 188/335
Links: 25/46 ok, 1/0 warning, 2/1 error, 0/1 unknown, 3/1 bad-endpoint
se01.indiacms.res.in: ok/ok
89%Transfer (from/to): 9289/3504 files, 14.307/6.361 TB ok
Errors: src_error: 11/0, trn_timeout: 170/3, trn_user: 1/9, trn_error: 68/1015, dst_permission: 0/2, dst_path: 0/3, dst_error: 0/661 foreign: 100/554
Links: 25/39 ok, 2/0 warning, 3/1 error, 0/2 unknown, 2/0 bad-endpoint
se01.indiacms.res.in: ok/ok
Site Readiness:
87%SAM: ok (15min evaluations: 93 ok, 0 warning, 1 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (274 Success ...),
FTS: ok (Links: 22/46 ok, 0/1 warning, 5/1 error, 0/1 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
96%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (298 Success ...),
FTS: ok (Links: 26/46 ok, 1/0 warning, 3/1 error, 0/0 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
87%SAM: ok (15min evaluations: 92 ok, 0 warning, 3 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...),
FTS: ok (Links: 25/37 ok, 2/0 warning, 1/1 error, 0/2 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
74%SAM: ok (15min evaluations: 72 ok, 0 warning, 0 error, 24 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...),
FTS: ok (Links: 23/38 ok, 3/1 warning, 3/1 error, 0/1 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
67%SAM: error (15min evaluations: 67 ok, 0 warning, 28 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (378 Success ...),
FTS: ok (Links: 30/49 ok, 4/0 warning, 3/1 error, 0/0 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
46%SAM: error (15min evaluations: 45 ok, 0 warning, 50 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 28/46 ok, 1/1 warning, 7/1 error, 0/0 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
88%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (273 Success ...; 1 Failed, ExitCode 8021 ...; 2 Failed, ExitCode 8028 ...),
FTS: ok (Links: 31/38 ok, 1/4 warning, 3/1 error, 1/2 unknown, 2/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
96%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (301 Success ...),
FTS: ok (Links: 40/45 ok, 0/2 warning, 3/2 error, 1/0 unknown, 2/1 bad-endpoint; se01.indiacms.res.in: ok/ok)
93%SAM: ok (15min evaluations: 88 ok, 5 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (275 Success ...),
FTS: ok (Links: 33/48 ok, 0/1 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint; se01.indiacms.res.in: ok/ok)
92%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (303 Success ...),
FTS: ok (Links: 28/35 ok, 0/0 warning, 1/1 error, 0/3 unknown, 3/1 bad-endpoint; se01.indiacms.res.in: ok/ok)
91%SAM: ok (15min evaluations: 91 ok, 1 warning, 2 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (286 Success ...),
FTS: ok (Links: 5/27 ok, 0/0 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
94%SAM: ok (15min evaluations: 91 ok, 1 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 5/32 ok, 0/0 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
94%SAM: ok (15min evaluations: 93 ok, 0 warning, 1 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 33/46 ok, 0/0 warning, 2/1 error, 0/1 unknown, 3/1 bad-endpoint; se01.indiacms.res.in: ok/ok)
96%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...),
FTS: ok (Links: 33/48 ok, 0/1 warning, 2/1 error, 0/1 unknown, 3/1 bad-endpoint; se01.indiacms.res.in: ok/ok)
94%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (288 Success ...),
FTS: ok (Links: 25/46 ok, 1/0 warning, 2/1 error, 0/1 unknown, 3/1 bad-endpoint; se01.indiacms.res.in: ok/ok)
44%SAM: ok (15min evaluations: 66 ok, 0 warning, 1 error, 29 unknown, 0 downtime (0h0m)),
HC: ok (272 Success ...),
FTS: ok (Links: 25/39 ok, 2/0 warning, 3/1 error, 0/2 unknown, 2/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_IT_Bari
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 81%15min evaluations: 77 ok, 0 warning, 17 error, 2 unknown, 0 downtime (0h0m) 98%15min evaluations: 74 ok, 0 warning, 1 error, 21 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 88 ok, 0 warning, 2 error, 6 unknown, 0 downtime (0h0m) 92%15min evaluations: 88 ok, 1 warning, 7 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 91%15min evaluations: 88 ok, 0 warning, 8 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 91 ok, 0 warning, 2 error, 3 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%296 Success [crab3@vocms0120.cern.ch#52861904.0#1589239646 200511_105600:sciaba_crab_HC-93-T2_IT_Bari-89134-20200511125303 150 0]... 100%280 Success [crab3@vocms0107.cern.ch#54989146.0#1589325136 200512_045115:sciaba_crab_HC-93-T2_IT_Bari-89134-20200511125303 220 0]... 100%294 Success [crab3@vocms0122.cern.ch#57433985.0#1589412858 200513_150259:sciaba_crab_HC-93-T2_IT_Bari-89216-20200513170104 102 0]... 100%281 Success [crab3@vocms0144.cern.ch#55238681.0#1589499352 200514_085923:sciaba_crab_HC-93-T2_IT_Bari-89216-20200513170104 175 0]... 100%320 Success [crab3@vocms0122.cern.ch#57516371.0#1589585359 200515_184201:sciaba_crab_HC-93-T2_IT_Bari-89297-20200515204104 57 0]... 100%299 Success [crab3@vocms0137.cern.ch#51519386.0#1589672067 200516_102906:sciaba_crab_HC-93-T2_IT_Bari-89370-20200516122702 156 0]... 100%226 Success [crab3@vocms0198.cern.ch#48581907.0#1589758215 200517_222846:sciaba_crab_HC-93-T2_IT_Bari-89370-20200516122702 12 0]... 100%296 Success [crab3@vocms0121.cern.ch#53930449.0#1589843702 200518_115844:sciaba_crab_HC-93-T2_IT_Bari-89440-20200518135503 135 0]... 100%279 Success [crab3@vocms0137.cern.ch#51599879.0#1589931003 200519_055326:sciaba_crab_HC-93-T2_IT_Bari-89440-20200518135503 211 0]... 100%293 Success [crab3@vocms0198.cern.ch#48711201.0#1590016445 200520_142240:sciaba_crab_HC-93-T2_IT_Bari-89518-20200520162103 106 0]... 100%284 Success [crab3@vocms0137.cern.ch#51673780.0#1590103052 200521_082133:sciaba_crab_HC-93-T2_IT_Bari-89518-20200520162103 179 0]... 100%289 Success [crab3@vocms0199.cern.ch#13210753.0#1590190210 200522_160911:sciaba_crab_HC-93-T2_IT_Bari-89596-20200522180703 88 0]... 100%282 Success [crab3@vocms0199.cern.ch#13270021.0#1590276886 200523_100258:sciaba_crab_HC-93-T2_IT_Bari-89596-20200522180703 162 0]... 100%294 Success [crab3@vocms0107.cern.ch#55410964.0#1590362491 200524_125007:sciaba_crab_HC-93-T2_IT_Bari-89669-20200524144303 126 0]... 100%279 Success [crab3@vocms0195.cern.ch#52133322.0#1590449312 200525_064212:sciaba_crab_HC-93-T2_IT_Bari-89669-20200524144303 201 0]... 100%276 Success [crab3@vocms0122.cern.ch#57933640.0#1590535760 200526_092313:sciaba_crab_HC-93-T2_IT_Bari-89740-20200526112103 169 0]...
FTS Status: 99%Transfer (from/to): 12403/56420 files, 4.045/11.193 TB ok
Errors: src_error: 39/0, trn_timeout: 2/581, trn_user: 0/19, trn_error: 40/160, dst_error: 0/19 foreign: 1017/17
Links: 57/59 ok, 2/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 13915/21364 files, 3.506/13.950 TB ok
Errors: src_permission: 1/0, src_error: 2939/0, trn_timeout: 12/286, trn_user: 0/517, trn_error: 3/57, dst_error: 0/210 foreign: 117/2224
Links: 55/58 ok, 0/1 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
93%Transfer (from/to): 5579/18699 files, 1.364/12.559 TB ok
Errors: src_permission: 300/0, src_error: 333/0, trn_timeout: 23/94, trn_user: 6/0, trn_error: 35/101, dst_permission: 0/804, dst_error: 0/32 foreign: 426/68
Links: 43/29 ok, 15/25 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 3573/10400 files, 1.364/23.965 TB ok
Errors: src_error: 17/0, trn_timeout: 4/169, trn_error: 7/4, dst_error: 0/29 foreign: 21/29
Links: 53/55 ok, 3/1 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 5692/9175 files, 9.871/19.695 TB ok
Errors: src_error: 4580/0, trn_timeout: 21/183, trn_user: 0/404, trn_error: 359/119 foreign: 69/1918
Links: 53/53 ok, 2/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 3085/12110 files, 3.693/4.418 TB ok
Errors: src_permission: 1/0, src_error: 1190/0, trn_timeout: 4/186, trn_user: 0/46, trn_error: 84/7 foreign: 98/185
Links: 55/55 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 2729/11430 files, 3.423/23.630 TB ok
Errors: src_permission: 40/0, src_error: 792/0, trn_timeout: 12/130, trn_error: 37/22, dst_space: 0/229 foreign: 138/14
Links: 52/52 ok, 2/3 warning, 2/1 error, 1/1 unknown, 2/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 4097/44783 files, 5.099/38.883 TB ok
Errors: src_permission: 4/0, src_error: 75/0, trn_timeout: 6/11, trn_user: 1/27, trn_error: 28/217, dst_space: 0/435, dst_error: 0/87 foreign: 279/603
Links: 58/55 ok, 2/3 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
99%Transfer (from/to): 4512/43107 files, 6.134/41.176 TB ok
Errors: src_permission: 7/0, src_error: 3/0, trn_timeout: 3/7, trn_user: 0/6, trn_error: 35/4, dst_space: 0/3807, dst_error: 0/1 foreign: 30/1392
Links: 57/57 ok, 1/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 7533/31216 files, 9.552/8.868 TB ok
Errors: src_error: 136/0, trn_timeout: 2/15, trn_error: 16/19 foreign: 1418/264
Links: 50/55 ok, 1/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
99%Transfer (from/to): 1962/19002 files, 2.724/21.272 TB ok
Errors: trn_timeout: 11/9, trn_error: 7/238, dst_error: 0/13 foreign: 5775/83
Links: 53/56 ok, 1/1 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 2204/14112 files, 3.229/23.397 TB ok
Errors: src_error: 1/0, trn_timeout: 5/1, trn_error: 92/1443, dst_path: 0/1, dst_space: 0/282 foreign: 30/43
Links: 48/52 ok, 0/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
99%Transfer (from/to): 4612/68329 files, 10.904/43.857 TB ok
Errors: src_error: 212/0, trn_timeout: 0/22, trn_error: 45/29, dst_space: 0/998, dst_error: 0/15 foreign: 50/140
Links: 52/53 ok, 0/4 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
99%Transfer (from/to): 2141/38568 files, 3.514/31.573 TB ok
Errors: src_error: 153/0, trn_timeout: 14/59, trn_user: 0/42, trn_error: 4/51, dst_error: 0/8 foreign: 36/222
Links: 50/58 ok, 0/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 1674/22751 files, 2.033/12.421 TB ok
Errors: src_permission: 1/0, src_missing_file: 6/0, src_error: 256/0, trn_timeout: 3/11, trn_user: 0/5120, trn_error: 9/11, dst_error: 0/12 foreign: 39/26202
Links: 48/52 ok, 1/0 warning, 1/0 error, 4/4 unknown, 3/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
99%Transfer (from/to): 608/15065 files, 0.766/30.430 TB ok
Errors: src_error: 8/0, trn_timeout: 1/21, trn_error: 4/4, dst_error: 0/21 foreign: 24/304
Links: 56/52 ok, 1/2 warning, 0/0 error, 0/3 unknown, 2/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
Site Readiness:
99%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 57/59 ok, 2/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
94%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 55/58 ok, 0/1 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
77%SAM: warning (15min evaluations: 77 ok, 0 warning, 17 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 43/29 ok, 15/25 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
72%SAM: ok (15min evaluations: 74 ok, 0 warning, 1 error, 21 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 53/55 ok, 3/1 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
97%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (320 Success ...),
FTS: ok (Links: 53/53 ok, 2/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
97%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (299 Success ...),
FTS: ok (Links: 55/55 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
77%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (226 Success ...),
FTS: ok (Links: 52/52 ok, 2/3 warning, 2/1 error, 1/1 unknown, 2/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
89%SAM: ok (15min evaluations: 88 ok, 0 warning, 2 error, 6 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 58/55 ok, 2/3 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
86%SAM: ok (15min evaluations: 88 ok, 1 warning, 7 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 57/57 ok, 1/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
96%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 50/55 ok, 1/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
94%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (284 Success ...),
FTS: ok (Links: 53/56 ok, 1/1 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
96%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...),
FTS: ok (Links: 48/52 ok, 0/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
88%SAM: ok (15min evaluations: 88 ok, 0 warning, 8 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 52/53 ok, 0/4 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 50/58 ok, 0/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
91%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 48/52 ok, 1/0 warning, 1/0 error, 4/4 unknown, 3/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
66%SAM: ok (15min evaluations: 91 ok, 0 warning, 2 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (276 Success ...),
FTS: ok (Links: 56/52 ok, 1/2 warning, 0/0 error, 0/3 unknown, 2/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_IT_Legnaro
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 94 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 93%15min evaluations: 69 ok, 0 warning, 5 error, 22 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%297 Success [crab3@vocms0199.cern.ch#12716771.0#1589239843 200511_105900:sciaba_crab_HC-93-T2_IT_Legnaro-89134-20200511125303 150 0]... 100%277 Success [crab3@vocms0119.cern.ch#53634330.0#1589326418 200512_225925:sciaba_crab_HC-93-T2_IT_Legnaro-89134-20200511125303 6 0]... 100%293 Success [crab3@vocms0137.cern.ch#51354422.0#1589412758 200513_150600:sciaba_crab_HC-93-T2_IT_Legnaro-89216-20200513170104 101 0]... 100%280 Success [crab3@vocms0106.cern.ch#43205972.0#1589499250 200514_090224:sciaba_crab_HC-93-T2_IT_Legnaro-89216-20200513170104 174 0]... 100%319 Success [crab3@vocms0144.cern.ch#55281319.0#1589585358 200515_184222:sciaba_crab_HC-93-T2_IT_Legnaro-89297-20200515204104 57 0]... 100%299 Success [crab3@vocms0195.cern.ch#51859302.0#1589671614 200516_103442:sciaba_crab_HC-93-T2_IT_Legnaro-89370-20200516122702 154 0]... 100%228 Success [crab3@vocms0137.cern.ch#51546063.0#1589758106 200517_222702:sciaba_crab_HC-93-T2_IT_Legnaro-89370-20200516122702 12 0]... 100%296 Success [crab3@vocms0198.cern.ch#48643602.0#1589843555 200518_115626:sciaba_crab_HC-93-T2_IT_Legnaro-89440-20200518135503 135 0]... 100%280 Success [crab3@vocms0194.cern.ch#52905619.0#1589931220 200519_055121:sciaba_crab_HC-93-T2_IT_Legnaro-89440-20200518135503 212 0]... 100%293 Success [crab3@vocms0122.cern.ch#57709876.0#1590017173 200520_142446:sciaba_crab_HC-93-T2_IT_Legnaro-89518-20200520162103 108 0]... 100%282 Success [crab3@vocms0199.cern.ch#13168731.0#1590103707 200521_082735:sciaba_crab_HC-93-T2_IT_Legnaro-89518-20200520162103 180 0]... 100%289 Success [crab3@vocms0197.cern.ch#52335995.0#1590190139 200522_161305:sciaba_crab_HC-93-T2_IT_Legnaro-89596-20200522180703 87 0]... 100%280 Success [crab3@vocms0199.cern.ch#13270020.0#1590276876 200523_102323:sciaba_crab_HC-93-T2_IT_Legnaro-89596-20200522180703 158 0]... 100%291 Success [crab3@vocms0107.cern.ch#55410998.0#1590362747 200524_124946:sciaba_crab_HC-93-T2_IT_Legnaro-89669-20200524144303 127 0]... 100%282 Success [crab3@vocms0155.cern.ch#55691043.0#1590449498 200525_070025:sciaba_crab_HC-93-T2_IT_Legnaro-89669-20200524144303 198 0]... 100%276 Success [crab3@vocms0199.cern.ch#13345388.0#1590535979 200526_092657:sciaba_crab_HC-93-T2_IT_Legnaro-89740-20200526112103 169 0]...
FTS Status: 99%Transfer (from/to): 8624/1616 files, 10.281/4.652 TB ok
Errors: src_permission: 5/0, src_error: 1/0, trn_user: 1/0, trn_error: 7/4 foreign: 143/149
Links: 50/25 ok, 1/0 warning, 0/0 error, 0/4 unknown, 1/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
99%Transfer (from/to): 14015/2634 files, 3.612/4.886 TB ok
Errors: src_error: 843/0, trn_timeout: 5/0, trn_user: 7/0, trn_error: 21/0, dst_error: 0/3 foreign: 627/138
Links: 46/31 ok, 0/0 warning, 1/0 error, 0/3 unknown, 1/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
98%Transfer (from/to): 9371/2800 files, 4.217/8.778 TB ok
Errors: src_error: 600/0, trn_timeout: 46/0, trn_user: 14/0, trn_error: 89/0 foreign: 1804/206
Links: 51/34 ok, 0/0 warning, 1/0 error, 0/2 unknown, 1/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
98%Transfer (from/to): 8702/1463 files, 7.374/4.603 TB ok
Errors: src_error: 3935/0, trn_timeout: 6/3, trn_user: 9/0, trn_error: 177/1 foreign: 182/201
Links: 43/24 ok, 1/1 warning, 3/0 error, 0/4 unknown, 1/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
97%Transfer (from/to): 8386/14657 files, 4.311/39.581 TB ok
Errors: src_error: 16295/0, trn_timeout: 21/42, trn_user: 8/0, trn_error: 394/119, dst_error: 0/4 foreign: 165/309
Links: 48/34 ok, 2/1 warning, 2/0 error, 0/3 unknown, 1/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
97%Transfer (from/to): 10985/4303 files, 20.082/11.214 TB ok
Errors: src_error: 2777/0, trn_timeout: 7/63, trn_user: 17/0, trn_error: 61/30, dst_permission: 0/1, dst_space: 0/1 foreign: 130/197
Links: 55/41 ok, 0/2 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
97%Transfer (from/to): 17405/22181 files, 29.481/58.918 TB ok
Errors: src_error: 1332/0, trn_timeout: 11/11, trn_user: 23/0, trn_error: 50/10, dst_space: 0/1 foreign: 1061/195
Links: 52/38 ok, 0/2 warning, 0/0 error, 2/1 unknown, 2/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
98%Transfer (from/to): 22428/8062 files, 29.433/22.393 TB ok
Errors: src_error: 11/0, trn_timeout: 3/0, trn_user: 12/0, trn_error: 51/20, dst_error: 0/2 foreign: 2413/233
Links: 53/37 ok, 0/2 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
97%Transfer (from/to): 13951/1857 files, 47.771/5.261 TB ok
Errors: src_error: 2/0, trn_timeout: 19/0, trn_user: 22/0, trn_error: 223/3 foreign: 659/247
Links: 54/35 ok, 1/1 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
98%Transfer (from/to): 22111/4139 files, 36.982/10.882 TB ok
Errors: src_error: 259/0, trn_timeout: 5/13, trn_user: 16/0, trn_error: 83/5, dst_error: 0/1 foreign: 441/179
Links: 46/28 ok, 0/0 warning, 1/0 error, 0/5 unknown, 3/1 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
98%Transfer (from/to): 7220/21271 files, 13.769/62.267 TB ok
Errors: src_error: 50/0, trn_timeout: 13/8, trn_error: 9/7, dst_error: 0/8 foreign: 856/171
Links: 45/32 ok, 2/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
100%Transfer (from/to): 5717/4145 files, 5.024/12.424 TB ok
Errors: trn_timeout: 14/0, trn_error: 23/0, dst_error: 0/2 foreign: 1530/177
Links: 45/26 ok, 0/0 warning, 0/0 error, 0/5 unknown, 2/1 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
98%Transfer (from/to): 5109/5769 files, 11.032/15.076 TB ok
Errors: src_error: 48/0, trn_timeout: 2/16, trn_user: 5/0, trn_error: 6/108 foreign: 2079/226
Links: 45/41 ok, 0/0 warning, 0/1 error, 0/3 unknown, 3/1 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
95%Transfer (from/to): 5363/11391 files, 8.062/26.572 TB ok
Errors: src_error: 112/0, trn_timeout: 10/16, trn_user: 5/0, trn_error: 27/2270, dst_path: 0/28, dst_error: 0/2 foreign: 1351/178
Links: 45/39 ok, 0/1 warning, 1/1 error, 0/3 unknown, 2/1 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
97%Transfer (from/to): 4375/17426 files, 7.005/49.961 TB ok
Errors: src_error: 493/0, trn_timeout: 3/0, trn_user: 2/0, trn_error: 9/3163, dst_error: 0/44 foreign: 835/298
Links: 40/43 ok, 0/0 warning, 2/1 error, 1/3 unknown, 4/1 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
97%Transfer (from/to): 3207/9357 files, 6.187/28.683 TB ok
Errors: trn_timeout: 22/37, trn_user: 2/0, trn_error: 10/1616, dst_space: 0/1, dst_error: 0/6 foreign: 727/184
Links: 39/41 ok, 1/0 warning, 0/1 error, 1/3 unknown, 3/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
Site Readiness:
78%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 50/25 ok, 1/0 warning, 0/0 error, 0/4 unknown, 1/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
68%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (277 Success ...),
FTS: ok (Links: 46/31 ok, 0/0 warning, 1/0 error, 0/3 unknown, 1/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
76%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 51/34 ok, 0/0 warning, 1/0 error, 0/2 unknown, 1/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
50%SAM: ok (15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 43/24 ok, 1/1 warning, 3/0 error, 0/4 unknown, 1/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
97%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (319 Success ...),
FTS: ok (Links: 48/34 ok, 2/1 warning, 2/0 error, 0/3 unknown, 1/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
99%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (299 Success ...),
FTS: ok (Links: 55/41 ok, 0/2 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
78%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (228 Success ...),
FTS: ok (Links: 52/38 ok, 0/2 warning, 0/0 error, 2/1 unknown, 2/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
95%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 53/37 ok, 0/2 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
96%SAM: ok (15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 54/35 ok, 1/1 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 46/28 ok, 0/0 warning, 1/0 error, 0/5 unknown, 3/1 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
94%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 45/32 ok, 2/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
81%SAM: ok (15min evaluations: 94 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...),
FTS: ok (Links: 45/26 ok, 0/0 warning, 0/0 error, 0/5 unknown, 2/1 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
86%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 45/41 ok, 0/0 warning, 0/1 error, 0/3 unknown, 3/1 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
99%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...),
FTS: ok (Links: 45/39 ok, 0/1 warning, 1/1 error, 0/3 unknown, 2/1 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
94%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 40/43 ok, 0/0 warning, 2/1 error, 1/3 unknown, 4/1 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
43%SAM: ok (15min evaluations: 69 ok, 0 warning, 5 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (276 Success ...),
FTS: ok (Links: 39/41 ok, 1/0 warning, 0/1 error, 1/3 unknown, 3/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_IT_Pisa
GGUS Tickets: 146557
Downtimes:
SAM Status: 47%15min evaluations: 44 ok, 0 warning, 49 error, 3 unknown, 0 downtime (0h0m) 87%15min evaluations: 84 ok, 0 warning, 12 error, 0 unknown, 0 downtime (0h0m) 87%15min evaluations: 80 ok, 0 warning, 12 error, 4 unknown, 0 downtime (0h0m) 84%15min evaluations: 62 ok, 0 warning, 11 error, 23 unknown, 0 downtime (0h0m) 87%15min evaluations: 80 ok, 0 warning, 12 error, 4 unknown, 0 downtime (0h0m) 94%15min evaluations: 91 ok, 0 warning, 5 error, 0 unknown, 0 downtime (0h0m) 90%15min evaluations: 85 ok, 0 warning, 9 error, 2 unknown, 0 downtime (0h0m) 83%15min evaluations: 79 ok, 0 warning, 16 error, 1 unknown, 0 downtime (0h0m) 96%15min evaluations: 90 ok, 1 warning, 3 error, 2 unknown, 0 downtime (0h0m) 86%15min evaluations: 83 ok, 0 warning, 13 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 93 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 60%15min evaluations: 57 ok, 0 warning, 38 error, 1 unknown, 0 downtime (0h0m) 61%15min evaluations: 59 ok, 0 warning, 37 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 91%15min evaluations: 86 ok, 0 warning, 8 error, 2 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%299 Success [crab3@vocms0199.cern.ch#12716230.0#1589239632 200511_110054:sciaba_crab_HC-93-T2_IT_Pisa-89134-20200511125303 149 0]... 100%279 Success [crab3@vocms0121.cern.ch#53610763.0#1589326714 200512_230028:sciaba_crab_HC-93-T2_IT_Pisa-89134-20200511125303 7 0]... 98%290 Success [crab3@vocms0119.cern.ch#53687673.0#1589413000 200513_150444:sciaba_crab_HC-93-T2_IT_Pisa-89216-20200513170104 102 0]...
3 Failed, ExitCode 47 [crab3@vocms0119.cern.ch#53690022.0#1589416890 200513_150444:sciaba_crab_HC-93-T2_IT_Pisa-89216-20200513170104 115 0]...
1 Failed, ExitCode 10040 [crab3@vocms0119.cern.ch#53689588.0#1589415994 200513_150444:sciaba_crab_HC-93-T2_IT_Pisa-89216-20200513170104 112 0]...
100%288 Success [crab3@vocms0195.cern.ch#51790967.0#1589498288 200514_090049:sciaba_crab_HC-93-T2_IT_Pisa-89216-20200513170104 171 0]... 100%314 Success [crab3@vocms0198.cern.ch#48521962.0#1589586797 200515_184635:sciaba_crab_HC-93-T2_IT_Pisa-89297-20200515204104 61 0]... 100%297 Success [crab3@vocms0194.cern.ch#52813955.0#1589671442 200516_103309:sciaba_crab_HC-93-T2_IT_Pisa-89370-20200516122702 153 0]... 100%226 Success [crab3@vocms0144.cern.ch#55346208.0#1589758309 200517_225040:sciaba_crab_HC-93-T2_IT_Pisa-89370-20200516122702 8 0]... 100%296 Success [crab3@vocms0195.cern.ch#51945397.0#1589844397 200518_120019:sciaba_crab_HC-93-T2_IT_Pisa-89440-20200518135503 137 0]... 100%282 Success [crab3@vocms0137.cern.ch#51599880.0#1589931123 200519_055418:sciaba_crab_HC-93-T2_IT_Pisa-89440-20200518135503 211 0]... 100%292 Success [crab3@vocms0194.cern.ch#52926272.0#1590017129 200520_142431:sciaba_crab_HC-93-T2_IT_Pisa-89518-20200520162103 108 0]... 100%282 Success [crab3@vocms0107.cern.ch#55323882.0#1590103582 200521_082525:sciaba_crab_HC-93-T2_IT_Pisa-89518-20200520162103 180 0]... 100%297 Success [crab3@vocms0122.cern.ch#57785174.0#1590189448 200522_161107:sciaba_crab_HC-93-T2_IT_Pisa-89596-20200522180703 85 0]... 100%280 Success [crab3@vocms0195.cern.ch#52094013.0#1590276872 200523_100319:sciaba_crab_HC-93-T2_IT_Pisa-89596-20200522180703 162 0]... 100%294 Success [crab3@vocms0196.cern.ch#52692537.0#1590363030 200524_124433:sciaba_crab_HC-93-T2_IT_Pisa-89669-20200524144303 129 0]... 100%288 Success [crab3@vocms0197.cern.ch#52427096.0#1590448744 200525_063756:sciaba_crab_HC-93-T2_IT_Pisa-89669-20200524144303 200 0]... 100%274 Success [crab3@vocms0137.cern.ch#51852260.0#1590536998 200526_092359:sciaba_crab_HC-93-T2_IT_Pisa-89740-20200526112103 173 0]...
FTS Status: 79%Transfer (from/to): 3864/4947 files, 2.329/9.114 TB ok
Errors: src_missing_file: 32/0, src_error: 32/0, trn_timeout: 490/719, trn_user: 28/0, trn_error: 206/192, dst_error: 0/1 foreign: 78/1
Links: 19/33 ok, 10/1 warning, 5/1 error, 1/0 unknown, 1/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
89%Transfer (from/to): 13328/6727 files, 4.613/10.453 TB ok
Errors: src_missing_file: 62/0, src_error: 4083/0, trn_timeout: 127/552, trn_user: 12/0, trn_error: 50/0, dst_permission: 0/22, dst_path: 0/2, dst_error: 0/1 foreign: 937/3
Links: 34/38 ok, 0/0 warning, 4/1 error, 2/0 unknown, 1/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
88%Transfer (from/to): 12823/3312 files, 1.845/2.764 TB ok
Errors: src_missing_file: 59/0, src_error: 4557/0, trn_timeout: 122/25, trn_error: 90/0 foreign: 3930/7
Links: 35/34 ok, 0/0 warning, 5/0 error, 1/0 unknown, 1/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
88%Transfer (from/to): 8855/2956 files, 0.964/1.095 TB ok
Errors: src_missing_file: 52/0, src_error: 3082/0, trn_timeout: 56/15, trn_error: 518/0 foreign: 451/0
Links: 36/28 ok, 1/0 warning, 5/0 error, 1/0 unknown, 1/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
94%Transfer (from/to): 3133/8606 files, 1.946/2.548 TB ok
Errors: src_missing_file: 44/0, src_error: 11961/0, trn_timeout: 23/227, trn_error: 11/1, dst_error: 0/1 foreign: 54/6
Links: 43/30 ok, 5/1 warning, 3/0 error, 3/0 unknown, 1/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
95%Transfer (from/to): 3349/5942 files, 6.740/13.450 TB ok
Errors: src_missing_file: 38/0, src_error: 1336/0, trn_timeout: 44/380, trn_user: 0/402, trn_error: 19/2 foreign: 10/452
Links: 46/28 ok, 2/0 warning, 2/0 error, 1/0 unknown, 1/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
92%Transfer (from/to): 2100/12282 files, 1.592/21.289 TB ok
Errors: src_missing_file: 41/0, src_error: 5510/0, trn_timeout: 53/252, trn_user: 0/336, trn_error: 11/0, dst_error: 0/1 foreign: 19/41
Links: 43/25 ok, 0/0 warning, 4/0 error, 3/1 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
94%Transfer (from/to): 3134/6205 files, 1.939/12.394 TB ok
Errors: src_missing_file: 39/0, src_error: 274/0, trn_timeout: 31/1, trn_user: 1/219, trn_error: 74/1 foreign: 266/40
Links: 44/21 ok, 1/0 warning, 5/0 error, 1/2 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
95%Transfer (from/to): 4054/6317 files, 2.169/11.905 TB ok
Errors: src_missing_file: 40/0, src_error: 195/0, trn_timeout: 28/11, trn_user: 0/265, trn_error: 17/0 foreign: 370/3
Links: 45/24 ok, 3/0 warning, 2/0 error, 1/0 unknown, 3/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
94%Transfer (from/to): 3575/2417 files, 2.791/9.994 TB ok
Errors: src_missing_file: 42/0, src_error: 35/0, trn_timeout: 30/5, trn_user: 0/373, trn_error: 2/1, dst_permission: 0/1, dst_path: 0/1 foreign: 150/0
Links: 40/18 ok, 1/0 warning, 2/0 error, 1/0 unknown, 3/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
93%Transfer (from/to): 2118/2080 files, 2.509/12.433 TB ok
Errors: src_missing_file: 46/0, src_error: 22/0, trn_timeout: 24/0, trn_user: 0/416, trn_error: 3/0 foreign: 192/0
Links: 33/17 ok, 0/0 warning, 3/0 error, 0/0 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
91%Transfer (from/to): 2230/1107 files, 2.825/6.576 TB ok
Errors: src_missing_file: 73/0, src_error: 19/0, trn_timeout: 8/3, trn_user: 0/258, trn_error: 8/0 foreign: 111/0
Links: 32/15 ok, 0/0 warning, 4/0 error, 0/0 unknown, 3/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
94%Transfer (from/to): 1182/2171 files, 2.546/11.786 TB ok
Errors: src_missing_file: 58/0, src_error: 338/0, trn_timeout: 9/188, trn_user: 0/323, trn_error: 8/0 foreign: 185/0
Links: 33/22 ok, 0/0 warning, 3/1 error, 1/0 unknown, 3/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
94%Transfer (from/to): 1210/1046 files, 2.912/0.000 TB ok
Errors: src_missing_file: 49/0, src_error: 21/0, trn_timeout: 10/0, trn_error: 123/0 foreign: 353/0
Links: 34/15 ok, 1/0 warning, 1/0 error, 3/0 unknown, 3/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
96%Transfer (from/to): 1683/3059 files, 3.438/14.823 TB ok
Errors: src_missing_file: 36/0, src_error: 5/0, trn_timeout: 8/3, trn_user: 0/28, trn_error: 8/16 foreign: 515/0
Links: 31/23 ok, 0/0 warning, 1/0 error, 1/0 unknown, 3/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
93%Transfer (from/to): 653/2013 files, 1.277/0.417 TB ok
Errors: src_missing_file: 46/0, src_error: 9/0, trn_timeout: 4/1, trn_user: 0/2, trn_error: 5/7 foreign: 89/0
Links: 29/15 ok, 1/1 warning, 2/0 error, 0/0 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
Site Readiness:
43%SAM: error (15min evaluations: 44 ok, 0 warning, 49 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (299 Success ...),
FTS: ok (Links: 19/33 ok, 10/1 warning, 5/1 error, 1/0 unknown, 1/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
84%SAM: warning (15min evaluations: 84 ok, 0 warning, 12 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...),
FTS: ok (Links: 34/38 ok, 0/0 warning, 4/1 error, 2/0 unknown, 1/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
81%SAM: warning (15min evaluations: 80 ok, 0 warning, 12 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (290 Success ...; 3 Failed, ExitCode 47 ...; 1 Failed, ExitCode 10040 ...),
FTS: ok (Links: 35/34 ok, 0/0 warning, 5/0 error, 1/0 unknown, 1/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
62%SAM: warning (15min evaluations: 62 ok, 0 warning, 11 error, 23 unknown, 0 downtime (0h0m)),
HC: ok (288 Success ...),
FTS: ok (Links: 36/28 ok, 1/0 warning, 5/0 error, 1/0 unknown, 1/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
81%SAM: warning (15min evaluations: 80 ok, 0 warning, 12 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (314 Success ...),
FTS: ok (Links: 43/30 ok, 5/1 warning, 3/0 error, 3/0 unknown, 1/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
94%SAM: ok (15min evaluations: 91 ok, 0 warning, 5 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 46/28 ok, 2/0 warning, 2/0 error, 1/0 unknown, 1/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
68%SAM: ok (15min evaluations: 85 ok, 0 warning, 9 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (226 Success ...),
FTS: ok (Links: 43/25 ok, 0/0 warning, 4/0 error, 3/1 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
82%SAM: warning (15min evaluations: 79 ok, 0 warning, 16 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 44/21 ok, 1/0 warning, 5/0 error, 1/2 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
88%SAM: ok (15min evaluations: 90 ok, 1 warning, 3 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 45/24 ok, 3/0 warning, 2/0 error, 1/0 unknown, 3/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
84%SAM: warning (15min evaluations: 83 ok, 0 warning, 13 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 40/18 ok, 1/0 warning, 2/0 error, 1/0 unknown, 3/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
93%SAM: ok (15min evaluations: 93 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 33/17 ok, 0/0 warning, 3/0 error, 0/0 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
96%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 32/15 ok, 0/0 warning, 4/0 error, 0/0 unknown, 3/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
55%SAM: error (15min evaluations: 57 ok, 0 warning, 38 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 33/22 ok, 0/0 warning, 3/1 error, 1/0 unknown, 3/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
60%SAM: error (15min evaluations: 59 ok, 0 warning, 37 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (294 Success ...),
FTS: ok (Links: 34/15 ok, 1/0 warning, 1/0 error, 3/0 unknown, 3/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
91%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (288 Success ...),
FTS: ok (Links: 31/23 ok, 0/0 warning, 1/0 error, 1/0 unknown, 3/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
64%SAM: ok (15min evaluations: 86 ok, 0 warning, 8 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (274 Success ...),
FTS: ok (Links: 29/15 ok, 1/1 warning, 2/0 error, 0/0 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_IT_Rome
GGUS Tickets: 147129
Downtimes: Dcmsrm-se01.roma1.infn.it/SE, all CEs (cmsrm-cream02.roma1.infn.it, cmsrm-cream01.roma1.infn.it), all XROOTDs (cmsrm-xrootd01.roma1.infn.it, cmsrm-xrootd02.roma1.infn.it)
SAM Status: 100%15min evaluations: 71 ok, 0 warning, 0 error, 25 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 84%15min evaluations: 81 ok, 0 warning, 15 error, 0 unknown, 0 downtime (0h0m) 75%15min evaluations: 55 ok, 1 warning, 18 error, 22 unknown, 0 downtime (0h0m) 87%15min evaluations: 72 ok, 0 warning, 10 error, 14 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 85 ok, 1 warning, 0 error, 10 unknown, 0 downtime (0h0m) 87%15min evaluations: 49 ok, 0 warning, 7 error, 39 unknown, 0 downtime (0h0m) 88%15min evaluations: 61 ok, 3 warning, 8 error, 23 unknown, 0 downtime (0h0m) 63%15min evaluations: 32 ok, 4 warning, 21 error, 39 unknown, 0 downtime (0h0m) 47%15min evaluations: 9 ok, 0 warning, 10 error, 76 unknown, 0 downtime (0h0m) 32%15min evaluations: 29 ok, 0 warning, 60 error, 7 unknown, 0 downtime (0h0m) 33%15min evaluations: 31 ok, 0 warning, 62 error, 3 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%304 Success [crab3@vocms0119.cern.ch#53601928.0#1589240492 200511_105530:sciaba_crab_HC-93-T2_IT_Rome-89134-20200511125303 153 0]... 100%277 Success [crab3@vocms0121.cern.ch#53610761.0#1589326680 200512_223734:sciaba_crab_HC-93-T2_IT_Rome-89134-20200511125303 11 0]... 99%289 Success [crab3@vocms0107.cern.ch#55044425.0#1589412223 200513_150712:sciaba_crab_HC-93-T2_IT_Rome-89216-20200513170104 99 0]...
1 Failed, ExitCode 1 [crab3@vocms0107.cern.ch#55062952.0#1589435024 200513_150712:sciaba_crab_HC-93-T2_IT_Rome-89216-20200513170104 175 0]...
99%279 Success [crab3@vocms0119.cern.ch#53745170.0#1589496379 200514_090501:sciaba_crab_HC-93-T2_IT_Rome-89216-20200513170104 164 0]...
1 Failed, ExitCode 135 [crab3@vocms0197.cern.ch#51984504.0#1589556527 200515_031234:sciaba_crab_HC-93-T2_IT_Rome-89216-20200513170104 147 0]...
94%312 Success [crab3@vocms0198.cern.ch#48521256.0#1589584105 200515_184610:sciaba_crab_HC-93-T2_IT_Rome-89297-20200515204104 52 0]...
12 Failed, ExitCode 8021 [crab3@vocms0198.cern.ch#48533546.0#1589607509 200515_184610:sciaba_crab_HC-93-T2_IT_Rome-89297-20200515204104 130 0]...
1 Failed, ExitCode 8006 [crab3@vocms0198.cern.ch#48534218.0#1589611712 200515_184610:sciaba_crab_HC-93-T2_IT_Rome-89297-20200515204104 144 0]...
7 Failed, Removed due to wall clock limit [crab3@vocms0198.cern.ch#48533973.0#1589610225 200515_184610:sciaba_crab_HC-93-T2_IT_Rome-89297-20200515204104 133 1]...
100%297 Success [crab3@vocms0194.cern.ch#52813989.0#1589671777 200516_103116:sciaba_crab_HC-93-T2_IT_Rome-89370-20200516122702 155 0]... 100%229 Success [crab3@vocms0196.cern.ch#52451594.0#1589757963 200517_224952:sciaba_crab_HC-93-T2_IT_Rome-89370-20200516122702 7 0]... 100%291 Success [crab3@vocms0107.cern.ch#55254771.0#1589844786 200518_120139:sciaba_crab_HC-93-T2_IT_Rome-89440-20200518135503 138 0]... 100%278 Success [crab3@vocms0120.cern.ch#53329839.0#1589930222 200519_055445:sciaba_crab_HC-93-T2_IT_Rome-89440-20200518135503 208 0]... 100%292 Success [crab3@vocms0119.cern.ch#54058346.0#1590015795 200520_142212:sciaba_crab_HC-93-T2_IT_Rome-89518-20200520162103 104 0]... 100%282 Success [crab3@vocms0122.cern.ch#57757032.0#1590102062 200521_081949:sciaba_crab_HC-93-T2_IT_Rome-89518-20200520162103 176 0]... 98%273 Success [crab3@vocms0198.cern.ch#48799797.0#1590189194 200522_161153:sciaba_crab_HC-93-T2_IT_Rome-89596-20200522180703 84 0]...
4 Failed, ExitCode 1 [crab3@vocms0119.cern.ch#54161343.0#1590236756 200523_100457:sciaba_crab_HC-93-T2_IT_Rome-89596-20200522180703 28 0]...
97%250 Success [crab3@vocms0119.cern.ch#54171932.0#1590273363 200523_100457:sciaba_crab_HC-93-T2_IT_Rome-89596-20200522180703 150 0]...
2 Failed, ExitCode 1 [crab3@vocms0197.cern.ch#52370136.0#1590306024 200524_041357:sciaba_crab_HC-93-T2_IT_Rome-89596-20200522180703 41 0]...
1 Failed, ExitCode 47 [crab3@vocms0106.cern.ch#43428049.0#1590360423 200524_124559:sciaba_crab_HC-93-T2_IT_Rome-89669-20200524144303 120 0]...
2 Failed, Removed due to wall clock limit [crab3@vocms0106.cern.ch#43425230.0#1590343619 200524_124559:sciaba_crab_HC-93-T2_IT_Rome-89669-20200524144303 64 0]...
1 Failed, ExitCode 135 [crab3@vocms0106.cern.ch#43426867.0#1590350823 200524_124559:sciaba_crab_HC-93-T2_IT_Rome-89669-20200524144303 88 0]...
51%153 Success [crab3@vocms0106.cern.ch#43427263.0#1590352921 200524_124559:sciaba_crab_HC-93-T2_IT_Rome-89669-20200524144303 95 0]...
54 Failed, ExitCode 47 [crab3@vocms0106.cern.ch#43428514.0#1590365225 200524_124559:sciaba_crab_HC-93-T2_IT_Rome-89669-20200524144303 136 0]...
77 Failed, Removed due to wall clock limit [crab3@vocms0106.cern.ch#43425509.0#1590346322 200524_124559:sciaba_crab_HC-93-T2_IT_Rome-89669-20200524144303 73 0]...
1 Failed, ExitCode 59 [crab3@vocms0106.cern.ch#43433366.0#1590385631 200524_124559:sciaba_crab_HC-93-T2_IT_Rome-89669-20200524144303 204 0]...
12 Failed, ExitCode 135 [crab3@vocms0106.cern.ch#43433941.0#1590387427 200524_124559:sciaba_crab_HC-93-T2_IT_Rome-89669-20200524144303 210 0]...
1 Failed, ExitCode 50513 [crab3@vocms0106.cern.ch#43434316.0#1590391733 200524_124559:sciaba_crab_HC-93-T2_IT_Rome-89669-20200524144303 185 1]...
97%280 Success [crab3@vocms0137.cern.ch#51816149.0#1590442619 200525_104043:sciaba_crab_HC-93-T2_IT_Rome-89669-20200524144303 131 0]...
7 Failed, Removed due to wall clock limit [crab3@vocms0137.cern.ch#51812982.0#1590436619 200525_104043:sciaba_crab_HC-93-T2_IT_Rome-89669-20200524144303 111 0]...
100%278 Success [crab3@vocms0155.cern.ch#55725263.0#1590534812 200526_092228:sciaba_crab_HC-93-T2_IT_Rome-89740-20200526112103 166 0]...
FTS Status: 98%Transfer (from/to): 3559/308 files, 0.315/0.658 TB ok
Errors: src_permission: 4/0, src_error: 9/0, trn_error: 255/0 foreign: 569/11
Links: 35/45 ok, 1/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
100%Transfer (from/to): 3401/340 files, 0.615/0.735 TB ok
Errors: src_error: 4228/0, trn_timeout: 0/1, trn_error: 4/1 foreign: 1051/11
Links: 38/45 ok, 0/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
96%Transfer (from/to): 4379/332 files, 2.181/0.718 TB ok
Errors: src_error: 6777/0, trn_timeout: 62/0, trn_error: 112/0 foreign: 1969/10
Links: 32/45 ok, 0/0 warning, 4/0 error, 0/1 unknown, 1/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
97%Transfer (from/to): 7350/322 files, 2.650/0.695 TB ok
Errors: src_error: 935/0, trn_timeout: 12/3, trn_error: 212/0 foreign: 424/4
Links: 29/44 ok, 1/1 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
96%Transfer (from/to): 9031/342 files, 1.231/0.739 TB ok
Errors: src_missing_file: 1/0, src_error: 13162/0, trn_timeout: 10/1, trn_error: 120/2, dst_error: 0/1 foreign: 9/16
Links: 30/45 ok, 1/0 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
97%Transfer (from/to): 8459/334 files, 0.528/0.722 TB ok
Errors: src_error: 6730/0, trn_timeout: 5/2, trn_error: 28/5 foreign: 23/8
Links: 40/43 ok, 1/1 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
98%Transfer (from/to): 4022/339 files, 0.351/0.726 TB ok
Errors: src_error: 513/0, trn_timeout: 0/1, trn_error: 5/6 foreign: 18/11
Links: 38/43 ok, 0/2 warning, 2/0 error, 2/1 unknown, 2/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
99%Transfer (from/to): 7586/311 files, 2.388/0.670 TB ok
Errors: src_error: 113/0, trn_timeout: 7/0, trn_error: 32/0 foreign: 96/23
Links: 42/44 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
100%Transfer (from/to): 9151/325 files, 0.510/0.696 TB ok
Errors: trn_timeout: 8/0, trn_error: 9/1 foreign: 40/32
Links: 40/44 ok, 0/0 warning, 0/0 error, 0/2 unknown, 2/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
100%Transfer (from/to): 4800/327 files, 2.652/0.716 TB ok
Errors: trn_timeout: 13/0, trn_error: 5/0 foreign: 920/30
Links: 38/44 ok, 0/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
99%Transfer (from/to): 1605/1309 files, 1.112/3.677 TB ok
Errors: src_error: 4/0, trn_timeout: 0/1, trn_error: 2/0 foreign: 172/37
Links: 31/43 ok, 0/1 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
100%Transfer (from/to): 770/335 files, 0.305/0.725 TB ok
Errors: trn_error: 5/0 foreign: 33/40
Links: 32/43 ok, 0/0 warning, 0/0 error, 0/3 unknown, 3/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
97%Transfer (from/to): 2886/323 files, 1.085/0.701 TB ok
Errors: trn_timeout: 0/9, trn_error: 56/0 foreign: 76/40
Links: 35/42 ok, 0/0 warning, 0/1 error, 0/3 unknown, 3/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
99%Transfer (from/to): 4209/1303 files, 2.692/3.944 TB ok
Errors: src_error: 40/0, trn_timeout: 7/8, trn_error: 86/0 foreign: 20/47
Links: 29/43 ok, 0/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
100%Transfer (from/to): 1897/2396 files, 0.681/7.758 TB ok
Errors: trn_timeout: 3/0, trn_error: 4/2 foreign: 35/55
Links: 28/44 ok, 0/0 warning, 0/0 error, 1/3 unknown, 3/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
99%Transfer (from/to): 1208/899 files, 0.332/2.731 TB ok
Errors: trn_timeout: 0/1, trn_error: 2/0 foreign: 11/33
Links: 31/41 ok, 0/1 warning, 0/0 error, 0/5 unknown, 2/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
Site Readiness:
45%SAM: ok (15min evaluations: 71 ok, 0 warning, 0 error, 25 unknown, 0 downtime (0h0m)),
HC: ok (304 Success ...),
FTS: ok (Links: 35/45 ok, 1/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
63%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (277 Success ...),
FTS: ok (Links: 38/45 ok, 0/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
56%SAM: warning (15min evaluations: 81 ok, 0 warning, 15 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (289 Success ...; 1 Failed, ExitCode 1 ...),
FTS: ok (Links: 32/45 ok, 0/0 warning, 4/0 error, 0/1 unknown, 1/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
35%SAM: error (15min evaluations: 55 ok, 1 warning, 18 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...; 1 Failed, ExitCode 135 ...),
FTS: ok (Links: 29/44 ok, 1/1 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
50%SAM: warning (15min evaluations: 72 ok, 0 warning, 10 error, 14 unknown, 0 downtime (0h0m)),
HC: ok (312 Success ...; 12 Failed, ExitCode 8021 ...; 1 Failed, ExitCode 8006 ...; 7 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 30/45 ok, 1/0 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
61%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (297 Success ...),
FTS: ok (Links: 40/43 ok, 1/1 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
49%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (229 Success ...),
FTS: ok (Links: 38/43 ok, 0/2 warning, 2/0 error, 2/1 unknown, 2/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
61%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...),
FTS: ok (Links: 42/44 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
62%SAM: ok (15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (278 Success ...),
FTS: ok (Links: 40/44 ok, 0/0 warning, 0/0 error, 0/2 unknown, 2/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
54%SAM: ok (15min evaluations: 85 ok, 1 warning, 0 error, 10 unknown, 0 downtime (0h0m)),
HC: ok (292 Success ...),
FTS: ok (Links: 38/44 ok, 0/0 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
46%SAM: warning (15min evaluations: 49 ok, 0 warning, 7 error, 39 unknown, 0 downtime (0h0m)),
HC: ok (282 Success ...),
FTS: ok (Links: 31/43 ok, 0/1 warning, 0/0 error, 0/2 unknown, 3/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
37%SAM: warning (15min evaluations: 61 ok, 3 warning, 8 error, 23 unknown, 0 downtime (0h0m)),
HC: ok (273 Success ...; 4 Failed, ExitCode 1 ...),
FTS: ok (Links: 32/43 ok, 0/0 warning, 0/0 error, 0/3 unknown, 3/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
21%SAM: error (15min evaluations: 32 ok, 4 warning, 21 error, 39 unknown, 0 downtime (0h0m)),
HC: ok (250 Success ...; 2 Failed, ExitCode 1 ...; 1 Failed, ExitCode 47 ...; 2 Failed, Removed due to wall clock limit ...; 1 Failed, ExitCode 135 ...),
FTS: ok (Links: 35/42 ok, 0/0 warning, 0/1 error, 0/3 unknown, 3/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
1%SAM: unknown (15min evaluations: 9 ok, 0 warning, 10 error, 76 unknown, 0 downtime (0h0m)),
HC: error (153 Success ...; 54 Failed, ExitCode 47 ...; 77 Failed, Removed due to wall clock limit ...; 1 Failed, ExitCode 59 ...; 12 Failed, ExitCode 135 ...; 1 Failed, ExitCode 50513 ...),
FTS: ok (Links: 29/43 ok, 0/0 warning, 1/0 error, 0/3 unknown, 3/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
21%SAM: error (15min evaluations: 29 ok, 0 warning, 60 error, 7 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...; 7 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 28/44 ok, 0/0 warning, 0/0 error, 1/3 unknown, 3/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok),
downtime: no scheduled downtime
1%SAM: error (15min evaluations: 31 ok, 0 warning, 62 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (278 Success ...),
FTS: ok (Links: 31/41 ok, 0/1 warning, 0/0 error, 0/5 unknown, 2/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok),
downtime: no scheduled downtime
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_KR_KISTI
GGUS Tickets:
Downtimes:
SAM Status: 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 90%15min evaluations: 87 ok, 0 warning, 9 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 3 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 81%15min evaluations: 77 ok, 0 warning, 18 error, 0 unknown, 0 downtime (0h0m) 92%15min evaluations: 87 ok, 1 warning, 7 error, 1 unknown, 0 downtime (0h0m) 91%15min evaluations: 63 ok, 0 warning, 6 error, 27 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%281 Success [crab3@vocms0119.cern.ch#53601326.0#1589239339 200511_183623:sciaba_crab_HC-99-T2_KR_KISTI-89092-20200510081104 57 0]... 100%295 Success [crab3@vocms0155.cern.ch#55088777.0#1589326402 200512_080144:sciaba_crab_HC-99-T2_KR_KISTI-89169-20200512095704 186 0]... 98%279 Success [crab3@vocms0196.cern.ch#52276637.0#1589412533 200513_200629:sciaba_crab_HC-99-T2_KR_KISTI-89169-20200512095704 40 0]...
4 Failed, ExitCode 8021 [crab3@vocms0196.cern.ch#52279231.0#1589418535 200513_200629:sciaba_crab_HC-99-T2_KR_KISTI-89169-20200512095704 60 0]...
100%300 Success [crab3@vocms0120.cern.ch#53099615.0#1589499290 200514_110332:sciaba_crab_HC-99-T2_KR_KISTI-89252-20200514125904 150 0]... 100%367 Success [crab3@vocms0137.cern.ch#51492843.0#1589585065 200515_224325:sciaba_crab_HC-99-T2_KR_KISTI-89252-20200514125904 8 0]... 100%298 Success [crab3@vocms0120.cern.ch#53200373.0#1589671619 200516_103457:sciaba_crab_HC-99-T2_KR_KISTI-89365-20200516122702 154 0]... 99%271 Success [crab3@vocms0197.cern.ch#52100095.0#1589757467 200517_223159:sciaba_crab_HC-99-T2_KR_KISTI-89365-20200516122702 9 0]...
2 Failed, ExitCode 8028 [crab3@vocms0197.cern.ch#52113592.0#1589785074 200517_223159:sciaba_crab_HC-99-T2_KR_KISTI-89365-20200516122702 101 0]...
100%296 Success [crab3@vocms0199.cern.ch#13063641.0#1589844843 200518_082221:sciaba_crab_HC-99-T2_KR_KISTI-89437-20200518101503 182 0]... 100%280 Success [crab3@vocms0195.cern.ch#51977075.0#1589930553 200519_202107:sciaba_crab_HC-99-T2_KR_KISTI-89437-20200518101503 36 0]... 100%295 Success [crab3@vocms0155.cern.ch#55478763.0#1590017350 200520_062226:sciaba_crab_HC-99-T2_KR_KISTI-89506-20200520081902 205 0]... 98%281 Success [crab3@vocms0121.cern.ch#54039373.0#1590103376 200521_182653:sciaba_crab_HC-99-T2_KR_KISTI-89506-20200520081902 59 0]...
2 Failed, ExitCode 8021 [crab3@vocms0144.cern.ch#55502151.0#1590123709 200522_020530:sciaba_crab_HC-99-T2_KR_KISTI-89571-20200522035702 35 0]...
1 Failed, ExitCode 1 [crab3@vocms0144.cern.ch#55522894.0#1590169023 200522_020530:sciaba_crab_HC-99-T2_KR_KISTI-89571-20200522035702 186 0]...
100%293 Success [crab3@vocms0107.cern.ch#55352112.0#1590189836 200522_195725:sciaba_crab_HC-99-T2_KR_KISTI-89571-20200522035702 41 0]... 100%283 Success [crab3@vocms0194.cern.ch#53017748.0#1590276347 200523_140415:sciaba_crab_HC-99-T2_KR_KISTI-89571-20200522035702 112 0]... 100%291 Success [crab3@vocms0122.cern.ch#57866553.0#1590363207 200524_222728:sciaba_crab_HC-99-T2_KR_KISTI-89653-20200524062903 13 0]... 96%279 Success [crab3@vocms0195.cern.ch#52133325.0#1590449467 200525_163433:sciaba_crab_HC-99-T2_KR_KISTI-89653-20200524062903 83 0]...
9 Failed, ExitCode 8021 [crab3@vocms0195.cern.ch#52134737.0#1590455471 200525_163433:sciaba_crab_HC-99-T2_KR_KISTI-89653-20200524062903 103 0]...
96%269 Success [crab3@vocms0144.cern.ch#55663418.0#1590535646 200526_215628:sciaba_crab_HC-99-T2_KR_KISTI-89728-20200526055903 18 0]...
9 Failed, ExitCode 8021 [crab3@vocms0144.cern.ch#55673731.0#1590559052 200526_215628:sciaba_crab_HC-99-T2_KR_KISTI-89728-20200526055903 96 0]...
FTS Status: 96%Transfer (from/to): 3170/4701 files, 0.849/6.022 TB ok
Errors: src_permission: 5/0, trn_timeout: 5/25, trn_error: 15/57, dst_permission: 0/3, dst_error: 0/10 foreign: 200/9
Links: 54/51 ok, 1/0 warning, 2/2 error, 0/1 unknown, 1/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
96%Transfer (from/to): 3656/15161 files, 0.599/7.436 TB ok
Errors: src_missing_file: 35/0, src_error: 294/0, trn_timeout: 22/198, trn_error: 28/126, dst_error: 0/16 foreign: 1160/16
Links: 53/59 ok, 1/0 warning, 2/2 error, 0/0 unknown, 1/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
95%Transfer (from/to): 7983/2693 files, 0.837/1.984 TB ok
Errors: src_missing_file: 154/0, src_error: 301/0, trn_timeout: 108/568, trn_user: 0/3, trn_error: 641/1459, dst_permission: 0/1, dst_error: 0/10 foreign: 3214/15
Links: 47/57 ok, 9/1 warning, 3/2 error, 0/0 unknown, 1/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
96%Transfer (from/to): 3260/1182 files, 0.775/1.185 TB ok
Errors: src_missing_file: 63/0, src_error: 440/0, trn_timeout: 52/38, trn_error: 14/217, dst_error: 0/2 foreign: 284/21
Links: 51/48 ok, 5/6 warning, 2/1 error, 1/1 unknown, 1/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
95%Transfer (from/to): 2867/1938 files, 1.662/3.771 TB ok
Errors: src_error: 17/0, trn_timeout: 12/5, trn_error: 2969/534, dst_error: 0/2 foreign: 2037/123
Links: 49/42 ok, 4/13 warning, 3/1 error, 1/1 unknown, 1/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
95%Transfer (from/to): 3214/22619 files, 1.569/11.933 TB ok
Errors: src_error: 4/0, trn_timeout: 15/11, trn_error: 494/2318, dst_error: 0/29 foreign: 654/246
Links: 54/58 ok, 3/1 warning, 2/2 error, 1/0 unknown, 0/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
94%Transfer (from/to): 3225/4676 files, 2.189/8.403 TB ok
Errors: src_error: 164/0, trn_timeout: 3/9, trn_error: 89/659, dst_error: 0/7 foreign: 492/18
Links: 52/51 ok, 0/5 warning, 3/3 error, 1/0 unknown, 2/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
94%Transfer (from/to): 5984/5183 files, 6.287/11.956 TB ok
Errors: src_missing_file: 238/0, src_error: 75/0, trn_timeout: 38/31, trn_error: 45/1480, dst_error: 0/3 foreign: 292/32
Links: 52/49 ok, 2/7 warning, 3/2 error, 0/0 unknown, 2/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
93%Transfer (from/to): 1609/4890 files, 2.794/11.227 TB ok
Errors: src_error: 5/0, trn_timeout: 3/3, trn_error: 527/1337, dst_error: 0/4 foreign: 404/29
Links: 55/54 ok, 1/2 warning, 2/3 error, 0/1 unknown, 3/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
95%Transfer (from/to): 3384/2811 files, 0.774/7.759 TB ok
Errors: src_error: 374/0, trn_timeout: 2/7, trn_error: 44/671, dst_error: 0/2 foreign: 141/25
Links: 56/44 ok, 1/8 warning, 2/2 error, 0/1 unknown, 2/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
96%Transfer (from/to): 1242/4290 files, 0.999/8.631 TB ok
Errors: src_error: 4/0, trn_timeout: 5/12, trn_error: 319/294, dst_error: 0/12 foreign: 289/31
Links: 54/53 ok, 2/2 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
95%Transfer (from/to): 1421/4460 files, 1.580/7.916 TB ok
Errors: trn_timeout: 5/11, trn_error: 50/825, dst_error: 0/5 foreign: 232/58
Links: 52/44 ok, 2/8 warning, 1/2 error, 0/2 unknown, 3/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
96%Transfer (from/to): 2600/3285 files, 3.346/6.813 TB ok
Errors: trn_timeout: 30/15, trn_error: 17/830, dst_error: 0/3 foreign: 132/34
Links: 55/49 ok, 0/6 warning, 1/2 error, 0/1 unknown, 3/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
82%Transfer (from/to): 6197/4891 files, 9.392/11.190 TB ok
Errors: src_missing_file: 701/0, src_error: 1377/0, trn_timeout: 111/32, trn_error: 3628/200, dst_permission: 0/12, dst_error: 0/345 foreign: 2458/24
Links: 25/48 ok, 15/5 warning, 18/2 error, 0/2 unknown, 3/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
89%Transfer (from/to): 5825/12970 files, 10.733/15.080 TB ok
Errors: src_missing_file: 1282/0, src_error: 1325/0, trn_timeout: 175/5, trn_user: 0/16533, trn_error: 4540/122, dst_permission: 0/8, dst_error: 0/52 foreign: 3500/613
Links: 20/57 ok, 10/0 warning, 12/2 error, 16/1 unknown, 3/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
86%Transfer (from/to): 2791/9147 files, 1.041/7.867 TB ok
Errors: src_missing_file: 912/0, src_error: 8/0, trn_timeout: 780/60, trn_error: 1018/162, dst_permission: 0/3, dst_error: 0/5 foreign: 845/106
Links: 19/56 ok, 1/0 warning, 7/2 error, 32/1 unknown, 2/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
Site Readiness:
94%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...),
FTS: ok (Links: 54/51 ok, 1/0 warning, 2/2 error, 0/1 unknown, 1/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
96%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 53/59 ok, 1/0 warning, 2/2 error, 0/0 unknown, 1/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
88%SAM: ok (15min evaluations: 87 ok, 0 warning, 9 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...; 4 Failed, ExitCode 8021 ...),
FTS: ok (Links: 47/57 ok, 9/1 warning, 3/2 error, 0/0 unknown, 1/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
75%SAM: ok (15min evaluations: 74 ok, 0 warning, 0 error, 22 unknown, 0 downtime (0h0m)),
HC: ok (300 Success ...),
FTS: ok (Links: 51/48 ok, 5/6 warning, 2/1 error, 1/1 unknown, 1/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
94%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (367 Success ...),
FTS: ok (Links: 49/42 ok, 4/13 warning, 3/1 error, 1/1 unknown, 1/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
99%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (298 Success ...),
FTS: ok (Links: 54/58 ok, 3/1 warning, 2/2 error, 1/0 unknown, 0/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
91%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (271 Success ...; 2 Failed, ExitCode 8028 ...),
FTS: ok (Links: 52/51 ok, 0/5 warning, 3/3 error, 1/0 unknown, 2/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
97%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (296 Success ...),
FTS: ok (Links: 52/49 ok, 2/7 warning, 3/2 error, 0/0 unknown, 2/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
96%SAM: ok (15min evaluations: 93 ok, 3 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...),
FTS: ok (Links: 55/54 ok, 1/2 warning, 2/3 error, 0/1 unknown, 3/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
100%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (295 Success ...),
FTS: ok (Links: 56/44 ok, 1/8 warning, 2/2 error, 0/1 unknown, 2/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
89%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (281 Success ...; 2 Failed, ExitCode 8021 ...; 1 Failed, ExitCode 1 ...),
FTS: ok (Links: 54/53 ok, 2/2 warning, 1/0 error, 0/2 unknown, 3/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
99%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (293 Success ...),
FTS: ok (Links: 52/44 ok, 2/8 warning, 1/2 error, 0/2 unknown, 3/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
95%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (283 Success ...),
FTS: ok (Links: 55/49 ok, 0/6 warning, 1/2 error, 0/1 unknown, 3/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
79%SAM: warning (15min evaluations: 77 ok, 0 warning, 18 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (291 Success ...),
FTS: ok (Links: 25/48 ok, 15/5 warning, 18/2 error, 0/2 unknown, 3/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
84%SAM: ok (15min evaluations: 87 ok, 1 warning, 7 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...; 9 Failed, ExitCode 8021 ...),
FTS: ok (Links: 20/57 ok, 10/0 warning, 12/2 error, 16/1 unknown, 3/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
33%SAM: ok (15min evaluations: 63 ok, 0 warning, 6 error, 27 unknown, 0 downtime (0h0m)),
HC: ok (269 Success ...; 9 Failed, ExitCode 8021 ...),
FTS: ok (Links: 19/56 ok, 1/0 warning, 7/2 error, 32/1 unknown, 2/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
Life Status:
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_PK_NCP
GGUS Tickets: 144063
Downtimes:
SAM Status: 85%15min evaluations: 0 ok, 82 warning, 14 error, 0 unknown, 0 downtime (0h0m) 93%15min evaluations: 0 ok, 90 warning, 6 error, 0 unknown, 0 downtime (0h0m) 77%15min evaluations: 0 ok, 74 warning, 22 error, 0 unknown, 0 downtime (0h0m) 80%15min evaluations: 0 ok, 60 warning, 15 error, 21 unknown, 0 downtime (0h0m) 91%15min evaluations: 0 ok, 88 warning, 8 error, 0 unknown, 0 downtime (0h0m) 76%15min evaluations: 0 ok, 73 warning, 23 error, 0 unknown, 0 downtime (0h0m) 90%15min evaluations: 0 ok, 87 warning, 9 error, 0 unknown, 0 downtime (0h0m) 88%15min evaluations: 0 ok, 85 warning, 11 error, 0 unknown, 0 downtime (0h0m) 88%15min evaluations: 0 ok, 85 warning, 11 error, 0 unknown, 0 downtime (0h0m) 88%15min evaluations: 0 ok, 85 warning, 11 error, 0 unknown, 0 downtime (0h0m) 90%15min evaluations: 0 ok, 86 warning, 9 error, 0 unknown, 0 downtime (0h0m) 92%15min evaluations: 0 ok, 88 warning, 7 error, 1 unknown, 0 downtime (0h0m) 88%15min evaluations: 0 ok, 85 warning, 11 error, 0 unknown, 0 downtime (0h0m) 89%15min evaluations: 0 ok, 85 warning, 10 error, 0 unknown, 0 downtime (0h0m) 88%15min evaluations: 0 ok, 84 warning, 11 error, 1 unknown, 0 downtime (0h0m) 71%15min evaluations: 0 ok, 64 warning, 26 error, 6 unknown, 0 downtime (0h0m)
Hammer Cloud: 95%261 Success [crab3@vocms0144.cern.ch#55042225.0#1589233073 200511_003227:sciaba_crab_HC-99-T2_PK_NCP-89092-20200510081104 138 2]...
10 Failed, ExitCode 8021 [crab3@vocms0155.cern.ch#55027381.0#1589252804 200512_013702:sciaba_crab_HC-99-T2_PK_NCP-89092-20200510081104 17 0]...
1 Failed, ExitCode 47 [crab3@vocms0194.cern.ch#52602556.0#1589271113 200512_080518:sciaba_crab_HC-99-T2_PK_NCP-89169-20200512095704 1 0]...
1 Failed, ExitCode 10040 [crab3@vocms0194.cern.ch#52605336.0#1589288819 200512_080518:sciaba_crab_HC-99-T2_PK_NCP-89169-20200512095704 60 0]...
1 Failed, ExitCode 1 [crab3@vocms0194.cern.ch#52605958.0#1589292417 200512_080518:sciaba_crab_HC-99-T2_PK_NCP-89169-20200512095704 72 0]...
80%286 Success [crab3@vocms0194.cern.ch#52612446.0#1589322127 200512_080518:sciaba_crab_HC-99-T2_PK_NCP-89169-20200512095704 171 0]...
71 Failed, ExitCode 8021 [crab3@vocms0194.cern.ch#52614137.0#1589327229 200512_080518:sciaba_crab_HC-99-T2_PK_NCP-89169-20200512095704 188 0]...
80%210 Success [crab3@vocms0121.cern.ch#53670371.0#1589412430 200513_220116:sciaba_crab_HC-99-T2_PK_NCP-89169-20200512095704 17 0]...
20 Failed, ExitCode 8021 [crab3@vocms0121.cern.ch#53673671.0#1589424729 200513_220116:sciaba_crab_HC-99-T2_PK_NCP-89169-20200512095704 58 0]...
21 Failed, ExitCode 10040 [crab3@vocms0121.cern.ch#53674712.0#1589428931 200513_220116:sciaba_crab_HC-99-T2_PK_NCP-89169-20200512095704 72 0]...
2 Failed, ExitCode 1 [crab3@vocms0121.cern.ch#53674445.0#1589427430 200513_220116:sciaba_crab_HC-99-T2_PK_NCP-89169-20200512095704 67 0]...
4 Failed, ExitCode 47 [crab3@vocms0121.cern.ch#53675698.0#1589429831 200513_220116:sciaba_crab_HC-99-T2_PK_NCP-89169-20200512095704 75 0]...
3 Failed, ExitCode 8001 [crab3@vocms0121.cern.ch#53676446.0#1589435230 200513_220116:sciaba_crab_HC-99-T2_PK_NCP-89169-20200512095704 93 0]...
2 Failed, ExitCode 8003 [crab3@vocms0121.cern.ch#53676315.0#1589434031 200513_220116:sciaba_crab_HC-99-T2_PK_NCP-89169-20200512095704 89 0]...
93%308 Success [crab3@vocms0121.cern.ch#53697575.0#1589487811 200514_110121:sciaba_crab_HC-99-T2_PK_NCP-89252-20200514125904 112 0]...
20 Failed, ExitCode 8021 [crab3@vocms0121.cern.ch#53700920.0#1589492313 200514_110121:sciaba_crab_HC-99-T2_PK_NCP-89252-20200514125904 127 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0121.cern.ch#53704438.0#1589502216 200514_110121:sciaba_crab_HC-99-T2_PK_NCP-89252-20200514125904 160 0]...
85%373 Success [crab3@vocms0194.cern.ch#52760001.0#1589583219 200515_061641:sciaba_crab_HC-99-T2_PK_NCP-89252-20200514125904 199 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0194.cern.ch#52746620.0#1589570615 200515_061641:sciaba_crab_HC-99-T2_PK_NCP-89252-20200514125904 157 0]...
60 Failed, ExitCode 8021 [crab3@vocms0155.cern.ch#55290464.0#1589593317 200516_002550:sciaba_crab_HC-99-T2_PK_NCP-89252-20200514125904 15 0]...
1 Failed, ExitCode 47 [crab3@vocms0155.cern.ch#55295331.0#1589615223 200516_002550:sciaba_crab_HC-99-T2_PK_NCP-89252-20200514125904 88 0]...
86%300 Success [crab3@vocms0194.cern.ch#52813682.0#1589668749 200516_103626:sciaba_crab_HC-99-T2_PK_NCP-89365-20200516122702 144 0]...
46 Failed, ExitCode 8021 [crab3@vocms0194.cern.ch#52814453.0#1589674457 200516_103626:sciaba_crab_HC-99-T2_PK_NCP-89365-20200516122702 163 0]...
92%274 Success [crab3@vocms0119.cern.ch#53905596.0#1589757111 200517_225045:sciaba_crab_HC-99-T2_PK_NCP-89365-20200516122702 4 0]...
21 Failed, ExitCode 8021 [crab3@vocms0119.cern.ch#53913159.0#1589769113 200517_225045:sciaba_crab_HC-99-T2_PK_NCP-89365-20200516122702 44 0]...
1 Failed, ExitCode 8028 [crab3@vocms0119.cern.ch#53928591.0#1589785319 200517_225045:sciaba_crab_HC-99-T2_PK_NCP-89365-20200516122702 98 0]...
95%258 Success [crab3@vocms0122.cern.ch#57623207.0#1589843509 200518_082429:sciaba_crab_HC-99-T2_PK_NCP-89437-20200518101503 177 0]...
13 Failed, ExitCode 8021 [crab3@vocms0122.cern.ch#57625689.0#1589851910 200518_082429:sciaba_crab_HC-99-T2_PK_NCP-89437-20200518101503 205 0]...
91%263 Success [crab3@vocms0199.cern.ch#13083701.0#1589919968 200519_023439:sciaba_crab_HC-99-T2_PK_NCP-89437-20200518101503 214 0]...
23 Failed, ExitCode 8021 [crab3@vocms0144.cern.ch#55424507.0#1589929268 200519_222010:sciaba_crab_HC-99-T2_PK_NCP-89437-20200518101503 8 0]...
1 Failed, ExitCode 47 [crab3@vocms0198.cern.ch#48684976.0#1589965434 200520_062246:sciaba_crab_HC-99-T2_PK_NCP-89506-20200520081902 32 0]...
95%280 Success [crab3@vocms0198.cern.ch#48709858.0#1590012546 200520_062246:sciaba_crab_HC-99-T2_PK_NCP-89506-20200520081902 189 0]...
13 Failed, ExitCode 8021 [crab3@vocms0198.cern.ch#48710640.0#1590014645 200520_062246:sciaba_crab_HC-99-T2_PK_NCP-89506-20200520081902 196 0]...
99%279 Success [crab3@vocms0119.cern.ch#54100029.0#1590103120 200521_204736:sciaba_crab_HC-99-T2_PK_NCP-89506-20200520081902 30 0]...
1 Failed, ExitCode 8021 [crab3@vocms0120.cern.ch#53500247.0#1590177954 200522_015913:sciaba_crab_HC-99-T2_PK_NCP-89571-20200522035702 217 0]...
88%284 Success [crab3@vocms0196.cern.ch#52600749.0#1590188350 200522_195319:sciaba_crab_HC-99-T2_PK_NCP-89571-20200522035702 37 0]...
37 Failed, ExitCode 8021 [crab3@vocms0196.cern.ch#52615476.0#1590208458 200522_195319:sciaba_crab_HC-99-T2_PK_NCP-89571-20200522035702 104 0]...
89%269 Success [crab3@vocms0122.cern.ch#57840578.0#1590273976 200523_140003:sciaba_crab_HC-99-T2_PK_NCP-89571-20200522035702 105 0]...
33 Failed, ExitCode 8021 [crab3@vocms0122.cern.ch#57841276.0#1590276376 200523_140003:sciaba_crab_HC-99-T2_PK_NCP-89571-20200522035702 113 0]...
94%302 Success [crab3@vocms0122.cern.ch#57866374.0#1590361221 200524_043411:sciaba_crab_HC-99-T2_PK_NCP-89653-20200524062903 221 0]...
18 Failed, ExitCode 8021 [crab3@vocms0122.cern.ch#57866330.0#1590360319 200524_043411:sciaba_crab_HC-99-T2_PK_NCP-89653-20200524062903 218 0]...
95%280 Success [crab3@vocms0121.cern.ch#54160586.0#1590447835 200525_163248:sciaba_crab_HC-99-T2_PK_NCP-89653-20200524062903 78 0]...
14 Failed, ExitCode 8021 [crab3@vocms0121.cern.ch#54161343.0#1590453238 200525_163248:sciaba_crab_HC-99-T2_PK_NCP-89653-20200524062903 96 0]...
95%222 Success [crab3@vocms0137.cern.ch#51851930.0#1590533758 200526_215454:sciaba_crab_HC-99-T2_PK_NCP-89728-20200526055903 12 0]...
1 Failed, ExitCode 8028 [crab3@vocms0137.cern.ch#51854797.0#1590547258 200526_215454:sciaba_crab_HC-99-T2_PK_NCP-89728-20200526055903 57 0]...
10 Failed, ExitCode 8021 [crab3@vocms0137.cern.ch#51856855.0#1590554161 200526_215454:sciaba_crab_HC-99-T2_PK_NCP-89728-20200526055903 80 0]...
FTS Status: 0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 4/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 7/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 2/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 6/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 3/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: src_error: 1/0, trn_error: 1/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/1 files, 0.000/0.000 TB ok
Errors: trn_error: 4/0 foreign: 3/0
Links: 0/1 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/warning
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 4/0 foreign: 14/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
No inforrmation available 0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 2/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 4/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 4/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 8/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: src_missing_file: 2/0, trn_error: 3/0
Links: 0/0 ok, 1/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: warning/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 7/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 4/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
Site Readiness:
0%SAM: warning (15min evaluations: 0 ok, 82 warning, 14 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (261 Success ...; 10 Failed, ExitCode 8021 ...; 1 Failed, ExitCode 47 ...; 1 Failed, ExitCode 10040 ...; 1 Failed, ExitCode 1 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 0 ok, 90 warning, 6 error, 0 unknown, 0 downtime (0h0m)),
HC: warning (286 Success ...; 71 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: error (15min evaluations: 0 ok, 74 warning, 22 error, 0 unknown, 0 downtime (0h0m)),
HC: warning (210 Success ...; 20 Failed, ExitCode 8021 ...; 21 Failed, ExitCode 10040 ...; 2 Failed, ExitCode 1 ...; 4 Failed, ExitCode 47 ...; 3 Failed, ExitCode 8001 ...; 2 Failed, ExitCode 8003 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: warning (15min evaluations: 0 ok, 60 warning, 15 error, 21 unknown, 0 downtime (0h0m)),
HC: ok (308 Success ...; 20 Failed, ExitCode 8021 ...; 1 Failed, Removed due to wall clock limit ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 0 ok, 88 warning, 8 error, 0 unknown, 0 downtime (0h0m)),
HC: warning (373 Success ...; 1 Failed, Removed due to wall clock limit ...; 60 Failed, ExitCode 8021 ...; 1 Failed, ExitCode 47 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: error (15min evaluations: 0 ok, 73 warning, 23 error, 0 unknown, 0 downtime (0h0m)),
HC: warning (300 Success ...; 46 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 0 ok, 87 warning, 9 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (274 Success ...; 21 Failed, ExitCode 8021 ...; 1 Failed, ExitCode 8028 ...),
FTS: unknown (Links: 0/1 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/warning)
0%SAM: warning (15min evaluations: 0 ok, 85 warning, 11 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (258 Success ...; 13 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: warning (15min evaluations: 0 ok, 85 warning, 11 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (263 Success ...; 23 Failed, ExitCode 8021 ...; 1 Failed, ExitCode 47 ...)
0%SAM: warning (15min evaluations: 0 ok, 85 warning, 11 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...; 13 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 0 ok, 86 warning, 9 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (279 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 0 ok, 88 warning, 7 error, 1 unknown, 0 downtime (0h0m)),
HC: warning (284 Success ...; 37 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: warning (15min evaluations: 0 ok, 85 warning, 11 error, 0 unknown, 0 downtime (0h0m)),
HC: warning (269 Success ...; 33 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: warning (15min evaluations: 0 ok, 85 warning, 10 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (302 Success ...; 18 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 0/0 ok, 1/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: warning/unknown)
0%SAM: warning (15min evaluations: 0 ok, 84 warning, 11 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (280 Success ...; 14 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: error (15min evaluations: 0 ok, 64 warning, 26 error, 6 unknown, 0 downtime (0h0m)),
HC: ok (222 Success ...; 1 Failed, ExitCode 8028 ...; 10 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
Life Status: WR WR WR WR WR WR WR WR WR WR WR WR WR WR WR WR WR
Prod Status:
CRAB Status:
12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28
May

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-May-28 11:30:12 UTC

 

 

T2_PL_Swierk
GGUS Tickets: 146838
Downtimes: Use.cis.gov.pl/SE, se.cis.gov.pl/XRD, se.cis.gov.pl/SE Dse.cis.gov.pl/SE, se.cis.gov.pl/SE, all XROOTDs (se.cis.gov.pl) Dse.cis.gov.pl/SE, se.cis.gov.pl/SE, all XROOTDs (se.cis.gov.pl) Dse.cis.gov.pl/SE, se.cis.gov.pl/SE, all XROOTDs (se.cis.gov.pl) Dse.cis.gov.pl/SE, se.cis.gov.pl/SE, all XROOTDs (se.cis.gov.pl) Dse.cis.gov.pl/SE, se.cis.gov.pl/SE, all XROOTDs (se.cis.gov.pl) Dse.cis.gov.pl/SE, se.cis.gov.pl/SE, all XROOTDs (se.cis.gov.pl) Dse.cis.gov.pl/SE, se.cis.gov.pl/SE, all XROOTDs (se.cis.gov.pl) Dse.cis.gov.pl/SE, se.cis.gov.pl/SE, all XROOTDs (se.cis.gov.pl) Dse.cis.gov.pl/SE, se.cis.gov.pl/SE, all XROOTDs (se.cis.gov.pl)
SAM Status: 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 72 ok, 0 warning, 2 error, 22 unknown, 0 downtime (0h0m) 69%15min evaluations: 67 ok, 0 warning, 29 error, 0 unknown, 0 downtime (0h0m) 87%15min evaluations: 82 ok, 1 warning, 12 error, 1 unknown, 0 downtime (0h0m) 26%15min evaluations: 25 ok, 0 warning, 71 error, 0 unknown, 0 downtime (0h0m) 0%15min evaluations: 0 ok, 0 warning, 37 error, 0 unknown, 59 downtime (15h0m) n/a15min evaluations: 0 ok, 0 warning, 0 error, 0 unknown, 96 downtime (24h0m) n/a15min evaluations: 0 ok, 0 warning, 0 error, 0 unknown, 96 downtime (24h0m) n/a15min evaluations: 0 ok, 0 warning, 0 error, 0 unknown, 95 downtime (24h0m) 0%15min evaluations: 0 ok, 0 warning, 12 error, 0 unknown, 84 downtime (21h0m) 0%15min evaluations: 0 ok, 0 warning, 40 error, 0 unknown, 56 downtime (14h15m) n/a15min evaluations: 0 ok, 0 warning, 0 error, 0 unknown, 96 downtime (24h0m) n/a15min evaluations: 0 ok, 0 warning, 0 error, 0 unknown, 96 downtime (24h0m)