CMS Site Readiness Report of Fr, 2020-Oct-30

 

 

T0_CH_CERN
GGUS Tickets: 148790 149271
Downtimes: Pce509.cern.ch/CE, ce510.cern.ch/CE
SAM Status: 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available No inforrmation available
FTS Status: 97%Transfer (from/to): 58491/167129 files, 177.804/24.728 TB ok
Errors: src_missing_file: 34/0, src_error: 123/0, trn_timeout: 572/1193, trn_error: 962/1707, dst_permission: 0/1, dst_space: 0/5785, dst_error: 0/65 foreign: 473/1038
Links: 118/112 ok, 2/0 warning, 2/2 error, 0/2 unknown, 3/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
97%Transfer (from/to): 52530/138438 files, 55.789/148.082 TB ok
Errors: src_missing_file: 13/0, trn_timeout: 36/26, trn_user: 0/1, trn_error: 444/140, dst_permission: 0/87, dst_path: 0/3, dst_space: 0/6, dst_error: 0/2 foreign: 324/483
Links: 117/112 ok, 1/0 warning, 2/1 error, 0/2 unknown, 3/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 102568/138385 files, 115.446/247.900 TB ok
Errors: src_missing_file: 5/0, trn_timeout: 600/63, trn_user: 0/1, trn_error: 453/484, dst_permission: 0/1888, dst_space: 0/10864, dst_error: 0/1 foreign: 381/776
Links: 118/111 ok, 0/0 warning, 1/2 error, 0/2 unknown, 3/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
96%Transfer (from/to): 89401/134694 files, 106.855/126.543 TB ok
Errors: src_missing_file: 12/0, trn_timeout: 451/41, trn_user: 0/1, trn_error: 48/150, dst_permission: 0/2, dst_space: 0/20037 foreign: 116/2406
Links: 118/110 ok, 3/0 warning, 1/3 error, 0/2 unknown, 2/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
97%Transfer (from/to): 39027/13494 files, 38.358/17.478 TB ok
Errors: src_missing_file: 14/0, trn_timeout: 617/2, trn_error: 177/14, dst_space: 0/8 foreign: 246/174
Links: 115/112 ok, 3/1 warning, 1/0 error, 0/1 unknown, 3/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
94%Transfer (from/to): 58337/72973 files, 45.546/7.650 TB ok
Errors: src_missing_file: 67/0, trn_timeout: 265/39, trn_error: 718/44, dst_space: 0/939 foreign: 581/374
Links: 111/111 ok, 5/2 warning, 2/1 error, 0/2 unknown, 4/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
96%Transfer (from/to): 72436/50132 files, 56.848/16.653 TB ok
Errors: src_missing_file: 59/0, trn_timeout: 639/117, trn_user: 0/1, trn_error: 2186/30, dst_space: 0/2697 foreign: 1203/354
Links: 117/109 ok, 3/0 warning, 2/4 error, 0/2 unknown, 2/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
94%Transfer (from/to): 29139/35898 files, 27.306/23.048 TB ok
Errors: src_missing_file: 54/0, trn_timeout: 332/21, trn_user: 0/970, trn_error: 25/39, dst_space: 0/3497, dst_error: 0/1 foreign: 1432/8331
Links: 116/107 ok, 5/2 warning, 1/4 error, 0/2 unknown, 3/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
97%Transfer (from/to): 69636/86975 files, 37.222/32.579 TB ok
Errors: src_missing_file: 34/0, trn_timeout: 598/80, trn_user: 0/358, trn_error: 312/506, dst_space: 0/358, dst_error: 0/1 foreign: 1837/4715
Links: 118/110 ok, 4/3 warning, 1/1 error, 0/2 unknown, 6/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
97%Transfer (from/to): 36500/84950 files, 19.355/51.811 TB ok
Errors: src_missing_file: 47/0, trn_timeout: 480/38, trn_user: 0/1, trn_error: 118/285, dst_space: 0/12786 foreign: 742/646
Links: 117/107 ok, 4/3 warning, 2/2 error, 0/2 unknown, 4/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
97%Transfer (from/to): 22692/31468 files, 13.247/8.405 TB ok
Errors: src_missing_file: 88/0, trn_timeout: 433/5, trn_user: 0/1, trn_error: 163/229, dst_space: 0/1034 foreign: 712/316
Links: 119/108 ok, 1/1 warning, 2/0 error, 0/2 unknown, 3/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 44157/25571 files, 18.727/17.399 TB ok
Errors: src_missing_file: 29/0, trn_timeout: 562/9, trn_error: 1718/239, dst_permission: 0/1, dst_space: 0/491 foreign: 969/332
Links: 114/109 ok, 5/0 warning, 1/1 error, 0/2 unknown, 4/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
91%Transfer (from/to): 35664/68030 files, 59.868/14.280 TB ok
Errors: src_missing_file: 57/0, trn_timeout: 510/60, trn_error: 1337/509, dst_space: 0/90965 foreign: 557/3252
Links: 119/102 ok, 4/1 warning, 1/9 error, 0/2 unknown, 1/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
96%Transfer (from/to): 66962/81309 files, 58.321/40.698 TB ok
Errors: src_missing_file: 32/0, src_error: 21/0, trn_timeout: 540/77, trn_user: 4/231, trn_error: 1419/230, dst_space: 0/11028, dst_error: 0/1 foreign: 104007/3587
Links: 118/110 ok, 2/0 warning, 1/4 error, 0/3 unknown, 3/2 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
96%Transfer (from/to): 67716/66850 files, 38.046/48.590 TB ok
Errors: src_permission: 453/0, src_missing_file: 36/0, trn_timeout: 736/9, trn_user: 88/0, trn_error: 4473/994, dst_space: 0/3745 foreign: 33940/1143
Links: 114/110 ok, 1/0 warning, 3/0 error, 0/5 unknown, 3/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
96%Transfer (from/to): 37878/63847 files, 43.391/17.725 TB ok
Errors: src_missing_file: 31/0, trn_timeout: 1284/1, trn_user: 2/32, trn_error: 718/491, dst_permission: 0/1, dst_space: 0/13172 foreign: 1240/854
Links: 111/110 ok, 4/0 warning, 1/3 error, 0/2 unknown, 3/0 bad-endpoint
srm-cms.cern.ch: ok/ok
eoscmsftp.cern.ch: ok/ok
Site Readiness:
0%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 118/112 ok, 2/0 warning, 2/2 error, 0/2 unknown, 3/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 117/112 ok, 1/0 warning, 2/1 error, 0/2 unknown, 3/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 118/111 ok, 0/0 warning, 1/2 error, 0/2 unknown, 3/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 118/110 ok, 3/0 warning, 1/3 error, 0/2 unknown, 2/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 115/112 ok, 3/1 warning, 1/0 error, 0/1 unknown, 3/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 111/111 ok, 5/2 warning, 2/1 error, 0/2 unknown, 4/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 117/109 ok, 3/0 warning, 2/4 error, 0/2 unknown, 2/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 116/107 ok, 5/2 warning, 1/4 error, 0/2 unknown, 3/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 118/110 ok, 4/3 warning, 1/1 error, 0/2 unknown, 6/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 117/107 ok, 4/3 warning, 2/2 error, 0/2 unknown, 4/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 119/108 ok, 1/1 warning, 2/0 error, 0/2 unknown, 3/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 114/109 ok, 5/0 warning, 1/1 error, 0/2 unknown, 4/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 119/102 ok, 4/1 warning, 1/9 error, 0/2 unknown, 1/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 118/110 ok, 2/0 warning, 1/4 error, 0/3 unknown, 3/2 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 114/110 ok, 1/0 warning, 3/0 error, 0/5 unknown, 3/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
FTS: ok (Links: 111/110 ok, 4/0 warning, 1/3 error, 0/2 unknown, 3/0 bad-endpoint; srm-cms.cern.ch: ok/ok; eoscmsftp.cern.ch: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T1_DE_KIT
GGUS Tickets: 148617
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%190 Success [crab3@vocms0120.cern.ch#58494133.0#1602632061 201013_075020:sciaba_crab_HC-101-T1_DE_KIT-93186-20201013094703 172 0]... 100%112 Success [crab3@vocms0120.cern.ch#58527591.0#1602718714 201014_074903:sciaba_crab_HC-101-T1_DE_KIT-93196-20201014080703 188 0]... 100%228 Success [crab3@vocms0122.cern.ch#62649008.0#1602805097 201015_125229:sciaba_crab_HC-101-T1_DE_KIT-93206-20201015063703 129 0]... 100%265 Success [crab3@vocms0155.cern.ch#60782625.0#1602891077 201016_232527:sciaba_crab_HC-101-T1_DE_KIT-93228-20201016070903 1 0]... 99%258 Success [crab3@vocms0119.cern.ch#59072757.0#1602977876 201017_051141:sciaba_crab_HC-101-T1_DE_KIT-93239-20201017070302 221 0]...
1 Failed, GlobalPool periodic cleanup [crab3@vocms0107.cern.ch#59936446.0#1603062747 201018_052117:sciaba_crab_HC-101-T1_DE_KIT-93249-20201018071703 214 0]...
100%199 Success [crab3@vocms0107.cern.ch#59936510.0#1603064851 201018_052117:sciaba_crab_HC-101-T1_DE_KIT-93249-20201018071703 221 0]... 100%140 Success [crab3@vocms0196.cern.ch#56989440.0#1603152486 201019_070215:sciaba_crab_HC-101-T1_DE_KIT-93261-20201019085303 205 0]... 100%178 Success [crab3@vocms0137.cern.ch#56605087.0#1603236425 201020_064056:sciaba_crab_HC-101-T1_DE_KIT-93274-20201020083303 201 0]... 100%193 Success [crab3@vocms0155.cern.ch#61063374.0#1603323003 201021_065357:sciaba_crab_HC-101-T1_DE_KIT-93284-20201021083902 199 0]... 100%192 Success [crab3@vocms0137.cern.ch#56703126.0#1603409534 201022_224124:sciaba_crab_HC-101-T1_DE_KIT-93300-20201022062102 10 0]... 98%205 Success [crab3@vocms0155.cern.ch#61133342.0#1603496187 201023_221538:sciaba_crab_HC-101-T1_DE_KIT-93311-20201023055702 16 0]...
3 Failed, GlobalPool periodic cleanup [crab3@vocms0106.cern.ch#48010274.0#1603578054 201024_220943:sciaba_crab_HC-101-T1_DE_KIT-93322-20201024060303 2 0]...
99%260 Success [crab3@vocms0106.cern.ch#48011351.0#1603582552 201024_220943:sciaba_crab_HC-101-T1_DE_KIT-93322-20201024060303 17 0]...
2 Failed, GlobalPool periodic cleanup [crab3@vocms0106.cern.ch#48014455.0#1603610624 201025_051732:sciaba_crab_HC-101-T1_DE_KIT-93333-20201025061303 25 0]...
100%235 Success [crab3@vocms0106.cern.ch#48034316.0#1603668836 201025_051732:sciaba_crab_HC-101-T1_DE_KIT-93333-20201025061303 219 0]... 99%185 Success [crab3@vocms0137.cern.ch#56882979.0#1603755559 201026_222248:sciaba_crab_HC-101-T1_DE_KIT-93344-20201026051303 15 0]...
1 Failed, GlobalPool periodic cleanup [crab3@vocms0107.cern.ch#60158540.0#1603819033 201027_045603:sciaba_crab_HC-101-T1_DE_KIT-93355-20201027053903 148 0]...
99%265 Success [crab3@vocms0155.cern.ch#61253684.0#1603841716 201027_230421:sciaba_crab_HC-101-T1_DE_KIT-93355-20201027053903 6 0]...
2 Failed, GlobalPool periodic cleanup [crab3@vocms0195.cern.ch#56946171.0#1603898231 201028_040547:sciaba_crab_HC-101-T1_DE_KIT-93367-20201028045502 134 0]...
99%245 Success [crab3@vocms0144.cern.ch#60702798.0#1603927966 201028_221147:sciaba_crab_HC-101-T1_DE_KIT-93367-20201028045502 16 0]...
1 Failed, GlobalPool periodic cleanup [crab3@vocms0197.cern.ch#57604853.0#1604003738 201029_200915:sciaba_crab_HC-101-T1_DE_KIT-93382-20201029032302 5 0]...
FTS Status: 96%Transfer (from/to): 30274/13562 files, 167.633/102.892 TB ok
Errors: src_missing_file: 11/0, trn_timeout: 427/4, trn_error: 316/64, dst_permission: 0/2, dst_error: 0/1 foreign: 242/107
Links: 57/56 ok, 1/0 warning, 2/2 error, 0/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
96%Transfer (from/to): 5218/1518 files, 7.023/2.136 TB ok
Errors: trn_error: 176/47, dst_permission: 0/2, dst_error: 0/2 foreign: 138/59
Links: 59/56 ok, 0/0 warning, 2/2 error, 0/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
96%Transfer (from/to): 3250/42681 files, 3.144/11.674 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 16/8, trn_error: 12/54, dst_permission: 0/18, dst_error: 0/6 foreign: 45/355
Links: 60/56 ok, 0/0 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
96%Transfer (from/to): 1735/2650 files, 4.382/5.696 TB ok
Errors: trn_timeout: 103/21, trn_error: 14/46, dst_error: 0/4 foreign: 46/359
Links: 60/56 ok, 0/0 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
96%Transfer (from/to): 1692/1272 files, 2.379/3.754 TB ok
Errors: trn_timeout: 12/0, trn_error: 12/47, dst_permission: 0/7, dst_error: 0/4 foreign: 37/373
Links: 59/56 ok, 0/0 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
95%Transfer (from/to): 5049/13158 files, 10.785/38.920 TB ok
Errors: trn_timeout: 13/4, trn_error: 22/61, dst_error: 0/5 foreign: 34/274
Links: 56/55 ok, 1/1 warning, 2/2 error, 0/1 unknown, 2/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
94%Transfer (from/to): 8077/3078 files, 9.452/8.386 TB ok
Errors: src_permission: 6/0, trn_timeout: 71/11, trn_user: 0/2, trn_error: 14/48, dst_permission: 0/1, dst_error: 0/4 foreign: 46/420
Links: 60/55 ok, 1/0 warning, 2/3 error, 0/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
93%Transfer (from/to): 5862/2598 files, 13.296/13.353 TB ok
Errors: src_error: 271/0, trn_timeout: 19/24, trn_error: 13/50, dst_error: 0/3 foreign: 63/373
Links: 60/54 ok, 0/1 warning, 2/3 error, 0/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
96%Transfer (from/to): 6915/33559 files, 23.490/100.648 TB ok
Errors: src_missing_file: 57/0, src_error: 95/0, trn_timeout: 23/13, trn_error: 14/83, dst_permission: 0/49, dst_error: 0/2 foreign: 49/1135
Links: 58/56 ok, 1/1 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
97%Transfer (from/to): 4295/2233 files, 10.930/5.486 TB ok
Errors: src_missing_file: 96/0, trn_timeout: 14/6, trn_error: 3/33, dst_permission: 0/55, dst_error: 0/4 foreign: 55/457
Links: 57/56 ok, 1/1 warning, 2/0 error, 0/1 unknown, 2/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
98%Transfer (from/to): 2890/2708 files, 3.029/12.555 TB ok
Errors: src_missing_file: 60/0, trn_timeout: 18/3, trn_error: 4/42, dst_permission: 0/17, dst_error: 0/5 foreign: 52/68
Links: 58/55 ok, 0/0 warning, 1/0 error, 0/1 unknown, 1/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
98%Transfer (from/to): 1869/4670 files, 5.065/23.267 TB ok
Errors: src_missing_file: 26/0, trn_timeout: 10/1, trn_error: 9/60, dst_permission: 0/22, dst_error: 0/4 foreign: 50/107
Links: 58/55 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
98%Transfer (from/to): 3288/3717 files, 6.256/8.037 TB ok
Errors: src_missing_file: 33/0, trn_timeout: 4/13, trn_error: 216/54, dst_permission: 0/13, dst_error: 0/4 foreign: 24/66
Links: 59/56 ok, 2/1 warning, 1/0 error, 0/1 unknown, 0/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
98%Transfer (from/to): 3173/5703 files, 10.205/6.938 TB ok
Errors: src_missing_file: 36/0, src_error: 16/0, trn_timeout: 12/7, trn_user: 4/0, trn_error: 37/41, dst_permission: 0/23, dst_error: 0/4 foreign: 735/72
Links: 59/55 ok, 0/3 warning, 0/1 error, 0/1 unknown, 1/1 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
98%Transfer (from/to): 5501/2403 files, 15.851/14.078 TB ok
Errors: src_missing_file: 30/0, trn_timeout: 9/0, trn_user: 19/0, trn_error: 195/14, dst_permission: 0/16, dst_error: 0/5 foreign: 1431/80
Links: 54/56 ok, 2/0 warning, 1/1 error, 1/2 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
96%Transfer (from/to): 3755/9700 files, 7.771/20.203 TB ok
Errors: src_missing_file: 32/0, trn_timeout: 12/16, trn_user: 18/0, trn_error: 167/64, dst_permission: 0/21, dst_error: 0/4 foreign: 2343/83
Links: 57/56 ok, 1/2 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
cmssrm-kit.gridka.de: ok/ok
Site Readiness:
79%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (190 Success ...),
FTS: ok (Links: 57/56 ok, 1/0 warning, 2/2 error, 0/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
41%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (112 Success ...),
FTS: ok (Links: 59/56 ok, 0/0 warning, 2/2 error, 0/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
86%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (228 Success ...),
FTS: ok (Links: 60/56 ok, 0/0 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
84%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (265 Success ...),
FTS: ok (Links: 60/56 ok, 0/0 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
78%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (258 Success ...; 1 Failed, GlobalPool periodic cleanup ...),
FTS: ok (Links: 59/56 ok, 0/0 warning, 1/2 error, 0/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
85%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (199 Success ...),
FTS: ok (Links: 56/55 ok, 1/1 warning, 2/2 error, 0/1 unknown, 2/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
64%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (140 Success ...),
FTS: ok (Links: 60/55 ok, 1/0 warning, 2/3 error, 0/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
84%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (178 Success ...),
FTS: ok (Links: 60/54 ok, 0/1 warning, 2/3 error, 0/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
86%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (193 Success ...),
FTS: ok (Links: 58/56 ok, 1/1 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
83%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (192 Success ...),
FTS: ok (Links: 57/56 ok, 1/1 warning, 2/0 error, 0/1 unknown, 2/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
78%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (205 Success ...; 3 Failed, GlobalPool periodic cleanup ...),
FTS: ok (Links: 58/55 ok, 0/0 warning, 1/0 error, 0/1 unknown, 1/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
92%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (260 Success ...; 2 Failed, GlobalPool periodic cleanup ...),
FTS: ok (Links: 58/55 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
89%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (235 Success ...),
FTS: ok (Links: 59/56 ok, 2/1 warning, 1/0 error, 0/1 unknown, 0/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
82%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (185 Success ...; 1 Failed, GlobalPool periodic cleanup ...),
FTS: ok (Links: 59/55 ok, 0/3 warning, 0/1 error, 0/1 unknown, 1/1 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
93%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (265 Success ...; 2 Failed, GlobalPool periodic cleanup ...),
FTS: ok (Links: 54/56 ok, 2/0 warning, 1/1 error, 1/2 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
87%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (245 Success ...; 1 Failed, GlobalPool periodic cleanup ...),
FTS: ok (Links: 57/56 ok, 1/2 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; cmssrm-kit.gridka.de: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T1_ES_PIC
GGUS Tickets: 148029
Downtimes: Usrmcms.pic.es/SE, ce13.pic.es/CE, ce14.pic.es/CE
SAM Status: 94%15min evaluations: 88 ok, 3 warning, 5 error, 0 unknown, 0 downtime (0h0m) 93%15min evaluations: 90 ok, 0 warning, 6 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 95%15min evaluations: 89 ok, 0 warning, 4 error, 3 unknown, 0 downtime (0h0m)
Hammer Cloud: 99%267 Success [crab3@vocms0120.cern.ch#58494208.0#1602632363 201013_075744:sciaba_crab_HC-101-T1_ES_PIC-93186-20201013094703 173 0]...
1 Failed, ExitCode 8021 [crab3@vocms0122.cern.ch#62599754.0#1602715146 201014_061701:sciaba_crab_HC-101-T1_ES_PIC-93196-20201014080703 192 0]...
100%93 Success [crab3@vocms0122.cern.ch#62601249.0#1602718746 201014_061701:sciaba_crab_HC-101-T1_ES_PIC-93196-20201014080703 204 0]... 100%203 Success [crab3@vocms0121.cern.ch#58857955.0#1602805060 201015_125626:sciaba_crab_HC-101-T1_ES_PIC-93206-20201015063703 128 0]... 100%229 Success [crab3@vocms0195.cern.ch#56525744.0#1602891494 201016_232211:sciaba_crab_HC-101-T1_ES_PIC-93228-20201016070903 3 0]... 100%270 Success [crab3@vocms0119.cern.ch#59072756.0#1602977858 201017_232636:sciaba_crab_HC-101-T1_ES_PIC-93239-20201017070302 2 0]... 100%211 Success [crab3@vocms0120.cern.ch#58651355.0#1603064366 201018_053314:sciaba_crab_HC-101-T1_ES_PIC-93249-20201018071703 217 0]... 100%181 Success [crab3@vocms0195.cern.ch#56623665.0#1603150840 201019_065920:sciaba_crab_HC-101-T1_ES_PIC-93261-20201019085303 200 0]...
5 Success, no Chirp ExitCode [crab3@vocms0195.cern.ch#56687765.0#1603229492 201020_064524:sciaba_crab_HC-101-T1_ES_PIC-93274-20201020083303 177 0]...
100%159 Success [crab3@vocms0195.cern.ch#56690456.0#1603236996 201020_064524:sciaba_crab_HC-101-T1_ES_PIC-93274-20201020083303 202 0]...
27 Success, no Chirp ExitCode [crab3@vocms0195.cern.ch#56690552.0#1603237896 201020_064524:sciaba_crab_HC-101-T1_ES_PIC-93274-20201020083303 205 0]...
100%24 Success, no Chirp ExitCode [crab3@vocms0199.cern.ch#17722541.0#1603324237 201021_064931:sciaba_crab_HC-101-T1_ES_PIC-93284-20201021083902 204 0]...
157 Success [crab3@vocms0199.cern.ch#17723925.0#1603325136 201021_064931:sciaba_crab_HC-101-T1_ES_PIC-93284-20201021083902 207 0]...
100%224 Success [crab3@vocms0195.cern.ch#56786524.0#1603409719 201022_223910:sciaba_crab_HC-101-T1_ES_PIC-93300-20201022062102 11 0]... 100%253 Success [crab3@vocms0144.cern.ch#60526042.0#1603495996 201023_221224:sciaba_crab_HC-101-T1_ES_PIC-93311-20201023055702 16 0]... 100%234 Success [crab3@vocms0119.cern.ch#59443826.0#1603582939 201024_221602:sciaba_crab_HC-101-T1_ES_PIC-93322-20201024060303 17 0]... 99%147 Success [crab3@vocms0196.cern.ch#57213812.0#1603669026 201025_053049:sciaba_crab_HC-101-T1_ES_PIC-93333-20201025061303 217 0]...
1 Failed, ExitCode 8021 [crab3@vocms0155.cern.ch#61195416.0#1603694039 201026_043245:sciaba_crab_HC-101-T1_ES_PIC-93344-20201026051303 24 0]...
100%245 Success [crab3@vocms0155.cern.ch#61210041.0#1603755647 201026_043245:sciaba_crab_HC-101-T1_ES_PIC-93344-20201026051303 118 0]... 100%194 Success [crab3@vocms0107.cern.ch#60175451.0#1603842606 201027_224840:sciaba_crab_HC-101-T1_ES_PIC-93355-20201027053903 12 0]... 100%235 Success [crab3@vocms0196.cern.ch#57346096.0#1603928255 201028_220644:sciaba_crab_HC-101-T1_ES_PIC-93367-20201028045502 18 0]...
FTS Status: 93%Transfer (from/to): 2619/1280 files, 3.869/2.566 TB ok
Errors: src_error: 5/0, trn_timeout: 55/24, trn_user: 0/10, trn_error: 309/43 foreign: 206/179
Links: 61/54 ok, 0/0 warning, 2/4 error, 0/1 unknown, 3/0 bad-endpoint
srmcms.pic.es: ok/ok
93%Transfer (from/to): 4359/1196 files, 6.243/2.277 TB ok
Errors: trn_timeout: 68/18, trn_user: 0/9, trn_error: 84/30, dst_error: 0/2 foreign: 123/107
Links: 59/54 ok, 0/1 warning, 2/3 error, 0/1 unknown, 3/0 bad-endpoint
srmcms.pic.es: ok/ok
94%Transfer (from/to): 6479/1660 files, 13.629/2.088 TB ok
Errors: src_permission: 1/0, src_missing_file: 3/0, trn_timeout: 39/24, trn_user: 0/10, trn_error: 19/41, dst_error: 0/4 foreign: 52/128
Links: 60/55 ok, 0/1 warning, 1/2 error, 1/1 unknown, 3/0 bad-endpoint
srmcms.pic.es: ok/ok
93%Transfer (from/to): 2948/1229 files, 6.626/2.611 TB ok
Errors: src_missing_file: 7/0, src_error: 1/0, trn_timeout: 20/21, trn_user: 0/19, trn_error: 4/48, dst_error: 0/5 foreign: 40/120
Links: 59/54 ok, 0/0 warning, 1/4 error, 0/1 unknown, 3/0 bad-endpoint
srmcms.pic.es: ok/ok
94%Transfer (from/to): 2270/1154 files, 2.623/2.759 TB ok
Errors: src_missing_file: 3/0, trn_timeout: 22/19, trn_user: 0/22, trn_error: 1/48, dst_error: 0/5 foreign: 75/99
Links: 60/54 ok, 0/0 warning, 1/4 error, 1/1 unknown, 3/0 bad-endpoint
srmcms.pic.es: ok/ok
93%Transfer (from/to): 5136/1543 files, 12.395/5.517 TB ok
Errors: trn_timeout: 37/17, trn_user: 0/14, trn_error: 50/46, dst_error: 0/3 foreign: 55/104
Links: 57/53 ok, 2/1 warning, 2/4 error, 1/1 unknown, 4/0 bad-endpoint
srmcms.pic.es: ok/ok
94%Transfer (from/to): 1565/2091 files, 2.780/10.985 TB ok
Errors: src_permission: 7/0, src_error: 1/0, trn_timeout: 25/32, trn_user: 0/17, trn_error: 14/44, dst_permission: 0/1, dst_error: 0/4 foreign: 62/116
Links: 60/54 ok, 1/0 warning, 1/4 error, 0/1 unknown, 3/0 bad-endpoint
srmcms.pic.es: ok/ok
89%Transfer (from/to): 1912/1926 files, 2.661/8.888 TB ok
Errors: src_error: 564/0, trn_timeout: 79/30, trn_user: 0/13, trn_error: 284/156, dst_error: 0/4 foreign: 49/109
Links: 56/51 ok, 0/0 warning, 4/7 error, 0/1 unknown, 3/0 bad-endpoint
srmcms.pic.es: ok/ok
92%Transfer (from/to): 2835/1529 files, 6.217/5.668 TB ok
Errors: src_missing_file: 1/0, src_error: 211/0, trn_timeout: 40/28, trn_user: 0/11, trn_error: 317/144, dst_permission: 0/1, dst_error: 0/6 foreign: 117/146
Links: 60/51 ok, 0/3 warning, 1/4 error, 0/1 unknown, 5/1 bad-endpoint
srmcms.pic.es: ok/ok
96%Transfer (from/to): 1961/1057 files, 3.509/2.349 TB ok
Errors: trn_timeout: 18/9, trn_user: 0/11, trn_error: 17/42, dst_error: 0/4 foreign: 134/138
Links: 58/54 ok, 0/2 warning, 2/1 error, 0/1 unknown, 4/1 bad-endpoint
srmcms.pic.es: ok/ok
99%Transfer (from/to): 850/1453 files, 1.451/3.061 TB ok
Errors: trn_timeout: 2/0, trn_user: 0/11, trn_error: 13/29, dst_error: 0/4 foreign: 104/104
Links: 61/56 ok, 1/0 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint
srmcms.pic.es: ok/ok
98%Transfer (from/to): 2454/1362 files, 4.837/2.581 TB ok
Errors: trn_timeout: 2/1, trn_user: 0/11, trn_error: 11/46, dst_permission: 0/2, dst_error: 0/3 foreign: 70/123
Links: 60/55 ok, 1/0 warning, 0/1 error, 0/1 unknown, 3/1 bad-endpoint
srmcms.pic.es: ok/ok
98%Transfer (from/to): 1888/1613 files, 3.430/4.276 TB ok
Errors: trn_timeout: 5/0, trn_user: 0/11, trn_error: 13/41, dst_error: 0/4 foreign: 53/70
Links: 62/56 ok, 0/0 warning, 0/1 error, 0/1 unknown, 1/1 bad-endpoint
srmcms.pic.es: ok/ok
98%Transfer (from/to): 2831/1352 files, 12.701/3.358 TB ok
Errors: src_error: 104/0, trn_timeout: 26/1, trn_user: 0/13, trn_error: 120/22, dst_permission: 0/1, dst_error: 0/3 foreign: 93/57
Links: 59/58 ok, 1/0 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint
srmcms.pic.es: ok/ok
98%Transfer (from/to): 2546/1420 files, 4.548/3.615 TB ok
Errors: src_permission: 2/0, trn_timeout: 27/3, trn_user: 0/10, trn_error: 291/10, dst_permission: 0/7, dst_error: 0/3 foreign: 73/111
Links: 58/55 ok, 1/1 warning, 0/0 error, 0/2 unknown, 2/0 bad-endpoint
srmcms.pic.es: ok/ok
98%Transfer (from/to): 1541/1382 files, 3.956/8.267 TB ok
Errors: src_permission: 2/0, trn_timeout: 5/0, trn_user: 0/5, trn_error: 126/18, dst_permission: 0/2, dst_error: 0/1 foreign: 60/84
Links: 59/57 ok, 1/1 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint
srmcms.pic.es: ok/ok
Site Readiness:
90%SAM: ok (15min evaluations: 88 ok, 3 warning, 5 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (267 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 61/54 ok, 0/0 warning, 2/4 error, 0/1 unknown, 3/0 bad-endpoint; srmcms.pic.es: ok/ok)
39%SAM: ok (15min evaluations: 90 ok, 0 warning, 6 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (93 Success ...),
FTS: ok (Links: 59/54 ok, 0/1 warning, 2/3 error, 0/1 unknown, 3/0 bad-endpoint; srmcms.pic.es: ok/ok)
77%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (203 Success ...),
FTS: ok (Links: 60/55 ok, 0/1 warning, 1/2 error, 1/1 unknown, 3/0 bad-endpoint; srmcms.pic.es: ok/ok)
85%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (229 Success ...),
FTS: ok (Links: 59/54 ok, 0/0 warning, 1/4 error, 0/1 unknown, 3/0 bad-endpoint; srmcms.pic.es: ok/ok)
80%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (270 Success ...),
FTS: ok (Links: 60/54 ok, 0/0 warning, 1/4 error, 1/1 unknown, 3/0 bad-endpoint; srmcms.pic.es: ok/ok)
77%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (211 Success ...),
FTS: ok (Links: 57/53 ok, 2/1 warning, 2/4 error, 1/1 unknown, 4/0 bad-endpoint; srmcms.pic.es: ok/ok)
79%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (181 Success ...; 5 Success, no Chirp ExitCode ...),
FTS: ok (Links: 60/54 ok, 1/0 warning, 1/4 error, 0/1 unknown, 3/0 bad-endpoint; srmcms.pic.es: ok/ok)
80%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (159 Success ...; 27 Success, no Chirp ExitCode ...),
FTS: ok (Links: 56/51 ok, 0/0 warning, 4/7 error, 0/1 unknown, 3/0 bad-endpoint; srmcms.pic.es: ok/ok)
79%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (24 Success, no Chirp ExitCode ...; 157 Success ...),
FTS: ok (Links: 60/51 ok, 0/3 warning, 1/4 error, 0/1 unknown, 5/1 bad-endpoint; srmcms.pic.es: ok/ok)
75%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (224 Success ...),
FTS: ok (Links: 58/54 ok, 0/2 warning, 2/1 error, 0/1 unknown, 4/1 bad-endpoint; srmcms.pic.es: ok/ok)
76%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (253 Success ...),
FTS: ok (Links: 61/56 ok, 1/0 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint; srmcms.pic.es: ok/ok)
86%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (234 Success ...),
FTS: ok (Links: 60/55 ok, 1/0 warning, 0/1 error, 0/1 unknown, 3/1 bad-endpoint; srmcms.pic.es: ok/ok)
49%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (147 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 62/56 ok, 0/0 warning, 0/1 error, 0/1 unknown, 1/1 bad-endpoint; srmcms.pic.es: ok/ok)
84%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (245 Success ...),
FTS: ok (Links: 59/58 ok, 1/0 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint; srmcms.pic.es: ok/ok)
78%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (194 Success ...),
FTS: ok (Links: 58/55 ok, 1/1 warning, 0/0 error, 0/2 unknown, 2/0 bad-endpoint; srmcms.pic.es: ok/ok)
82%SAM: ok (15min evaluations: 89 ok, 0 warning, 4 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (235 Success ...),
FTS: ok (Links: 59/57 ok, 1/1 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint; srmcms.pic.es: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T1_FR_CCIN2P3
GGUS Tickets: 149132
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%229 Success [crab3@vocms0119.cern.ch#58942610.0#1602631709 201013_075725:sciaba_crab_HC-101-T1_FR_CCIN2P3-93186-20201013094703 186 0]... 100%145 Success [crab3@vocms0121.cern.ch#58800491.0#1602718884 201014_061933:sciaba_crab_HC-101-T1_FR_CCIN2P3-93196-20201014080703 203 0]... 100%177 Success [crab3@vocms0106.cern.ch#47771202.0#1602804938 201015_063352:sciaba_crab_HC-101-T1_FR_CCIN2P3-93206-20201015063703 204 0]... 100%265 Success [crab3@vocms0197.cern.ch#57156685.0#1602891381 201016_232027:sciaba_crab_HC-101-T1_FR_CCIN2P3-93228-20201016070903 3 0]... 100%246 Success [crab3@vocms0144.cern.ch#60253446.0#1602977323 201017_232237:sciaba_crab_HC-101-T1_FR_CCIN2P3-93239-20201017070302 1 0]... 100%195 Success [crab3@vocms0197.cern.ch#57205350.0#1603064251 201018_053629:sciaba_crab_HC-101-T1_FR_CCIN2P3-93249-20201018071703 216 0]... 100%140 Success [crab3@vocms0119.cern.ch#59177788.0#1603150578 201019_065447:sciaba_crab_HC-101-T1_FR_CCIN2P3-93261-20201019085303 200 0]... 100%229 Success [crab3@vocms0137.cern.ch#56605054.0#1603236400 201020_064503:sciaba_crab_HC-101-T1_FR_CCIN2P3-93274-20201020083303 200 0]... 100%113 Success [crab3@vocms0197.cern.ch#57249658.0#1603322659 201021_064812:sciaba_crab_HC-101-T1_FR_CCIN2P3-93284-20201021083902 199 0]... 100%151 Success [crab3@vocms0106.cern.ch#47937062.0#1603426420 201023_040232:sciaba_crab_HC-101-T1_FR_CCIN2P3-93311-20201023055702 2 0]... 100%195 Success [crab3@vocms0194.cern.ch#57716299.0#1603497171 201023_220627:sciaba_crab_HC-101-T1_FR_CCIN2P3-93311-20201023055702 21 0]... 100%243 Success [crab3@vocms0195.cern.ch#56838433.0#1603582303 201024_223020:sciaba_crab_HC-101-T1_FR_CCIN2P3-93322-20201024060303 12 0]... 100%211 Success [crab3@vocms0199.cern.ch#17855524.0#1603668613 201025_053340:sciaba_crab_HC-101-T1_FR_CCIN2P3-93333-20201025061303 215 0]... 100%177 Success [crab3@vocms0194.cern.ch#57816544.0#1603755258 201026_222758:sciaba_crab_HC-101-T1_FR_CCIN2P3-93344-20201026051303 13 0]... 100%222 Success [crab3@vocms0194.cern.ch#57879460.0#1603842654 201027_225935:sciaba_crab_HC-101-T1_FR_CCIN2P3-93355-20201027053903 10 0]... 100%243 Success [crab3@vocms0121.cern.ch#59283101.0#1603928466 201028_214501:sciaba_crab_HC-101-T1_FR_CCIN2P3-93367-20201028045502 23 0]...
FTS Status: 96%Transfer (from/to): 4345/22416 files, 10.027/226.296 TB ok
Errors: src_missing_file: 6/0, trn_timeout: 9/1113, trn_error: 572/95, dst_permission: 0/3 foreign: 286/148
Links: 62/56 ok, 0/1 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 4581/2080 files, 9.818/2.647 TB ok
Errors: src_missing_file: 9/0, trn_timeout: 1/6, trn_error: 142/41, dst_permission: 0/49, dst_error: 0/1 foreign: 193/137
Links: 61/57 ok, 0/0 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
97%Transfer (from/to): 18426/2437 files, 46.558/3.016 TB ok
Errors: src_missing_file: 38/0, trn_timeout: 11/7, trn_user: 0/2, trn_error: 61/25, dst_permission: 0/16, dst_error: 0/4 foreign: 218/915
Links: 63/57 ok, 0/1 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 8509/1894 files, 23.931/4.302 TB ok
Errors: src_missing_file: 9/0, src_error: 1/0, trn_timeout: 6/26, trn_user: 0/1, trn_error: 8/21, dst_permission: 0/24, dst_error: 0/6 foreign: 46/903
Links: 61/57 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
97%Transfer (from/to): 3227/1351 files, 4.785/5.958 TB ok
Errors: src_missing_file: 10/0, trn_timeout: 1/8, trn_error: 12/23, dst_permission: 0/15, dst_error: 0/4 foreign: 50/625
Links: 60/56 ok, 1/1 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
96%Transfer (from/to): 10949/8534 files, 13.805/22.581 TB ok
Errors: src_missing_file: 9/0, trn_timeout: 38/71, trn_user: 0/1, trn_error: 33/30, dst_permission: 0/43, dst_error: 0/4 foreign: 85/617
Links: 60/56 ok, 1/1 warning, 0/1 error, 0/1 unknown, 3/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
96%Transfer (from/to): 2734/12710 files, 3.299/36.132 TB ok
Errors: src_permission: 5/0, src_missing_file: 9/0, src_error: 3/0, trn_timeout: 34/44, trn_user: 0/1, trn_error: 33/25, dst_permission: 0/16, dst_error: 0/2 foreign: 153/719
Links: 59/55 ok, 1/1 warning, 2/2 error, 0/1 unknown, 1/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
96%Transfer (from/to): 3683/5540 files, 4.754/16.610 TB ok
Errors: src_missing_file: 6/0, src_error: 212/0, trn_timeout: 24/35, trn_error: 4/25, dst_permission: 0/13, dst_error: 0/4 foreign: 79/757
Links: 62/55 ok, 0/1 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
96%Transfer (from/to): 13071/2595 files, 33.951/12.411 TB ok
Errors: src_missing_file: 10/0, src_error: 144/0, trn_timeout: 105/20, trn_user: 0/1, trn_error: 33/48, dst_permission: 0/12, dst_error: 0/4 foreign: 99/808
Links: 61/55 ok, 2/2 warning, 0/1 error, 0/1 unknown, 4/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
97%Transfer (from/to): 3269/2476 files, 2.362/6.681 TB ok
Errors: src_missing_file: 9/0, trn_timeout: 45/8, trn_user: 0/1, trn_error: 3/39, dst_permission: 0/58, dst_error: 0/5 foreign: 663/691
Links: 59/55 ok, 1/2 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
100%Transfer (from/to): 9598/2183 files, 8.457/14.074 TB ok
Errors: src_missing_file: 9/0, trn_timeout: 9/0, trn_user: 1/37, trn_error: 6/36, dst_permission: 0/28, dst_error: 0/4 foreign: 81/82
Links: 59/56 ok, 0/0 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 2982/4434 files, 6.018/16.529 TB ok
Errors: src_missing_file: 9/0, trn_timeout: 3/0, trn_user: 0/1, trn_error: 19/43, dst_permission: 0/26, dst_space: 0/1, dst_error: 0/4 foreign: 124/142
Links: 57/56 ok, 1/0 warning, 1/1 error, 0/1 unknown, 2/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 13287/5610 files, 31.345/18.981 TB ok
Errors: src_missing_file: 6/0, trn_timeout: 4/1, trn_user: 2/0, trn_error: 16/41, dst_permission: 0/20, dst_error: 0/4 foreign: 1173/62
Links: 61/56 ok, 0/0 warning, 0/1 error, 0/1 unknown, 1/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 2275/6555 files, 6.807/22.083 TB ok
Errors: src_missing_file: 9/0, src_error: 4/0, trn_timeout: 7/2, trn_user: 6/0, trn_error: 42/24, dst_permission: 0/32, dst_error: 0/4 foreign: 671/85
Links: 58/58 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 3221/5879 files, 8.702/31.923 TB ok
Errors: src_missing_file: 9/0, trn_timeout: 13/82, trn_user: 7/0, trn_error: 81/0, dst_permission: 0/15, dst_error: 0/4 foreign: 712/116
Links: 59/56 ok, 0/0 warning, 1/0 error, 0/2 unknown, 2/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
98%Transfer (from/to): 4883/1814 files, 6.535/8.626 TB ok
Errors: src_missing_file: 9/0, trn_timeout: 6/0, trn_user: 2/0, trn_error: 141/19, dst_permission: 0/23, dst_error: 0/3 foreign: 213/76
Links: 60/56 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
ccsrm.in2p3.fr: ok/ok
Site Readiness:
90%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (229 Success ...),
FTS: ok (Links: 62/56 ok, 0/1 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
56%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (145 Success ...),
FTS: ok (Links: 61/57 ok, 0/0 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
76%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (177 Success ...),
FTS: ok (Links: 63/57 ok, 0/1 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
91%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (265 Success ...),
FTS: ok (Links: 61/57 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
79%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (246 Success ...),
FTS: ok (Links: 60/56 ok, 1/1 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
70%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (195 Success ...),
FTS: ok (Links: 60/56 ok, 1/1 warning, 0/1 error, 0/1 unknown, 3/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
66%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (140 Success ...),
FTS: ok (Links: 59/55 ok, 1/1 warning, 2/2 error, 0/1 unknown, 1/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
92%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (229 Success ...),
FTS: ok (Links: 62/55 ok, 0/1 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
49%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (113 Success ...),
FTS: ok (Links: 61/55 ok, 2/2 warning, 0/1 error, 0/1 unknown, 4/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
65%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (151 Success ...),
FTS: ok (Links: 59/55 ok, 1/2 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
86%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (195 Success ...),
FTS: ok (Links: 59/56 ok, 0/0 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
89%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (243 Success ...),
FTS: ok (Links: 57/56 ok, 1/0 warning, 1/1 error, 0/1 unknown, 2/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
81%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (211 Success ...),
FTS: ok (Links: 61/56 ok, 0/0 warning, 0/1 error, 0/1 unknown, 1/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
75%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (177 Success ...),
FTS: ok (Links: 58/58 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
85%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (222 Success ...),
FTS: ok (Links: 59/56 ok, 0/0 warning, 1/0 error, 0/2 unknown, 2/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
91%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (243 Success ...),
FTS: ok (Links: 60/56 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; ccsrm.in2p3.fr: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T1_IT_CNAF
GGUS Tickets: 149155 149215
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m) 88%15min evaluations: 75 ok, 3 warning, 10 error, 8 unknown, 0 downtime (0h0m) 90%15min evaluations: 87 ok, 0 warning, 9 error, 0 unknown, 0 downtime (0h0m) 86%15min evaluations: 83 ok, 0 warning, 13 error, 0 unknown, 0 downtime (0h0m) 94%15min evaluations: 91 ok, 0 warning, 5 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 78%15min evaluations: 72 ok, 0 warning, 20 error, 4 unknown, 0 downtime (0h0m) 59%15min evaluations: 52 ok, 0 warning, 35 error, 9 unknown, 0 downtime (0h0m) 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%249 Success [crab3@vocms0199.cern.ch#17521070.0#1602632189 201013_075510:sciaba_crab_HC-101-T1_IT_CNAF-93186-20201013094703 188 0]... 100%104 Success [crab3@vocms0122.cern.ch#62601144.0#1602718501 201014_062034:sciaba_crab_HC-101-T1_IT_CNAF-93196-20201014080703 196 0]... 100%201 Success [crab3@vocms0196.cern.ch#56833090.0#1602804740 201015_063053:sciaba_crab_HC-101-T1_IT_CNAF-93206-20201015063703 204 0]... 100%265 Success [crab3@vocms0144.cern.ch#60215376.0#1602891339 201016_232941:sciaba_crab_HC-101-T1_IT_CNAF-93228-20201016070903 1 0]... 100%265 Success [crab3@vocms0119.cern.ch#59072806.0#1602978589 201017_051832:sciaba_crab_HC-101-T1_IT_CNAF-93239-20201017070302 222 0]... 100%240 Success [crab3@vocms0122.cern.ch#62748870.0#1603063989 201018_053653:sciaba_crab_HC-101-T1_IT_CNAF-93249-20201018071703 215 0]... 100%123 Success [crab3@vocms0137.cern.ch#56537671.0#1603150690 201019_070653:sciaba_crab_HC-101-T1_IT_CNAF-93261-20201019085303 198 0]...
1 Success, no Chirp ExitCode [crab3@vocms0119.cern.ch#59257591.0#1603233656 201020_063949:sciaba_crab_HC-101-T1_IT_CNAF-93274-20201020083303 192 0]...
100%18 Success, no Chirp ExitCode [crab3@vocms0119.cern.ch#59258065.0#1603233955 201020_063949:sciaba_crab_HC-101-T1_IT_CNAF-93274-20201020083303 193 0]...
163 Success [crab3@vocms0119.cern.ch#59259621.0#1603235757 201020_063949:sciaba_crab_HC-101-T1_IT_CNAF-93274-20201020083303 199 0]...
100%174 Success [crab3@vocms0199.cern.ch#17720198.0#1603322656 201021_065315:sciaba_crab_HC-101-T1_IT_CNAF-93284-20201021083902 198 0]...
3 Success, no Chirp ExitCode [crab3@vocms0194.cern.ch#57628612.0#1603344522 201022_042750:sciaba_crab_HC-101-T1_IT_CNAF-93300-20201022062102 12 0]...
98%233 Success [crab3@vocms0137.cern.ch#56702873.0#1603409120 201022_222925:sciaba_crab_HC-101-T1_IT_CNAF-93300-20201022062102 11 0]...
3 Failed, ExitCode 8021 [crab3@vocms0137.cern.ch#56706176.0#1603419622 201022_222925:sciaba_crab_HC-101-T1_IT_CNAF-93300-20201022062102 46 0]...
100%222 Success [crab3@vocms0120.cern.ch#58802541.0#1603497851 201023_221751:sciaba_crab_HC-101-T1_IT_CNAF-93311-20201023055702 21 0]... 99%263 Success [crab3@vocms0194.cern.ch#57744190.0#1603582189 201024_222339:sciaba_crab_HC-101-T1_IT_CNAF-93322-20201024060303 13 0]...
1 Failed, ExitCode 8021 [crab3@vocms0194.cern.ch#57766522.0#1603669205 201025_053850:sciaba_crab_HC-101-T1_IT_CNAF-93333-20201025061303 216 0]...
100%256 Success [crab3@vocms0194.cern.ch#57766432.0#1603668604 201025_053850:sciaba_crab_HC-101-T1_IT_CNAF-93333-20201025061303 214 0]... 100%213 Success [crab3@vocms0144.cern.ch#60614178.0#1603757034 201026_222616:sciaba_crab_HC-101-T1_IT_CNAF-93344-20201026051303 10 0]... 99%256 Success [crab3@vocms0155.cern.ch#61253682.0#1603841685 201027_222830:sciaba_crab_HC-101-T1_IT_CNAF-93355-20201027053903 13 0]...
1 Failed, ExitCode 8021 [crab3@vocms0155.cern.ch#61255218.0#1603853689 201027_222830:sciaba_crab_HC-101-T1_IT_CNAF-93355-20201027053903 53 0]...
100%250 Success [crab3@vocms0195.cern.ch#56952921.0#1603927813 201028_221349:sciaba_crab_HC-101-T1_IT_CNAF-93367-20201028045502 15 0]...
FTS Status: 83%Transfer (from/to): 20766/1640 files, 4.405/2.812 TB ok
Errors: src_missing_file: 6/0, src_error: 206/0, trn_timeout: 112/27, trn_error: 808/11, dst_permission: 0/3916, dst_error: 0/1 foreign: 83/220
Links: 57/15 ok, 0/5 warning, 5/38 error, 0/1 unknown, 2/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/error
90%Transfer (from/to): 39406/3033 files, 16.305/5.000 TB ok
Errors: src_missing_file: 24/0, src_error: 722/0, trn_timeout: 1/18, trn_error: 352/9, dst_permission: 0/3018, dst_error: 0/4 foreign: 72/128
Links: 54/27 ok, 1/3 warning, 4/28 error, 0/1 unknown, 2/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/warning
89%Transfer (from/to): 81235/3079 files, 40.280/4.948 TB ok
Errors: src_missing_file: 18/0, src_error: 6552/0, trn_timeout: 9/13, trn_user: 5/0, trn_error: 63/14, dst_permission: 0/139, dst_error: 0/4 foreign: 359/97
Links: 50/59 ok, 1/0 warning, 10/0 error, 0/1 unknown, 2/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
85%Transfer (from/to): 9573/2043 files, 21.354/4.796 TB ok
Errors: src_missing_file: 16/0, src_error: 6472/0, trn_timeout: 50/16, trn_user: 6/0, trn_error: 6/17, dst_error: 0/4 foreign: 88/109
Links: 40/56 ok, 0/0 warning, 20/2 error, 1/1 unknown, 2/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
88%Transfer (from/to): 4715/2994 files, 5.769/13.934 TB ok
Errors: src_missing_file: 2/0, src_error: 3797/0, trn_timeout: 4/20, trn_user: 1/0, trn_error: 5/22, dst_permission: 0/6, dst_error: 0/73 foreign: 70/77
Links: 40/56 ok, 1/0 warning, 19/2 error, 0/1 unknown, 2/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
87%Transfer (from/to): 7916/5989 files, 14.060/14.565 TB ok
Errors: src_missing_file: 1/0, src_error: 3646/0, trn_timeout: 17/24, trn_user: 1/0, trn_error: 93/25, dst_error: 0/4 foreign: 85/259
Links: 44/55 ok, 3/1 warning, 16/2 error, 0/1 unknown, 3/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
81%Transfer (from/to): 12172/2231 files, 10.645/5.834 TB ok
Errors: src_missing_file: 5/0, src_error: 4763/0, trn_timeout: 29/28, trn_user: 12/0, trn_error: 12/22, dst_error: 0/5 foreign: 643/392
Links: 39/55 ok, 2/1 warning, 20/2 error, 0/1 unknown, 2/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
80%Transfer (from/to): 3433/2383 files, 3.331/5.896 TB ok
Errors: src_missing_file: 1/0, src_error: 4438/0, trn_timeout: 63/31, trn_user: 2/0, trn_error: 8/29, dst_error: 0/5 foreign: 105/486
Links: 38/56 ok, 3/0 warning, 21/2 error, 0/1 unknown, 2/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
83%Transfer (from/to): 4884/10054 files, 9.790/38.807 TB ok
Errors: src_missing_file: 3/0, src_error: 5546/0, trn_timeout: 64/284, trn_user: 3/0, trn_error: 9/103, dst_permission: 0/1387, dst_error: 0/78 foreign: 143/1264
Links: 41/57 ok, 2/0 warning, 18/1 error, 0/1 unknown, 3/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
83%Transfer (from/to): 14555/2994 files, 5.446/5.534 TB ok
Errors: src_missing_file: 295/0, src_error: 4689/0, trn_timeout: 232/15, trn_user: 6/0, trn_error: 30/39, dst_permission: 0/2181, dst_error: 0/6 foreign: 202/725
Links: 44/47 ok, 2/1 warning, 18/9 error, 0/1 unknown, 3/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
86%Transfer (from/to): 40176/3728 files, 4.473/26.230 TB ok
Errors: src_missing_file: 2217/0, src_error: 1716/0, trn_timeout: 372/6, trn_error: 95/31, dst_permission: 0/1606, dst_error: 0/4 foreign: 116/520
Links: 59/47 ok, 0/1 warning, 4/8 error, 0/1 unknown, 2/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
92%Transfer (from/to): 2526/5626 files, 2.084/15.846 TB ok
Errors: src_missing_file: 2691/0, src_error: 1766/0, trn_timeout: 507/2, trn_user: 1/0, trn_error: 8/45, dst_permission: 0/843, dst_path: 0/2, dst_error: 0/6 foreign: 92/561
Links: 56/52 ok, 0/0 warning, 4/4 error, 0/1 unknown, 3/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
93%Transfer (from/to): 13801/24877 files, 19.727/67.173 TB ok
Errors: src_missing_file: 2339/0, src_error: 1772/0, trn_timeout: 420/8, trn_user: 1/0, trn_error: 56/68, dst_permission: 0/661, dst_error: 0/6 foreign: 33/385
Links: 58/54 ok, 3/0 warning, 4/3 error, 0/1 unknown, 1/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
83%Transfer (from/to): 23354/2161 files, 80.975/5.091 TB ok
Errors: src_missing_file: 1381/0, src_error: 121/0, trn_timeout: 486/1, trn_error: 881/60, dst_permission: 0/1269, dst_path: 0/1, dst_error: 0/4 foreign: 1025/542
Links: 58/48 ok, 0/1 warning, 3/9 error, 0/1 unknown, 1/1 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
89%Transfer (from/to): 68718/3269 files, 100.518/9.071 TB ok
Errors: src_permission: 16848/0, src_missing_file: 884/0, src_error: 177/0, trn_timeout: 92/1, trn_user: 35/0, trn_error: 4035/27, dst_permission: 0/893, dst_error: 0/4 foreign: 371/267
Links: 57/50 ok, 1/2 warning, 4/5 error, 0/2 unknown, 2/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
87%Transfer (from/to): 20611/3716 files, 66.533/19.200 TB ok
Errors: src_missing_file: 312/0, src_error: 1327/0, trn_timeout: 11/0, trn_error: 2241/41, dst_permission: 0/896, dst_error: 0/5 foreign: 215/175
Links: 63/51 ok, 0/0 warning, 2/7 error, 0/1 unknown, 2/0 bad-endpoint
storm-fe-cms.cr.cnaf.infn.it: ok/ok
Site Readiness:
66%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (249 Success ...),
FTS: error (Links: 57/15 ok, 0/5 warning, 5/38 error, 0/1 unknown, 2/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/error)
35%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (104 Success ...),
FTS: warning (Links: 54/27 ok, 1/3 warning, 4/28 error, 0/1 unknown, 2/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/warning)
70%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (201 Success ...),
FTS: ok (Links: 50/59 ok, 1/0 warning, 10/0 error, 0/1 unknown, 2/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
83%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (265 Success ...),
FTS: ok (Links: 40/56 ok, 0/0 warning, 20/2 error, 1/1 unknown, 2/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
63%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (265 Success ...),
FTS: ok (Links: 40/56 ok, 1/0 warning, 19/2 error, 0/1 unknown, 2/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
63%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (240 Success ...),
FTS: ok (Links: 44/55 ok, 3/1 warning, 16/2 error, 0/1 unknown, 3/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
35%SAM: error (15min evaluations: 75 ok, 3 warning, 10 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (123 Success ...; 1 Success, no Chirp ExitCode ...),
FTS: ok (Links: 39/55 ok, 2/1 warning, 20/2 error, 0/1 unknown, 2/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
52%SAM: ok (15min evaluations: 87 ok, 0 warning, 9 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (18 Success, no Chirp ExitCode ...; 163 Success ...),
FTS: ok (Links: 38/56 ok, 3/0 warning, 21/2 error, 0/1 unknown, 2/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
46%SAM: error (15min evaluations: 83 ok, 0 warning, 13 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (174 Success ...; 3 Success, no Chirp ExitCode ...),
FTS: ok (Links: 41/57 ok, 2/0 warning, 18/1 error, 0/1 unknown, 3/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
53%SAM: ok (15min evaluations: 91 ok, 0 warning, 5 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (233 Success ...; 3 Failed, ExitCode 8021 ...),
FTS: ok (Links: 44/47 ok, 2/1 warning, 18/9 error, 0/1 unknown, 3/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
84%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (222 Success ...),
FTS: ok (Links: 59/47 ok, 0/1 warning, 4/8 error, 0/1 unknown, 2/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
87%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (263 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 56/52 ok, 0/0 warning, 4/4 error, 0/1 unknown, 3/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
64%SAM: error (15min evaluations: 72 ok, 0 warning, 20 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (256 Success ...),
FTS: ok (Links: 58/54 ok, 3/0 warning, 4/3 error, 0/1 unknown, 1/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
41%SAM: error (15min evaluations: 52 ok, 0 warning, 35 error, 9 unknown, 0 downtime (0h0m)),
HC: ok (213 Success ...),
FTS: ok (Links: 58/48 ok, 0/1 warning, 3/9 error, 0/1 unknown, 1/1 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
87%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (256 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 57/50 ok, 1/2 warning, 4/5 error, 0/2 unknown, 2/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
82%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (250 Success ...),
FTS: ok (Links: 63/51 ok, 0/0 warning, 2/7 error, 0/1 unknown, 2/0 bad-endpoint; storm-fe-cms.cr.cnaf.infn.it: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T1_RU_JINR
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 93%15min evaluations: 89 ok, 0 warning, 6 error, 1 unknown, 0 downtime (0h0m) 88%15min evaluations: 85 ok, 0 warning, 11 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 87 ok, 0 warning, 0 error, 9 unknown, 0 downtime (0h0m) 100%15min evaluations: 76 ok, 0 warning, 0 error, 20 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 93%15min evaluations: 88 ok, 0 warning, 6 error, 2 unknown, 0 downtime (0h0m) 82%15min evaluations: 78 ok, 0 warning, 17 error, 1 unknown, 0 downtime (0h0m) 90%15min evaluations: 87 ok, 0 warning, 9 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%122 Success [crab3@vocms0194.cern.ch#57464425.0#1602632161 201013_075438:sciaba_crab_HC-101-T1_RU_JINR-93186-20201013094703 188 0]... 100%94 Success [crab3@vocms0196.cern.ch#56772405.0#1602718561 201014_075900:sciaba_crab_HC-101-T1_RU_JINR-93196-20201014080703 187 0]... 100%200 Success [crab3@vocms0137.cern.ch#56410950.0#1602805889 201015_125505:sciaba_crab_HC-101-T1_RU_JINR-93206-20201015063703 131 0]... 100%254 Success [crab3@vocms0144.cern.ch#60215362.0#1602891286 201016_230401:sciaba_crab_HC-101-T1_RU_JINR-93228-20201016070903 6 0]... 100%259 Success [crab3@vocms0155.cern.ch#60797743.0#1602977799 201017_233034:sciaba_crab_HC-101-T1_RU_JINR-93239-20201017070302 1 0]... 100%200 Success [crab3@vocms0137.cern.ch#56474632.0#1603064324 201018_230744:sciaba_crab_HC-101-T1_RU_JINR-93249-20201018071703 6 0]... 100%104 Success [crab3@vocms0196.cern.ch#56990898.0#1603155334 201019_070437:sciaba_crab_HC-101-T1_RU_JINR-93261-20201019085303 214 0]...
8 Success, no Chirp ExitCode [crab3@vocms0119.cern.ch#59230584.0#1603200192 201020_063722:sciaba_crab_HC-101-T1_RU_JINR-93274-20201020083303 81 0]...
100%191 Success [crab3@vocms0119.cern.ch#59260343.0#1603237098 201020_063722:sciaba_crab_HC-101-T1_RU_JINR-93274-20201020083303 204 0]...
19 Success, no Chirp ExitCode [crab3@vocms0119.cern.ch#59268980.0#1603256850 201021_003621:sciaba_crab_HC-101-T1_RU_JINR-93274-20201020083303 54 0]...
100%160 Success [crab3@vocms0195.cern.ch#56738794.0#1603323453 201021_065110:sciaba_crab_HC-101-T1_RU_JINR-93284-20201021083902 201 0]...
7 Success, no Chirp ExitCode [crab3@vocms0195.cern.ch#56740355.0#1603327054 201021_065110:sciaba_crab_HC-101-T1_RU_JINR-93284-20201021083902 213 0]...
100%156 Success [crab3@vocms0120.cern.ch#58750439.0#1603410788 201022_224153:sciaba_crab_HC-101-T1_RU_JINR-93300-20201022062102 14 0]... 100%192 Success [crab3@vocms0120.cern.ch#58802031.0#1603496109 201023_222406:sciaba_crab_HC-101-T1_RU_JINR-93311-20201023055702 14 0]... 100%249 Success [crab3@vocms0107.cern.ch#60082005.0#1603583035 201024_220806:sciaba_crab_HC-101-T1_RU_JINR-93322-20201024060303 19 0]... 100%240 Success [crab3@vocms0107.cern.ch#60101269.0#1603669517 201025_233407:sciaba_crab_HC-101-T1_RU_JINR-93333-20201025061303 2 0]... 99%254 Success [crab3@vocms0195.cern.ch#56883193.0#1603755598 201026_222854:sciaba_crab_HC-101-T1_RU_JINR-93344-20201026051303 14 0]...
2 Failed, Removed due to wall clock limit [crab3@vocms0119.cern.ch#59541952.0#1603804399 201027_045720:sciaba_crab_HC-101-T1_RU_JINR-93355-20201027053903 99 0]...
100%186 Success [crab3@vocms0194.cern.ch#57879416.0#1603842242 201027_230752:sciaba_crab_HC-101-T1_RU_JINR-93355-20201027053903 7 0]... 100%249 Success [crab3@vocms0195.cern.ch#56952933.0#1603928150 201028_221502:sciaba_crab_HC-101-T1_RU_JINR-93367-20201028045502 16 0]...
FTS Status: 97%Transfer (from/to): 26401/1558 files, 11.749/2.281 TB ok
Errors: src_missing_file: 6/0, src_error: 1390/0, trn_timeout: 83/27, trn_error: 460/11, dst_permission: 0/72, dst_error: 0/3 foreign: 466/142
Links: 111/102 ok, 2/3 warning, 2/3 error, 0/1 unknown, 1/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 16706/2764 files, 24.852/2.102 TB ok
Errors: src_missing_file: 11/0, trn_timeout: 40/10, trn_error: 106/18, dst_permission: 0/104, dst_error: 0/1 foreign: 443/194
Links: 111/103 ok, 2/5 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 30056/3576 files, 49.652/2.682 TB ok
Errors: src_missing_file: 27/0, trn_timeout: 33/24, trn_error: 48/9, dst_permission: 0/44, dst_error: 0/1 foreign: 570/108
Links: 114/106 ok, 0/3 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 10047/13633 files, 22.732/43.163 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 17/57, trn_error: 12/5, dst_permission: 0/93, dst_error: 0/6 foreign: 42/106
Links: 112/107 ok, 1/2 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
97%Transfer (from/to): 14511/1378 files, 45.123/2.883 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 16/21, trn_error: 3/5, dst_permission: 0/84, dst_path: 0/1, dst_error: 0/2 foreign: 43/72
Links: 109/96 ok, 1/10 warning, 0/4 error, 0/1 unknown, 1/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 16976/8508 files, 62.821/19.459 TB ok
Errors: src_missing_file: 28/0, trn_timeout: 15/20, trn_error: 183/12, dst_permission: 0/66, dst_path: 0/3, dst_error: 0/1 foreign: 64/89
Links: 105/99 ok, 6/12 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
96%Transfer (from/to): 22033/2815 files, 62.929/6.682 TB ok
Errors: src_permission: 4/0, src_missing_file: 74/0, trn_timeout: 149/25, trn_user: 1/2, trn_error: 44/5, dst_permission: 0/110, dst_error: 0/2 foreign: 83/146
Links: 106/97 ok, 5/13 warning, 4/2 error, 0/1 unknown, 1/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
97%Transfer (from/to): 11899/7720 files, 85.212/11.370 TB ok
Errors: src_missing_file: 84/0, src_error: 272/0, trn_timeout: 18/41, trn_error: 70/8, dst_error: 0/3 foreign: 80/192
Links: 111/108 ok, 2/1 warning, 2/1 error, 0/1 unknown, 1/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
97%Transfer (from/to): 16273/2420 files, 138.206/5.364 TB ok
Errors: src_missing_file: 90/0, src_error: 149/0, trn_timeout: 25/30, trn_user: 5/0, trn_error: 544/18, dst_permission: 0/1 foreign: 481/173
Links: 110/107 ok, 1/1 warning, 1/2 error, 0/1 unknown, 4/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
97%Transfer (from/to): 13478/2873 files, 47.002/5.580 TB ok
Errors: src_missing_file: 124/0, trn_timeout: 137/20, trn_error: 142/43 foreign: 579/213
Links: 112/106 ok, 3/1 warning, 1/0 error, 0/1 unknown, 2/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 11675/3073 files, 138.206/20.763 TB ok
Errors: src_missing_file: 50/0, trn_timeout: 94/48, trn_user: 46/55, trn_error: 2/48 foreign: 776/140
Links: 109/106 ok, 2/0 warning, 0/0 error, 0/1 unknown, 2/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 14289/3210 files, 232.622/5.459 TB ok
Errors: src_missing_file: 62/0, trn_timeout: 37/22, trn_user: 37/0, trn_error: 37/36, dst_error: 0/1 foreign: 606/151
Links: 107/104 ok, 3/0 warning, 1/2 error, 0/1 unknown, 2/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 12518/7623 files, 56.544/19.116 TB ok
Errors: src_missing_file: 52/0, trn_timeout: 10/0, trn_error: 23/40, dst_error: 0/4 foreign: 162/645
Links: 112/106 ok, 3/2 warning, 0/0 error, 0/1 unknown, 0/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 17578/4161 files, 96.495/11.132 TB ok
Errors: src_missing_file: 520/0, src_error: 152/0, trn_timeout: 22/7, trn_user: 112/0, trn_error: 373/48, dst_permission: 0/1, dst_space: 0/4, dst_error: 0/5 foreign: 300/95
Links: 113/109 ok, 1/1 warning, 1/0 error, 0/1 unknown, 2/2 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 11378/1912 files, 140.198/4.217 TB ok
Errors: src_missing_file: 24/0, src_error: 3/0, trn_timeout: 11/3, trn_user: 327/0, trn_error: 1310/49 foreign: 154/75
Links: 107/103 ok, 3/3 warning, 1/0 error, 1/3 unknown, 2/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
98%Transfer (from/to): 15388/4386 files, 196.200/11.868 TB ok
Errors: src_missing_file: 10/0, src_error: 12/0, trn_timeout: 21/7, trn_user: 280/0, trn_error: 1328/431, dst_path: 0/8, dst_error: 0/10 foreign: 236/190
Links: 107/109 ok, 3/0 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint
srm-cms.jinr-t1.ru: ok/ok
srm-cms-mss.jinr-t1.ru: ok/ok
Site Readiness:
31%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (122 Success ...),
FTS: ok (Links: 111/102 ok, 2/3 warning, 2/3 error, 0/1 unknown, 1/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
30%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (94 Success ...),
FTS: ok (Links: 111/103 ok, 2/5 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
43%SAM: ok (15min evaluations: 89 ok, 0 warning, 6 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (200 Success ...),
FTS: ok (Links: 114/106 ok, 0/3 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
46%SAM: error (15min evaluations: 85 ok, 0 warning, 11 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (254 Success ...),
FTS: ok (Links: 112/107 ok, 1/2 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
50%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (259 Success ...),
FTS: ok (Links: 109/96 ok, 1/10 warning, 0/4 error, 0/1 unknown, 1/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
53%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (200 Success ...),
FTS: ok (Links: 105/99 ok, 6/12 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
27%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (104 Success ...; 8 Success, no Chirp ExitCode ...),
FTS: ok (Links: 106/97 ok, 5/13 warning, 4/2 error, 0/1 unknown, 1/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
42%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (191 Success ...; 19 Success, no Chirp ExitCode ...),
FTS: ok (Links: 111/108 ok, 2/1 warning, 2/1 error, 0/1 unknown, 1/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
34%SAM: ok (15min evaluations: 87 ok, 0 warning, 0 error, 9 unknown, 0 downtime (0h0m)),
HC: ok (160 Success ...; 7 Success, no Chirp ExitCode ...),
FTS: ok (Links: 110/107 ok, 1/1 warning, 1/2 error, 0/1 unknown, 4/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
33%SAM: ok (15min evaluations: 76 ok, 0 warning, 0 error, 20 unknown, 0 downtime (0h0m)),
HC: ok (156 Success ...),
FTS: ok (Links: 112/106 ok, 3/1 warning, 1/0 error, 0/1 unknown, 2/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
31%SAM: ok (15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (192 Success ...),
FTS: ok (Links: 109/106 ok, 2/0 warning, 0/0 error, 0/1 unknown, 2/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
50%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (249 Success ...),
FTS: ok (Links: 107/104 ok, 3/0 warning, 1/2 error, 0/1 unknown, 2/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
42%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (240 Success ...),
FTS: ok (Links: 112/106 ok, 3/2 warning, 0/0 error, 0/1 unknown, 0/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
39%SAM: ok (15min evaluations: 88 ok, 0 warning, 6 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (254 Success ...; 2 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 113/109 ok, 1/1 warning, 1/0 error, 0/1 unknown, 2/2 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
31%SAM: error (15min evaluations: 78 ok, 0 warning, 17 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (186 Success ...),
FTS: ok (Links: 107/103 ok, 3/3 warning, 1/0 error, 1/3 unknown, 2/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
50%SAM: ok (15min evaluations: 87 ok, 0 warning, 9 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (249 Success ...),
FTS: ok (Links: 107/109 ok, 3/0 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint; srm-cms.jinr-t1.ru: ok/ok; srm-cms-mss.jinr-t1.ru: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T1_UK_RAL
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 92 ok, 0 warning, 3 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 93%15min evaluations: 87 ok, 0 warning, 6 error, 3 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 94 ok, 0 warning, 1 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 91%15min evaluations: 88 ok, 0 warning, 8 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 96%165 Success [crab3@vocms0122.cern.ch#62563869.0#1602632047 201013_075105:sciaba_crab_HC-101-T1_UK_RAL-93186-20201013094703 160 0]...
6 Failed, ExitCode 8021 [crab3@vocms0122.cern.ch#62564573.0#1602632946 201013_075105:sciaba_crab_HC-101-T1_UK_RAL-93186-20201013094703 163 0]...
93%169 Success [crab3@vocms0119.cern.ch#58988437.0#1602718354 201014_065900:sciaba_crab_HC-101-T1_UK_RAL-93196-20201014080703 192 0]...
11 Failed, ExitCode 8021 [crab3@vocms0119.cern.ch#58988520.0#1602720754 201014_065900:sciaba_crab_HC-101-T1_UK_RAL-93196-20201014080703 200 0]...
95%195 Success [crab3@vocms0199.cern.ch#17586551.0#1602804460 201015_063622:sciaba_crab_HC-101-T1_UK_RAL-93206-20201015063703 202 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0199.cern.ch#17577441.0#1602793359 201015_063622:sciaba_crab_HC-101-T1_UK_RAL-93206-20201015063703 165 0]...
9 Failed, ExitCode 8021 [crab3@vocms0121.cern.ch#58866035.0#1602820761 201016_004245:sciaba_crab_HC-101-T1_UK_RAL-93206-20201015063703 39 0]...
97%260 Success [crab3@vocms0197.cern.ch#57156686.0#1602891456 201016_232139:sciaba_crab_HC-101-T1_UK_RAL-93228-20201016070903 3 0]...
8 Failed, ExitCode 8021 [crab3@vocms0197.cern.ch#57156736.0#1602897758 201016_232139:sciaba_crab_HC-101-T1_UK_RAL-93228-20201016070903 24 0]...
96%258 Success [crab3@vocms0107.cern.ch#59915379.0#1602977245 201017_231644:sciaba_crab_HC-101-T1_UK_RAL-93239-20201017070302 2 0]...
9 Failed, ExitCode 8021 [crab3@vocms0107.cern.ch#59915627.0#1602978744 201017_231644:sciaba_crab_HC-101-T1_UK_RAL-93239-20201017070302 7 0]...
98%203 Success [crab3@vocms0107.cern.ch#59936502.0#1603064633 201018_052749:sciaba_crab_HC-101-T1_UK_RAL-93249-20201018071703 219 0]...
4 Failed, ExitCode 8021 [crab3@vocms0137.cern.ch#56475964.0#1603075091 201018_232717:sciaba_crab_HC-101-T1_UK_RAL-93249-20201018071703 38 0]...
99%184 Success [crab3@vocms0119.cern.ch#59177903.0#1603150876 201019_065522:sciaba_crab_HC-101-T1_UK_RAL-93261-20201019085303 201 0]...
10 Success, no Chirp ExitCode [crab3@vocms0195.cern.ch#56665139.0#1603200532 201020_064305:sciaba_crab_HC-101-T1_UK_RAL-93274-20201020083303 81 0]...
1 Failed, ExitCode 8021 [crab3@vocms0195.cern.ch#56689228.0#1603233241 201020_064305:sciaba_crab_HC-101-T1_UK_RAL-93274-20201020083303 190 0]...
99%198 Success [crab3@vocms0195.cern.ch#56690396.0#1603236544 201020_064305:sciaba_crab_HC-101-T1_UK_RAL-93274-20201020083303 201 0]...
29 Success, no Chirp ExitCode [crab3@vocms0197.cern.ch#57217235.0#1603242213 201021_004250:sciaba_crab_HC-101-T1_UK_RAL-93274-20201020083303 4 0]...
2 Failed, ExitCode 8021 [crab3@vocms0194.cern.ch#57609289.0#1603291430 201021_064734:sciaba_crab_HC-101-T1_UK_RAL-93284-20201021083902 95 0]...
98%176 Success [crab3@vocms0194.cern.ch#57623549.0#1603324155 201021_064734:sciaba_crab_HC-101-T1_UK_RAL-93284-20201021083902 204 0]...
7 Success, no Chirp ExitCode [crab3@vocms0194.cern.ch#57620999.0#1603323556 201021_064734:sciaba_crab_HC-101-T1_UK_RAL-93284-20201021083902 202 0]...
1 Failed, ExitCode 8021 [crab3@vocms0106.cern.ch#47889001.0#1603344034 201022_043439:sciaba_crab_HC-101-T1_UK_RAL-93300-20201022062102 9 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0106.cern.ch#47918489.0#1603390248 201022_043439:sciaba_crab_HC-101-T1_UK_RAL-93300-20201022062102 163 0]...
98%227 Success [crab3@vocms0119.cern.ch#59367789.0#1603411260 201022_223513:sciaba_crab_HC-101-T1_UK_RAL-93300-20201022062102 17 0]...
3 Failed, ExitCode 8021 [crab3@vocms0137.cern.ch#56711214.0#1603438956 201023_040627:sciaba_crab_HC-101-T1_UK_RAL-93311-20201023055702 43 0]...
99%217 Success [crab3@vocms0119.cern.ch#59406197.0#1603496370 201023_220807:sciaba_crab_HC-101-T1_UK_RAL-93311-20201023055702 18 0]...
1 Failed, ExitCode 8021 [crab3@vocms0155.cern.ch#61145865.0#1603516033 201024_041049:sciaba_crab_HC-101-T1_UK_RAL-93322-20201024060303 11 0]...
100%237 Success [crab3@vocms0199.cern.ch#17825637.0#1603582666 201024_221136:sciaba_crab_HC-101-T1_UK_RAL-93322-20201024060303 17 0]... 100%263 Success [crab3@vocms0199.cern.ch#17855531.0#1603669000 201025_233024:sciaba_crab_HC-101-T1_UK_RAL-93333-20201025061303 1 0]... 99%209 Success [crab3@vocms0106.cern.ch#48082499.0#1603755490 201026_220152:sciaba_crab_HC-101-T1_UK_RAL-93344-20201026051303 19 0]...
1 Failed, ExitCode 8021 [crab3@vocms0106.cern.ch#48128108.0#1603831333 201027_044605:sciaba_crab_HC-101-T1_UK_RAL-93355-20201027053903 191 0]...
100%185 Success [crab3@vocms0137.cern.ch#56930659.0#1603841564 201027_225626:sciaba_crab_HC-101-T1_UK_RAL-93355-20201027053903 7 0]... 100%253 Success [crab3@vocms0120.cern.ch#58995885.0#1603927431 201028_222730:sciaba_crab_HC-101-T1_UK_RAL-93367-20201028045502 11 0]...
FTS Status: 92%Transfer (from/to): 43201/4897 files, 4.608/13.699 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 132/20, trn_error: 1376/28, dst_permission: 0/16, dst_path: 0/3, dst_error: 0/1 foreign: 264/59
Links: 108/105 ok, 1/2 warning, 2/5 error, 0/1 unknown, 2/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
96%Transfer (from/to): 18349/5855 files, 2.805/13.385 TB ok
Errors: trn_timeout: 0/9, trn_error: 313/16, dst_permission: 0/88, dst_path: 0/3, dst_error: 0/2 foreign: 170/74
Links: 112/109 ok, 1/1 warning, 2/2 error, 0/1 unknown, 2/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
95%Transfer (from/to): 32299/69564 files, 5.898/200.686 TB ok
Errors: src_missing_file: 9/0, src_error: 1/0, trn_timeout: 151/22, trn_user: 0/1, trn_error: 16/23, dst_permission: 0/2, dst_error: 0/7 foreign: 201/1070
Links: 116/107 ok, 2/2 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
94%Transfer (from/to): 2836/68558 files, 5.119/198.889 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 1/35, trn_error: 8/15, dst_permission: 0/27, dst_error: 0/5 foreign: 35/1004
Links: 115/107 ok, 1/2 warning, 0/3 error, 0/1 unknown, 2/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
94%Transfer (from/to): 2876/18588 files, 2.940/53.657 TB ok
Errors: trn_timeout: 11/14, trn_error: 5/39, dst_permission: 0/27, dst_error: 0/34 foreign: 22/613
Links: 114/100 ok, 1/6 warning, 0/3 error, 0/1 unknown, 2/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
94%Transfer (from/to): 1964/7988 files, 3.297/25.648 TB ok
Errors: trn_timeout: 9/17, trn_error: 10/39, dst_permission: 0/240, dst_error: 0/6 foreign: 21/744
Links: 109/104 ok, 6/6 warning, 0/3 error, 0/1 unknown, 3/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
84%Transfer (from/to): 11344/2738 files, 21.504/11.030 TB ok
Errors: src_error: 1/0, trn_timeout: 36/21, trn_user: 0/1, trn_error: 42/45, dst_permission: 0/623, dst_error: 0/5 foreign: 67/564
Links: 108/90 ok, 5/7 warning, 3/15 error, 0/1 unknown, 2/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
78%Transfer (from/to): 7609/2263 files, 7.092/6.225 TB ok
Errors: trn_timeout: 28/23, trn_user: 51/2, trn_error: 6/20, dst_permission: 0/818, dst_error: 0/4 foreign: 65/534
Links: 114/89 ok, 2/6 warning, 2/16 error, 0/1 unknown, 2/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
78%Transfer (from/to): 7693/2495 files, 10.273/14.583 TB ok
Errors: src_error: 6/0, trn_timeout: 39/28, trn_user: 24/1, trn_error: 24/26, dst_permission: 0/839, dst_error: 0/4 foreign: 132/806
Links: 110/89 ok, 8/4 warning, 0/20 error, 0/1 unknown, 3/2 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
74%Transfer (from/to): 4045/2556 files, 3.425/11.502 TB ok
Errors: trn_timeout: 13/28, trn_error: 10/35, dst_permission: 0/1154, dst_error: 0/2 foreign: 156/727
Links: 115/83 ok, 2/4 warning, 1/22 error, 0/1 unknown, 3/2 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
79%Transfer (from/to): 1832/2681 files, 2.265/22.040 TB ok
Errors: trn_timeout: 9/6, trn_error: 10/31, dst_permission: 0/657, dst_error: 0/5 foreign: 102/120
Links: 111/82 ok, 4/8 warning, 0/17 error, 0/1 unknown, 3/2 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
77%Transfer (from/to): 4594/2275 files, 5.087/22.008 TB ok
Errors: trn_timeout: 2/43, trn_user: 0/2, trn_error: 17/45, dst_permission: 0/627, dst_error: 0/4 foreign: 96/93
Links: 111/83 ok, 4/9 warning, 0/17 error, 0/1 unknown, 3/2 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
91%Transfer (from/to): 3254/3938 files, 5.679/9.024 TB ok
Errors: src_error: 12/0, trn_timeout: 5/32, trn_error: 13/42, dst_permission: 0/493, dst_path: 0/4, dst_error: 0/5 foreign: 76/77
Links: 107/100 ok, 11/5 warning, 0/6 error, 0/1 unknown, 1/2 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
63%Transfer (from/to): 3567/8907 files, 21.125/26.412 TB ok
Errors: src_error: 921/0, trn_timeout: 15/23, trn_user: 3/0, trn_error: 84/42, dst_permission: 0/811, dst_error: 0/4 foreign: 237/170
Links: 77/108 ok, 13/2 warning, 22/3 error, 0/1 unknown, 3/2 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: warning/ok
29%Transfer (from/to): 2286/1761 files, 10.954/10.045 TB ok
Errors: src_error: 1738/0, trn_timeout: 20/2, trn_user: 0/68, trn_error: 238/43, dst_permission: 0/677, dst_error: 0/38 foreign: 856/234
Links: 64/85 ok, 7/6 warning, 41/19 error, 0/3 unknown, 3/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: error/ok
81%Transfer (from/to): 2932/5700 files, 9.160/31.230 TB ok
Errors: trn_timeout: 7/1, trn_user: 0/24, trn_error: 200/83, dst_permission: 0/946, dst_path: 0/1, dst_error: 0/2 foreign: 391/134
Links: 114/89 ok, 0/3 warning, 0/15 error, 0/1 unknown, 3/0 bad-endpoint
gridftp.echo.stfc.ac.uk: ok/ok
srm-cms.gridpp.rl.ac.uk: ok/ok
Site Readiness:
22%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (165 Success ...; 6 Failed, ExitCode 8021 ...),
FTS: ok (Links: 108/105 ok, 1/2 warning, 2/5 error, 0/1 unknown, 2/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
36%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (169 Success ...; 11 Failed, ExitCode 8021 ...),
FTS: ok (Links: 112/109 ok, 1/1 warning, 2/2 error, 0/1 unknown, 2/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
49%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (195 Success ...; 1 Failed, Removed due to wall clock limit ...; 9 Failed, ExitCode 8021 ...),
FTS: ok (Links: 116/107 ok, 2/2 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
57%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (260 Success ...; 8 Failed, ExitCode 8021 ...),
FTS: ok (Links: 115/107 ok, 1/2 warning, 0/3 error, 0/1 unknown, 2/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
43%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (258 Success ...; 9 Failed, ExitCode 8021 ...),
FTS: ok (Links: 114/100 ok, 1/6 warning, 0/3 error, 0/1 unknown, 2/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
36%SAM: ok (15min evaluations: 92 ok, 0 warning, 3 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (203 Success ...; 4 Failed, ExitCode 8021 ...),
FTS: ok (Links: 109/104 ok, 6/6 warning, 0/3 error, 0/1 unknown, 3/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
38%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (184 Success ...; 10 Success, no Chirp ExitCode ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 108/90 ok, 5/7 warning, 3/15 error, 0/1 unknown, 2/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
54%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (198 Success ...; 29 Success, no Chirp ExitCode ...; 2 Failed, ExitCode 8021 ...),
FTS: ok (Links: 114/89 ok, 2/6 warning, 2/16 error, 0/1 unknown, 2/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
30%SAM: ok (15min evaluations: 87 ok, 0 warning, 6 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (176 Success ...; 7 Success, no Chirp ExitCode ...; 1 Failed, ExitCode 8021 ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 110/89 ok, 8/4 warning, 0/20 error, 0/1 unknown, 3/2 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
33%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (227 Success ...; 3 Failed, ExitCode 8021 ...),
FTS: ok (Links: 115/83 ok, 2/4 warning, 1/22 error, 0/1 unknown, 3/2 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
33%SAM: ok (15min evaluations: 94 ok, 0 warning, 1 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (217 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 111/82 ok, 4/8 warning, 0/17 error, 0/1 unknown, 3/2 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
49%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (237 Success ...),
FTS: ok (Links: 111/83 ok, 4/9 warning, 0/17 error, 0/1 unknown, 3/2 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
51%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (263 Success ...),
FTS: ok (Links: 107/100 ok, 11/5 warning, 0/6 error, 0/1 unknown, 1/2 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
49%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (209 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: warning (Links: 77/108 ok, 13/2 warning, 22/3 error, 0/1 unknown, 3/2 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: warning/ok)
31%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (185 Success ...),
FTS: error (Links: 64/85 ok, 7/6 warning, 41/19 error, 0/3 unknown, 3/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: error/ok)
41%SAM: ok (15min evaluations: 88 ok, 0 warning, 8 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (253 Success ...),
FTS: ok (Links: 114/89 ok, 0/3 warning, 0/15 error, 0/1 unknown, 3/0 bad-endpoint; gridftp.echo.stfc.ac.uk: ok/ok; srm-cms.gridpp.rl.ac.uk: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T1_US_FNAL
GGUS Tickets: 149136
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 7%15min evaluations: 7 ok, 0 warning, 89 error, 0 unknown, 0 downtime (0h0m) 90%15min evaluations: 82 ok, 3 warning, 9 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%142 Success [crab3@vocms0137.cern.ch#56318122.0#1602632238 201013_075047:sciaba_crab_HC-101-T1_US_FNAL-93186-20201013094703 189 0]... 100%87 Success [crab3@vocms0155.cern.ch#60704568.0#1602718833 201014_071305:sciaba_crab_HC-101-T1_US_FNAL-93196-20201014080703 189 0]... 99%123 Success [crab3@vocms0137.cern.ch#56410888.0#1602804130 201015_130106:sciaba_crab_HC-101-T1_US_FNAL-93206-20201015063703 124 0]...
1 Failed, ExitCode 8028 [crab3@vocms0155.cern.ch#60781491.0#1602882349 201016_052610:sciaba_crab_HC-101-T1_US_FNAL-93228-20201016070903 115 0]...
100%206 Success [crab3@vocms0199.cern.ch#17616708.0#1602912729 201017_052624:sciaba_crab_HC-101-T1_US_FNAL-93239-20201017070302 1 0]... 99%251 Success [crab3@vocms0195.cern.ch#56556082.0#1602978053 201017_233501:sciaba_crab_HC-101-T1_US_FNAL-93239-20201017070302 1 0]...
2 Failed, Removed due to wall clock limit [crab3@vocms0199.cern.ch#17626953.0#1602978441 201017_052624:sciaba_crab_HC-101-T1_US_FNAL-93239-20201017070302 220 0]...
100%149 Success [crab3@vocms0121.cern.ch#58933591.0#1603063578 201018_053008:sciaba_crab_HC-101-T1_US_FNAL-93249-20201018071703 215 0]... 100%124 Success [crab3@vocms0155.cern.ch#60906343.0#1603151328 201019_070727:sciaba_crab_HC-101-T1_US_FNAL-93261-20201019085303 200 0]... 100%183 Success [crab3@vocms0119.cern.ch#59259348.0#1603235605 201020_064725:sciaba_crab_HC-101-T1_US_FNAL-93274-20201020083303 197 0]... 99%163 Success [crab3@vocms0199.cern.ch#17721888.0#1603324083 201021_064144:sciaba_crab_HC-101-T1_US_FNAL-93284-20201021083902 205 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0120.cern.ch#58738660.0#1603382560 201022_043126:sciaba_crab_HC-101-T1_US_FNAL-93300-20201022062102 138 0]...
99%207 Success [crab3@vocms0196.cern.ch#57125227.0#1603409346 201022_223317:sciaba_crab_HC-101-T1_US_FNAL-93300-20201022062102 11 0]...
2 Failed, ExitCode 8028 [crab3@vocms0106.cern.ch#47962664.0#1603486587 201023_041036:sciaba_crab_HC-101-T1_US_FNAL-93311-20201023055702 201 0]...
100%179 Success [crab3@vocms0122.cern.ch#62846589.0#1603494941 201023_221446:sciaba_crab_HC-101-T1_US_FNAL-93311-20201023055702 12 0]... 100%248 Success [crab3@vocms0194.cern.ch#57744191.0#1603582296 201024_222017:sciaba_crab_HC-101-T1_US_FNAL-93322-20201024060303 14 0]... 99%249 Success [crab3@vocms0106.cern.ch#48034309.0#1603668461 201025_053612:sciaba_crab_HC-101-T1_US_FNAL-93333-20201025061303 214 0]...
2 Failed, Removed due to wall clock limit [crab3@vocms0122.cern.ch#62920233.0#1603710163 201026_042144:sciaba_crab_HC-101-T1_US_FNAL-93344-20201026051303 80 0]...
99%249 Success [crab3@vocms0106.cern.ch#48082490.0#1603755290 201026_222403:sciaba_crab_HC-101-T1_US_FNAL-93344-20201026051303 14 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0122.cern.ch#62959653.0#1603783999 201027_044221:sciaba_crab_HC-101-T1_US_FNAL-93355-20201027053903 34 0]...
100%196 Success [crab3@vocms0107.cern.ch#60175146.0#1603841596 201027_225227:sciaba_crab_HC-101-T1_US_FNAL-93355-20201027053903 8 0]... 99%251 Success [crab3@vocms0107.cern.ch#60195570.0#1603928783 201028_221001:sciaba_crab_HC-101-T1_US_FNAL-93367-20201028045502 19 0]...
1 Failed, ExitCode 8028 [crab3@vocms0107.cern.ch#60196898.0#1603935686 201028_221001:sciaba_crab_HC-101-T1_US_FNAL-93367-20201028045502 42 0]...
FTS Status: 95%Transfer (from/to): 3683/9949 files, 12.682/21.458 TB ok
Errors: src_missing_file: 49/0, trn_timeout: 22/34, trn_user: 18/47, trn_error: 597/85, dst_permission: 0/3, dst_error: 0/8 foreign: 1398/240
Links: 116/96 ok, 1/0 warning, 4/2 error, 0/2 unknown, 4/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
98%Transfer (from/to): 4519/59549 files, 12.414/173.050 TB ok
Errors: src_missing_file: 32/0, trn_timeout: 18/22, trn_user: 14/34, trn_error: 134/184, dst_permission: 0/398, dst_error: 0/17 foreign: 375/502
Links: 116/98 ok, 1/4 warning, 2/0 error, 0/2 unknown, 4/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
96%Transfer (from/to): 15647/97049 files, 41.884/279.994 TB ok
Errors: src_missing_file: 24/0, src_error: 4/0, trn_timeout: 24/585, trn_user: 0/31, trn_error: 25/633, dst_permission: 0/892, dst_error: 0/23 foreign: 155/2115
Links: 116/97 ok, 1/4 warning, 1/1 error, 0/2 unknown, 4/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
97%Transfer (from/to): 9925/49021 files, 29.368/140.714 TB ok
Errors: src_missing_file: 15/0, src_error: 2/0, trn_timeout: 23/471, trn_user: 4/40, trn_error: 7/83, dst_permission: 0/12, dst_error: 0/26 foreign: 124/2291
Links: 119/99 ok, 2/2 warning, 1/1 error, 0/2 unknown, 4/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
94%Transfer (from/to): 1100/26012 files, 2.525/73.935 TB ok
Errors: src_missing_file: 10/0, trn_timeout: 26/319, trn_user: 2/43, trn_error: 7/214, dst_permission: 0/4, dst_error: 0/13 foreign: 89/872
Links: 118/99 ok, 1/1 warning, 1/2 error, 0/2 unknown, 4/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
96%Transfer (from/to): 19520/51287 files, 58.295/151.956 TB ok
Errors: src_missing_file: 52/0, trn_timeout: 159/42, trn_user: 1/46, trn_error: 304/215, dst_permission: 0/3, dst_error: 0/6 foreign: 194/1027
Links: 113/106 ok, 6/3 warning, 4/1 error, 0/2 unknown, 6/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
93%Transfer (from/to): 27677/33445 files, 94.201/105.047 TB ok
Errors: src_missing_file: 137/0, trn_timeout: 113/599, trn_user: 1/53, trn_error: 30/232, dst_permission: 0/2, dst_space: 0/2, dst_error: 0/8 foreign: 358/1008
Links: 114/104 ok, 3/2 warning, 6/2 error, 0/2 unknown, 4/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
78%Transfer (from/to): 7863/7133 files, 13.787/33.459 TB ok
Errors: src_missing_file: 172/0, trn_timeout: 98/277, trn_user: 5/33, trn_error: 538/3327, dst_permission: 0/3, dst_space: 0/1, dst_error: 0/5 foreign: 365/896
Links: 99/85 ok, 1/4 warning, 26/15 error, 0/2 unknown, 4/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
83%Transfer (from/to): 22804/15673 files, 77.423/82.939 TB ok
Errors: src_missing_file: 220/0, src_error: 4/0, trn_timeout: 151/357, trn_user: 7/116, trn_error: 1954/3424, dst_permission: 0/5, dst_space: 0/1, dst_error: 0/5 foreign: 751/1758
Links: 96/84 ok, 7/6 warning, 20/13 error, 0/2 unknown, 6/1 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
95%Transfer (from/to): 12937/3329 files, 34.440/8.253 TB ok
Errors: src_missing_file: 172/0, trn_timeout: 87/110, trn_user: 2/39, trn_error: 28/39, dst_permission: 0/2, dst_space: 0/1, dst_error: 0/3 foreign: 1005/1948
Links: 121/94 ok, 3/3 warning, 3/2 error, 0/2 unknown, 4/2 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
94%Transfer (from/to): 4567/3043 files, 14.012/16.470 TB ok
Errors: src_missing_file: 139/0, trn_timeout: 48/50, trn_user: 3/68, trn_error: 11/34, dst_permission: 0/3, dst_space: 0/1, dst_error: 0/5 foreign: 704/1832
Links: 117/94 ok, 1/1 warning, 2/3 error, 0/2 unknown, 3/2 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
94%Transfer (from/to): 4987/8009 files, 9.439/54.243 TB ok
Errors: src_missing_file: 159/0, trn_timeout: 42/36, trn_user: 6/59, trn_error: 10/60, dst_permission: 0/4, dst_error: 0/5 foreign: 976/2058
Links: 117/93 ok, 2/1 warning, 2/4 error, 0/2 unknown, 3/2 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
96%Transfer (from/to): 29427/13562 files, 101.933/55.460 TB ok
Errors: src_missing_file: 83/0, trn_timeout: 56/127, trn_user: 8/59, trn_error: 21/51, dst_permission: 0/3, dst_space: 0/1, dst_error: 0/5 foreign: 628/1928
Links: 121/102 ok, 6/2 warning, 2/1 error, 0/1 unknown, 1/2 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
98%Transfer (from/to): 25204/45405 files, 117.209/296.660 TB ok
Errors: src_missing_file: 208/0, trn_timeout: 163/309, trn_user: 14/249, trn_error: 2847/410, dst_permission: 0/4, dst_error: 0/13 foreign: 944/807
Links: 123/108 ok, 0/1 warning, 1/1 error, 0/1 unknown, 4/2 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
96%Transfer (from/to): 10826/51629 files, 72.183/312.032 TB ok
Errors: src_missing_file: 27/0, trn_timeout: 77/267, trn_user: 16/151, trn_error: 5166/184, dst_permission: 0/6, dst_error: 0/11 foreign: 882/934
Links: 111/105 ok, 1/1 warning, 3/2 error, 1/3 unknown, 4/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
96%Transfer (from/to): 8954/37649 files, 53.047/235.935 TB ok
Errors: src_missing_file: 55/0, src_error: 7/0, trn_timeout: 50/184, trn_user: 8/130, trn_error: 2179/104, dst_permission: 0/15, dst_space: 0/2, dst_error: 0/10 foreign: 1063/601
Links: 116/108 ok, 1/1 warning, 2/1 error, 2/2 unknown, 4/0 bad-endpoint
cmsdcatape.fnal.gov: ok/ok
cmsdcadisk.fnal.gov: ok/ok
Site Readiness:
39%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (142 Success ...),
FTS: ok (Links: 116/96 ok, 1/0 warning, 4/2 error, 0/2 unknown, 4/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
18%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (87 Success ...),
FTS: ok (Links: 116/98 ok, 1/4 warning, 2/0 error, 0/2 unknown, 4/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
27%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (123 Success ...; 1 Failed, ExitCode 8028 ...),
FTS: ok (Links: 116/97 ok, 1/4 warning, 1/1 error, 0/2 unknown, 4/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
44%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (206 Success ...),
FTS: ok (Links: 119/99 ok, 2/2 warning, 1/1 error, 0/2 unknown, 4/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
41%SAM: ok (15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (251 Success ...; 2 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 118/99 ok, 1/1 warning, 1/2 error, 0/2 unknown, 4/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
37%SAM: ok (15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (149 Success ...),
FTS: ok (Links: 113/106 ok, 6/3 warning, 4/1 error, 0/2 unknown, 6/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
57%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (124 Success ...),
FTS: ok (Links: 114/104 ok, 3/2 warning, 6/2 error, 0/2 unknown, 4/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
6%SAM: error (15min evaluations: 7 ok, 0 warning, 89 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (183 Success ...),
FTS: ok (Links: 99/85 ok, 1/4 warning, 26/15 error, 0/2 unknown, 4/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
45%SAM: ok (15min evaluations: 82 ok, 3 warning, 9 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (163 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 96/84 ok, 7/6 warning, 20/13 error, 0/2 unknown, 6/1 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
43%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (207 Success ...; 2 Failed, ExitCode 8028 ...),
FTS: ok (Links: 121/94 ok, 3/3 warning, 3/2 error, 0/2 unknown, 4/2 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
35%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (179 Success ...),
FTS: ok (Links: 117/94 ok, 1/1 warning, 2/3 error, 0/2 unknown, 3/2 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
49%SAM: ok (15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (248 Success ...),
FTS: ok (Links: 117/93 ok, 2/1 warning, 2/4 error, 0/2 unknown, 3/2 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
54%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (249 Success ...; 2 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 121/102 ok, 6/2 warning, 2/1 error, 0/1 unknown, 1/2 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
79%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (249 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 123/108 ok, 0/1 warning, 1/1 error, 0/1 unknown, 4/2 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
52%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (196 Success ...),
FTS: ok (Links: 111/105 ok, 1/1 warning, 3/2 error, 1/3 unknown, 4/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
65%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (251 Success ...; 1 Failed, ExitCode 8028 ...),
FTS: ok (Links: 116/108 ok, 1/1 warning, 2/1 error, 2/2 unknown, 4/0 bad-endpoint; cmsdcatape.fnal.gov: ok/ok; cmsdcadisk.fnal.gov: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_AT_Vienna
GGUS Tickets: 148309 149270
Downtimes: DAll CEs (ce-1.grid.vbc.ac.at), all XROOTDs (eos.grid.vbc.ac.at) DAll CEs (ce-1.grid.vbc.ac.at), all XROOTDs (eos.grid.vbc.ac.at) DAll CEs (ce-1.grid.vbc.ac.at), all XROOTDs (eos.grid.vbc.ac.at) DAll CEs (ce-1.grid.vbc.ac.at), all XROOTDs (eos.grid.vbc.ac.at) DAll CEs (ce-1.grid.vbc.ac.at), all XROOTDs (eos.grid.vbc.ac.at) DAll CEs (ce-1.grid.vbc.ac.at), all XROOTDs (eos.grid.vbc.ac.at)
SAM Status: 89%15min evaluations: 86 ok, 0 warning, 10 error, 0 unknown, 0 downtime (0h0m) 85%15min evaluations: 65 ok, 0 warning, 11 error, 20 unknown, 0 downtime (0h0m) 95%15min evaluations: 77 ok, 0 warning, 4 error, 15 unknown, 0 downtime (0h0m) 95%15min evaluations: 89 ok, 0 warning, 4 error, 3 unknown, 0 downtime (0h0m) 83%15min evaluations: 79 ok, 0 warning, 16 error, 1 unknown, 0 downtime (0h0m) 77%15min evaluations: 69 ok, 1 warning, 20 error, 6 unknown, 0 downtime (0h0m) 40%15min evaluations: 24 ok, 0 warning, 36 error, 36 unknown, 0 downtime (0h0m) 0%15min evaluations: 0 ok, 0 warning, 48 error, 48 unknown, 0 downtime (0h0m) 0%15min evaluations: 72 ok, 0 warning, 12 error, 12 unknown, 0 downtime (18h0m) n/a15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (24h0m) n/a15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (24h0m) n/a15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (24h0m) n/a15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (24h0m) 95%15min evaluations: 92 ok, 2 warning, 2 error, 0 unknown, 0 downtime (14h0m) 92%15min evaluations: 88 ok, 0 warning, 7 error, 1 unknown, 0 downtime (0h0m) 89%15min evaluations: 83 ok, 0 warning, 10 error, 3 unknown, 0 downtime (0h0m)
Hammer Cloud: 96%196 Success [crab3@vocms0194.cern.ch#57464235.0#1602627600 201013_103859:sciaba_crab_HC-98-T2_AT_Vienna-93179-20201012183702 140 0]...
6 Failed, ExitCode 139 [crab3@vocms0194.cern.ch#57466282.0#1602646500 201013_103859:sciaba_crab_HC-98-T2_AT_Vienna-93179-20201012183702 203 0]...
2 Success, no Chirp ExitCode [crab3@vocms0120.cern.ch#58516287.0#1602688161 201014_121254:sciaba_crab_HC-98-T2_AT_Vienna-93200-20201014140301 35 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0120.cern.ch#58517098.0#1602692963 201014_121254:sciaba_crab_HC-98-T2_AT_Vienna-93200-20201014140301 51 0]...
95%11 Failed, ExitCode 139 [crab3@vocms0120.cern.ch#58527587.0#1602718469 201014_121254:sciaba_crab_HC-98-T2_AT_Vienna-93200-20201014140301 136 0]...
228 Success [crab3@vocms0120.cern.ch#58526097.0#1602707971 201014_121254:sciaba_crab_HC-98-T2_AT_Vienna-93200-20201014140301 101 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0120.cern.ch#58529384.0#1602736171 201014_121254:sciaba_crab_HC-98-T2_AT_Vienna-93200-20201014140301 195 0]...
1 Success, no Chirp ExitCode [crab3@vocms0199.cern.ch#17568468.0#1602786314 201015_063351:sciaba_crab_HC-98-T2_AT_Vienna-93200-20201014140301 142 0]...
95%9 Failed, ExitCode 139 [crab3@vocms0199.cern.ch#17587012.0#1602805817 201015_063351:sciaba_crab_HC-98-T2_AT_Vienna-93200-20201014140301 207 0]...
176 Success [crab3@vocms0199.cern.ch#17586546.0#1602804317 201015_063351:sciaba_crab_HC-98-T2_AT_Vienna-93200-20201014140301 202 0]...
92%209 Success [crab3@vocms0106.cern.ch#47798860.0#1602877886 201016_095013:sciaba_crab_HC-98-T2_AT_Vienna-93232-20201016113902 120 0]...
16 Failed, ExitCode 139 [crab3@vocms0199.cern.ch#17615727.0#1602907838 201017_034429:sciaba_crab_HC-98-T2_AT_Vienna-93232-20201016113902 5 0]...
94%237 Success [crab3@vocms0199.cern.ch#17625682.0#1602972355 201017_034429:sciaba_crab_HC-98-T2_AT_Vienna-93232-20201016113902 220 0]...
14 Failed, ExitCode 139 [crab3@vocms0144.cern.ch#60253909.0#1602979696 201017_220231:sciaba_crab_HC-98-T2_AT_Vienna-93232-20201016113902 25 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0107.cern.ch#59934433.0#1603039329 201018_113117:sciaba_crab_HC-98-T2_AT_Vienna-93255-20201018132902 62 0]...
94%175 Success [crab3@vocms0107.cern.ch#59936500.0#1603064534 201018_113117:sciaba_crab_HC-98-T2_AT_Vienna-93255-20201018132902 146 0]...
8 Failed, ExitCode 139 [crab3@vocms0107.cern.ch#59936882.0#1603084635 201018_113117:sciaba_crab_HC-98-T2_AT_Vienna-93255-20201018132902 213 0]...
2 Failed, ExitCode 8021 [crab3@vocms0107.cern.ch#59936792.0#1603079235 201018_113117:sciaba_crab_HC-98-T2_AT_Vienna-93255-20201018132902 195 0]...
96%50 Success [crab3@vocms0155.cern.ch#60904958.0#1603148513 201019_054544:sciaba_crab_HC-98-T2_AT_Vienna-93255-20201018132902 207 0]...
2 Failed, ExitCode 139 [crab3@vocms0155.cern.ch#60906410.0#1603151516 201019_054544:sciaba_crab_HC-98-T2_AT_Vienna-93255-20201018132902 217 0]...
1 Success, no Chirp ExitCode [crab3@vocms0137.cern.ch#56540561.0#1603164735 201020_005114:sciaba_crab_HC-98-T2_AT_Vienna-93255-20201018132902 32 0]...
? ? 92%8 Failed, ExitCode 139 [crab3@vocms0107.cern.ch#59974492.0#1603357393 201022_080702:sciaba_crab_HC-98-T2_AT_Vienna-93306-20201022095702 11 0]...
101 Success [crab3@vocms0107.cern.ch#59974363.0#1603354993 201022_080702:sciaba_crab_HC-98-T2_AT_Vienna-93306-20201022095702 3 0]...
95%188 Success [crab3@vocms0106.cern.ch#47969648.0#1603496583 201023_220215:sciaba_crab_HC-98-T2_AT_Vienna-93306-20201022095702 20 0]...
9 Failed, ExitCode 139 [crab3@vocms0106.cern.ch#47979615.0#1603512790 201023_220215:sciaba_crab_HC-98-T2_AT_Vienna-93306-20201022095702 74 0]...
93%245 Success [crab3@vocms0107.cern.ch#60081700.0#1603580847 201024_061612:sciaba_crab_HC-98-T2_AT_Vienna-93324-20201024080702 202 0]...
15 Failed, ExitCode 139 [crab3@vocms0194.cern.ch#57745945.0#1603594287 201025_015006:sciaba_crab_HC-98-T2_AT_Vienna-93324-20201024080702 12 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0194.cern.ch#57756243.0#1603635996 201025_015006:sciaba_crab_HC-98-T2_AT_Vienna-93324-20201024080702 151 0]...
95%12 Failed, ExitCode 139 [crab3@vocms0155.cern.ch#61186938.0#1603659936 201025_195434:sciaba_crab_HC-98-T2_AT_Vienna-93324-20201024080702 14 0]...
229 Success [crab3@vocms0155.cern.ch#61187157.0#1603668341 201025_195434:sciaba_crab_HC-98-T2_AT_Vienna-93324-20201024080702 42 0]...
96%232 Success [crab3@vocms0155.cern.ch#61213306.0#1603758104 201026_213033:sciaba_crab_HC-98-T2_AT_Vienna-93343-20201026042702 34 0]...
9 Failed, ExitCode 139 [crab3@vocms0155.cern.ch#61214681.0#1603772509 201026_213033:sciaba_crab_HC-98-T2_AT_Vienna-93343-20201026042702 82 0]...
1 Success, no Chirp ExitCode [crab3@vocms0155.cern.ch#61215138.0#1603779709 201026_213033:sciaba_crab_HC-98-T2_AT_Vienna-93343-20201026042702 106 0]...
93%15 Failed, ExitCode 139 [crab3@vocms0119.cern.ch#59558357.0#1603833786 201027_153701:sciaba_crab_HC-98-T2_AT_Vienna-93343-20201026042702 69 0]...
230 Success [crab3@vocms0119.cern.ch#59561614.0#1603843990 201027_153701:sciaba_crab_HC-98-T2_AT_Vienna-93343-20201026042702 103 0]...
2 Success, no Chirp ExitCode [crab3@vocms0194.cern.ch#57907116.0#1603906319 201028_045044:sciaba_crab_HC-98-T2_AT_Vienna-93368-20201028053702 152 0]...
95%228 Success [crab3@vocms0194.cern.ch#57912885.0#1603927020 201028_045044:sciaba_crab_HC-98-T2_AT_Vienna-93368-20201028053702 221 0]...
10 Failed, ExitCode 139 [crab3@vocms0199.cern.ch#17950350.0#1603937070 201028_223817:sciaba_crab_HC-98-T2_AT_Vienna-93368-20201028053702 41 0]...
FTS Status: 59%Transfer (from/to): 242/309 files, 0.285/0.640 TB ok
Errors: trn_error: 164/10, dst_permission: 0/4 foreign: 12/10
Links: 27/43 ok, 2/0 warning, 19/0 error, 0/1 unknown, 1/0 bad-endpoint
se.grid.vbc.ac.at: ok/ok
63%Transfer (from/to): 1690/249 files, 0.217/0.539 TB ok
Errors: trn_error: 126/1, dst_permission: 0/5 foreign: 10/8
Links: 30/38 ok, 1/5 warning, 17/0 error, 0/1 unknown, 1/0 bad-endpoint
se.grid.vbc.ac.at: ok/ok
59%Transfer (from/to): 194/630 files, 0.282/0.818 TB ok
Errors: trn_error: 177/10 foreign: 9/8
Links: 26/44 ok, 4/0 warning, 18/0 error, 0/1 unknown, 1/0 bad-endpoint
se.grid.vbc.ac.at: ok/ok
59%Transfer (from/to): 570/590 files, 0.273/0.701 TB ok
Errors: trn_error: 195/31, dst_permission: 0/2 foreign: 10/10
Links: 28/38 ok, 3/7 warning, 19/0 error, 0/1 unknown, 1/0 bad-endpoint
se.grid.vbc.ac.at: ok/ok
59%Transfer (from/to): 550/509 files, 0.254/0.720 TB ok
Errors: trn_timeout: 1/0, trn_error: 201/0, dst_permission: 0/3 foreign: 13/7
Links: 27/46 ok, 4/0 warning, 19/0 error, 0/1 unknown, 1/0 bad-endpoint
se.grid.vbc.ac.at: ok/ok
27%Transfer (from/to): 125/5113 files, 0.183/4.440 TB ok
Errors: src_error: 1/0, trn_timeout: 1/572, trn_error: 234/2068, dst_error: 0/279 foreign: 12/43
Links: 8/34 ok, 20/17 warning, 21/8 error, 0/1 unknown, 1/0 bad-endpoint
se.grid.vbc.ac.at: error/ok
43%Transfer (from/to): 103/2195 files, 0.251/3.389 TB ok
Errors: src_permission: 2/0, src_missing_file: 2/0, trn_timeout: 2/0, trn_error: 226/203, dst_error: 0/1 foreign: 9/19
Links: 19/55 ok, 3/0 warning, 24/1 error, 0/1 unknown, 1/0 bad-endpoint
se.grid.vbc.ac.at: error/ok
43%Transfer (from/to): 85/326 files, 0.208/0.698 TB ok
Errors: trn_timeout: 5/1, trn_error: 220/7, dst_permission: 0/3 foreign: 8/7
Links: 19/42 ok, 3/0 warning, 25/1 error, 0/1 unknown, 1/0 bad-endpoint
se.grid.vbc.ac.at: error/ok
43%Transfer (from/to): 47/191 files, 0.115/0.410 TB ok
Errors: src_missing_file: 22/0, src_error: 1/0, trn_timeout: 1/0, trn_error: 151/2 foreign: 7/6
Links: 18/42 ok, 4/0 warning, 24/0 error, 0/1 unknown, 2/1 bad-endpoint
se.grid.vbc.ac.at: error/ok
0%Transfer (from/to): 20/0 files, 0.000/0.000 TB ok
Errors: src_missing_file: 29/0, trn_error: 3/0
Links: 1/0 ok, 0/0 warning, 0/0 error, 1/0 unknown, 1/0 bad-endpoint
se.grid.vbc.ac.at: warning/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: src_missing_file: 16/0, trn_error: 1/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 1/0 unknown, 1/0 bad-endpoint
se.grid.vbc.ac.at: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: src_missing_file: 21/0, trn_error: 2/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 1/0 unknown, 1/0 bad-endpoint
se.grid.vbc.ac.at: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: src_missing_file: 12/0, trn_error: 1/0
Links: 0/0 ok, 1/0 warning, 0/0 error, 2/0 unknown, 0/0 bad-endpoint
se.grid.vbc.ac.at: warning/unknown
90%Transfer (from/to): 65/6 files, 0.159/0.000 TB ok
Errors: src_missing_file: 27/0, trn_error: 19/0 foreign: 1/0
Links: 39/3 ok, 5/0 warning, 4/0 error, 0/0 unknown, 0/0 bad-endpoint
se.grid.vbc.ac.at: ok/ok
0%Transfer (from/to): 4719/0 files, 0.374/0.000 TB ok
Errors: src_missing_file: 34/0, src_error: 2/0, trn_error: 66/0 foreign: 3/0
Links: 37/0 ok, 5/0 warning, 6/0 error, 1/0 unknown, 0/0 bad-endpoint
se.grid.vbc.ac.at: ok/unknown
81%Transfer (from/to): 126/569 files, 0.308/1.198 TB ok
Errors: src_missing_file: 31/0, trn_timeout: 0/55, trn_error: 81/18, dst_path: 0/65, dst_error: 0/34 foreign: 2/6
Links: 34/29 ok, 3/22 warning, 8/0 error, 0/1 unknown, 0/0 bad-endpoint
se.grid.vbc.ac.at: ok/ok
Site Readiness:
34%SAM: warning (15min evaluations: 86 ok, 0 warning, 10 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (196 Success ...; 6 Failed, ExitCode 139 ...; 2 Success, no Chirp ExitCode ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 27/43 ok, 2/0 warning, 19/0 error, 0/1 unknown, 1/0 bad-endpoint; se.grid.vbc.ac.at: ok/ok)
18%SAM: warning (15min evaluations: 65 ok, 0 warning, 11 error, 20 unknown, 0 downtime (0h0m)),
HC: ok (11 Failed, ExitCode 139 ...; 228 Success ...; 1 Failed, Removed due to wall clock limit ...; 1 Success, no Chirp ExitCode ...),
FTS: ok (Links: 30/38 ok, 1/5 warning, 17/0 error, 0/1 unknown, 1/0 bad-endpoint; se.grid.vbc.ac.at: ok/ok)
26%SAM: ok (15min evaluations: 77 ok, 0 warning, 4 error, 15 unknown, 0 downtime (0h0m)),
HC: ok (9 Failed, ExitCode 139 ...; 176 Success ...),
FTS: ok (Links: 26/44 ok, 4/0 warning, 18/0 error, 0/1 unknown, 1/0 bad-endpoint; se.grid.vbc.ac.at: ok/ok)
37%SAM: ok (15min evaluations: 89 ok, 0 warning, 4 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (209 Success ...; 16 Failed, ExitCode 139 ...),
FTS: ok (Links: 28/38 ok, 3/7 warning, 19/0 error, 0/1 unknown, 1/0 bad-endpoint; se.grid.vbc.ac.at: ok/ok)
40%SAM: warning (15min evaluations: 79 ok, 0 warning, 16 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (237 Success ...; 14 Failed, ExitCode 139 ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 27/46 ok, 4/0 warning, 19/0 error, 0/1 unknown, 1/0 bad-endpoint; se.grid.vbc.ac.at: ok/ok)
37%SAM: error (15min evaluations: 69 ok, 1 warning, 20 error, 6 unknown, 0 downtime (0h0m)),
HC: ok (175 Success ...; 8 Failed, ExitCode 139 ...; 2 Failed, ExitCode 8021 ...),
FTS: error (Links: 8/34 ok, 20/17 warning, 21/8 error, 0/1 unknown, 1/0 bad-endpoint; se.grid.vbc.ac.at: error/ok),
downtime: no scheduled downtime
18%SAM: error (15min evaluations: 24 ok, 0 warning, 36 error, 36 unknown, 0 downtime (0h0m)),
HC: ok (50 Success ...; 2 Failed, ExitCode 139 ...; 1 Success, no Chirp ExitCode ...),
FTS: error (Links: 19/55 ok, 3/0 warning, 24/1 error, 0/1 unknown, 1/0 bad-endpoint; se.grid.vbc.ac.at: error/ok),
downtime: no scheduled downtime
0%SAM: error (15min evaluations: 0 ok, 0 warning, 48 error, 48 unknown, 0 downtime (0h0m)),
HC: unknown,
FTS: error (Links: 19/42 ok, 3/0 warning, 25/1 error, 0/1 unknown, 1/0 bad-endpoint; se.grid.vbc.ac.at: error/ok),
downtime: no scheduled downtime
0%SAM: downtime (15min evaluations: 72 ok, 0 warning, 12 error, 12 unknown, 0 downtime (18h0m)),
HC: unknown,
FTS: error (Links: 18/42 ok, 4/0 warning, 24/0 error, 0/1 unknown, 2/1 bad-endpoint; se.grid.vbc.ac.at: error/ok)
0%SAM: downtime (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (24h0m)),
HC: ok (8 Failed, ExitCode 139 ...; 101 Success ...),
FTS: unknown (Links: 1/0 ok, 0/0 warning, 0/0 error, 1/0 unknown, 1/0 bad-endpoint; se.grid.vbc.ac.at: warning/unknown)
0%SAM: downtime (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (24h0m)),
HC: ok (188 Success ...; 9 Failed, ExitCode 139 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 1/0 unknown, 1/0 bad-endpoint; se.grid.vbc.ac.at: unknown/unknown)
0%SAM: downtime (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (24h0m)),
HC: ok (245 Success ...; 15 Failed, ExitCode 139 ...; 1 Failed, Removed due to wall clock limit ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 1/0 unknown, 1/0 bad-endpoint; se.grid.vbc.ac.at: unknown/unknown)
0%SAM: downtime (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (24h0m)),
HC: ok (12 Failed, ExitCode 139 ...; 229 Success ...),
FTS: unknown (Links: 0/0 ok, 1/0 warning, 0/0 error, 2/0 unknown, 0/0 bad-endpoint; se.grid.vbc.ac.at: warning/unknown)
2%SAM: ok (15min evaluations: 92 ok, 2 warning, 2 error, 0 unknown, 0 downtime (14h0m)),
HC: ok (232 Success ...; 9 Failed, ExitCode 139 ...; 1 Success, no Chirp ExitCode ...),
FTS: ok (Links: 39/3 ok, 5/0 warning, 4/0 error, 0/0 unknown, 0/0 bad-endpoint; se.grid.vbc.ac.at: ok/ok)
0%SAM: ok (15min evaluations: 88 ok, 0 warning, 7 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (15 Failed, ExitCode 139 ...; 230 Success ...; 2 Success, no Chirp ExitCode ...),
FTS: unknown (Links: 37/0 ok, 5/0 warning, 6/0 error, 1/0 unknown, 0/0 bad-endpoint; se.grid.vbc.ac.at: ok/unknown)
17%SAM: warning (15min evaluations: 83 ok, 0 warning, 10 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (228 Success ...; 10 Failed, ExitCode 139 ...),
FTS: ok (Links: 34/29 ok, 3/22 warning, 8/0 error, 0/1 unknown, 0/0 bad-endpoint; se.grid.vbc.ac.at: ok/ok)
Life Status: WR WR WR WR WR WR WR WR WR WR WR
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_BE_IIHE
GGUS Tickets: 149255
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 73%15min evaluations: 67 ok, 0 warning, 24 error, 5 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 95%15min evaluations: 87 ok, 0 warning, 4 error, 5 unknown, 0 downtime (0h0m) 98%15min evaluations: 79 ok, 0 warning, 1 error, 16 unknown, 0 downtime (0h0m) 98%15min evaluations: 90 ok, 0 warning, 1 error, 5 unknown, 0 downtime (0h0m) 100%15min evaluations: 85 ok, 0 warning, 0 error, 11 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 41 ok, 0 warning, 0 error, 55 unknown, 0 downtime (0h0m) 50%15min evaluations: 2 ok, 0 warning, 2 error, 92 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%207 Success [crab3@vocms0122.cern.ch#62565581.0#1602638899 201014_005923:sciaba_crab_HC-100-T2_BE_IIHE-93191-20201013222902 3 0]... 100%205 Success [crab3@vocms0107.cern.ch#59802522.0#1602718665 201014_181630:sciaba_crab_HC-100-T2_BE_IIHE-93203-20201014201302 64 0]... 100%215 Success [crab3@vocms0199.cern.ch#17586543.0#1602804141 201015_165125:sciaba_crab_HC-100-T2_BE_IIHE-93221-20201015184702 78 0]... 76%90 Success [crab3@vocms0199.cern.ch#17617075.0#1602924579 201017_084354:sciaba_crab_HC-100-T2_BE_IIHE-93234-20201016165102 1 0]...
28 Failed, Removed due to wall clock limit [crab3@vocms0120.cern.ch#58623883.0#1602948028 201017_150421:sciaba_crab_HC-100-T2_BE_IIHE-93243-20201017165902 3 0]...
100%252 Success [crab3@vocms0120.cern.ch#58641075.0#1602977736 201017_150421:sciaba_crab_HC-100-T2_BE_IIHE-93243-20201017165902 102 0]... 99%191 Success [crab3@vocms0121.cern.ch#58933833.0#1603064312 201018_140745:sciaba_crab_HC-100-T2_BE_IIHE-93257-20201018155302 114 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0121.cern.ch#58931230.0#1603056810 201018_140745:sciaba_crab_HC-100-T2_BE_IIHE-93257-20201018155302 89 0]...
95%110 Success [crab3@vocms0155.cern.ch#60905904.0#1603150131 201019_130800:sciaba_crab_HC-100-T2_BE_IIHE-93265-20201019150502 124 0]...
5 Failed, Removed due to wall clock limit [crab3@vocms0155.cern.ch#60887158.0#1603134229 201019_130800:sciaba_crab_HC-100-T2_BE_IIHE-93265-20201019150502 71 0]...
1 Success, no Chirp ExitCode [crab3@vocms0119.cern.ch#59230971.0#1603201048 201020_110618:sciaba_crab_HC-100-T2_BE_IIHE-93277-20201020125702 30 0]...
100%1 Success, no Chirp ExitCode [crab3@vocms0119.cern.ch#59260279.0#1603236159 201020_110618:sciaba_crab_HC-100-T2_BE_IIHE-93277-20201020125702 147 0]...
148 Success [crab3@vocms0119.cern.ch#59260300.0#1603236460 201020_110618:sciaba_crab_HC-100-T2_BE_IIHE-93277-20201020125702 148 0]...
100%147 Success [crab3@vocms0196.cern.ch#57092937.0#1603322661 201021_092757:sciaba_crab_HC-100-T2_BE_IIHE-93286-20201021111702 167 0]... 100%214 Success [crab3@vocms0106.cern.ch#47927426.0#1603408119 201022_110736:sciaba_crab_HC-100-T2_BE_IIHE-93307-20201022125502 144 0]... 100%138 Success [crab3@vocms0120.cern.ch#58807009.0#1603512301 201024_035400:sciaba_crab_HC-100-T2_BE_IIHE-93315-20201023113502 2 0]... 100%231 Success [crab3@vocms0194.cern.ch#57743945.0#1603581507 201024_094702:sciaba_crab_HC-100-T2_BE_IIHE-93329-20201024114302 162 0]... 100%233 Success [crab3@vocms0137.cern.ch#56822596.0#1603667625 201025_113250:sciaba_crab_HC-100-T2_BE_IIHE-93337-20201025121702 140 0]... 100%93 Success [crab3@vocms0144.cern.ch#60613271.0#1603754027 201026_103135:sciaba_crab_HC-100-T2_BE_IIHE-93350-20201026112102 152 0]... 100%217 Success [crab3@vocms0195.cern.ch#56923737.0#1603840977 201027_120131:sciaba_crab_HC-100-T2_BE_IIHE-93360-20201027125102 136 0]... 100%107 Success [crab3@vocms0196.cern.ch#57345286.0#1603923252 201028_132248:sciaba_crab_HC-100-T2_BE_IIHE-93379-20201028141902 106 0]...
FTS Status: 96%Transfer (from/to): 4230/4951 files, 1.959/1.040 TB ok
Errors: trn_timeout: 0/6, trn_error: 188/13, dst_permission: 0/163 foreign: 124/40
Links: 48/52 ok, 1/0 warning, 1/2 error, 0/1 unknown, 3/0 bad-endpoint
maite.iihe.ac.be: ok/ok
96%Transfer (from/to): 12157/1494 files, 2.900/3.198 TB ok
Errors: src_missing_file: 1/0, src_error: 8/0, trn_timeout: 0/5, trn_user: 1/0, trn_error: 39/7, dst_error: 0/1 foreign: 264/35
Links: 51/52 ok, 0/0 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint
maite.iihe.ac.be: ok/ok
97%Transfer (from/to): 18998/3774 files, 6.190/3.043 TB ok
Errors: src_missing_file: 3/0, trn_timeout: 6/5, trn_error: 2/17 foreign: 572/50
Links: 47/58 ok, 0/0 warning, 0/2 error, 0/1 unknown, 3/0 bad-endpoint
maite.iihe.ac.be: ok/ok
96%Transfer (from/to): 5996/1114 files, 3.930/3.110 TB ok
Errors: src_missing_file: 12/0, src_error: 212/0, trn_timeout: 13/7, trn_error: 1/11, dst_error: 0/113 foreign: 102/29
Links: 33/49 ok, 5/4 warning, 1/2 error, 1/1 unknown, 3/0 bad-endpoint
maite.iihe.ac.be: ok/ok
96%Transfer (from/to): 4746/5098 files, 0.736/6.644 TB ok
Errors: trn_timeout: 0/7, trn_error: 5/9, dst_permission: 0/1, dst_error: 0/1 foreign: 70/33
Links: 36/54 ok, 0/0 warning, 0/2 error, 0/1 unknown, 3/0 bad-endpoint
maite.iihe.ac.be: ok/ok
94%Transfer (from/to): 8222/4988 files, 3.751/2.097 TB ok
Errors: src_missing_file: 16/0, src_error: 17/0, trn_timeout: 6/7, trn_error: 22/315, dst_permission: 0/2, dst_path: 0/4, dst_space: 0/1, dst_error: 0/123 foreign: 61/68
Links: 53/55 ok, 0/1 warning, 0/2 error, 0/1 unknown, 4/0 bad-endpoint
maite.iihe.ac.be: ok/ok
95%Transfer (from/to): 9486/79628 files, 2.856/20.165 TB ok
Errors: src_permission: 3/0, src_missing_file: 14/0, trn_timeout: 10/74, trn_error: 5/45, dst_permission: 0/1, dst_error: 0/3 foreign: 41/133
Links: 44/55 ok, 2/2 warning, 1/2 error, 0/1 unknown, 3/0 bad-endpoint
maite.iihe.ac.be: ok/ok
93%Transfer (from/to): 9363/44364 files, 1.359/22.867 TB ok
Errors: src_missing_file: 20/0, src_error: 23/0, trn_timeout: 5/40, trn_error: 7/26, dst_error: 0/1 foreign: 145/155
Links: 48/54 ok, 0/1 warning, 0/3 error, 0/1 unknown, 3/0 bad-endpoint
maite.iihe.ac.be: ok/ok
93%Transfer (from/to): 4634/6225 files, 3.471/3.633 TB ok
Errors: src_missing_file: 17/0, src_error: 36/0, trn_timeout: 22/12, trn_error: 7/16 foreign: 2017/208
Links: 46/51 ok, 0/1 warning, 1/3 error, 0/2 unknown, 5/1 bad-endpoint
maite.iihe.ac.be: ok/ok
97%Transfer (from/to): 5079/17975 files, 1.276/5.290 TB ok
Errors: src_missing_file: 10/0, trn_timeout: 6/11, trn_error: 4/15 foreign: 198/229
Links: 48/53 ok, 0/2 warning, 2/1 error, 0/1 unknown, 4/1 bad-endpoint
maite.iihe.ac.be: ok/ok
98%Transfer (from/to): 4487/11021 files, 2.355/7.523 TB ok
Errors: src_missing_file: 4/0, trn_timeout: 0/10, trn_error: 65/13, dst_space: 0/1 foreign: 352/74
Links: 42/53 ok, 0/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint
maite.iihe.ac.be: ok/ok
96%Transfer (from/to): 8896/1693 files, 1.849/10.693 TB ok
Errors: src_missing_file: 5/0, trn_timeout: 0/3, trn_error: 11/15 foreign: 519/126
Links: 43/49 ok, 1/1 warning, 0/2 error, 0/1 unknown, 3/1 bad-endpoint
maite.iihe.ac.be: ok/ok
97%Transfer (from/to): 6538/13769 files, 3.172/10.582 TB ok
Errors: src_missing_file: 3/0, trn_timeout: 1/7, trn_error: 1/18, dst_error: 0/3 foreign: 172/70
Links: 36/50 ok, 1/2 warning, 0/1 error, 1/1 unknown, 0/1 bad-endpoint
maite.iihe.ac.be: ok/ok
98%Transfer (from/to): 15730/35792 files, 7.273/5.183 TB ok
Errors: src_missing_file: 8/0, src_error: 307/0, trn_timeout: 37/7, trn_error: 1259/75, dst_permission: 0/2 foreign: 10499/179
Links: 29/55 ok, 0/0 warning, 1/1 error, 0/2 unknown, 1/1 bad-endpoint
maite.iihe.ac.be: ok/ok
98%Transfer (from/to): 12059/2568 files, 6.780/9.020 TB ok
Errors: src_missing_file: 17/0, trn_timeout: 3/9, trn_user: 0/16, trn_error: 4098/0 foreign: 507/230
Links: 44/53 ok, 0/0 warning, 0/1 error, 0/2 unknown, 2/0 bad-endpoint
maite.iihe.ac.be: ok/ok
98%Transfer (from/to): 4280/23707 files, 6.736/39.216 TB ok
Errors: src_missing_file: 5/0, trn_timeout: 0/53, trn_user: 0/17, trn_error: 1650/45, dst_error: 0/5 foreign: 265/238
Links: 51/55 ok, 0/1 warning, 1/1 error, 0/2 unknown, 2/0 bad-endpoint
maite.iihe.ac.be: ok/ok
Site Readiness:
78%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (207 Success ...),
FTS: ok (Links: 48/52 ok, 1/0 warning, 1/2 error, 0/1 unknown, 3/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
60%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (205 Success ...),
FTS: ok (Links: 51/52 ok, 0/0 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
81%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (215 Success ...),
FTS: ok (Links: 47/58 ok, 0/0 warning, 0/2 error, 0/1 unknown, 3/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
22%SAM: error (15min evaluations: 67 ok, 0 warning, 24 error, 5 unknown, 0 downtime (0h0m)),
HC: error (90 Success ...; 28 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 33/49 ok, 5/4 warning, 1/2 error, 1/1 unknown, 3/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
68%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (252 Success ...),
FTS: ok (Links: 36/54 ok, 0/0 warning, 0/2 error, 0/1 unknown, 3/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
57%SAM: ok (15min evaluations: 87 ok, 0 warning, 4 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (191 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 53/55 ok, 0/1 warning, 0/2 error, 0/1 unknown, 4/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
49%SAM: ok (15min evaluations: 79 ok, 0 warning, 1 error, 16 unknown, 0 downtime (0h0m)),
HC: ok (110 Success ...; 5 Failed, Removed due to wall clock limit ...; 1 Success, no Chirp ExitCode ...),
FTS: ok (Links: 44/55 ok, 2/2 warning, 1/2 error, 0/1 unknown, 3/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
69%SAM: ok (15min evaluations: 90 ok, 0 warning, 1 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (1 Success, no Chirp ExitCode ...; 148 Success ...),
FTS: ok (Links: 48/54 ok, 0/1 warning, 0/3 error, 0/1 unknown, 3/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
63%SAM: ok (15min evaluations: 85 ok, 0 warning, 0 error, 11 unknown, 0 downtime (0h0m)),
HC: ok (147 Success ...),
FTS: ok (Links: 46/51 ok, 0/1 warning, 1/3 error, 0/2 unknown, 5/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
82%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (214 Success ...),
FTS: ok (Links: 48/53 ok, 0/2 warning, 2/1 error, 0/1 unknown, 4/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
59%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (138 Success ...),
FTS: ok (Links: 42/53 ok, 0/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
86%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (231 Success ...),
FTS: ok (Links: 43/49 ok, 1/1 warning, 0/2 error, 0/1 unknown, 3/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
74%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (233 Success ...),
FTS: ok (Links: 36/50 ok, 1/2 warning, 0/1 error, 1/1 unknown, 0/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
39%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (93 Success ...),
FTS: ok (Links: 29/55 ok, 0/0 warning, 1/1 error, 0/2 unknown, 1/1 bad-endpoint; maite.iihe.ac.be: ok/ok)
39%SAM: unknown (15min evaluations: 41 ok, 0 warning, 0 error, 55 unknown, 0 downtime (0h0m)),
HC: ok (217 Success ...),
FTS: ok (Links: 44/53 ok, 0/0 warning, 0/1 error, 0/2 unknown, 2/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
1%SAM: unknown (15min evaluations: 2 ok, 0 warning, 2 error, 92 unknown, 0 downtime (0h0m)),
HC: ok (107 Success ...),
FTS: ok (Links: 51/55 ok, 0/1 warning, 1/1 error, 0/2 unknown, 2/0 bad-endpoint; maite.iihe.ac.be: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_BE_UCL
GGUS Tickets: 148354 149235
Downtimes:
SAM Status: 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 83 ok, 0 warning, 0 error, 13 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 86 ok, 0 warning, 0 error, 10 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m) 78%15min evaluations: 66 ok, 0 warning, 18 error, 12 unknown, 0 downtime (0h0m) 76%15min evaluations: 65 ok, 0 warning, 20 error, 11 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 87%15min evaluations: 80 ok, 0 warning, 12 error, 4 unknown, 0 downtime (0h0m) 46%15min evaluations: 34 ok, 0 warning, 39 error, 23 unknown, 0 downtime (0h0m) 0%15min evaluations: 0 ok, 0 warning, 24 error, 72 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%125 Success [crab3@vocms0196.cern.ch#56702646.0#1602633217 201013_223732:sciaba_crab_HC-100-T2_BE_UCL-93191-20201013222902 12 0]... 100%187 Success [crab3@vocms0121.cern.ch#58800362.0#1602717777 201014_182146:sciaba_crab_HC-100-T2_BE_UCL-93203-20201014201302 60 0]... 100%195 Success [crab3@vocms0107.cern.ch#59849681.0#1602804407 201015_170032:sciaba_crab_HC-100-T2_BE_UCL-93221-20201015184702 77 0]... 96%5 Failed, ExitCode 65 [crab3@vocms0119.cern.ch#59067008.0#1602926089 201017_090359:sciaba_crab_HC-100-T2_BE_UCL-93234-20201016165102 2 0]...
134 Success [crab3@vocms0119.cern.ch#59066998.0#1602925787 201017_090359:sciaba_crab_HC-100-T2_BE_UCL-93234-20201016165102 1 0]...
100%249 Success [crab3@vocms0144.cern.ch#60253615.0#1602978079 201017_150526:sciaba_crab_HC-100-T2_BE_UCL-93243-20201017165902 103 0]... 100%200 Success [crab3@vocms0199.cern.ch#17648218.0#1603064007 201018_140230:sciaba_crab_HC-100-T2_BE_UCL-93257-20201018155302 114 0]... 100%155 Success [crab3@vocms0119.cern.ch#59177513.0#1603149985 201019_131958:sciaba_crab_HC-100-T2_BE_UCL-93265-20201019150502 121 0]... 100%128 Success [crab3@vocms0155.cern.ch#60995990.0#1603237561 201020_105940:sciaba_crab_HC-100-T2_BE_UCL-93277-20201020125702 153 0]... 100%206 Success [crab3@vocms0196.cern.ch#57092946.0#1603322918 201021_092230:sciaba_crab_HC-100-T2_BE_UCL-93286-20201021111702 169 0]... 100%194 Success [crab3@vocms0144.cern.ch#60496683.0#1603409510 201022_110050:sciaba_crab_HC-100-T2_BE_UCL-93307-20201022125502 150 0]... 100%183 Success [crab3@vocms0119.cern.ch#59415564.0#1603511852 201024_035127:sciaba_crab_HC-100-T2_BE_UCL-93315-20201023113502 1 0]... 100%245 Success [crab3@vocms0199.cern.ch#17824688.0#1603577791 201024_095032:sciaba_crab_HC-100-T2_BE_UCL-93329-20201024114302 149 0]... 100%236 Success [crab3@vocms0196.cern.ch#57212962.0#1603665597 201025_112855:sciaba_crab_HC-100-T2_BE_UCL-93337-20201025121702 134 0]... 100%220 Success [crab3@vocms0107.cern.ch#60135302.0#1603754384 201026_102847:sciaba_crab_HC-100-T2_BE_UCL-93350-20201026112102 154 0]... 98%240 Success [crab3@vocms0107.cern.ch#60173405.0#1603839062 201027_115506:sciaba_crab_HC-100-T2_BE_UCL-93360-20201027125102 131 0]...
3 Failed, ExitCode 8003 [crab3@vocms0195.cern.ch#56937412.0#1603870736 201028_060250:sciaba_crab_HC-100-T2_BE_UCL-93360-20201027125102 19 0]...
100%249 Success [crab3@vocms0199.cern.ch#17949602.0#1603927633 201028_132101:sciaba_crab_HC-100-T2_BE_UCL-93379-20201028141902 121 0]...
FTS Status: 97%Transfer (from/to): 213/339 files, 0.577/0.660 TB ok
Errors: trn_error: 92/6, dst_error: 0/1 foreign: 24/12
Links: 42/42 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
97%Transfer (from/to): 319/387 files, 0.606/0.595 TB ok
Errors: trn_timeout: 1/0, trn_error: 20/8 foreign: 22/7
Links: 45/47 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
98%Transfer (from/to): 625/610 files, 0.604/0.766 TB ok
Errors: trn_timeout: 2/0, trn_error: 3/7, dst_path: 0/1 foreign: 16/12
Links: 51/49 ok, 0/0 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
97%Transfer (from/to): 308/805 files, 0.529/2.300 TB ok
Errors: trn_timeout: 2/1, trn_error: 1/7, dst_path: 0/1, dst_error: 0/2 foreign: 1/6
Links: 48/42 ok, 1/1 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
97%Transfer (from/to): 188/403 files, 0.459/0.839 TB ok
Errors: trn_timeout: 3/0, trn_error: 5/9, dst_path: 0/7 foreign: 5/11
Links: 45/47 ok, 1/0 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
97%Transfer (from/to): 184/481 files, 0.442/1.223 TB ok
Errors: trn_timeout: 3/0, trn_error: 4/7, dst_path: 0/3, dst_error: 0/3 foreign: 0/17
Links: 44/46 ok, 2/3 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
96%Transfer (from/to): 199/515 files, 0.457/2.592 TB ok
Errors: src_error: 2/0, trn_timeout: 7/1, trn_error: 5/11, dst_path: 0/5 foreign: 2/22
Links: 43/43 ok, 2/2 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
98%Transfer (from/to): 457/638 files, 1.227/1.595 TB ok
Errors: trn_timeout: 5/3, trn_error: 3/4, dst_path: 0/2 foreign: 2/21
Links: 50/48 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
87%Transfer (from/to): 2589/453 files, 11.141/1.001 TB ok
Errors: src_missing_file: 6/0, src_error: 949/0, trn_timeout: 92/0, trn_error: 24/7, dst_path: 0/7, dst_error: 0/1 foreign: 201/35
Links: 41/45 ok, 4/1 warning, 7/1 error, 0/1 unknown, 2/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
97%Transfer (from/to): 2296/4790 files, 16.066/12.480 TB ok
Errors: src_missing_file: 13/0, src_error: 589/0, trn_timeout: 273/118, trn_error: 7/38, dst_path: 0/10, dst_error: 0/6 foreign: 313/520
Links: 50/47 ok, 4/2 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
99%Transfer (from/to): 261/1459 files, 0.485/3.526 TB ok
Errors: trn_timeout: 2/32, trn_error: 4/13, dst_path: 0/9 foreign: 250/2249
Links: 46/47 ok, 1/0 warning, 0/0 error, 1/1 unknown, 2/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
97%Transfer (from/to): 309/629 files, 0.611/1.190 TB ok
Errors: trn_timeout: 5/1, trn_error: 9/16, dst_path: 0/3, dst_error: 0/1 foreign: 164/2724
Links: 47/45 ok, 3/0 warning, 0/1 error, 1/1 unknown, 2/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
98%Transfer (from/to): 236/921 files, 0.547/2.595 TB ok
Errors: trn_timeout: 3/2, trn_error: 6/11, dst_path: 0/4 foreign: 103/2356
Links: 44/47 ok, 3/1 warning, 0/0 error, 1/1 unknown, 1/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
87%Transfer (from/to): 274/2102 files, 0.681/2.919 TB ok
Errors: trn_timeout: 2/109, trn_error: 1/2052, dst_path: 0/11 foreign: 196/1391
Links: 46/28 ok, 0/17 warning, 0/4 error, 1/1 unknown, 1/1 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
60%Transfer (from/to): 199/4334 files, 0.474/4.569 TB ok
Errors: trn_timeout: 0/4, trn_user: 0/108, trn_error: 2286/5005, dst_path: 0/16 foreign: 151/895
Links: 45/15 ok, 0/27 warning, 0/10 error, 1/1 unknown, 2/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
76%Transfer (from/to): 260/1998 files, 0.508/5.591 TB ok
Errors: trn_timeout: 3/5, trn_user: 0/56, trn_error: 903/2484, dst_path: 0/7 foreign: 150/1574
Links: 43/23 ok, 1/22 warning, 0/7 error, 1/1 unknown, 2/0 bad-endpoint
ingrid-se02.cism.ucl.ac.be: ok/ok
Site Readiness:
20%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (125 Success ...),
FTS: ok (Links: 42/42 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
34%SAM: ok (15min evaluations: 83 ok, 0 warning, 0 error, 13 unknown, 0 downtime (0h0m)),
HC: ok (187 Success ...),
FTS: ok (Links: 45/47 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
37%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (195 Success ...),
FTS: ok (Links: 51/49 ok, 0/0 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
24%SAM: ok (15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (5 Failed, ExitCode 65 ...; 134 Success ...),
FTS: ok (Links: 48/42 ok, 1/1 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
33%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (249 Success ...),
FTS: ok (Links: 45/47 ok, 1/0 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
13%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (200 Success ...),
FTS: ok (Links: 44/46 ok, 2/3 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
28%SAM: ok (15min evaluations: 86 ok, 0 warning, 0 error, 10 unknown, 0 downtime (0h0m)),
HC: ok (155 Success ...),
FTS: ok (Links: 43/43 ok, 2/2 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
32%SAM: ok (15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (128 Success ...),
FTS: ok (Links: 50/48 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
35%SAM: error (15min evaluations: 66 ok, 0 warning, 18 error, 12 unknown, 0 downtime (0h0m)),
HC: ok (206 Success ...),
FTS: ok (Links: 41/45 ok, 4/1 warning, 7/1 error, 0/1 unknown, 2/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
50%SAM: error (15min evaluations: 65 ok, 0 warning, 20 error, 11 unknown, 0 downtime (0h0m)),
HC: ok (194 Success ...),
FTS: ok (Links: 50/47 ok, 4/2 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
29%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (183 Success ...),
FTS: ok (Links: 46/47 ok, 1/0 warning, 0/0 error, 1/1 unknown, 2/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
43%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (245 Success ...),
FTS: ok (Links: 47/45 ok, 3/0 warning, 0/1 error, 1/1 unknown, 2/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
42%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (236 Success ...),
FTS: ok (Links: 44/47 ok, 3/1 warning, 0/0 error, 1/1 unknown, 1/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
39%SAM: warning (15min evaluations: 80 ok, 0 warning, 12 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (220 Success ...),
FTS: ok (Links: 46/28 ok, 0/17 warning, 0/4 error, 1/1 unknown, 1/1 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
9%SAM: error (15min evaluations: 34 ok, 0 warning, 39 error, 23 unknown, 0 downtime (0h0m)),
HC: ok (240 Success ...; 3 Failed, ExitCode 8003 ...),
FTS: ok (Links: 45/15 ok, 0/27 warning, 0/10 error, 1/1 unknown, 2/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
0%SAM: unknown (15min evaluations: 0 ok, 0 warning, 24 error, 72 unknown, 0 downtime (0h0m)),
HC: ok (249 Success ...),
FTS: ok (Links: 43/23 ok, 1/22 warning, 0/7 error, 1/1 unknown, 2/0 bad-endpoint; ingrid-se02.cism.ucl.ac.be: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_BR_SPRACE
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 66 ok, 29 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 16 ok, 80 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 29 ok, 65 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 35 ok, 52 warning, 0 error, 9 unknown, 0 downtime (0h0m) 76%15min evaluations: 39 ok, 31 warning, 22 error, 4 unknown, 0 downtime (0h0m) 61%15min evaluations: 58 ok, 0 warning, 36 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 86 ok, 10 warning, 0 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 86 ok, 8 warning, 2 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 4 warning, 0 error, 0 unknown, 0 downtime (0h0m) 95%15min evaluations: 86 ok, 6 warning, 4 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%192 Success [crab3@vocms0107.cern.ch#59770695.0#1602632142 201013_050253:sciaba_crab_HC-95-T2_BR_SPRACE-93185-20201013065502 149 0]... 100%121 Success [crab3@vocms0195.cern.ch#56475895.0#1602718884 201014_073118:sciaba_crab_HC-95-T2_BR_SPRACE-93197-20201014081502 189 0]... 100%201 Success [crab3@vocms0137.cern.ch#56410913.0#1602805014 201015_081517:sciaba_crab_HC-95-T2_BR_SPRACE-93219-20201015100101 184 0]... 100%205 Success [crab3@vocms0194.cern.ch#57554544.0#1602906338 201017_033945:sciaba_crab_HC-95-T2_BR_SPRACE-93231-20201016113302 1 0]... 100%259 Success [crab3@vocms0195.cern.ch#56556104.0#1602978206 201017_102725:sciaba_crab_HC-95-T2_BR_SPRACE-93242-20201017115702 159 0]... 100%254 Success [crab3@vocms0194.cern.ch#57572409.0#1603064172 201018_121515:sciaba_crab_HC-95-T2_BR_SPRACE-93256-20201018141101 136 0]... 100%194 Success [crab3@vocms0144.cern.ch#60325174.0#1603149580 201019_115318:sciaba_crab_HC-95-T2_BR_SPRACE-93264-20201019134902 137 0]... 100%214 Success [crab3@vocms0195.cern.ch#56690395.0#1603236538 201020_134725:sciaba_crab_HC-95-T2_BR_SPRACE-93279-20201020152702 116 0]... 100%199 Success [crab3@vocms0107.cern.ch#59964161.0#1603322807 201021_141539:sciaba_crab_HC-95-T2_BR_SPRACE-93287-20201021161303 110 0]... 100%266 Success [crab3@vocms0106.cern.ch#47927955.0#1603409582 201022_152644:sciaba_crab_HC-95-T2_BR_SPRACE-93308-20201022170302 97 0]... 100%142 Success [crab3@vocms0195.cern.ch#56829747.0#1603526463 201024_074515:sciaba_crab_HC-95-T2_BR_SPRACE-93317-20201023145302 3 0]... 100%248 Success [crab3@vocms0120.cern.ch#58826887.0#1603582474 201024_150812:sciaba_crab_HC-95-T2_BR_SPRACE-93330-20201024165301 101 0]... 100%234 Success [crab3@vocms0196.cern.ch#57213806.0#1603668717 201025_141038:sciaba_crab_HC-95-T2_BR_SPRACE-93339-20201025145101 112 0]... 100%140 Success [crab3@vocms0195.cern.ch#56886065.0#1603779310 201026_141626:sciaba_crab_HC-95-T2_BR_SPRACE-93352-20201026145702 97 0]... 100%228 Success [crab3@vocms0121.cern.ch#59241859.0#1603843560 201027_164421:sciaba_crab_HC-95-T2_BR_SPRACE-93361-20201027172102 88 0]... 100%221 Success [crab3@vocms0194.cern.ch#57912986.0#1603927767 201028_174832:sciaba_crab_HC-95-T2_BR_SPRACE-93381-20201028183502 68 0]...
FTS Status: 96%Transfer (from/to): 6000/690 files, 1.086/1.633 TB ok
Errors: src_missing_file: 86/0, trn_timeout: 16/5, trn_error: 237/5, dst_error: 0/2 foreign: 917/10
Links: 52/48 ok, 0/1 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
96%Transfer (from/to): 3579/520 files, 1.394/0.740 TB ok
Errors: src_missing_file: 21/0, trn_timeout: 1/9, trn_error: 70/7, dst_error: 0/1 foreign: 35/3
Links: 53/52 ok, 0/1 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
96%Transfer (from/to): 2994/431 files, 0.883/0.720 TB ok
Errors: src_missing_file: 14/0, trn_timeout: 13/1, trn_error: 4/22, dst_error: 0/2 foreign: 9787/32
Links: 53/49 ok, 0/2 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
95%Transfer (from/to): 6193/924 files, 0.634/2.558 TB ok
Errors: trn_timeout: 1/3, trn_error: 2/28, dst_error: 0/1 foreign: 19159/32
Links: 49/47 ok, 0/0 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
97%Transfer (from/to): 2319/869 files, 0.689/0.936 TB ok
Errors: trn_timeout: 3/0, trn_error: 3/10, dst_error: 0/1 foreign: 16/23
Links: 51/49 ok, 1/1 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
98%Transfer (from/to): 3354/717 files, 0.943/4.035 TB ok
Errors: src_missing_file: 98/0, trn_timeout: 10/3, trn_error: 24/11, dst_error: 0/1 foreign: 61/19
Links: 49/52 ok, 1/2 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
97%Transfer (from/to): 4091/627 files, 1.735/2.782 TB ok
Errors: src_permission: 2/0, trn_timeout: 6/0, trn_error: 4/10, dst_permission: 0/1, dst_error: 0/2 foreign: 2724/24
Links: 52/49 ok, 3/2 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
94%Transfer (from/to): 4440/848 files, 1.169/5.471 TB ok
Errors: src_missing_file: 14/0, src_error: 173/0, trn_timeout: 8/5, trn_error: 4/81, dst_permission: 0/5 foreign: 2619/24
Links: 54/52 ok, 1/2 warning, 0/3 error, 0/1 unknown, 2/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
95%Transfer (from/to): 4275/598 files, 1.013/1.438 TB ok
Errors: src_missing_file: 11/0, src_error: 105/0, trn_timeout: 10/6, trn_error: 12/19, dst_permission: 0/2, dst_error: 0/1 foreign: 248/28
Links: 55/49 ok, 1/1 warning, 0/2 error, 0/1 unknown, 4/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
96%Transfer (from/to): 8677/1383 files, 3.069/3.342 TB ok
Errors: src_missing_file: 4/0, trn_timeout: 6/15, trn_error: 2/12, dst_permission: 0/1, dst_error: 0/1 foreign: 5178/17
Links: 52/52 ok, 3/2 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
96%Transfer (from/to): 15278/618 files, 0.963/2.862 TB ok
Errors: src_missing_file: 2/0, trn_timeout: 1/7, trn_error: 15/19 foreign: 107/14
Links: 52/47 ok, 0/1 warning, 1/1 error, 0/1 unknown, 2/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
98%Transfer (from/to): 4620/734 files, 0.992/4.327 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 188/14, trn_error: 6/13, dst_permission: 0/1, dst_error: 0/3 foreign: 63/21
Links: 49/52 ok, 1/2 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
99%Transfer (from/to): 3246/2174 files, 1.066/10.339 TB ok
Errors: src_missing_file: 6/0, trn_timeout: 5/11, trn_error: 0/9, dst_error: 0/1 foreign: 1535/5
Links: 50/52 ok, 1/1 warning, 0/0 error, 0/1 unknown, 0/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
97%Transfer (from/to): 5786/884 files, 2.672/2.758 TB ok
Errors: src_error: 4/0, trn_timeout: 2/5, trn_user: 1/0, trn_error: 13/10, dst_permission: 0/3 foreign: 5966/28
Links: 52/51 ok, 0/1 warning, 0/1 error, 0/2 unknown, 2/1 bad-endpoint
osg-se.sprace.org.br: ok/ok
97%Transfer (from/to): 4379/861 files, 5.500/1.578 TB ok
Errors: trn_timeout: 10/8, trn_user: 2/0, trn_error: 17/11, dst_permission: 0/2, dst_error: 0/2 foreign: 82/60
Links: 56/51 ok, 0/1 warning, 1/1 error, 0/3 unknown, 2/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
96%Transfer (from/to): 5970/1079 files, 6.729/2.375 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 8/53, trn_error: 63/13, dst_permission: 0/1 foreign: 199/14
Links: 56/52 ok, 0/1 warning, 0/1 error, 2/2 unknown, 2/0 bad-endpoint
osg-se.sprace.org.br: ok/ok
Site Readiness:
56%SAM: ok (15min evaluations: 66 ok, 29 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (192 Success ...),
FTS: ok (Links: 52/48 ok, 0/1 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
44%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (121 Success ...),
FTS: ok (Links: 53/52 ok, 0/1 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
67%SAM: ok (15min evaluations: 16 ok, 80 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (201 Success ...),
FTS: ok (Links: 53/49 ok, 0/2 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
49%SAM: ok (15min evaluations: 29 ok, 65 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (205 Success ...),
FTS: ok (Links: 49/47 ok, 0/0 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
76%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (259 Success ...),
FTS: ok (Links: 51/49 ok, 1/1 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
82%SAM: ok (15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (254 Success ...),
FTS: ok (Links: 49/52 ok, 1/2 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
69%SAM: ok (15min evaluations: 35 ok, 52 warning, 0 error, 9 unknown, 0 downtime (0h0m)),
HC: ok (194 Success ...),
FTS: ok (Links: 52/49 ok, 3/2 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
59%SAM: error (15min evaluations: 39 ok, 31 warning, 22 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (214 Success ...),
FTS: ok (Links: 54/52 ok, 1/2 warning, 0/3 error, 0/1 unknown, 2/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
49%SAM: error (15min evaluations: 58 ok, 0 warning, 36 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (199 Success ...),
FTS: ok (Links: 55/49 ok, 1/1 warning, 0/2 error, 0/1 unknown, 4/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
80%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (266 Success ...),
FTS: ok (Links: 52/52 ok, 3/2 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
54%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (142 Success ...),
FTS: ok (Links: 52/47 ok, 0/1 warning, 1/1 error, 0/1 unknown, 2/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
86%SAM: ok (15min evaluations: 86 ok, 10 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (248 Success ...),
FTS: ok (Links: 49/52 ok, 1/2 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
77%SAM: ok (15min evaluations: 86 ok, 8 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (234 Success ...),
FTS: ok (Links: 50/52 ok, 1/1 warning, 0/0 error, 0/1 unknown, 0/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
58%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (140 Success ...),
FTS: ok (Links: 52/51 ok, 0/1 warning, 0/1 error, 0/2 unknown, 2/1 bad-endpoint; osg-se.sprace.org.br: ok/ok)
88%SAM: ok (15min evaluations: 92 ok, 4 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (228 Success ...),
FTS: ok (Links: 56/51 ok, 0/1 warning, 1/1 error, 0/3 unknown, 2/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
74%SAM: ok (15min evaluations: 86 ok, 6 warning, 4 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (221 Success ...),
FTS: ok (Links: 56/52 ok, 0/1 warning, 0/1 error, 2/2 unknown, 2/0 bad-endpoint; osg-se.sprace.org.br: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_BR_UERJ
GGUS Tickets:
Downtimes:
SAM Status: 97%15min evaluations: 85 ok, 3 warning, 2 error, 6 unknown, 0 downtime (0h0m) 97%15min evaluations: 79 ok, 12 warning, 2 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 77 ok, 16 warning, 0 error, 3 unknown, 0 downtime (0h0m) 97%15min evaluations: 61 ok, 32 warning, 2 error, 1 unknown, 0 downtime (0h0m) 96%15min evaluations: 78 ok, 5 warning, 3 error, 10 unknown, 0 downtime (0h0m) 98%15min evaluations: 84 ok, 4 warning, 1 error, 7 unknown, 0 downtime (0h0m) 98%15min evaluations: 84 ok, 2 warning, 1 error, 9 unknown, 0 downtime (0h0m) 94%15min evaluations: 83 ok, 7 warning, 5 error, 1 unknown, 0 downtime (0h0m) 97%15min evaluations: 93 ok, 0 warning, 2 error, 1 unknown, 0 downtime (0h0m) 97%15min evaluations: 89 ok, 2 warning, 2 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 92 ok, 0 warning, 2 error, 2 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 94 ok, 0 warning, 1 error, 1 unknown, 0 downtime (0h0m) 90%15min evaluations: 78 ok, 9 warning, 9 error, 0 unknown, 0 downtime (0h0m) 95%15min evaluations: 83 ok, 5 warning, 4 error, 4 unknown, 0 downtime (0h0m)
Hammer Cloud: 97%195 Success [crab3@vocms0122.cern.ch#62563729.0#1602631740 201013_045914:sciaba_crab_HC-95-T2_BR_UERJ-93185-20201013065502 159 0]...
3 Failed, ExitCode 8021 [crab3@vocms0121.cern.ch#58781159.0#1602683493 201014_071227:sciaba_crab_HC-95-T2_BR_UERJ-93197-20201014081502 71 0]...
1 Failed, ExitCode 8028 [crab3@vocms0121.cern.ch#58781844.0#1602686085 201014_071227:sciaba_crab_HC-95-T2_BR_UERJ-93197-20201014081502 71 1]...
2 Failed, Removed due to wall clock limit [crab3@vocms0121.cern.ch#58782233.0#1602687396 201014_071227:sciaba_crab_HC-95-T2_BR_UERJ-93197-20201014081502 84 0]...
96%166 Success [crab3@vocms0121.cern.ch#58800239.0#1602716502 201014_071227:sciaba_crab_HC-95-T2_BR_UERJ-93197-20201014081502 181 0]...
1 Failed, ExitCode 86 [crab3@vocms0122.cern.ch#62629520.0#1602769785 201015_083345:sciaba_crab_HC-95-T2_BR_UERJ-93219-20201015100101 63 0]...
4 Failed, ExitCode 65 [crab3@vocms0122.cern.ch#62629601.0#1602771282 201015_083345:sciaba_crab_HC-95-T2_BR_UERJ-93219-20201015100101 68 0]...
1 Failed, ExitCode 1 [crab3@vocms0122.cern.ch#62629585.0#1602770684 201015_083345:sciaba_crab_HC-95-T2_BR_UERJ-93219-20201015100101 66 0]...
99%222 Success [crab3@vocms0122.cern.ch#62648981.0#1602803997 201015_083345:sciaba_crab_HC-95-T2_BR_UERJ-93219-20201015100101 177 0]...
1 Failed, ExitCode 65 [crab3@vocms0122.cern.ch#62650116.0#1602814801 201015_083345:sciaba_crab_HC-95-T2_BR_UERJ-93219-20201015100101 213 0]...
1 Success, no Chirp ExitCode [crab3@vocms0197.cern.ch#57130830.0#1602815928 201016_023229:sciaba_crab_HC-95-T2_BR_UERJ-93219-20201015100101 1 0]...
99%204 Success [crab3@vocms0197.cern.ch#57158159.0#1602907255 201017_035503:sciaba_crab_HC-95-T2_BR_UERJ-93231-20201016113302 1 0]...
2 Failed, ExitCode 134 [crab3@vocms0195.cern.ch#56541552.0#1602935117 201017_102415:sciaba_crab_HC-95-T2_BR_UERJ-93242-20201017115702 16 0]...
100%254 Success [crab3@vocms0195.cern.ch#56555508.0#1602976822 201017_102415:sciaba_crab_HC-95-T2_BR_UERJ-93242-20201017115702 155 0]... 98%239 Success [crab3@vocms0122.cern.ch#62748810.0#1603063387 201018_123216:sciaba_crab_HC-95-T2_BR_UERJ-93256-20201018141101 130 0]...
2 Failed, ExitCode 8028 [crab3@vocms0137.cern.ch#56526513.0#1603124981 201019_120830:sciaba_crab_HC-95-T2_BR_UERJ-93264-20201019134902 52 0]...
1 Failed, ExitCode 8021 [crab3@vocms0137.cern.ch#56526121.0#1603124077 201019_120830:sciaba_crab_HC-95-T2_BR_UERJ-93264-20201019134902 49 0]...
100%178 Success [crab3@vocms0137.cern.ch#56537642.0#1603149889 201019_120830:sciaba_crab_HC-95-T2_BR_UERJ-93264-20201019134902 135 0]... 100%177 Success [crab3@vocms0137.cern.ch#56605404.0#1603236780 201020_134638:sciaba_crab_HC-95-T2_BR_UERJ-93279-20201020152702 117 0]... 99%190 Success [crab3@vocms0144.cern.ch#60457377.0#1603322715 201021_143356:sciaba_crab_HC-95-T2_BR_UERJ-93287-20201021161303 106 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0144.cern.ch#60455090.0#1603314015 201021_143356:sciaba_crab_HC-95-T2_BR_UERJ-93287-20201021161303 77 0]...
98%190 Success [crab3@vocms0119.cern.ch#59367794.0#1603411420 201022_152218:sciaba_crab_HC-95-T2_BR_UERJ-93308-20201022170302 104 0]...
3 Failed, ExitCode 8028 [crab3@vocms0137.cern.ch#56725705.0#1603485688 201023_131510:sciaba_crab_HC-95-T2_BR_UERJ-93317-20201023145302 89 0]...
100%6 Success [crab3@vocms0155.cern.ch#61160075.0#1603553819 201024_150608:sciaba_crab_HC-95-T2_BR_UERJ-93330-20201024165301 6 0]... 100%221 Success [crab3@vocms0155.cern.ch#61160252.0#1603556216 201024_150608:sciaba_crab_HC-95-T2_BR_UERJ-93330-20201024165301 14 0]... 100%276 Success [crab3@vocms0119.cern.ch#59468314.0#1603653231 201025_141802:sciaba_crab_HC-95-T2_BR_UERJ-93339-20201025145101 59 0]... 100%23 Success [crab3@vocms0195.cern.ch#56886054.0#1603778415 201026_142313:sciaba_crab_HC-95-T2_BR_UERJ-93352-20201026145702 94 0]... 100%259 Success [crab3@vocms0199.cern.ch#17915470.0#1603818180 201027_163205:sciaba_crab_HC-95-T2_BR_UERJ-93361-20201027172102 6 0]... 98%92 Success [crab3@vocms0121.cern.ch#59279860.0#1603916481 201028_175454:sciaba_crab_HC-95-T2_BR_UERJ-93381-20201028183502 29 0]...
1 Failed, ExitCode 8021 [crab3@vocms0121.cern.ch#59282947.0#1603927580 201028_175454:sciaba_crab_HC-95-T2_BR_UERJ-93381-20201028183502 66 0]...
FTS Status: 97%Transfer (from/to): 360/257 files, 0.383/0.445 TB ok
Errors: src_permission: 1/0, trn_timeout: 2/1, trn_error: 21/3
Links: 46/34 ok, 1/0 warning, 1/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
100%Transfer (from/to): 937/205 files, 0.414/0.370 TB ok
Errors: trn_timeout: 1/0, trn_error: 7/0 foreign: 1/1
Links: 48/28 ok, 3/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
100%Transfer (from/to): 456/230 files, 0.448/0.476 TB ok
Errors: trn_timeout: 5/0 foreign: 56/0
Links: 47/21 ok, 2/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
98%Transfer (from/to): 709/220 files, 0.455/0.460 TB ok
Errors: trn_timeout: 2/0, trn_error: 1/0 foreign: 824/0
Links: 49/20 ok, 1/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
99%Transfer (from/to): 387/267 files, 0.453/0.617 TB ok
Errors: trn_timeout: 1/0 foreign: 1/0
Links: 46/20 ok, 1/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
99%Transfer (from/to): 857/738 files, 0.456/1.734 TB ok
Errors: trn_timeout: 6/0, trn_error: 22/0 foreign: 2/2
Links: 46/20 ok, 3/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
100%Transfer (from/to): 1191/218 files, 0.441/0.463 TB ok
Errors: src_permission: 2/0, trn_timeout: 12/0, trn_error: 6/0 foreign: 2/2
Links: 44/19 ok, 5/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
100%Transfer (from/to): 568/245 files, 0.482/0.505 TB ok
Errors: trn_timeout: 41/0, trn_user: 2/0, trn_error: 2/0 foreign: 546/0
Links: 49/26 ok, 4/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
95%Transfer (from/to): 446/501 files, 0.423/4.084 TB ok
Errors: src_permission: 4/0, trn_timeout: 25/5, trn_error: 9/468, dst_permission: 0/136 foreign: 10/2
Links: 45/19 ok, 6/1 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
96%Transfer (from/to): 359/281 files, 0.405/0.956 TB ok
Errors: src_permission: 2/0, src_error: 2/0, trn_timeout: 15/0, trn_error: 3/113, dst_error: 0/1 foreign: 16/2
Links: 49/21 ok, 1/0 warning, 1/1 error, 0/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
98%Transfer (from/to): 233/323 files, 0.460/1.057 TB ok
Errors: trn_timeout: 5/0, trn_error: 7/1 foreign: 11/0
Links: 49/24 ok, 3/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
98%Transfer (from/to): 281/460 files, 0.455/0.937 TB ok
Errors: trn_timeout: 1/0, trn_error: 4/0 foreign: 4/4
Links: 46/22 ok, 2/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
98%Transfer (from/to): 328/8087 files, 0.627/0.953 TB ok
Errors: trn_timeout: 3/0, trn_error: 3/0
Links: 46/22 ok, 4/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
99%Transfer (from/to): 379/880 files, 1.596/0.939 TB ok
Errors: trn_timeout: 2/0, trn_user: 1/0, trn_error: 0/32 foreign: 31/4
Links: 47/23 ok, 1/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
100%Transfer (from/to): 328/261 files, 1.241/0.543 TB ok
Errors: trn_timeout: 6/1, trn_error: 20/0 foreign: 3/1
Links: 50/23 ok, 2/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
99%Transfer (from/to): 252/258 files, 0.706/0.508 TB ok
Errors: trn_timeout: 1/0, trn_error: 8/1 foreign: 2/2
Links: 47/24 ok, 1/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
gridftp.hepgrid.uerj.br: ok/ok
Site Readiness:
31%SAM: ok (15min evaluations: 85 ok, 3 warning, 2 error, 6 unknown, 0 downtime (0h0m)),
HC: ok (195 Success ...; 3 Failed, ExitCode 8021 ...; 1 Failed, ExitCode 8028 ...; 2 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 46/34 ok, 1/0 warning, 1/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
44%SAM: ok (15min evaluations: 79 ok, 12 warning, 2 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (166 Success ...; 1 Failed, ExitCode 86 ...; 4 Failed, ExitCode 65 ...; 1 Failed, ExitCode 1 ...),
FTS: ok (Links: 48/28 ok, 3/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
56%SAM: ok (15min evaluations: 77 ok, 16 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (222 Success ...; 1 Failed, ExitCode 65 ...; 1 Success, no Chirp ExitCode ...),
FTS: ok (Links: 47/21 ok, 2/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
36%SAM: ok (15min evaluations: 61 ok, 32 warning, 2 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (204 Success ...; 2 Failed, ExitCode 134 ...),
FTS: ok (Links: 49/20 ok, 1/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
37%SAM: ok (15min evaluations: 78 ok, 5 warning, 3 error, 10 unknown, 0 downtime (0h0m)),
HC: ok (254 Success ...),
FTS: ok (Links: 46/20 ok, 1/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
52%SAM: ok (15min evaluations: 84 ok, 4 warning, 1 error, 7 unknown, 0 downtime (0h0m)),
HC: ok (239 Success ...; 2 Failed, ExitCode 8028 ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 46/20 ok, 3/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
56%SAM: ok (15min evaluations: 84 ok, 2 warning, 1 error, 9 unknown, 0 downtime (0h0m)),
HC: ok (178 Success ...),
FTS: ok (Links: 44/19 ok, 5/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
52%SAM: ok (15min evaluations: 83 ok, 7 warning, 5 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (177 Success ...),
FTS: ok (Links: 49/26 ok, 4/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
59%SAM: ok (15min evaluations: 93 ok, 0 warning, 2 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (190 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 45/19 ok, 6/1 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
40%SAM: ok (15min evaluations: 89 ok, 2 warning, 2 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (190 Success ...; 3 Failed, ExitCode 8028 ...),
FTS: ok (Links: 49/21 ok, 1/0 warning, 1/1 error, 0/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
2%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (6 Success ...),
FTS: ok (Links: 49/24 ok, 3/0 warning, 1/0 error, 0/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
36%SAM: ok (15min evaluations: 92 ok, 0 warning, 2 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (221 Success ...),
FTS: ok (Links: 46/22 ok, 2/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
43%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (276 Success ...),
FTS: ok (Links: 46/22 ok, 4/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
7%SAM: ok (15min evaluations: 94 ok, 0 warning, 1 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (23 Success ...),
FTS: ok (Links: 47/23 ok, 1/0 warning, 0/0 error, 0/0 unknown, 0/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
43%SAM: ok (15min evaluations: 78 ok, 9 warning, 9 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (259 Success ...),
FTS: ok (Links: 50/23 ok, 2/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
35%SAM: ok (15min evaluations: 83 ok, 5 warning, 4 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (92 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 47/24 ok, 1/0 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; gridftp.hepgrid.uerj.br: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_CH_CERN
GGUS Tickets:
Downtimes: Pce509.cern.ch/CE, ce510.cern.ch/CE
SAM Status: 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 99%127 Success [crab3@vocms0119.cern.ch#58942549.0#1602631558 201013_083443:sciaba_crab_HC-94-T2_CH_CERN-93187-20201013102502 178 0]...
1 Failed, ExitCode 8021 [crab3@vocms0155.cern.ch#60684454.0#1602692664 201014_085304:sciaba_crab_HC-94-T2_CH_CERN-93199-20201014103302 90 0]...
100%174 Success [crab3@vocms0155.cern.ch#60704821.0#1602720271 201014_085304:sciaba_crab_HC-94-T2_CH_CERN-93199-20201014103302 182 0]... 100%199 Success [crab3@vocms0119.cern.ch#59020482.0#1602805606 201015_081035:sciaba_crab_HC-94-T2_CH_CERN-93218-20201015095902 187 0]... 100%178 Success [crab3@vocms0155.cern.ch#60784412.0#1602906568 201017_034327:sciaba_crab_HC-94-T2_CH_CERN-93230-20201016112502 1 0]... 99%196 Success [crab3@vocms0122.cern.ch#62742200.0#1602978165 201017_072118:sciaba_crab_HC-94-T2_CH_CERN-93240-20201017090502 196 0]...
1 Failed, Removed due to memory use [crab3@vocms0122.cern.ch#62742286.0#1602981168 201017_072118:sciaba_crab_HC-94-T2_CH_CERN-93240-20201017090502 206 0]...
99%189 Success [crab3@vocms0144.cern.ch#60270359.0#1603064359 201018_084838:sciaba_crab_HC-94-T2_CH_CERN-93253-20201018103501 105 0]...
1 Failed, Removed due to memory use [crab3@vocms0144.cern.ch#60277333.0#1603084162 201018_084838:sciaba_crab_HC-94-T2_CH_CERN-93253-20201018103501 171 0]...
98%2 Failed, Removed due to memory use [crab3@vocms0155.cern.ch#60906105.0#1603150691 201019_082208:sciaba_crab_HC-94-T2_CH_CERN-93262-20201019100501 183 0]...
187 Success [crab3@vocms0155.cern.ch#60906649.0#1603152191 201019_082208:sciaba_crab_HC-94-T2_CH_CERN-93262-20201019100501 188 0]...
98%233 Success [crab3@vocms0195.cern.ch#56690469.0#1603237112 201020_101221:sciaba_crab_HC-94-T2_CH_CERN-93276-20201020120502 161 0]...
4 Failed, Removed due to memory use [crab3@vocms0195.cern.ch#56697076.0#1603251518 201020_101221:sciaba_crab_HC-94-T2_CH_CERN-93276-20201020120502 209 0]...
98%194 Success [crab3@vocms0122.cern.ch#62784770.0#1603322409 201021_084912:sciaba_crab_HC-94-T2_CH_CERN-93285-20201021104102 174 0]...
2 Failed, Removed due to memory use [crab3@vocms0122.cern.ch#62792329.0#1603349267 201022_025201:sciaba_crab_HC-94-T2_CH_CERN-93285-20201021104102 47 0]...
1 Failed, ExitCode 8021 [crab3@vocms0199.cern.ch#17761169.0#1603393407 201022_075212:sciaba_crab_HC-94-T2_CH_CERN-93303-20201022093902 134 0]...
99%209 Success [crab3@vocms0199.cern.ch#17769703.0#1603409012 201022_075212:sciaba_crab_HC-94-T2_CH_CERN-93303-20201022093902 186 0]...
1 Failed, Removed due to memory use [crab3@vocms0144.cern.ch#60514076.0#1603450410 201023_083712:sciaba_crab_HC-94-T2_CH_CERN-93313-20201023102702 27 0]...
1 Failed, ExitCode 8021 [crab3@vocms0144.cern.ch#60514637.0#1603452810 201023_083712:sciaba_crab_HC-94-T2_CH_CERN-93313-20201023102702 35 0]...
99%198 Success [crab3@vocms0197.cern.ch#57317249.0#1603507855 201024_024506:sciaba_crab_HC-94-T2_CH_CERN-93313-20201023102702 1 0]...
1 Success, no Chirp ExitCode [crab3@vocms0106.cern.ch#47992163.0#1603541643 201024_091249:sciaba_crab_HC-94-T2_CH_CERN-93328-20201024105702 36 0]...
1 Failed, Removed due to memory use [crab3@vocms0106.cern.ch#47992513.0#1603542842 201024_091249:sciaba_crab_HC-94-T2_CH_CERN-93328-20201024105702 40 0]...
97%236 Success [crab3@vocms0106.cern.ch#48011346.0#1603582152 201024_091249:sciaba_crab_HC-94-T2_CH_CERN-93328-20201024105702 171 0]...
5 Failed, Removed due to memory use [crab3@vocms0106.cern.ch#48011742.0#1603592353 201024_091249:sciaba_crab_HC-94-T2_CH_CERN-93328-20201024105702 205 0]...
97%209 Success [crab3@vocms0196.cern.ch#57213799.0#1603668334 201025_075919:sciaba_crab_HC-94-T2_CH_CERN-93334-20201025084902 185 0]...
6 Failed, Removed due to memory use [crab3@vocms0196.cern.ch#57214215.0#1603674634 201025_075919:sciaba_crab_HC-94-T2_CH_CERN-93334-20201025084902 206 0]...
98%208 Success [crab3@vocms0119.cern.ch#59513205.0#1603754918 201026_094512:sciaba_crab_HC-94-T2_CH_CERN-93349-20201026102902 143 0]...
3 Failed, Removed due to memory use [crab3@vocms0119.cern.ch#59518211.0#1603766027 201026_094512:sciaba_crab_HC-94-T2_CH_CERN-93349-20201026102902 180 0]...
98%228 Success [crab3@vocms0106.cern.ch#48141002.0#1603841631 201027_082220:sciaba_crab_HC-94-T2_CH_CERN-93356-20201027092102 182 0]...
2 Success, no Chirp ExitCode [crab3@vocms0122.cern.ch#62987346.0#1603889678 201028_100310:sciaba_crab_HC-94-T2_CH_CERN-93371-20201028105102 34 0]...
3 Failed, Removed due to memory use [crab3@vocms0122.cern.ch#62987387.0#1603892377 201028_100310:sciaba_crab_HC-94-T2_CH_CERN-93371-20201028105102 43 0]...
99%218 Success [crab3@vocms0122.cern.ch#63006413.0#1603926886 201028_100310:sciaba_crab_HC-94-T2_CH_CERN-93371-20201028105102 158 0]...
4 Success, no Chirp ExitCode [crab3@vocms0122.cern.ch#63008844.0#1603938286 201028_100310:sciaba_crab_HC-94-T2_CH_CERN-93371-20201028105102 196 0]...
2 Failed, Removed due to memory use [crab3@vocms0195.cern.ch#56958113.0#1603946664 201029_040326:sciaba_crab_HC-94-T2_CH_CERN-93371-20201028105102 8 0]...
FTS Status: 97%Transfer (from/to): 51689/166660 files, 149.231/23.684 TB ok
Errors: src_missing_file: 21/0, src_error: 123/0, trn_timeout: 562/1193, trn_error: 950/1699, dst_permission: 0/1, dst_space: 0/5785, dst_error: 0/65 foreign: 292/963
Links: 62/59 ok, 1/0 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 52288/138087 files, 55.036/147.297 TB ok
Errors: src_missing_file: 9/0, trn_timeout: 36/26, trn_user: 0/1, trn_error: 443/135, dst_permission: 0/87, dst_path: 0/3, dst_space: 0/6, dst_error: 0/2 foreign: 302/431
Links: 63/59 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 101295/137893 files, 111.869/246.791 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 598/63, trn_user: 0/1, trn_error: 453/476, dst_permission: 0/1888, dst_space: 0/10864, dst_error: 0/1 foreign: 348/714
Links: 62/58 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
96%Transfer (from/to): 89016/133663 files, 105.690/123.662 TB ok
Errors: src_missing_file: 5/0, trn_timeout: 444/28, trn_user: 0/1, trn_error: 46/145, dst_space: 0/20037 foreign: 80/2378
Links: 61/57 ok, 1/0 warning, 0/2 error, 0/1 unknown, 1/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
99%Transfer (from/to): 37708/13338 files, 34.958/17.125 TB ok
Errors: src_missing_file: 9/0, trn_timeout: 613/2, trn_error: 175/13, dst_space: 0/8 foreign: 141/166
Links: 60/58 ok, 1/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 56360/72444 files, 39.677/6.445 TB ok
Errors: src_missing_file: 61/0, trn_timeout: 258/36, trn_error: 713/36, dst_space: 0/939 foreign: 547/336
Links: 58/58 ok, 2/1 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
97%Transfer (from/to): 69515/49627 files, 48.015/15.520 TB ok
Errors: src_missing_file: 54/0, trn_timeout: 631/113, trn_user: 0/1, trn_error: 2163/21, dst_space: 0/2697 foreign: 1169/316
Links: 62/56 ok, 1/0 warning, 0/2 error, 0/1 unknown, 1/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
94%Transfer (from/to): 28786/35385 files, 26.211/21.892 TB ok
Errors: src_missing_file: 47/0, trn_timeout: 326/11, trn_user: 0/970, trn_error: 20/32, dst_space: 0/3497, dst_error: 0/1 foreign: 1399/8294
Links: 62/54 ok, 0/1 warning, 1/3 error, 0/1 unknown, 2/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 69344/86467 files, 36.186/31.433 TB ok
Errors: src_missing_file: 27/0, trn_timeout: 592/73, trn_user: 0/358, trn_error: 309/496, dst_space: 0/358, dst_error: 0/1 foreign: 1807/4692
Links: 62/57 ok, 3/1 warning, 0/0 error, 0/1 unknown, 4/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
97%Transfer (from/to): 36221/84491 files, 18.290/50.775 TB ok
Errors: src_missing_file: 41/0, trn_timeout: 475/35, trn_user: 0/1, trn_error: 117/274, dst_space: 0/12786 foreign: 716/629
Links: 61/54 ok, 2/1 warning, 1/2 error, 0/1 unknown, 3/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 22355/30961 files, 12.198/7.265 TB ok
Errors: src_missing_file: 79/0, trn_timeout: 430/4, trn_user: 0/1, trn_error: 161/221, dst_space: 0/1034 foreign: 676/303
Links: 63/56 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 43907/25058 files, 17.940/16.238 TB ok
Errors: src_missing_file: 27/0, trn_timeout: 561/9, trn_error: 1714/230, dst_permission: 0/1, dst_space: 0/491 foreign: 938/315
Links: 60/56 ok, 2/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
91%Transfer (from/to): 27652/67528 files, 31.932/13.154 TB ok
Errors: src_missing_file: 52/0, trn_timeout: 457/59, trn_error: 1300/499, dst_space: 0/90965 foreign: 530/3234
Links: 61/48 ok, 2/1 warning, 1/9 error, 0/1 unknown, 1/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
96%Transfer (from/to): 66117/80865 files, 54.013/39.706 TB ok
Errors: src_missing_file: 23/0, src_error: 21/0, trn_timeout: 534/75, trn_user: 4/231, trn_error: 1328/226, dst_space: 0/11028, dst_error: 0/1 foreign: 103975/3561
Links: 60/55 ok, 1/0 warning, 1/4 error, 0/2 unknown, 2/1 bad-endpoint
eoscmsftp.cern.ch: ok/ok
96%Transfer (from/to): 67151/66483 files, 36.358/47.786 TB ok
Errors: src_permission: 453/0, src_missing_file: 27/0, trn_timeout: 731/9, trn_user: 88/0, trn_error: 4323/993, dst_space: 0/3745 foreign: 33901/1109
Links: 60/58 ok, 0/0 warning, 2/0 error, 0/3 unknown, 2/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
98%Transfer (from/to): 37642/63352 files, 42.584/16.608 TB ok
Errors: src_missing_file: 27/0, trn_timeout: 1282/0, trn_user: 2/32, trn_error: 683/491, dst_permission: 0/1, dst_space: 0/13172 foreign: 1218/830
Links: 62/55 ok, 1/0 warning, 0/3 error, 0/1 unknown, 2/0 bad-endpoint
eoscmsftp.cern.ch: ok/ok
Site Readiness:
60%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (127 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 62/59 ok, 1/0 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
67%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (174 Success ...),
FTS: ok (Links: 63/59 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
80%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (199 Success ...),
FTS: ok (Links: 62/58 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
71%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (178 Success ...),
FTS: ok (Links: 61/57 ok, 1/0 warning, 0/2 error, 0/1 unknown, 1/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
72%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (196 Success ...; 1 Failed, Removed due to memory use ...),
FTS: ok (Links: 60/58 ok, 1/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
76%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (189 Success ...; 1 Failed, Removed due to memory use ...),
FTS: ok (Links: 58/58 ok, 2/1 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
74%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (2 Failed, Removed due to memory use ...; 187 Success ...),
FTS: ok (Links: 62/56 ok, 1/0 warning, 0/2 error, 0/1 unknown, 1/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
88%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (233 Success ...; 4 Failed, Removed due to memory use ...),
FTS: ok (Links: 62/54 ok, 0/1 warning, 1/3 error, 0/1 unknown, 2/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
75%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (194 Success ...; 2 Failed, Removed due to memory use ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 62/57 ok, 3/1 warning, 0/0 error, 0/1 unknown, 4/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
80%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (209 Success ...; 1 Failed, Removed due to memory use ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 61/54 ok, 2/1 warning, 1/2 error, 0/1 unknown, 3/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
76%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (198 Success ...; 1 Success, no Chirp ExitCode ...; 1 Failed, Removed due to memory use ...),
FTS: ok (Links: 63/56 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
87%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (236 Success ...; 5 Failed, Removed due to memory use ...),
FTS: ok (Links: 60/56 ok, 2/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
79%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (209 Success ...; 6 Failed, Removed due to memory use ...),
FTS: ok (Links: 61/48 ok, 2/1 warning, 1/9 error, 0/1 unknown, 1/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
83%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (208 Success ...; 3 Failed, Removed due to memory use ...),
FTS: ok (Links: 60/55 ok, 1/0 warning, 1/4 error, 0/2 unknown, 2/1 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
87%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (228 Success ...; 2 Success, no Chirp ExitCode ...; 3 Failed, Removed due to memory use ...),
FTS: ok (Links: 60/58 ok, 0/0 warning, 2/0 error, 0/3 unknown, 2/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
87%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (218 Success ...; 4 Success, no Chirp ExitCode ...; 2 Failed, Removed due to memory use ...),
FTS: ok (Links: 62/55 ok, 1/0 warning, 0/3 error, 0/1 unknown, 2/0 bad-endpoint; eoscmsftp.cern.ch: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_CH_CERN_HLT
GGUS Tickets:
Downtimes:
Site Readiness:
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_CH_CSCS
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 90 ok, 0 warning, 0 error, 6 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 86 ok, 0 warning, 0 error, 10 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 93%15min evaluations: 54 ok, 0 warning, 4 error, 38 unknown, 0 downtime (0h0m) 100%15min evaluations: 85 ok, 0 warning, 0 error, 11 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 97%15min evaluations: 92 ok, 0 warning, 2 error, 2 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%178 Success [crab3@vocms0137.cern.ch#56318247.0#1602632630 201013_103725:sciaba_crab_HC-98-T2_CH_CSCS-93179-20201012183702 157 0]... 100%198 Success [crab3@vocms0195.cern.ch#56475854.0#1602718238 201014_121419:sciaba_crab_HC-98-T2_CH_CSCS-93200-20201014140301 135 0]... 100%214 Success [crab3@vocms0107.cern.ch#59850604.0#1602804840 201015_063744:sciaba_crab_HC-98-T2_CH_CSCS-93200-20201014140301 203 0]... 100%227 Success [crab3@vocms0137.cern.ch#56451988.0#1602906412 201017_034109:sciaba_crab_HC-98-T2_CH_CSCS-93232-20201016113902 1 0]... 100%267 Success [crab3@vocms0137.cern.ch#56466419.0#1602977801 201017_214536:sciaba_crab_HC-98-T2_CH_CSCS-93232-20201016113902 22 0]... 100%208 Success [crab3@vocms0107.cern.ch#59936496.0#1603064416 201018_112929:sciaba_crab_HC-98-T2_CH_CSCS-93255-20201018132902 146 0]... 100%160 Success [crab3@vocms0119.cern.ch#59177549.0#1603150038 201019_053113:sciaba_crab_HC-98-T2_CH_CSCS-93255-20201018132902 215 0]... 100%215 Success [crab3@vocms0137.cern.ch#56605002.0#1603236374 201020_122500:sciaba_crab_HC-98-T2_CH_CSCS-93278-20201020141902 132 0]...
2 Success, no Chirp ExitCode [crab3@vocms0197.cern.ch#57227826.0#1603270302 201021_062103:sciaba_crab_HC-98-T2_CH_CSCS-93278-20201020141902 30 0]...
100%214 Success [crab3@vocms0197.cern.ch#57249682.0#1603322812 201021_062103:sciaba_crab_HC-98-T2_CH_CSCS-93278-20201020141902 205 0]... 100%205 Success [crab3@vocms0137.cern.ch#56702880.0#1603409413 201022_075846:sciaba_crab_HC-98-T2_CH_CSCS-93306-20201022095702 186 0]...
1 Success, no Chirp ExitCode [crab3@vocms0107.cern.ch#60016851.0#1603446604 201023_015415:sciaba_crab_HC-98-T2_CH_CSCS-93306-20201022095702 95 0]...
100%157 Success [crab3@vocms0107.cern.ch#60055826.0#1603520619 201024_061727:sciaba_crab_HC-98-T2_CH_CSCS-93324-20201024080702 1 0]... 100%268 Success [crab3@vocms0107.cern.ch#60081824.0#1603582134 201024_061727:sciaba_crab_HC-98-T2_CH_CSCS-93324-20201024080702 206 0]...
1 Success, no Chirp ExitCode [crab3@vocms0106.cern.ch#48033228.0#1603662152 201025_181609:sciaba_crab_HC-98-T2_CH_CSCS-93324-20201024080702 41 0]...
100%252 Success [crab3@vocms0106.cern.ch#48034307.0#1603668452 201025_181609:sciaba_crab_HC-98-T2_CH_CSCS-93324-20201024080702 62 0]...
3 Success, no Chirp ExitCode [crab3@vocms0120.cern.ch#58882070.0#1603740130 201026_034105:sciaba_crab_HC-98-T2_CH_CSCS-93343-20201026042702 188 0]...
100%247 Success [crab3@vocms0199.cern.ch#17894770.0#1603755446 201026_213635:sciaba_crab_HC-98-T2_CH_CSCS-93343-20201026042702 24 0]... 100%236 Success [crab3@vocms0194.cern.ch#57880079.0#1603842944 201027_154439:sciaba_crab_HC-98-T2_CH_CSCS-93343-20201026042702 98 0]... 100%254 Success [crab3@vocms0195.cern.ch#56952919.0#1603927731 201028_223731:sciaba_crab_HC-98-T2_CH_CSCS-93368-20201028053702 10 0]...
FTS Status: 96%Transfer (from/to): 3204/612 files, 1.193/1.159 TB ok
Errors: trn_timeout: 0/23, trn_error: 194/3, dst_permission: 0/1, dst_space: 0/1 foreign: 54/80
Links: 54/51 ok, 0/0 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
95%Transfer (from/to): 10665/1814 files, 2.247/0.803 TB ok
Errors: trn_timeout: 1/22, trn_error: 139/12, dst_permission: 0/9 foreign: 40/140
Links: 58/47 ok, 0/4 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
96%Transfer (from/to): 10081/527 files, 6.364/0.998 TB ok
Errors: trn_timeout: 3/23, trn_error: 9/1 foreign: 109/100
Links: 55/50 ok, 0/0 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
96%Transfer (from/to): 11421/784 files, 7.532/1.640 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 10/36, trn_error: 55/2 foreign: 27/114
Links: 55/51 ok, 0/0 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
96%Transfer (from/to): 1447/565 files, 1.282/1.181 TB ok
Errors: trn_timeout: 1/30, trn_error: 6/9 foreign: 39/246
Links: 51/51 ok, 1/0 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
95%Transfer (from/to): 19114/10031 files, 17.638/6.615 TB ok
Errors: src_missing_file: 223/0, src_error: 1/0, trn_timeout: 87/23, trn_error: 365/70, dst_permission: 0/1 foreign: 121/186
Links: 52/50 ok, 2/2 warning, 1/2 error, 0/1 unknown, 3/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
94%Transfer (from/to): 13034/7067 files, 9.889/1.315 TB ok
Errors: src_permission: 2/0, src_missing_file: 2/0, trn_timeout: 13/38, trn_user: 0/1, trn_error: 46/12, dst_permission: 0/1 foreign: 62/262
Links: 54/50 ok, 1/1 warning, 0/3 error, 0/1 unknown, 2/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
95%Transfer (from/to): 4057/1152 files, 5.605/1.707 TB ok
Errors: src_error: 415/0, trn_timeout: 4/34, trn_error: 4/6, dst_permission: 0/1 foreign: 100/244
Links: 59/53 ok, 0/1 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
94%Transfer (from/to): 5771/10286 files, 5.198/7.943 TB ok
Errors: src_error: 40/0, trn_timeout: 10/35, trn_error: 4/72, dst_error: 0/46 foreign: 215/397
Links: 57/50 ok, 0/0 warning, 0/3 error, 0/1 unknown, 3/1 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
98%Transfer (from/to): 7722/1498 files, 2.928/5.059 TB ok
Errors: src_permission: 1/0, trn_timeout: 2/27, trn_error: 9/23, dst_permission: 0/2 foreign: 277/258
Links: 55/51 ok, 3/2 warning, 0/1 error, 0/1 unknown, 3/1 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
96%Transfer (from/to): 4908/770 files, 1.577/3.480 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 2/28, trn_user: 0/1, trn_error: 19/19 foreign: 204/74
Links: 56/47 ok, 1/0 warning, 0/2 error, 0/1 unknown, 3/1 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
95%Transfer (from/to): 6583/1266 files, 1.391/8.316 TB ok
Errors: trn_timeout: 1/26, trn_error: 131/18 foreign: 160/87
Links: 53/49 ok, 1/0 warning, 1/3 error, 0/1 unknown, 2/1 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
94%Transfer (from/to): 3564/1381 files, 1.349/6.768 TB ok
Errors: trn_timeout: 3/24, trn_error: 9/22, dst_path: 0/1 foreign: 85/57
Links: 56/48 ok, 1/1 warning, 0/2 error, 0/1 unknown, 1/1 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
98%Transfer (from/to): 3188/4168 files, 2.978/5.929 TB ok
Errors: src_error: 10/0, trn_timeout: 1/27, trn_user: 1/0, trn_error: 12/11 foreign: 1802/119
Links: 53/50 ok, 0/0 warning, 0/1 error, 0/2 unknown, 2/1 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
94%Transfer (from/to): 4176/5487 files, 4.579/1.944 TB ok
Errors: trn_timeout: 8/29, trn_error: 281/13, dst_path: 0/1 foreign: 119/130
Links: 50/48 ok, 1/0 warning, 1/3 error, 0/2 unknown, 2/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
95%Transfer (from/to): 5848/9221 files, 2.796/6.212 TB ok
Errors: trn_timeout: 2/24, trn_error: 28/18 foreign: 253/90
Links: 52/50 ok, 2/1 warning, 0/2 error, 0/2 unknown, 2/0 bad-endpoint
storage01.lcg.cscs.ch: ok/ok
Site Readiness:
75%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (178 Success ...),
FTS: ok (Links: 54/51 ok, 0/0 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
55%SAM: ok (15min evaluations: 90 ok, 0 warning, 0 error, 6 unknown, 0 downtime (0h0m)),
HC: ok (198 Success ...),
FTS: ok (Links: 58/47 ok, 0/4 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
67%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (214 Success ...),
FTS: ok (Links: 55/50 ok, 0/0 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
74%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (227 Success ...),
FTS: ok (Links: 55/51 ok, 0/0 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
62%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (267 Success ...),
FTS: ok (Links: 51/51 ok, 1/0 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
79%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (208 Success ...),
FTS: ok (Links: 52/50 ok, 2/2 warning, 1/2 error, 0/1 unknown, 3/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
66%SAM: ok (15min evaluations: 86 ok, 0 warning, 0 error, 10 unknown, 0 downtime (0h0m)),
HC: ok (160 Success ...),
FTS: ok (Links: 54/50 ok, 1/1 warning, 0/3 error, 0/1 unknown, 2/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
88%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (215 Success ...; 2 Success, no Chirp ExitCode ...),
FTS: ok (Links: 59/53 ok, 0/1 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
86%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (214 Success ...),
FTS: ok (Links: 57/50 ok, 0/0 warning, 0/3 error, 0/1 unknown, 3/1 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
75%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (205 Success ...; 1 Success, no Chirp ExitCode ...),
FTS: ok (Links: 55/51 ok, 3/2 warning, 0/1 error, 0/1 unknown, 3/1 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
61%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (157 Success ...),
FTS: ok (Links: 56/47 ok, 1/0 warning, 0/2 error, 0/1 unknown, 3/1 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
96%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (268 Success ...; 1 Success, no Chirp ExitCode ...),
FTS: ok (Links: 53/49 ok, 1/0 warning, 1/3 error, 0/1 unknown, 2/1 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
38%SAM: ok (15min evaluations: 54 ok, 0 warning, 4 error, 38 unknown, 0 downtime (0h0m)),
HC: ok (252 Success ...; 3 Success, no Chirp ExitCode ...),
FTS: ok (Links: 56/48 ok, 1/1 warning, 0/2 error, 0/1 unknown, 1/1 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
68%SAM: ok (15min evaluations: 85 ok, 0 warning, 0 error, 11 unknown, 0 downtime (0h0m)),
HC: ok (247 Success ...),
FTS: ok (Links: 53/50 ok, 0/0 warning, 0/1 error, 0/2 unknown, 2/1 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
87%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (236 Success ...),
FTS: ok (Links: 50/48 ok, 1/0 warning, 1/3 error, 0/2 unknown, 2/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
91%SAM: ok (15min evaluations: 92 ok, 0 warning, 2 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (254 Success ...),
FTS: ok (Links: 52/50 ok, 2/1 warning, 0/2 error, 0/2 unknown, 2/0 bad-endpoint; storage01.lcg.cscs.ch: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_CN_Beijing
GGUS Tickets: 148688, 148780, 148997 149126
Downtimes: Dsrm.ihep.ac.cn/SE, all CEs (condorce01.ihep.ac.cn)
SAM Status: 68%15min evaluations: 66 ok, 0 warning, 30 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 94 ok, 0 warning, 1 error, 1 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 1 downtime (15h0m) 96%15min evaluations: 84 ok, 0 warning, 3 error, 9 unknown, 0 downtime (0h0m) 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 76%15min evaluations: 72 ok, 0 warning, 22 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 92 ok, 0 warning, 2 error, 2 unknown, 0 downtime (0h0m) 95%15min evaluations: 90 ok, 0 warning, 4 error, 2 unknown, 0 downtime (0h0m)
Hammer Cloud: 99%447 Success [crab3@vocms0196.cern.ch#56701958.0#1602631712 201013_222552:sciaba_crab_HC-100-T2_CN_Beijing-93191-20201013222902 8 0]...
1 Failed, ExitCode 8021 [crab3@vocms0196.cern.ch#56709643.0#1602646684 201013_222552:sciaba_crab_HC-100-T2_CN_Beijing-93191-20201013222902 58 0]...
2 Failed, Removed due to wall clock limit [crab3@vocms0196.cern.ch#56717825.0#1602660172 201013_222552:sciaba_crab_HC-100-T2_CN_Beijing-93191-20201013222902 103 0]...
100%192 Success [crab3@vocms0155.cern.ch#60704498.0#1602718537 201014_182446:sciaba_crab_HC-100-T2_CN_Beijing-93203-20201014201302 62 0]... 100%421 Success [crab3@vocms0121.cern.ch#58857223.0#1602804579 201015_170350:sciaba_crab_HC-100-T2_CN_Beijing-93221-20201015184702 76 0]... 100%159 Success [crab3@vocms0197.cern.ch#57162802.0#1602926585 201017_091718:sciaba_crab_HC-100-T2_CN_Beijing-93234-20201016165102 1 0]... 100%269 Success [crab3@vocms0199.cern.ch#17626955.0#1602978715 201017_150538:sciaba_crab_HC-100-T2_CN_Beijing-93243-20201017165902 105 0]... 98%224 Success [crab3@vocms0107.cern.ch#59936480.0#1603063889 201018_135517:sciaba_crab_HC-100-T2_CN_Beijing-93257-20201018155302 115 0]...
2 Failed, ExitCode 8028 [crab3@vocms0107.cern.ch#59936522.0#1603065391 201018_135517:sciaba_crab_HC-100-T2_CN_Beijing-93257-20201018155302 120 0]...
2 Failed, Removed due to wall clock limit [crab3@vocms0107.cern.ch#59936528.0#1603065691 201018_135517:sciaba_crab_HC-100-T2_CN_Beijing-93257-20201018155302 121 0]...
96%151 Success [crab3@vocms0144.cern.ch#60325243.0#1603150167 201019_132332:sciaba_crab_HC-100-T2_CN_Beijing-93265-20201019150502 121 0]...
2 Failed, ExitCode 8028 [crab3@vocms0144.cern.ch#60327356.0#1603154669 201019_132332:sciaba_crab_HC-100-T2_CN_Beijing-93265-20201019150502 136 0]...
3 Failed, ExitCode 8021 [crab3@vocms0144.cern.ch#60326016.0#1603153168 201019_132332:sciaba_crab_HC-100-T2_CN_Beijing-93265-20201019150502 131 0]...
100%187 Success [crab3@vocms0155.cern.ch#60995497.0#1603236547 201020_105748:sciaba_crab_HC-100-T2_CN_Beijing-93277-20201020125702 150 0]... 100%198 Success [crab3@vocms0121.cern.ch#58990012.0#1603324454 201021_092320:sciaba_crab_HC-100-T2_CN_Beijing-93286-20201021111702 174 0]...
1 Success, no Chirp ExitCode [crab3@vocms0137.cern.ch#56683957.0#1603378567 201022_105951:sciaba_crab_HC-100-T2_CN_Beijing-93307-20201022125502 47 0]...
99%204 Success [crab3@vocms0137.cern.ch#56703157.0#1603409774 201022_105951:sciaba_crab_HC-100-T2_CN_Beijing-93307-20201022125502 151 0]...
1 Failed, ExitCode 8021 [crab3@vocms0137.cern.ch#56702543.0#1603407369 201022_105951:sciaba_crab_HC-100-T2_CN_Beijing-93307-20201022125502 143 0]...
1 Failed, ExitCode 8028 [crab3@vocms0137.cern.ch#56703718.0#1603412172 201022_105951:sciaba_crab_HC-100-T2_CN_Beijing-93307-20201022125502 159 0]...
100%172 Success [crab3@vocms0195.cern.ch#56826593.0#1603511665 201024_034326:sciaba_crab_HC-100-T2_CN_Beijing-93315-20201023113502 2 0]... 99%260 Success [crab3@vocms0197.cern.ch#57364257.0#1603582189 201024_095337:sciaba_crab_HC-100-T2_CN_Beijing-93329-20201024114302 163 0]...
1 Failed, ExitCode 8021 [crab3@vocms0107.cern.ch#60097314.0#1603647967 201025_112459:sciaba_crab_HC-100-T2_CN_Beijing-93337-20201025121702 76 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0107.cern.ch#60095809.0#1603646767 201025_112459:sciaba_crab_HC-100-T2_CN_Beijing-93337-20201025121702 72 0]...
55%187 Success [crab3@vocms0107.cern.ch#60101104.0#1603667773 201025_112459:sciaba_crab_HC-100-T2_CN_Beijing-93337-20201025121702 142 0]...
148 Failed, ExitCode 8028 [crab3@vocms0107.cern.ch#60101271.0#1603669574 201025_112459:sciaba_crab_HC-100-T2_CN_Beijing-93337-20201025121702 148 0]...
3 Failed, ExitCode 8021 [crab3@vocms0107.cern.ch#60101251.0#1603668674 201025_112459:sciaba_crab_HC-100-T2_CN_Beijing-93337-20201025121702 145 0]...
99%223 Success [crab3@vocms0122.cern.ch#62955069.0#1603754910 201026_102719:sciaba_crab_HC-100-T2_CN_Beijing-93350-20201026112102 156 0]...
1 Failed, ExitCode 8021 [crab3@vocms0155.cern.ch#61246709.0#1603827743 201027_120555:sciaba_crab_HC-100-T2_CN_Beijing-93360-20201027125102 91 0]...
100%258 Success [crab3@vocms0155.cern.ch#61253670.0#1603841250 201027_120555:sciaba_crab_HC-100-T2_CN_Beijing-93360-20201027125102 136 0]... 100%236 Success [crab3@vocms0194.cern.ch#57912691.0#1603926105 201028_133027:sciaba_crab_HC-100-T2_CN_Beijing-93379-20201028141902 114 0]...
FTS Status: 82%Transfer (from/to): 8745/3709 files, 0.287/1.546 TB ok
Errors: src_error: 9/0, trn_timeout: 28/26, trn_error: 34/120, dst_error: 0/29 foreign: 208/5
Links: 37/43 ok, 1/4 warning, 7/3 error, 0/1 unknown, 2/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
82%Transfer (from/to): 424/242 files, 0.298/0.353 TB ok
Errors: trn_timeout: 22/60, trn_error: 28/13 foreign: 32/3
Links: 38/47 ok, 1/2 warning, 7/2 error, 0/1 unknown, 2/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
81%Transfer (from/to): 745/2200 files, 0.395/0.371 TB ok
Errors: trn_timeout: 37/37, trn_error: 38/85, dst_error: 0/604 foreign: 17/12
Links: 38/51 ok, 2/5 warning, 8/2 error, 0/1 unknown, 1/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
84%Transfer (from/to): 2573/949 files, 1.789/1.179 TB ok
Errors: trn_timeout: 51/10, trn_error: 41/14, dst_error: 0/70 foreign: 20/4
Links: 38/41 ok, 3/3 warning, 7/2 error, 0/1 unknown, 2/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
83%Transfer (from/to): 12300/12711 files, 0.367/0.424 TB ok
Errors: trn_timeout: 32/14, trn_error: 2127/205, dst_error: 0/613 foreign: 19/5
Links: 38/43 ok, 2/3 warning, 7/2 error, 0/1 unknown, 2/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
84%Transfer (from/to): 2215/20230 files, 0.407/0.403 TB ok
Errors: src_missing_file: 6/0, trn_timeout: 22/27, trn_error: 47/410, dst_space: 0/9, dst_error: 0/1368 foreign: 13/17
Links: 36/54 ok, 3/4 warning, 6/2 error, 0/1 unknown, 3/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
85%Transfer (from/to): 1012/1625 files, 0.361/1.174 TB ok
Errors: src_permission: 2/0, trn_timeout: 30/18, trn_error: 38/48 foreign: 14/6
Links: 37/39 ok, 4/6 warning, 6/2 error, 0/1 unknown, 2/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
80%Transfer (from/to): 168/7157 files, 0.358/0.410 TB ok
Errors: src_error: 13/0, trn_timeout: 35/60, trn_error: 37/109, dst_permission: 0/2, dst_error: 0/3417 foreign: 8/76
Links: 36/51 ok, 2/6 warning, 9/2 error, 0/1 unknown, 1/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
88%Transfer (from/to): 243/11891 files, 0.411/1.356 TB ok
Errors: src_error: 5/0, trn_timeout: 32/20, trn_user: 0/1, trn_error: 10/3243, dst_permission: 0/3, dst_error: 0/6196 foreign: 19/113
Links: 38/53 ok, 5/3 warning, 5/2 error, 0/1 unknown, 2/1 bad-endpoint
srm.ihep.ac.cn: ok/ok
87%Transfer (from/to): 5493/2778 files, 0.353/0.688 TB ok
Errors: src_permission: 2/0, trn_timeout: 33/3, trn_error: 4/95, dst_permission: 0/3, dst_error: 0/1574 foreign: 16/6
Links: 36/48 ok, 6/9 warning, 5/1 error, 0/1 unknown, 2/1 bad-endpoint
srm.ihep.ac.cn: ok/ok
86%Transfer (from/to): 206/1498 files, 0.485/0.580 TB ok
Errors: src_permission: 5/0, trn_timeout: 39/2, trn_error: 5/112, dst_error: 0/1023 foreign: 12/160
Links: 36/39 ok, 4/12 warning, 5/3 error, 1/1 unknown, 1/1 bad-endpoint
srm.ihep.ac.cn: ok/ok
88%Transfer (from/to): 239/120318 files, 0.463/1.547 TB ok
Errors: src_permission: 9/0, trn_timeout: 30/187, trn_error: 4/3760, dst_permission: 0/2, dst_error: 0/2938 foreign: 6/319
Links: 39/55 ok, 2/2 warning, 5/0 error, 1/1 unknown, 1/1 bad-endpoint
srm.ihep.ac.cn: ok/ok
88%Transfer (from/to): 246/2018 files, 0.415/3.252 TB ok
Errors: src_permission: 5/0, trn_timeout: 33/2, trn_error: 4/42, dst_error: 0/617 foreign: 6/6
Links: 37/53 ok, 4/6 warning, 5/0 error, 1/1 unknown, 1/1 bad-endpoint
srm.ihep.ac.cn: ok/ok
86%Transfer (from/to): 339/921 files, 0.419/1.673 TB ok
Errors: src_permission: 10/0, src_error: 37/0, trn_timeout: 35/1, trn_error: 9/8, dst_error: 0/67 foreign: 1752/6
Links: 39/46 ok, 4/3 warning, 5/0 error, 0/1 unknown, 1/1 bad-endpoint
srm.ihep.ac.cn: ok/ok
87%Transfer (from/to): 2459/4352 files, 0.522/1.445 TB ok
Errors: src_permission: 9/0, trn_timeout: 28/7, trn_error: 15/137, dst_permission: 0/1, dst_error: 0/1938 foreign: 22/40
Links: 37/49 ok, 4/8 warning, 5/2 error, 0/1 unknown, 1/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
91%Transfer (from/to): 23837/2214 files, 0.361/2.441 TB ok
Errors: trn_timeout: 68/4, trn_error: 7/132, dst_error: 0/15 foreign: 8/3
Links: 37/48 ok, 4/5 warning, 4/1 error, 1/1 unknown, 2/0 bad-endpoint
srm.ihep.ac.cn: ok/ok
Site Readiness:
40%SAM: error (15min evaluations: 66 ok, 0 warning, 30 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (447 Success ...; 1 Failed, ExitCode 8021 ...; 2 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 37/43 ok, 1/4 warning, 7/3 error, 0/1 unknown, 2/0 bad-endpoint; srm.ihep.ac.cn: ok/ok),
downtime: no scheduled downtime
34%SAM: ok (15min evaluations: 94 ok, 0 warning, 1 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (192 Success ...),
FTS: ok (Links: 38/47 ok, 1/2 warning, 7/2 error, 0/1 unknown, 2/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
41%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (421 Success ...),
FTS: ok (Links: 38/51 ok, 2/5 warning, 8/2 error, 0/1 unknown, 1/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
33%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (159 Success ...),
FTS: ok (Links: 38/41 ok, 3/3 warning, 7/2 error, 0/1 unknown, 2/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
59%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (269 Success ...),
FTS: ok (Links: 38/43 ok, 2/3 warning, 7/2 error, 0/1 unknown, 2/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
51%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 0 unknown, 1 downtime (15h0m)),
HC: ok (224 Success ...; 2 Failed, ExitCode 8028 ...; 2 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 36/54 ok, 3/4 warning, 6/2 error, 0/1 unknown, 3/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
47%SAM: ok (15min evaluations: 84 ok, 0 warning, 3 error, 9 unknown, 0 downtime (0h0m)),
HC: ok (151 Success ...; 2 Failed, ExitCode 8028 ...; 3 Failed, ExitCode 8021 ...),
FTS: ok (Links: 37/39 ok, 4/6 warning, 6/2 error, 0/1 unknown, 2/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
43%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (187 Success ...),
FTS: ok (Links: 36/51 ok, 2/6 warning, 9/2 error, 0/1 unknown, 1/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
55%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (198 Success ...; 1 Success, no Chirp ExitCode ...),
FTS: ok (Links: 38/53 ok, 5/3 warning, 5/2 error, 0/1 unknown, 2/1 bad-endpoint; srm.ihep.ac.cn: ok/ok)
49%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (204 Success ...; 1 Failed, ExitCode 8021 ...; 1 Failed, ExitCode 8028 ...),
FTS: ok (Links: 36/48 ok, 6/9 warning, 5/1 error, 0/1 unknown, 2/1 bad-endpoint; srm.ihep.ac.cn: ok/ok)
34%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (172 Success ...),
FTS: ok (Links: 36/39 ok, 4/12 warning, 5/3 error, 1/1 unknown, 1/1 bad-endpoint; srm.ihep.ac.cn: ok/ok)
58%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (260 Success ...; 1 Failed, ExitCode 8021 ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 39/55 ok, 2/2 warning, 5/0 error, 1/1 unknown, 1/1 bad-endpoint; srm.ihep.ac.cn: ok/ok)
44%SAM: error (15min evaluations: 72 ok, 0 warning, 22 error, 2 unknown, 0 downtime (0h0m)),
HC: error (187 Success ...; 148 Failed, ExitCode 8028 ...; 3 Failed, ExitCode 8021 ...),
FTS: ok (Links: 37/53 ok, 4/6 warning, 5/0 error, 1/1 unknown, 1/1 bad-endpoint; srm.ihep.ac.cn: ok/ok)
44%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (223 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 39/46 ok, 4/3 warning, 5/0 error, 0/1 unknown, 1/1 bad-endpoint; srm.ihep.ac.cn: ok/ok)
72%SAM: ok (15min evaluations: 92 ok, 0 warning, 2 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (258 Success ...),
FTS: ok (Links: 37/49 ok, 4/8 warning, 5/2 error, 0/1 unknown, 1/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
81%SAM: ok (15min evaluations: 90 ok, 0 warning, 4 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (236 Success ...),
FTS: ok (Links: 37/48 ok, 4/5 warning, 4/1 error, 1/1 unknown, 2/0 bad-endpoint; srm.ihep.ac.cn: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_DE_DESY
GGUS Tickets: 149071
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 98%15min evaluations: 59 ok, 0 warning, 1 error, 36 unknown, 0 downtime (0h0m) 98%15min evaluations: 92 ok, 0 warning, 1 error, 3 unknown, 0 downtime (0h0m) 74%15min evaluations: 26 ok, 0 warning, 9 error, 61 unknown, 0 downtime (0h0m) 100%15min evaluations: 65 ok, 0 warning, 0 error, 31 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 97%15min evaluations: 92 ok, 0 warning, 2 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 95%15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%254 Success [crab3@vocms0106.cern.ch#47669529.0#1602632592 201013_105704:sciaba_crab_HC-98-T2_DE_DESY-93179-20201012183702 153 0]... 100%233 Success [crab3@vocms0199.cern.ch#17543495.0#1602719109 201014_120415:sciaba_crab_HC-98-T2_DE_DESY-93200-20201014140301 140 0]... 100%226 Success [crab3@vocms0197.cern.ch#57130189.0#1602805328 201015_063053:sciaba_crab_HC-98-T2_DE_DESY-93200-20201014140301 206 0]... 100%210 Success [crab3@vocms0121.cern.ch#58894133.0#1602906571 201017_034333:sciaba_crab_HC-98-T2_DE_DESY-93232-20201016113902 1 0]... 100%242 Success [crab3@vocms0197.cern.ch#57178315.0#1602978374 201017_215004:sciaba_crab_HC-98-T2_DE_DESY-93232-20201016113902 23 0]... 100%245 Success [crab3@vocms0197.cern.ch#57205367.0#1603064872 201018_113641:sciaba_crab_HC-98-T2_DE_DESY-93255-20201018132902 146 0]... 100%193 Success [crab3@vocms0195.cern.ch#56623644.0#1603150639 201019_054612:sciaba_crab_HC-98-T2_DE_DESY-93255-20201018132902 214 0]...
2 Success, no Chirp ExitCode [crab3@vocms0195.cern.ch#56671458.0#1603206217 201020_122220:sciaba_crab_HC-98-T2_DE_DESY-93278-20201020141902 32 0]...
100%240 Success [crab3@vocms0195.cern.ch#56690488.0#1603237424 201020_122220:sciaba_crab_HC-98-T2_DE_DESY-93278-20201020141902 136 0]...
17 Success, no Chirp ExitCode [crab3@vocms0195.cern.ch#56692253.0#1603239528 201020_122220:sciaba_crab_HC-98-T2_DE_DESY-93278-20201020141902 143 0]...
100%1 Success, no Chirp ExitCode [crab3@vocms0195.cern.ch#56738651.0#1603322222 201021_062050:sciaba_crab_HC-98-T2_DE_DESY-93278-20201020141902 203 0]...
166 Success [crab3@vocms0195.cern.ch#56738882.0#1603323720 201021_062050:sciaba_crab_HC-98-T2_DE_DESY-93278-20201020141902 208 0]...
100%236 Success [crab3@vocms0106.cern.ch#47927600.0#1603408466 201022_075808:sciaba_crab_HC-98-T2_DE_DESY-93306-20201022095702 183 0]... 100%155 Success [crab3@vocms0199.cern.ch#17815704.0#1603521576 201024_061323:sciaba_crab_HC-98-T2_DE_DESY-93324-20201024080702 5 0]... 100%272 Success [crab3@vocms0199.cern.ch#17825568.0#1603582194 201024_061323:sciaba_crab_HC-98-T2_DE_DESY-93324-20201024080702 207 0]... 100%229 Success [crab3@vocms0197.cern.ch#57397331.0#1603668378 201025_181454:sciaba_crab_HC-98-T2_DE_DESY-93324-20201024080702 62 0]... 100%225 Success [crab3@vocms0119.cern.ch#59513207.0#1603754939 201026_214743:sciaba_crab_HC-98-T2_DE_DESY-93343-20201026042702 20 0]... 100%243 Success [crab3@vocms0144.cern.ch#60662666.0#1603839123 201027_155539:sciaba_crab_HC-98-T2_DE_DESY-93343-20201026042702 83 0]... 100%221 Success [crab3@vocms0155.cern.ch#61290148.0#1603928290 201028_224154:sciaba_crab_HC-98-T2_DE_DESY-93368-20201028053702 11 0]...
FTS Status: 88%Transfer (from/to): 9235/30545 files, 1.727/9.918 TB ok
Errors: src_missing_file: 94/0, src_error: 2/0, trn_timeout: 165/1, trn_user: 57/18, trn_error: 221/54, dst_permission: 0/18, dst_error: 0/2 foreign: 176/116
Links: 39/53 ok, 1/0 warning, 8/1 error, 0/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
95%Transfer (from/to): 13332/29961 files, 5.058/1.881 TB ok
Errors: src_missing_file: 63/0, trn_timeout: 78/0, trn_user: 43/14, trn_error: 55/15, dst_permission: 0/47 foreign: 128/38
Links: 52/54 ok, 0/1 warning, 3/0 error, 0/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
94%Transfer (from/to): 9624/51033 files, 17.630/0.901 TB ok
Errors: src_missing_file: 80/0, trn_timeout: 114/1, trn_user: 41/0, trn_error: 12/8, dst_permission: 0/2, dst_error: 0/3 foreign: 125/173
Links: 44/41 ok, 3/0 warning, 3/0 error, 1/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
92%Transfer (from/to): 10234/5074 files, 7.136/0.379 TB ok
Errors: src_missing_file: 87/0, src_error: 16/0, trn_timeout: 103/0, trn_user: 60/3, trn_error: 4/0, dst_permission: 0/2 foreign: 43/478
Links: 38/40 ok, 2/0 warning, 4/0 error, 0/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
87%Transfer (from/to): 4850/1421 files, 3.135/0.488 TB ok
Errors: src_missing_file: 74/0, trn_timeout: 79/0, trn_user: 65/2, trn_error: 16/0, dst_permission: 0/1 foreign: 52/323
Links: 37/27 ok, 1/0 warning, 7/0 error, 0/1 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
93%Transfer (from/to): 38576/23399 files, 6.632/6.025 TB ok
Errors: src_missing_file: 92/0, src_error: 1/0, trn_timeout: 108/5, trn_user: 60/1, trn_error: 112/2, dst_permission: 0/4 foreign: 696/310
Links: 48/41 ok, 3/0 warning, 5/0 error, 0/0 unknown, 2/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
90%Transfer (from/to): 31960/72776 files, 7.146/7.572 TB ok
Errors: src_permission: 2/0, src_missing_file: 88/0, trn_timeout: 184/19, trn_user: 70/1, trn_error: 99/22, dst_permission: 0/12, dst_error: 0/4 foreign: 56/357
Links: 40/51 ok, 5/0 warning, 6/1 error, 0/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
90%Transfer (from/to): 29774/64539 files, 12.042/7.939 TB ok
Errors: src_missing_file: 301/0, src_error: 2076/0, trn_timeout: 119/39, trn_user: 46/5, trn_error: 123/2762, dst_permission: 0/18, dst_error: 0/2 foreign: 617/453
Links: 45/49 ok, 1/0 warning, 5/3 error, 0/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
92%Transfer (from/to): 29774/76825 files, 6.353/10.176 TB ok
Errors: src_missing_file: 76/0, src_error: 798/0, trn_timeout: 112/22, trn_user: 50/7, trn_error: 240/1835, dst_permission: 0/12, dst_error: 0/1 foreign: 663/1728
Links: 47/55 ok, 3/0 warning, 4/2 error, 1/1 unknown, 3/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
93%Transfer (from/to): 40428/47122 files, 5.864/6.654 TB ok
Errors: src_missing_file: 95/0, trn_timeout: 89/13, trn_user: 47/3, trn_error: 7/36, dst_permission: 0/18 foreign: 487/304
Links: 45/50 ok, 3/1 warning, 3/0 error, 1/0 unknown, 2/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
99%Transfer (from/to): 7545/28441 files, 2.930/8.338 TB ok
Errors: src_missing_file: 81/0, trn_timeout: 67/5, trn_user: 57/5, trn_error: 0/3, dst_permission: 0/6 foreign: 273/60
Links: 47/48 ok, 0/0 warning, 1/0 error, 2/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
98%Transfer (from/to): 19017/28300 files, 2.204/14.860 TB ok
Errors: src_missing_file: 73/0, trn_timeout: 4/0, trn_user: 62/10, trn_error: 6/10 foreign: 240/245
Links: 45/51 ok, 1/0 warning, 1/0 error, 1/0 unknown, 2/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
98%Transfer (from/to): 12974/32801 files, 5.627/16.021 TB ok
Errors: src_missing_file: 73/0, trn_timeout: 11/3, trn_user: 71/8, trn_error: 1/144, dst_error: 0/3 foreign: 128/964
Links: 43/50 ok, 2/0 warning, 1/0 error, 2/0 unknown, 0/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
97%Transfer (from/to): 27770/70395 files, 4.742/9.080 TB ok
Errors: src_missing_file: 74/0, src_error: 681/0, trn_timeout: 15/3, trn_user: 92/14, trn_error: 12/105 foreign: 9688/1397
Links: 46/51 ok, 1/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
98%Transfer (from/to): 29262/88011 files, 6.810/3.699 TB ok
Errors: src_missing_file: 60/0, trn_timeout: 265/1, trn_user: 99/15, trn_error: 3091/62, dst_error: 0/1 foreign: 29823/2175
Links: 49/47 ok, 1/0 warning, 1/0 error, 1/2 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
98%Transfer (from/to): 15028/28182 files, 8.168/7.813 TB ok
Errors: src_missing_file: 23/0, trn_timeout: 17/1, trn_user: 74/3, trn_error: 1738/53, dst_error: 0/1 foreign: 640/1562
Links: 55/51 ok, 0/0 warning, 1/0 error, 1/0 unknown, 1/0 bad-endpoint
dcache-se-cms.desy.de: ok/ok
Site Readiness:
94%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (254 Success ...),
FTS: ok (Links: 39/53 ok, 1/0 warning, 8/1 error, 0/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
69%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (233 Success ...),
FTS: ok (Links: 52/54 ok, 0/1 warning, 3/0 error, 0/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
83%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (226 Success ...),
FTS: ok (Links: 44/41 ok, 3/0 warning, 3/0 error, 1/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
78%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (210 Success ...),
FTS: ok (Links: 38/40 ok, 2/0 warning, 4/0 error, 0/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
67%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (242 Success ...),
FTS: ok (Links: 37/27 ok, 1/0 warning, 7/0 error, 0/1 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
90%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (245 Success ...),
FTS: ok (Links: 48/41 ok, 3/0 warning, 5/0 error, 0/0 unknown, 2/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
76%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (193 Success ...; 2 Success, no Chirp ExitCode ...),
FTS: ok (Links: 40/51 ok, 5/0 warning, 6/1 error, 0/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
59%SAM: ok (15min evaluations: 59 ok, 0 warning, 1 error, 36 unknown, 0 downtime (0h0m)),
HC: ok (240 Success ...; 17 Success, no Chirp ExitCode ...),
FTS: ok (Links: 45/49 ok, 1/0 warning, 5/3 error, 0/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
71%SAM: ok (15min evaluations: 92 ok, 0 warning, 1 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (1 Success, no Chirp ExitCode ...; 166 Success ...),
FTS: ok (Links: 47/55 ok, 3/0 warning, 4/2 error, 1/1 unknown, 3/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
24%SAM: unknown (15min evaluations: 26 ok, 0 warning, 9 error, 61 unknown, 0 downtime (0h0m)),
HC: ok (236 Success ...),
FTS: ok (Links: 45/50 ok, 3/1 warning, 3/0 error, 1/0 unknown, 2/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
60%SAM: ok (15min evaluations: 65 ok, 0 warning, 0 error, 31 unknown, 0 downtime (0h0m)),
HC: ok (155 Success ...),
FTS: ok (Links: 47/48 ok, 0/0 warning, 1/0 error, 2/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
96%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (272 Success ...),
FTS: ok (Links: 45/51 ok, 1/0 warning, 1/0 error, 1/0 unknown, 2/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
84%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (229 Success ...),
FTS: ok (Links: 43/50 ok, 2/0 warning, 1/0 error, 2/0 unknown, 0/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
88%SAM: ok (15min evaluations: 92 ok, 0 warning, 2 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (225 Success ...),
FTS: ok (Links: 46/51 ok, 1/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
90%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (243 Success ...),
FTS: ok (Links: 49/47 ok, 1/0 warning, 1/0 error, 1/2 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
81%SAM: ok (15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (221 Success ...),
FTS: ok (Links: 55/51 ok, 0/0 warning, 1/0 error, 1/0 unknown, 1/0 bad-endpoint; dcache-se-cms.desy.de: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_DE_RWTH
GGUS Tickets:
Downtimes: Dgrid-srm.physik.rwth-aachen.de/SE, all CEs (grid-ce-1-rwth.gridka.de) Dgrid-srm.physik.rwth-aachen.de/SE, all CEs (grid-ce-1-rwth.gridka.de) Dgrid-srm.physik.rwth-aachen.de/SE, all CEs (grid-ce-1-rwth.gridka.de) Dgrid-srm.physik.rwth-aachen.de/SE, all CEs (grid-ce-1-rwth.gridka.de)
SAM Status: 90%15min evaluations: 70 ok, 0 warning, 7 error, 19 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 87 ok, 0 warning, 0 error, 9 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 91%15min evaluations: 26 ok, 0 warning, 2 error, 1 unknown, 67 downtime (18h0m) 0%15min evaluations: 0 ok, 0 warning, 32 error, 0 unknown, 64 downtime (16h0m) 0%15min evaluations: 0 ok, 0 warning, 66 error, 0 unknown, 30 downtime (0h0m)
Hammer Cloud: 100%264 Success [crab3@vocms0199.cern.ch#17520995.0#1602630753 201013_105634:sciaba_crab_HC-98-T2_DE_RWTH-93179-20201012183702 147 0]... 100%198 Success [crab3@vocms0199.cern.ch#17543459.0#1602717593 201014_120834:sciaba_crab_HC-98-T2_DE_RWTH-93200-20201014140301 134 0]... 100%171 Success [crab3@vocms0137.cern.ch#56410895.0#1602804270 201015_063229:sciaba_crab_HC-98-T2_DE_RWTH-93200-20201014140301 202 0]... 100%83 Success [crab3@vocms0196.cern.ch#56892747.0#1602943426 201017_134242:sciaba_crab_HC-98-T2_DE_RWTH-93232-20201016113902 4 0]... 100%268 Success [crab3@vocms0196.cern.ch#56904179.0#1602975233 201017_134242:sciaba_crab_HC-98-T2_DE_RWTH-93232-20201016113902 110 0]... 100%261 Success [crab3@vocms0120.cern.ch#58651095.0#1603061680 201018_113324:sciaba_crab_HC-98-T2_DE_RWTH-93255-20201018132902 136 0]... 100%179 Success [crab3@vocms0144.cern.ch#60324903.0#1603148196 201019_052516:sciaba_crab_HC-98-T2_DE_RWTH-93255-20201018132902 210 0]... 100%174 Success [crab3@vocms0155.cern.ch#60995727.0#1603237092 201020_122151:sciaba_crab_HC-98-T2_DE_RWTH-93278-20201020141902 135 0]... 100%130 Success [crab3@vocms0119.cern.ch#59319286.0#1603324474 201021_061813:sciaba_crab_HC-98-T2_DE_RWTH-93278-20201020141902 211 0]... 100%228 Success [crab3@vocms0155.cern.ch#61098739.0#1603407957 201022_075946:sciaba_crab_HC-98-T2_DE_RWTH-93306-20201022095702 181 0]... 100%146 Success [crab3@vocms0107.cern.ch#60055892.0#1603520797 201024_062046:sciaba_crab_HC-98-T2_DE_RWTH-93324-20201024080702 1 0]... 100%253 Success [crab3@vocms0107.cern.ch#60081893.0#1603582311 201024_062046:sciaba_crab_HC-98-T2_DE_RWTH-93324-20201024080702 206 0]... 100%233 Success [crab3@vocms0197.cern.ch#57396782.0#1603666880 201025_181959:sciaba_crab_HC-98-T2_DE_RWTH-93324-20201024080702 56 0]... 95%213 Success [crab3@vocms0120.cern.ch#58885169.0#1603755036 201026_213432:sciaba_crab_HC-98-T2_DE_RWTH-93343-20201026042702 23 0]...
9 Failed, ExitCode 8021 [crab3@vocms0120.cern.ch#58891323.0#1603782042 201026_213432:sciaba_crab_HC-98-T2_DE_RWTH-93343-20201026042702 113 0]...
93%199 Success [crab3@vocms0120.cern.ch#58948952.0#1603843652 201027_154111:sciaba_crab_HC-98-T2_DE_RWTH-93343-20201026042702 101 0]...
14 Failed, ExitCode 135 [crab3@vocms0144.cern.ch#60692595.0#1603909915 201028_044054:sciaba_crab_HC-98-T2_DE_RWTH-93368-20201028053702 166 0]...
97%221 Success [crab3@vocms0122.cern.ch#63006565.0#1603928333 201028_224530:sciaba_crab_HC-98-T2_DE_RWTH-93368-20201028053702 6 1]...
4 Failed, ExitCode 135 [crab3@vocms0122.cern.ch#63007023.0#1603930280 201028_224530:sciaba_crab_HC-98-T2_DE_RWTH-93368-20201028053702 17 0]...
1 Failed, Removed due to disk usage [crab3@vocms0122.cern.ch#63008602.0#1603936581 201028_224530:sciaba_crab_HC-98-T2_DE_RWTH-93368-20201028053702 38 0]...
FTS Status: 97%Transfer (from/to): 7242/1978 files, 0.739/0.820 TB ok
Errors: src_missing_file: 2/0, trn_timeout: 71/9, trn_error: 413/0 foreign: 77/14
Links: 43/37 ok, 0/0 warning, 1/0 error, 0/1 unknown, 3/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
98%Transfer (from/to): 15480/340 files, 4.373/0.564 TB ok
Errors: trn_timeout: 1/0, trn_error: 78/0, dst_error: 0/1 foreign: 56/12
Links: 40/37 ok, 0/0 warning, 1/0 error, 0/1 unknown, 3/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
100%Transfer (from/to): 11803/597 files, 6.983/0.598 TB ok
Errors: src_missing_file: 13/0, trn_error: 1/0 foreign: 50/15
Links: 44/42 ok, 0/0 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
100%Transfer (from/to): 4509/346 files, 3.307/0.714 TB ok
Errors: src_missing_file: 1/0, trn_error: 1/0 foreign: 13/14
Links: 39/32 ok, 0/0 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
100%Transfer (from/to): 1964/359 files, 1.180/0.814 TB ok
Errors: trn_error: 3/0, dst_error: 0/1 foreign: 32/14
Links: 41/25 ok, 0/0 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
98%Transfer (from/to): 5641/2049 files, 1.922/0.983 TB ok
Errors: src_missing_file: 31/0, trn_timeout: 15/0, trn_error: 74/0 foreign: 29/14
Links: 34/41 ok, 2/0 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
97%Transfer (from/to): 17218/312 files, 2.751/0.574 TB ok
Errors: src_permission: 2/0, src_missing_file: 76/0, trn_timeout: 20/0, trn_error: 224/0 foreign: 19/13
Links: 37/34 ok, 1/0 warning, 2/0 error, 0/1 unknown, 2/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
100%Transfer (from/to): 3726/766 files, 2.652/5.217 TB ok
Errors: src_missing_file: 94/0, src_error: 105/0, trn_timeout: 1/0, trn_error: 8/0 foreign: 55/0
Links: 43/43 ok, 0/0 warning, 1/0 error, 0/0 unknown, 3/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
99%Transfer (from/to): 5598/736 files, 0.893/5.579 TB ok
Errors: src_missing_file: 140/0, src_error: 78/0, trn_timeout: 2/0, trn_error: 21/0 foreign: 65/0
Links: 38/40 ok, 0/0 warning, 1/0 error, 1/0 unknown, 5/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
99%Transfer (from/to): 5041/623 files, 2.521/1.416 TB ok
Errors: src_missing_file: 97/0, trn_timeout: 2/0, trn_error: 4/0 foreign: 42/1
Links: 39/39 ok, 2/0 warning, 1/0 error, 0/0 unknown, 4/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
98%Transfer (from/to): 5512/499 files, 1.059/2.732 TB ok
Errors: src_missing_file: 75/0, trn_timeout: 2/12, trn_error: 25/1 foreign: 44/0
Links: 40/28 ok, 0/0 warning, 2/0 error, 0/0 unknown, 3/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
98%Transfer (from/to): 6592/515 files, 1.576/3.692 TB ok
Errors: src_missing_file: 90/0, trn_error: 22/3 foreign: 65/0
Links: 42/31 ok, 0/1 warning, 1/0 error, 0/0 unknown, 2/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
97%Transfer (from/to): 19788/366 files, 5.038/0.818 TB ok
Errors: src_missing_file: 45/0, trn_timeout: 1/0, trn_error: 10/4 foreign: 14/13
Links: 40/29 ok, 2/1 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: ok/ok
11%Transfer (from/to): 2849/120 files, 1.250/0.270 TB ok
Errors: src_missing_file: 45/0, src_error: 582/0, trn_user: 2/0, trn_error: 0/3843, dst_error: 0/213 foreign: 7/34
Links: 9/2 ok, 1/4 warning, 16/30 error, 0/1 unknown, 1/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: error/error
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: src_error: 1032/0, trn_error: 0/24567, dst_error: 0/300 foreign: 0/105
Links: 0/0 ok, 0/1 warning, 0/45 error, 28/1 unknown, 1/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: unknown/error
7%Transfer (from/to): 4768/854 files, 2.441/2.488 TB ok
Errors: src_missing_file: 28/0, src_error: 590/0, trn_timeout: 1/0, trn_error: 75/13835, dst_error: 0/178 foreign: 15/53
Links: 15/0 ok, 4/2 warning, 17/49 error, 3/1 unknown, 1/0 bad-endpoint
grid-srm.physik.rwth-aachen.de: warning/error
Site Readiness:
65%SAM: ok (15min evaluations: 70 ok, 0 warning, 7 error, 19 unknown, 0 downtime (0h0m)),
HC: ok (264 Success ...),
FTS: ok (Links: 43/37 ok, 0/0 warning, 1/0 error, 0/1 unknown, 3/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
55%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (198 Success ...),
FTS: ok (Links: 40/37 ok, 0/0 warning, 1/0 error, 0/1 unknown, 3/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
62%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (171 Success ...),
FTS: ok (Links: 44/42 ok, 0/0 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
19%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (83 Success ...),
FTS: ok (Links: 39/32 ok, 0/0 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
74%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (268 Success ...),
FTS: ok (Links: 41/25 ok, 0/0 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
80%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (261 Success ...),
FTS: ok (Links: 34/41 ok, 2/0 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
45%SAM: ok (15min evaluations: 87 ok, 0 warning, 0 error, 9 unknown, 0 downtime (0h0m)),
HC: ok (179 Success ...),
FTS: ok (Links: 37/34 ok, 1/0 warning, 2/0 error, 0/1 unknown, 2/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
70%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (174 Success ...),
FTS: ok (Links: 43/43 ok, 0/0 warning, 1/0 error, 0/0 unknown, 3/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
55%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (130 Success ...),
FTS: ok (Links: 38/40 ok, 0/0 warning, 1/0 error, 1/0 unknown, 5/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
64%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (228 Success ...),
FTS: ok (Links: 39/39 ok, 2/0 warning, 1/0 error, 0/0 unknown, 4/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
54%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (146 Success ...),
FTS: ok (Links: 40/28 ok, 0/0 warning, 2/0 error, 0/0 unknown, 3/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
78%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (253 Success ...),
FTS: ok (Links: 42/31 ok, 0/1 warning, 1/0 error, 0/0 unknown, 2/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
61%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (233 Success ...),
FTS: ok (Links: 40/29 ok, 2/1 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: ok/ok)
20%SAM: ok (15min evaluations: 26 ok, 0 warning, 2 error, 1 unknown, 67 downtime (18h0m)),
HC: ok (213 Success ...; 9 Failed, ExitCode 8021 ...),
FTS: error (Links: 9/2 ok, 1/4 warning, 16/30 error, 0/1 unknown, 1/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: error/error),
downtime: yes (18h 0min scheduled)
0%SAM: downtime (15min evaluations: 0 ok, 0 warning, 32 error, 0 unknown, 64 downtime (16h0m)),
HC: ok (199 Success ...; 14 Failed, ExitCode 135 ...),
FTS: error (Links: 0/0 ok, 0/1 warning, 0/45 error, 28/1 unknown, 1/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: unknown/error)
0%SAM: error (15min evaluations: 0 ok, 0 warning, 66 error, 0 unknown, 30 downtime (0h0m)),
HC: ok (221 Success ...; 4 Failed, ExitCode 135 ...; 1 Failed, Removed due to disk usage ...),
FTS: error (Links: 15/0 ok, 4/2 warning, 17/49 error, 3/1 unknown, 1/0 bad-endpoint; grid-srm.physik.rwth-aachen.de: warning/error),
downtime: no (7h 36min scheduled)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_EE_Estonia
GGUS Tickets: 149111
Downtimes:
SAM Status: 100%15min evaluations: 76 ok, 0 warning, 0 error, 20 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 84 ok, 0 warning, 0 error, 12 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m) 100%15min evaluations: 30 ok, 0 warning, 0 error, 66 unknown, 0 downtime (0h0m) 100%15min evaluations: 44 ok, 0 warning, 0 error, 52 unknown, 0 downtime (0h0m) 100%15min evaluations: 43 ok, 0 warning, 0 error, 53 unknown, 0 downtime (0h0m) 100%15min evaluations: 76 ok, 0 warning, 0 error, 20 unknown, 0 downtime (0h0m) 100%15min evaluations: 59 ok, 0 warning, 0 error, 37 unknown, 0 downtime (0h0m) 100%15min evaluations: 56 ok, 0 warning, 0 error, 40 unknown, 0 downtime (0h0m) 100%15min evaluations: 61 ok, 0 warning, 0 error, 35 unknown, 0 downtime (0h0m) 100%15min evaluations: 41 ok, 0 warning, 0 error, 55 unknown, 0 downtime (0h0m) 100%15min evaluations: 27 ok, 0 warning, 0 error, 69 unknown, 0 downtime (0h0m) 100%15min evaluations: 45 ok, 0 warning, 0 error, 51 unknown, 0 downtime (0h0m) 100%15min evaluations: 57 ok, 0 warning, 0 error, 39 unknown, 0 downtime (0h0m) 95%15min evaluations: 77 ok, 0 warning, 4 error, 15 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%219 Success [crab3@vocms0122.cern.ch#62568281.0#1602642973 201014_022100:sciaba_crab_HC-96-T2_EE_Estonia-93194-20201014032102 1 0]... 100%81 Success [crab3@vocms0121.cern.ch#58827077.0#1602766991 201015_125731:sciaba_crab_HC-96-T2_EE_Estonia-93205-20201015014703 1 0]... 100%231 Success [crab3@vocms0121.cern.ch#58855936.0#1602804201 201015_125731:sciaba_crab_HC-96-T2_EE_Estonia-93205-20201015014703 125 0]... 100%192 Success [crab3@vocms0106.cern.ch#47810226.0#1602902918 201017_024255:sciaba_crab_HC-96-T2_EE_Estonia-93238-20201017043502 1 0]... 100%186 Success [crab3@vocms0144.cern.ch#60253453.0#1602977560 201017_205158:sciaba_crab_HC-96-T2_EE_Estonia-93238-20201017043502 32 0]... 100%121 Success [crab3@vocms0155.cern.ch#60823845.0#1603080204 201019_034729:sciaba_crab_HC-96-T2_EE_Estonia-93260-20201019054303 3 0]... 100%155 Success [crab3@vocms0144.cern.ch#60325237.0#1603150127 201019_215236:sciaba_crab_HC-96-T2_EE_Estonia-93260-20201019054303 19 0]... 100%233 Success [crab3@vocms0194.cern.ch#57579724.0#1603236778 201020_210156:sciaba_crab_HC-96-T2_EE_Estonia-93270-20201020044303 30 0]... 100%186 Success [crab3@vocms0194.cern.ch#57620638.0#1603322806 201021_210101:sciaba_crab_HC-96-T2_EE_Estonia-93282-20201021044302 29 0]... 100%210 Success [crab3@vocms0122.cern.ch#62821951.0#1603409911 201022_225730:sciaba_crab_HC-96-T2_EE_Estonia-93302-20201022064302 8 0]... 100%179 Success [crab3@vocms0120.cern.ch#58803328.0#1603502399 201024_011403:sciaba_crab_HC-96-T2_EE_Estonia-93312-20201023090502 1 0]... 100%217 Success [crab3@vocms0194.cern.ch#57744213.0#1603582915 201024_063027:sciaba_crab_HC-96-T2_EE_Estonia-93325-20201024082102 206 0]... 100%221 Success [crab3@vocms0121.cern.ch#59139324.0#1603668748 201025_085117:sciaba_crab_HC-96-T2_EE_Estonia-93335-20201025094701 176 0]... 100%206 Success [crab3@vocms0155.cern.ch#61210043.0#1603755680 201026_111150:sciaba_crab_HC-96-T2_EE_Estonia-93351-20201026120702 118 0]... 99%232 Success [crab3@vocms0106.cern.ch#48142395.0#1603843043 201027_115618:sciaba_crab_HC-96-T2_EE_Estonia-93359-20201027123902 144 0]...
1 Failed, ExitCode 137 [crab3@vocms0199.cern.ch#17947056.0#1603917066 201028_105939:sciaba_crab_HC-96-T2_EE_Estonia-93372-20201028115302 114 0]...
100%225 Success [crab3@vocms0199.cern.ch#17949599.0#1603927570 201028_105939:sciaba_crab_HC-96-T2_EE_Estonia-93372-20201028115302 149 0]...
FTS Status: 93%Transfer (from/to): 6946/6496 files, 1.485/3.706 TB ok
Errors: src_error: 2/0, trn_timeout: 56/3, trn_error: 92/10, dst_permission: 0/63, dst_path: 0/2, dst_error: 0/94 foreign: 109/32
Links: 53/46 ok, 0/5 warning, 0/3 error, 0/1 unknown, 1/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
97%Transfer (from/to): 12090/685 files, 24.772/0.687 TB ok
Errors: src_error: 7/0, trn_timeout: 5/0, trn_error: 20/5, dst_permission: 0/39, dst_error: 0/27 foreign: 216/15
Links: 56/46 ok, 0/7 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
95%Transfer (from/to): 13149/488 files, 29.135/0.770 TB ok
Errors: src_error: 2/0, trn_timeout: 3/2, trn_error: 14/8, dst_permission: 0/5, dst_error: 0/21 foreign: 45/19
Links: 56/47 ok, 0/2 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
98%Transfer (from/to): 3607/2719 files, 6.776/0.842 TB ok
Errors: src_error: 3/0, trn_timeout: 3/5, trn_error: 1/11, dst_permission: 0/18, dst_path: 0/1, dst_error: 0/36 foreign: 15/24
Links: 54/54 ok, 1/0 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
98%Transfer (from/to): 757/4980 files, 0.733/0.966 TB ok
Errors: src_error: 3/0, trn_timeout: 3/0, trn_error: 3/10, dst_permission: 0/13, dst_path: 0/2, dst_error: 0/37 foreign: 29/42
Links: 54/53 ok, 1/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
94%Transfer (from/to): 9520/1325 files, 12.450/1.582 TB ok
Errors: src_missing_file: 28/0, trn_timeout: 52/3, trn_error: 64/9, dst_permission: 0/57, dst_path: 0/1, dst_error: 0/78 foreign: 29/29
Links: 53/50 ok, 2/2 warning, 0/2 error, 0/1 unknown, 4/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
95%Transfer (from/to): 13471/6498 files, 8.002/1.113 TB ok
Errors: src_permission: 2/0, src_missing_file: 21/0, src_error: 4/0, trn_timeout: 34/5, trn_error: 11/17, dst_error: 0/15 foreign: 43/39
Links: 55/52 ok, 3/1 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
91%Transfer (from/to): 9328/11381 files, 1.542/7.611 TB ok
Errors: src_missing_file: 8/0, trn_timeout: 19/6, trn_user: 316/0, trn_error: 1013/1325, dst_path: 0/1, dst_error: 0/26 foreign: 351/45
Links: 55/52 ok, 1/0 warning, 3/5 error, 0/1 unknown, 2/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
94%Transfer (from/to): 10765/3713 files, 1.282/5.815 TB ok
Errors: src_error: 1/0, trn_timeout: 4/5, trn_user: 113/0, trn_error: 932/254, dst_error: 0/11 foreign: 606/30
Links: 58/48 ok, 2/5 warning, 1/3 error, 0/1 unknown, 4/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
98%Transfer (from/to): 6620/680 files, 1.430/1.295 TB ok
Errors: src_missing_file: 17/0, src_error: 2/0, trn_timeout: 3/3, trn_error: 8/10, dst_error: 0/12 foreign: 141/29
Links: 57/51 ok, 2/1 warning, 0/0 error, 1/1 unknown, 4/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
97%Transfer (from/to): 6941/885 files, 1.558/10.164 TB ok
Errors: src_missing_file: 1/0, src_error: 2/0, trn_timeout: 5/3, trn_error: 20/9, dst_error: 0/18 foreign: 135/22
Links: 55/48 ok, 1/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
98%Transfer (from/to): 7290/1153 files, 1.595/11.203 TB ok
Errors: src_error: 2/0, trn_timeout: 1/0, trn_error: 5/12, dst_error: 0/23 foreign: 367/19
Links: 53/48 ok, 2/2 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
97%Transfer (from/to): 3341/5648 files, 2.567/8.954 TB ok
Errors: src_error: 2/0, trn_timeout: 3/3, trn_error: 4/13, dst_permission: 0/2, dst_error: 0/52 foreign: 176/18
Links: 53/47 ok, 2/3 warning, 0/0 error, 1/1 unknown, 1/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
99%Transfer (from/to): 5843/20372 files, 8.466/25.860 TB ok
Errors: src_permission: 25/0, trn_timeout: 9/117, trn_user: 19/0, trn_error: 12/148, dst_permission: 0/12, dst_error: 0/13 foreign: 7218/81
Links: 51/52 ok, 4/3 warning, 0/0 error, 0/2 unknown, 2/1 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
100%Transfer (from/to): 5778/699 files, 3.811/5.813 TB ok
Errors: src_error: 2/0, trn_timeout: 18/0, trn_user: 0/1, trn_error: 70/0, dst_error: 0/20 foreign: 244/120
Links: 50/47 ok, 4/2 warning, 0/0 error, 0/3 unknown, 2/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
95%Transfer (from/to): 11348/329 files, 3.756/0.808 TB ok
Errors: src_permission: 17/0, src_error: 3/0, trn_timeout: 2/0, trn_error: 60/6, dst_error: 0/4 foreign: 5212/58
Links: 51/42 ok, 1/1 warning, 0/1 error, 1/1 unknown, 2/0 bad-endpoint
ganymede.hep.kbfi.ee: ok/ok
Site Readiness:
64%SAM: ok (15min evaluations: 76 ok, 0 warning, 0 error, 20 unknown, 0 downtime (0h0m)),
HC: ok (219 Success ...),
FTS: ok (Links: 53/46 ok, 0/5 warning, 0/3 error, 0/1 unknown, 1/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
31%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (81 Success ...),
FTS: ok (Links: 56/46 ok, 0/7 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
61%SAM: ok (15min evaluations: 84 ok, 0 warning, 0 error, 12 unknown, 0 downtime (0h0m)),
HC: ok (231 Success ...),
FTS: ok (Links: 56/47 ok, 0/2 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
59%SAM: ok (15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (192 Success ...),
FTS: ok (Links: 54/54 ok, 1/0 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
18%SAM: unknown (15min evaluations: 30 ok, 0 warning, 0 error, 66 unknown, 0 downtime (0h0m)),
HC: ok (186 Success ...),
FTS: ok (Links: 54/53 ok, 1/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
30%SAM: unknown (15min evaluations: 44 ok, 0 warning, 0 error, 52 unknown, 0 downtime (0h0m)),
HC: ok (121 Success ...),
FTS: ok (Links: 53/50 ok, 2/2 warning, 0/2 error, 0/1 unknown, 4/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
33%SAM: unknown (15min evaluations: 43 ok, 0 warning, 0 error, 53 unknown, 0 downtime (0h0m)),
HC: ok (155 Success ...),
FTS: ok (Links: 55/52 ok, 3/1 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
76%SAM: ok (15min evaluations: 76 ok, 0 warning, 0 error, 20 unknown, 0 downtime (0h0m)),
HC: ok (233 Success ...),
FTS: ok (Links: 55/52 ok, 1/0 warning, 3/5 error, 0/1 unknown, 2/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
52%SAM: ok (15min evaluations: 59 ok, 0 warning, 0 error, 37 unknown, 0 downtime (0h0m)),
HC: ok (186 Success ...),
FTS: ok (Links: 58/48 ok, 2/5 warning, 1/3 error, 0/1 unknown, 4/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
49%SAM: ok (15min evaluations: 56 ok, 0 warning, 0 error, 40 unknown, 0 downtime (0h0m)),
HC: ok (210 Success ...),
FTS: ok (Links: 57/51 ok, 2/1 warning, 0/0 error, 1/1 unknown, 4/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
47%SAM: ok (15min evaluations: 61 ok, 0 warning, 0 error, 35 unknown, 0 downtime (0h0m)),
HC: ok (179 Success ...),
FTS: ok (Links: 55/48 ok, 1/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
38%SAM: unknown (15min evaluations: 41 ok, 0 warning, 0 error, 55 unknown, 0 downtime (0h0m)),
HC: ok (217 Success ...),
FTS: ok (Links: 53/48 ok, 2/2 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
14%SAM: unknown (15min evaluations: 27 ok, 0 warning, 0 error, 69 unknown, 0 downtime (0h0m)),
HC: ok (221 Success ...),
FTS: ok (Links: 53/47 ok, 2/3 warning, 0/0 error, 1/1 unknown, 1/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
41%SAM: unknown (15min evaluations: 45 ok, 0 warning, 0 error, 51 unknown, 0 downtime (0h0m)),
HC: ok (206 Success ...),
FTS: ok (Links: 51/52 ok, 4/3 warning, 0/0 error, 0/2 unknown, 2/1 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
51%SAM: ok (15min evaluations: 57 ok, 0 warning, 0 error, 39 unknown, 0 downtime (0h0m)),
HC: ok (232 Success ...; 1 Failed, ExitCode 137 ...),
FTS: ok (Links: 50/47 ok, 4/2 warning, 0/0 error, 0/3 unknown, 2/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
46%SAM: ok (15min evaluations: 77 ok, 0 warning, 4 error, 15 unknown, 0 downtime (0h0m)),
HC: ok (225 Success ...),
FTS: ok (Links: 51/42 ok, 1/1 warning, 0/1 error, 1/1 unknown, 2/0 bad-endpoint; ganymede.hep.kbfi.ee: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_ES_CIEMAT
GGUS Tickets: 149075
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 95%15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%142 Success [crab3@vocms0106.cern.ch#47669493.0#1602632081 201013_163940:sciaba_crab_HC-97-T2_ES_CIEMAT-93172-20201012061303 77 0]... 100%166 Success [crab3@vocms0195.cern.ch#56475885.0#1602718677 201014_062716:sciaba_crab_HC-97-T2_ES_CIEMAT-93193-20201014031102 190 0]... 100%190 Success [crab3@vocms0122.cern.ch#62649009.0#1602805102 201015_063217:sciaba_crab_HC-97-T2_ES_CIEMAT-93193-20201014031102 205 0]... 100%89 Success [crab3@vocms0196.cern.ch#56892630.0#1602942023 201017_133447:sciaba_crab_HC-97-T2_ES_CIEMAT-93229-20201016073503 1 0]... 100%240 Success [crab3@vocms0196.cern.ch#56905101.0#1602978030 201017_133447:sciaba_crab_HC-97-T2_ES_CIEMAT-93229-20201016073503 121 0]... 100%251 Success [crab3@vocms0197.cern.ch#57205351.0#1603064254 201018_095646:sciaba_crab_HC-97-T2_ES_CIEMAT-93254-20201018114903 164 0]... 100%172 Success [crab3@vocms0155.cern.ch#60906117.0#1603150704 201019_220700:sciaba_crab_HC-97-T2_ES_CIEMAT-93254-20201018114903 18 0]...
1 Success, no Chirp ExitCode [crab3@vocms0195.cern.ch#56688177.0#1603231256 201020_065447:sciaba_crab_HC-97-T2_ES_CIEMAT-93275-20201020084904 181 0]...
100%227 Success [crab3@vocms0195.cern.ch#56690454.0#1603236962 201020_065447:sciaba_crab_HC-97-T2_ES_CIEMAT-93275-20201020084904 200 0]...
9 Success, no Chirp ExitCode [crab3@vocms0194.cern.ch#57580285.0#1603243873 201021_010504:sciaba_crab_HC-97-T2_ES_CIEMAT-93275-20201020084904 5 0]...
100%215 Success [crab3@vocms0197.cern.ch#57249840.0#1603323656 201021_190500:sciaba_crab_HC-97-T2_ES_CIEMAT-93275-20201020084904 55 0]...
11 Success, no Chirp ExitCode [crab3@vocms0197.cern.ch#57253154.0#1603349461 201021_190500:sciaba_crab_HC-97-T2_ES_CIEMAT-93275-20201020084904 141 0]...
100%232 Success [crab3@vocms0197.cern.ch#57279722.0#1603410000 201022_074905:sciaba_crab_HC-97-T2_ES_CIEMAT-93304-20201022094503 190 0]... 100%173 Success [crab3@vocms0197.cern.ch#57324914.0#1603522952 201024_065612:sciaba_crab_HC-97-T2_ES_CIEMAT-93326-20201024084703 1 0]... 100%225 Success [crab3@vocms0197.cern.ch#57364115.0#1603581772 201024_065612:sciaba_crab_HC-97-T2_ES_CIEMAT-93326-20201024084703 197 0]... 100%245 Success [crab3@vocms0106.cern.ch#48034768.0#1603669359 201025_190624:sciaba_crab_HC-97-T2_ES_CIEMAT-93326-20201024084703 55 0]... 99%255 Success [crab3@vocms0106.cern.ch#48082481.0#1603755078 201026_074451:sciaba_crab_HC-97-T2_ES_CIEMAT-93347-20201026084303 189 0]...
1 Failed, ExitCode 8021 [crab3@vocms0106.cern.ch#48084882.0#1603763480 201026_074451:sciaba_crab_HC-97-T2_ES_CIEMAT-93347-20201026084303 217 0]...
100%235 Success [crab3@vocms0107.cern.ch#60175447.0#1603842512 201027_194206:sciaba_crab_HC-97-T2_ES_CIEMAT-93347-20201026084303 49 0]... 100%231 Success [crab3@vocms0119.cern.ch#59591803.0#1603928577 201028_214204:sciaba_crab_HC-97-T2_ES_CIEMAT-93366-20201028044702 24 0]...
FTS Status: 98%Transfer (from/to): 3854/624 files, 2.056/1.047 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 1/3, trn_error: 170/15 foreign: 145/46
Links: 50/52 ok, 0/0 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint
srm.ciemat.es: ok/ok
97%Transfer (from/to): 7485/1249 files, 5.383/2.718 TB ok
Errors: trn_timeout: 0/49, trn_error: 84/12 foreign: 120/40
Links: 56/46 ok, 0/7 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint
srm.ciemat.es: ok/ok
97%Transfer (from/to): 11619/562 files, 14.332/1.024 TB ok
Errors: trn_timeout: 8/105, trn_error: 12/11 foreign: 103/32
Links: 55/41 ok, 0/12 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
srm.ciemat.es: ok/ok
97%Transfer (from/to): 3641/547 files, 7.081/1.214 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 3/94, trn_error: 4/8 foreign: 28/37
Links: 54/41 ok, 0/8 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
srm.ciemat.es: ok/ok
97%Transfer (from/to): 1733/567 files, 2.228/1.263 TB ok
Errors: trn_timeout: 0/80, trn_error: 5/14, dst_error: 0/1 foreign: 34/25
Links: 53/36 ok, 0/13 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
srm.ciemat.es: ok/ok
97%Transfer (from/to): 2845/575 files, 3.820/1.044 TB ok
Errors: trn_timeout: 3/92, trn_error: 28/11, dst_error: 0/1 foreign: 42/25
Links: 52/38 ok, 1/14 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
srm.ciemat.es: ok/ok
93%Transfer (from/to): 4092/957 files, 3.670/2.538 TB ok
Errors: src_permission: 2/0, trn_timeout: 34/107, trn_error: 8/8 foreign: 52/26
Links: 53/29 ok, 1/19 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint
srm.ciemat.es: ok/ok
95%Transfer (from/to): 2084/891 files, 2.415/1.970 TB ok
Errors: src_missing_file: 6/0, src_error: 180/0, trn_timeout: 13/107, trn_error: 5/11 foreign: 131/23
Links: 56/38 ok, 0/14 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint
srm.ciemat.es: ok/ok
97%Transfer (from/to): 5198/1207 files, 2.651/2.736 TB ok
Errors: src_error: 75/0, trn_timeout: 22/77, trn_error: 10/19 foreign: 228/22
Links: 56/43 ok, 1/11 warning, 0/1 error, 0/1 unknown, 4/1 bad-endpoint
srm.ciemat.es: ok/ok
97%Transfer (from/to): 1268/548 files, 1.042/1.151 TB ok
Errors: trn_timeout: 13/73, trn_error: 6/11 foreign: 174/20
Links: 53/42 ok, 2/7 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint
srm.ciemat.es: ok/ok
98%Transfer (from/to): 1455/791 files, 0.966/3.357 TB ok
Errors: src_missing_file: 2/0, trn_timeout: 124/74, trn_error: 26/13 foreign: 129/20
Links: 54/43 ok, 3/8 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint
srm.ciemat.es: ok/ok
98%Transfer (from/to): 4781/901 files, 1.868/4.358 TB ok
Errors: trn_timeout: 6/81, trn_error: 5/11, dst_permission: 0/3 foreign: 117/15
Links: 51/38 ok, 1/9 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint
srm.ciemat.es: ok/ok
100%Transfer (from/to): 3840/2447 files, 3.369/8.655 TB ok
Errors: trn_timeout: 10/104, trn_user: 3/0, trn_error: 1/12 foreign: 48/11
Links: 53/35 ok, 0/14 warning, 0/0 error, 0/1 unknown, 1/1 bad-endpoint
srm.ciemat.es: ok/ok
100%Transfer (from/to): 6326/2359 files, 2.802/12.127 TB ok
Errors: src_error: 32/0, trn_timeout: 5/102, trn_user: 21/0, trn_error: 45/80, dst_error: 0/76 foreign: 3802/87
Links: 56/41 ok, 0/9 warning, 0/0 error, 0/2 unknown, 2/1 bad-endpoint
srm.ciemat.es: ok/ok
98%Transfer (from/to): 8091/812 files, 2.277/2.275 TB ok
Errors: src_error: 2/0, trn_timeout: 17/62, trn_user: 19/0, trn_error: 618/22, dst_error: 0/7 foreign: 207/91
Links: 55/40 ok, 1/9 warning, 0/0 error, 0/2 unknown, 2/0 bad-endpoint
srm.ciemat.es: ok/ok
98%Transfer (from/to): 3956/7423 files, 2.921/2.001 TB ok
Errors: trn_timeout: 3/78, trn_user: 16/0, trn_error: 246/12 foreign: 130/23
Links: 55/48 ok, 1/6 warning, 0/1 error, 0/2 unknown, 2/0 bad-endpoint
srm.ciemat.es: ok/ok
Site Readiness:
52%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (142 Success ...),
FTS: ok (Links: 50/52 ok, 0/0 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint; srm.ciemat.es: ok/ok)
60%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (166 Success ...),
FTS: ok (Links: 56/46 ok, 0/7 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint; srm.ciemat.es: ok/ok)
61%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (190 Success ...),
FTS: ok (Links: 55/41 ok, 0/12 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; srm.ciemat.es: ok/ok)
31%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (89 Success ...),
FTS: ok (Links: 54/41 ok, 0/8 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; srm.ciemat.es: ok/ok)
59%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (240 Success ...),
FTS: ok (Links: 53/36 ok, 0/13 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; srm.ciemat.es: ok/ok)
72%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (251 Success ...),
FTS: ok (Links: 52/38 ok, 1/14 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; srm.ciemat.es: ok/ok)
66%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (172 Success ...; 1 Success, no Chirp ExitCode ...),
FTS: ok (Links: 53/29 ok, 1/19 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint; srm.ciemat.es: ok/ok)
89%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (227 Success ...; 9 Success, no Chirp ExitCode ...),
FTS: ok (Links: 56/38 ok, 0/14 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint; srm.ciemat.es: ok/ok)
84%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (215 Success ...; 11 Success, no Chirp ExitCode ...),
FTS: ok (Links: 56/43 ok, 1/11 warning, 0/1 error, 0/1 unknown, 4/1 bad-endpoint; srm.ciemat.es: ok/ok)
72%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (232 Success ...),
FTS: ok (Links: 53/42 ok, 2/7 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint; srm.ciemat.es: ok/ok)
52%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (173 Success ...),
FTS: ok (Links: 54/43 ok, 3/8 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint; srm.ciemat.es: ok/ok)
82%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (225 Success ...),
FTS: ok (Links: 51/38 ok, 1/9 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint; srm.ciemat.es: ok/ok)
84%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (245 Success ...),
FTS: ok (Links: 53/35 ok, 0/14 warning, 0/0 error, 0/1 unknown, 1/1 bad-endpoint; srm.ciemat.es: ok/ok)
95%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (255 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 56/41 ok, 0/9 warning, 0/0 error, 0/2 unknown, 2/1 bad-endpoint; srm.ciemat.es: ok/ok)
91%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (235 Success ...),
FTS: ok (Links: 55/40 ok, 1/9 warning, 0/0 error, 0/2 unknown, 2/0 bad-endpoint; srm.ciemat.es: ok/ok)
86%SAM: ok (15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (231 Success ...),
FTS: ok (Links: 55/48 ok, 1/6 warning, 0/1 error, 0/2 unknown, 2/0 bad-endpoint; srm.ciemat.es: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_ES_IFCA
GGUS Tickets:
Downtimes:
SAM Status: 97%15min evaluations: 68 ok, 0 warning, 2 error, 26 unknown, 0 downtime (0h0m) 100%15min evaluations: 53 ok, 0 warning, 0 error, 43 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 8 ok, 88 warning, 0 error, 0 unknown, 0 downtime (0h0m) 7%15min evaluations: 0 ok, 7 warning, 89 error, 0 unknown, 0 downtime (0h0m) 68%15min evaluations: 59 ok, 0 warning, 27 error, 10 unknown, 0 downtime (0h0m) 98%15min evaluations: 93 ok, 1 warning, 1 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 91 ok, 1 warning, 1 error, 3 unknown, 0 downtime (0h0m) 96%15min evaluations: 70 ok, 12 warning, 3 error, 11 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%121 Success [crab3@vocms0194.cern.ch#57464354.0#1602631155 201013_164852:sciaba_crab_HC-97-T2_ES_IFCA-93172-20201012061303 75 0]... 100%200 Success [crab3@vocms0197.cern.ch#57098612.0#1602716850 201014_192618:sciaba_crab_HC-97-T2_ES_IFCA-93193-20201014031102 44 0]... 100%110 Success [crab3@vocms0106.cern.ch#47771147.0#1602804453 201015_131612:sciaba_crab_HC-97-T2_ES_IFCA-93193-20201014031102 122 0]... 100%142 Success [crab3@vocms0196.cern.ch#56885904.0#1602920254 201017_073150:sciaba_crab_HC-97-T2_ES_IFCA-93229-20201016073503 1 0]... 100%187 Success [crab3@vocms0196.cern.ch#56905092.0#1602977866 201017_073150:sciaba_crab_HC-97-T2_ES_IFCA-93229-20201016073503 193 0]... 100%210 Success [crab3@vocms0195.cern.ch#56561015.0#1603062697 201018_095256:sciaba_crab_HC-97-T2_ES_IFCA-93254-20201018114903 87 0]... 100%126 Success [crab3@vocms0155.cern.ch#60905839.0#1603149944 201019_100452:sciaba_crab_HC-97-T2_ES_IFCA-93254-20201018114903 160 0]... 100%92 Success [crab3@vocms0119.cern.ch#59260370.0#1603237448 201020_065250:sciaba_crab_HC-97-T2_ES_IFCA-93275-20201020084904 202 0]... 100%201 Success [crab3@vocms0121.cern.ch#58989700.0#1603324219 201021_190427:sciaba_crab_HC-97-T2_ES_IFCA-93275-20201020084904 57 0]... 100%237 Success [crab3@vocms0137.cern.ch#56703153.0#1603409678 201022_075303:sciaba_crab_HC-97-T2_ES_IFCA-93304-20201022094503 188 0]... 100%155 Success [crab3@vocms0199.cern.ch#17816408.0#1603523696 201024_065406:sciaba_crab_HC-97-T2_ES_IFCA-93326-20201024084703 4 0]... 100%259 Success [crab3@vocms0199.cern.ch#17825583.0#1603582514 201024_065406:sciaba_crab_HC-97-T2_ES_IFCA-93326-20201024084703 200 0]... 100%238 Success [crab3@vocms0107.cern.ch#60101260.0#1603669063 201025_185134:sciaba_crab_HC-97-T2_ES_IFCA-93326-20201024084703 57 0]... 100%211 Success [crab3@vocms0197.cern.ch#57454531.0#1603754488 201026_075005:sciaba_crab_HC-97-T2_ES_IFCA-93347-20201026084303 186 0]... 100%201 Success [crab3@vocms0144.cern.ch#60664637.0#1603842366 201027_200516:sciaba_crab_HC-97-T2_ES_IFCA-93347-20201026084303 44 0]... 99%267 Success [crab3@vocms0195.cern.ch#56952928.0#1603927987 201028_214651:sciaba_crab_HC-97-T2_ES_IFCA-93366-20201028044702 21 0]...
1 Failed, ExitCode 137 [crab3@vocms0195.cern.ch#56966901.0#1603967886 201028_214651:sciaba_crab_HC-97-T2_ES_IFCA-93366-20201028044702 154 0]...
FTS Status: 90%Transfer (from/to): 1865/166 files, 0.542/0.326 TB ok
Errors: src_missing_file: 14/0, src_error: 1510/0, trn_timeout: 0/1, trn_error: 63/0 foreign: 2140/5
Links: 20/43 ok, 2/1 warning, 1/0 error, 1/1 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/ok
95%Transfer (from/to): 2009/188 files, 0.333/0.324 TB ok
Errors: src_missing_file: 12/0, src_error: 1258/0, trn_timeout: 0/1, trn_error: 169/0 foreign: 1449/4
Links: 23/42 ok, 3/1 warning, 1/0 error, 1/1 unknown, 0/0 bad-endpoint
storm.ifca.es: ok/ok
92%Transfer (from/to): 3509/176 files, 0.623/0.373 TB ok
Errors: src_missing_file: 15/0, src_error: 2420/0, trn_timeout: 0/5, trn_error: 862/1 foreign: 9906/3
Links: 24/42 ok, 2/1 warning, 1/1 error, 1/1 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/ok
92%Transfer (from/to): 5956/273 files, 1.571/0.578 TB ok
Errors: src_missing_file: 14/0, src_error: 4146/0, trn_timeout: 15/4, trn_error: 88/1 foreign: 15204/14
Links: 23/42 ok, 2/1 warning, 1/1 error, 1/1 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/ok
95%Transfer (from/to): 991/224 files, 0.264/0.484 TB ok
Errors: src_missing_file: 14/0, src_error: 628/0, trn_timeout: 0/3, trn_error: 5/1 foreign: 38800/31
Links: 21/41 ok, 1/1 warning, 0/1 error, 2/1 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/ok
91%Transfer (from/to): 586/343 files, 0.261/1.122 TB ok
Errors: src_missing_file: 14/0, src_error: 715/0, trn_timeout: 8/0, trn_error: 42/2 foreign: 37044/13
Links: 22/20 ok, 0/0 warning, 2/0 error, 1/1 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/ok
96%Transfer (from/to): 666/156 files, 0.255/0.333 TB ok
Errors: src_missing_file: 12/0, src_error: 3059/0, trn_timeout: 25/0, trn_error: 29/0 foreign: 25738/7
Links: 24/23 ok, 2/0 warning, 1/0 error, 1/1 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/ok
87%Transfer (from/to): 445/811 files, 0.240/5.473 TB ok
Errors: src_error: 1083/0, trn_timeout: 0/24, trn_error: 293/1 foreign: 23637/16
Links: 21/46 ok, 4/1 warning, 2/1 error, 0/1 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/ok
90%Transfer (from/to): 2540/535 files, 0.505/2.134 TB ok
Errors: src_error: 1852/0, trn_timeout: 0/14, trn_error: 128/0, dst_permission: 0/3, dst_error: 0/2 foreign: 280/110
Links: 28/46 ok, 1/1 warning, 2/1 error, 0/1 unknown, 2/0 bad-endpoint
storm.ifca.es: ok/ok
95%Transfer (from/to): 2367/774 files, 1.972/3.706 TB ok
Errors: src_error: 1447/0, trn_timeout: 1/75, trn_error: 128/18, dst_permission: 0/1 foreign: 10/126
Links: 30/44 ok, 0/1 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint
storm.ifca.es: ok/ok
95%Transfer (from/to): 1641/468 files, 0.325/2.046 TB ok
Errors: src_error: 1126/0, trn_timeout: 0/5, trn_error: 38/9 foreign: 0/16
Links: 22/42 ok, 0/0 warning, 1/1 error, 0/1 unknown, 2/1 bad-endpoint
storm.ifca.es: ok/ok
95%Transfer (from/to): 4211/450 files, 0.584/4.154 TB ok
Errors: src_error: 1270/0, trn_timeout: 0/5, trn_user: 0/1, trn_error: 72/17 foreign: 59/12
Links: 25/43 ok, 2/0 warning, 0/2 error, 0/1 unknown, 2/1 bad-endpoint
storm.ifca.es: ok/ok
90%Transfer (from/to): 4723/1174 files, 0.418/3.614 TB ok
Errors: src_error: 3895/0, trn_timeout: 1/13, trn_error: 222/13 foreign: 1433/14
Links: 20/42 ok, 3/2 warning, 1/1 error, 0/1 unknown, 1/1 bad-endpoint
storm.ifca.es: ok/ok
95%Transfer (from/to): 3218/803 files, 1.421/2.932 TB ok
Errors: src_error: 3805/0, trn_timeout: 1/9, trn_error: 74/6 foreign: 2914/68
Links: 22/43 ok, 0/0 warning, 1/1 error, 0/2 unknown, 1/1 bad-endpoint
storm.ifca.es: ok/ok
95%Transfer (from/to): 6330/421 files, 1.288/1.236 TB ok
Errors: src_error: 4435/0, trn_timeout: 8/5, trn_error: 138/0 foreign: 101/102
Links: 23/45 ok, 3/0 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/ok
96%Transfer (from/to): 4457/133 files, 1.877/0.261 TB ok
Errors: src_error: 2957/0, trn_timeout: 1/2, trn_error: 122/0 foreign: 149/2
Links: 24/43 ok, 2/1 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
storm.ifca.es: ok/ok
Site Readiness:
19%SAM: ok (15min evaluations: 68 ok, 0 warning, 2 error, 26 unknown, 0 downtime (0h0m)),
HC: ok (121 Success ...),
FTS: ok (Links: 20/43 ok, 2/1 warning, 1/0 error, 1/1 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/ok)
29%SAM: ok (15min evaluations: 53 ok, 0 warning, 0 error, 43 unknown, 0 downtime (0h0m)),
HC: ok (200 Success ...),
FTS: ok (Links: 23/42 ok, 3/1 warning, 1/0 error, 1/1 unknown, 0/0 bad-endpoint; storm.ifca.es: ok/ok)
22%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (110 Success ...),
FTS: ok (Links: 24/42 ok, 2/1 warning, 1/1 error, 1/1 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/ok)
21%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (142 Success ...),
FTS: ok (Links: 23/42 ok, 2/1 warning, 1/1 error, 1/1 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/ok)
25%SAM: ok (15min evaluations: 8 ok, 88 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (187 Success ...),
FTS: ok (Links: 21/41 ok, 1/1 warning, 0/1 error, 2/1 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/ok)
0%SAM: error (15min evaluations: 0 ok, 7 warning, 89 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (210 Success ...),
FTS: ok (Links: 22/20 ok, 0/0 warning, 2/0 error, 1/1 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/ok)
7%SAM: error (15min evaluations: 59 ok, 0 warning, 27 error, 10 unknown, 0 downtime (0h0m)),
HC: ok (126 Success ...),
FTS: ok (Links: 24/23 ok, 2/0 warning, 1/0 error, 1/1 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/ok)
34%SAM: ok (15min evaluations: 93 ok, 1 warning, 1 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (92 Success ...),
FTS: ok (Links: 21/46 ok, 4/1 warning, 2/1 error, 0/1 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/ok)
62%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (201 Success ...),
FTS: ok (Links: 28/46 ok, 1/1 warning, 2/1 error, 0/1 unknown, 2/0 bad-endpoint; storm.ifca.es: ok/ok)
81%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (237 Success ...),
FTS: ok (Links: 30/44 ok, 0/1 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint; storm.ifca.es: ok/ok)
39%SAM: ok (15min evaluations: 91 ok, 1 warning, 1 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (155 Success ...),
FTS: ok (Links: 22/42 ok, 0/0 warning, 1/1 error, 0/1 unknown, 2/1 bad-endpoint; storm.ifca.es: ok/ok)
61%SAM: ok (15min evaluations: 70 ok, 12 warning, 3 error, 11 unknown, 0 downtime (0h0m)),
HC: ok (259 Success ...),
FTS: ok (Links: 25/43 ok, 2/0 warning, 0/2 error, 0/1 unknown, 2/1 bad-endpoint; storm.ifca.es: ok/ok)
62%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (238 Success ...),
FTS: ok (Links: 20/42 ok, 3/2 warning, 1/1 error, 0/1 unknown, 1/1 bad-endpoint; storm.ifca.es: ok/ok)
65%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (211 Success ...),
FTS: ok (Links: 22/43 ok, 0/0 warning, 1/1 error, 0/2 unknown, 1/1 bad-endpoint; storm.ifca.es: ok/ok)
65%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (201 Success ...),
FTS: ok (Links: 23/45 ok, 3/0 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/ok)
56%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (267 Success ...; 1 Failed, ExitCode 137 ...),
FTS: ok (Links: 24/43 ok, 2/1 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; storm.ifca.es: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_FI_HIP
GGUS Tickets: 148708
Downtimes: Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE Pkale-cms.grid.helsinki.fi/CE
SAM Status: 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 80 ok, 0 warning, 0 error, 16 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 87 ok, 0 warning, 0 error, 9 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 50 ok, 0 warning, 0 error, 46 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 80 ok, 0 warning, 0 error, 16 unknown, 0 downtime (0h0m) 97%15min evaluations: 85 ok, 0 warning, 2 error, 9 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%189 Success [crab3@vocms0120.cern.ch#58494127.0#1602632038 201013_032028:sciaba_crab_HC-96-T2_FI_HIP-93184-20201013050303 172 0]... 100%157 Success [crab3@vocms0119.cern.ch#58991665.0#1602743742 201015_062936:sciaba_crab_HC-96-T2_FI_HIP-93205-20201015014703 1 0]... 99%227 Success [crab3@vocms0119.cern.ch#59020459.0#1602804957 201015_062936:sciaba_crab_HC-96-T2_FI_HIP-93205-20201015014703 205 0]...
1 Failed, ExitCode 8028 [crab3@vocms0194.cern.ch#57550630.0#1602881525 201016_201609:sciaba_crab_HC-96-T2_FI_HIP-93226-20201016040102 7 0]...
100%221 Success [crab3@vocms0155.cern.ch#60784079.0#1602903646 201017_025429:sciaba_crab_HC-96-T2_FI_HIP-93238-20201017043502 1 0]... 100%268 Success [crab3@vocms0122.cern.ch#62742040.0#1602976145 201017_205800:sciaba_crab_HC-96-T2_FI_HIP-93238-20201017043502 26 0]... 100%170 Success [crab3@vocms0106.cern.ch#47856918.0#1603064368 201018_195821:sciaba_crab_HC-96-T2_FI_HIP-93248-20201018034102 44 0]... 99%177 Success [crab3@vocms0195.cern.ch#56623594.0#1603150474 201019_220341:sciaba_crab_HC-96-T2_FI_HIP-93260-20201019054303 18 0]...
1 Failed, ExitCode 47 [crab3@vocms0199.cern.ch#17662101.0#1603228482 201020_205352:sciaba_crab_HC-96-T2_FI_HIP-93270-20201020044303 4 0]...
100%225 Success [crab3@vocms0199.cern.ch#17663687.0#1603237184 201020_205352:sciaba_crab_HC-96-T2_FI_HIP-93270-20201020044303 33 0]... 100%171 Success [crab3@vocms0196.cern.ch#57092966.0#1603323377 201021_203503:sciaba_crab_HC-96-T2_FI_HIP-93282-20201021044302 36 0]... 100%165 Success [crab3@vocms0195.cern.ch#56786804.0#1603409954 201022_230316:sciaba_crab_HC-96-T2_FI_HIP-93302-20201022064302 7 0]... 100%174 Success [crab3@vocms0155.cern.ch#61139987.0#1603504011 201024_011046:sciaba_crab_HC-96-T2_FI_HIP-93312-20201023090502 7 0]... 99%252 Success [crab3@vocms0137.cern.ch#56785112.0#1603582619 201024_063551:sciaba_crab_HC-96-T2_FI_HIP-93325-20201024082102 204 0]...
1 Failed, ExitCode 47 [crab3@vocms0195.cern.ch#56849786.0#1603644560 201025_090308:sciaba_crab_HC-96-T2_FI_HIP-93335-20201025094701 93 0]...
100%205 Success [crab3@vocms0195.cern.ch#56852512.0#1603669167 201025_090308:sciaba_crab_HC-96-T2_FI_HIP-93335-20201025094701 175 0]... 100%199 Success [crab3@vocms0121.cern.ch#59180467.0#1603755338 201026_112408:sciaba_crab_HC-96-T2_FI_HIP-93351-20201026120702 146 0]... 100%230 Success [crab3@vocms0196.cern.ch#57286630.0#1603842560 201027_114246:sciaba_crab_HC-96-T2_FI_HIP-93359-20201027123902 145 0]... 100%247 Success [crab3@vocms0106.cern.ch#48154709.0#1603928261 201028_111117:sciaba_crab_HC-96-T2_FI_HIP-93372-20201028115302 149 0]...
FTS Status: 100%Transfer (from/to): 1730/347 files, 0.439/0.618 TB ok
Errors: trn_timeout: 0/2, trn_error: 1/0, dst_permission: 0/17 foreign: 62/9
Links: 48/44 ok, 0/4 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint
madhatter.csc.fi: ok/ok
99%Transfer (from/to): 696/404 files, 0.383/0.579 TB ok
Errors: trn_timeout: 2/1, trn_error: 1/0, dst_permission: 0/6 foreign: 46/4
Links: 47/48 ok, 1/2 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint
madhatter.csc.fi: ok/ok
98%Transfer (from/to): 776/370 files, 0.465/0.682 TB ok
Errors: trn_timeout: 2/0, trn_error: 2/0, dst_permission: 0/12 foreign: 10/8
Links: 45/48 ok, 1/1 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint
madhatter.csc.fi: ok/ok
97%Transfer (from/to): 257/417 files, 0.465/0.920 TB ok
Errors: trn_timeout: 3/0, trn_error: 2/0, dst_permission: 0/22 foreign: 11/24
Links: 47/45 ok, 0/1 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint
madhatter.csc.fi: ok/ok
98%Transfer (from/to): 1485/432 files, 0.455/0.719 TB ok
Errors: trn_timeout: 5/0, trn_error: 4/0, dst_permission: 0/12 foreign: 9/17
Links: 45/50 ok, 1/1 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint
madhatter.csc.fi: ok/ok
100%Transfer (from/to): 1917/369 files, 0.525/0.696 TB ok
Errors: src_missing_file: 2/0, src_error: 1/0, trn_timeout: 4/1, trn_error: 9/0, dst_permission: 0/14 foreign: 10/17
Links: 45/46 ok, 3/5 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint
madhatter.csc.fi: ok/ok
97%Transfer (from/to): 3152/478 files, 0.567/1.142 TB ok
Errors: trn_timeout: 2/3, trn_error: 3/1, dst_permission: 0/11 foreign: 11/20
Links: 47/47 ok, 1/1 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint
madhatter.csc.fi: ok/ok
92%Transfer (from/to): 573/5821 files, 0.497/2.084 TB ok
Errors: src_error: 14/0, trn_timeout: 5/6, trn_error: 1/521, dst_permission: 0/13, dst_error: 0/3 foreign: 17/25
Links: 48/47 ok, 2/3 warning, 0/4 error, 0/1 unknown, 2/0 bad-endpoint
madhatter.csc.fi: ok/ok
91%Transfer (from/to): 256/341 files, 0.437/0.701 TB ok
Errors: src_error: 13/0, trn_timeout: 3/5, trn_error: 19/44, dst_permission: 0/16, dst_error: 0/44 foreign: 15/21
Links: 37/31 ok, 12/16 warning, 0/3 error, 0/1 unknown, 2/1 bad-endpoint
madhatter.csc.fi: ok/ok
100%Transfer (from/to): 610/6417 files, 0.648/1.310 TB ok
Errors: src_error: 2/0, trn_timeout: 1/2, trn_error: 24/28, dst_permission: 0/7, dst_error: 0/8 foreign: 16/34
Links: 50/48 ok, 3/5 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint
madhatter.csc.fi: ok/ok
98%Transfer (from/to): 1634/2020 files, 2.810/5.703 TB ok
Errors: trn_timeout: 3/1, trn_error: 7/9, dst_permission: 0/9 foreign: 5/23
Links: 47/51 ok, 1/1 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint
madhatter.csc.fi: ok/ok
95%Transfer (from/to): 1674/469 files, 0.500/0.856 TB ok
Errors: trn_timeout: 2/0, trn_error: 31/14, dst_permission: 0/17 foreign: 21/23
Links: 46/42 ok, 2/1 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint
madhatter.csc.fi: ok/ok
97%Transfer (from/to): 766/1177 files, 0.499/0.952 TB ok
Errors: trn_timeout: 2/0, trn_error: 3/10, dst_permission: 0/11, dst_error: 0/1 foreign: 3/13
Links: 49/47 ok, 1/1 warning, 0/0 error, 0/1 unknown, 1/1 bad-endpoint
madhatter.csc.fi: ok/ok
97%Transfer (from/to): 1434/5382 files, 0.531/2.438 TB ok
Errors: trn_timeout: 2/1, trn_error: 8/7, dst_permission: 0/22, dst_error: 0/1 foreign: 2560/26
Links: 48/48 ok, 1/1 warning, 1/0 error, 0/2 unknown, 1/1 bad-endpoint
madhatter.csc.fi: ok/ok
100%Transfer (from/to): 748/956 files, 0.464/5.486 TB ok
Errors: trn_timeout: 2/0, trn_error: 25/1, dst_permission: 0/15, dst_error: 0/1 foreign: 485/38
Links: 47/44 ok, 2/9 warning, 0/0 error, 0/2 unknown, 2/0 bad-endpoint
madhatter.csc.fi: ok/ok
96%Transfer (from/to): 6281/554 files, 1.106/0.918 TB ok
Errors: trn_timeout: 2/0, trn_error: 30/0, dst_permission: 0/2, dst_error: 0/2 foreign: 5/11
Links: 45/51 ok, 1/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint
madhatter.csc.fi: ok/ok
Site Readiness:
53%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (189 Success ...),
FTS: ok (Links: 48/44 ok, 0/4 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint; madhatter.csc.fi: ok/ok)
52%SAM: ok (15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (157 Success ...),
FTS: ok (Links: 47/48 ok, 1/2 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint; madhatter.csc.fi: ok/ok)
53%SAM: ok (15min evaluations: 95 ok, 1 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (227 Success ...; 1 Failed, ExitCode 8028 ...),
FTS: ok (Links: 45/48 ok, 1/1 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint; madhatter.csc.fi: ok/ok)
33%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (221 Success ...),
FTS: ok (Links: 47/45 ok, 0/1 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint; madhatter.csc.fi: ok/ok)
33%SAM: ok (15min evaluations: 80 ok, 0 warning, 0 error, 16 unknown, 0 downtime (0h0m)),
HC: ok (268 Success ...),
FTS: ok (Links: 45/50 ok, 1/1 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint; madhatter.csc.fi: ok/ok)
36%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (170 Success ...),
FTS: ok (Links: 45/46 ok, 3/5 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint; madhatter.csc.fi: ok/ok)
52%SAM: ok (15min evaluations: 87 ok, 0 warning, 0 error, 9 unknown, 0 downtime (0h0m)),
HC: ok (177 Success ...; 1 Failed, ExitCode 47 ...),
FTS: ok (Links: 47/47 ok, 1/1 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint; madhatter.csc.fi: ok/ok)
66%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (225 Success ...),
FTS: ok (Links: 48/47 ok, 2/3 warning, 0/4 error, 0/1 unknown, 2/0 bad-endpoint; madhatter.csc.fi: ok/ok)
26%SAM: ok (15min evaluations: 50 ok, 0 warning, 0 error, 46 unknown, 0 downtime (0h0m)),
HC: ok (171 Success ...),
FTS: ok (Links: 37/31 ok, 12/16 warning, 0/3 error, 0/1 unknown, 2/1 bad-endpoint; madhatter.csc.fi: ok/ok)
57%SAM: ok (15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (165 Success ...),
FTS: ok (Links: 50/48 ok, 3/5 warning, 0/0 error, 0/1 unknown, 3/1 bad-endpoint; madhatter.csc.fi: ok/ok)
57%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (174 Success ...),
FTS: ok (Links: 47/51 ok, 1/1 warning, 0/0 error, 0/1 unknown, 2/1 bad-endpoint; madhatter.csc.fi: ok/ok)
55%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (252 Success ...; 1 Failed, ExitCode 47 ...),
FTS: ok (Links: 46/42 ok, 2/1 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint; madhatter.csc.fi: ok/ok)
40%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (205 Success ...),
FTS: ok (Links: 49/47 ok, 1/1 warning, 0/0 error, 0/1 unknown, 1/1 bad-endpoint; madhatter.csc.fi: ok/ok)
52%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (199 Success ...),
FTS: ok (Links: 48/48 ok, 1/1 warning, 1/0 error, 0/2 unknown, 1/1 bad-endpoint; madhatter.csc.fi: ok/ok)
57%SAM: ok (15min evaluations: 80 ok, 0 warning, 0 error, 16 unknown, 0 downtime (0h0m)),
HC: ok (230 Success ...),
FTS: ok (Links: 47/44 ok, 2/9 warning, 0/0 error, 0/2 unknown, 2/0 bad-endpoint; madhatter.csc.fi: ok/ok)
60%SAM: ok (15min evaluations: 85 ok, 0 warning, 2 error, 9 unknown, 0 downtime (0h0m)),
HC: ok (247 Success ...),
FTS: ok (Links: 45/51 ok, 1/0 warning, 1/0 error, 0/1 unknown, 1/0 bad-endpoint; madhatter.csc.fi: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_FR_CCIN2P3
GGUS Tickets: 149204
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 95%15min evaluations: 88 ok, 0 warning, 4 error, 4 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%206 Success [crab3@vocms0107.cern.ch#59771263.0#1602642954 201014_021539:sciaba_crab_HC-100-T2_FR_CCIN2P3-93191-20201013222902 2 0]... 100%245 Success [crab3@vocms0199.cern.ch#17543485.0#1602718643 201014_182615:sciaba_crab_HC-100-T2_FR_CCIN2P3-93203-20201014201302 62 0]... 100%104 Success [crab3@vocms0144.cern.ch#60191672.0#1602804933 201015_170445:sciaba_crab_HC-100-T2_FR_CCIN2P3-93221-20201015184702 78 0]... 100%145 Success [crab3@vocms0155.cern.ch#60788310.0#1602926421 201017_090438:sciaba_crab_HC-100-T2_FR_CCIN2P3-93234-20201016165102 3 0]... 100%257 Success [crab3@vocms0121.cern.ch#58913630.0#1602977326 201017_150256:sciaba_crab_HC-100-T2_FR_CCIN2P3-93243-20201017165902 101 0]... 100%222 Success [crab3@vocms0120.cern.ch#58651348.0#1603063853 201018_135431:sciaba_crab_HC-100-T2_FR_CCIN2P3-93257-20201018155302 115 0]... 100%119 Success [crab3@vocms0196.cern.ch#56989308.0#1603152304 201019_131414:sciaba_crab_HC-100-T2_FR_CCIN2P3-93265-20201019150502 130 0]... 100%183 Success [crab3@vocms0155.cern.ch#60996135.0#1603237888 201020_110948:sciaba_crab_HC-100-T2_FR_CCIN2P3-93277-20201020125702 152 0]...
8 Success, no Chirp ExitCode [crab3@vocms0120.cern.ch#58687687.0#1603291186 201021_092356:sciaba_crab_HC-100-T2_FR_CCIN2P3-93286-20201021111702 63 0]...
100%83 Success [crab3@vocms0120.cern.ch#58713987.0#1603324191 201021_092356:sciaba_crab_HC-100-T2_FR_CCIN2P3-93286-20201021111702 173 0]... 100%179 Success [crab3@vocms0196.cern.ch#57125420.0#1603412585 201022_105621:sciaba_crab_HC-100-T2_FR_CCIN2P3-93307-20201022125502 81 0]... 100%184 Success [crab3@vocms0197.cern.ch#57318262.0#1603512443 201024_034613:sciaba_crab_HC-100-T2_FR_CCIN2P3-93315-20201023113502 4 0]... 99%249 Success [crab3@vocms0106.cern.ch#48011345.0#1603582073 201024_094640:sciaba_crab_HC-100-T2_FR_CCIN2P3-93329-20201024114302 164 0]...
1 Failed, ExitCode 8021 [crab3@vocms0137.cern.ch#56817621.0#1603656184 201025_112128:sciaba_crab_HC-100-T2_FR_CCIN2P3-93337-20201025121702 104 0]...
100%251 Success [crab3@vocms0137.cern.ch#56823072.0#1603668480 201025_112128:sciaba_crab_HC-100-T2_FR_CCIN2P3-93337-20201025121702 145 0]... 100%235 Success [crab3@vocms0120.cern.ch#58885232.0#1603756107 201026_102203:sciaba_crab_HC-100-T2_FR_CCIN2P3-93350-20201026112102 161 0]... 100%257 Success [crab3@vocms0119.cern.ch#59561423.0#1603841919 201027_120717:sciaba_crab_HC-100-T2_FR_CCIN2P3-93360-20201027125102 138 0]... 100%258 Success [crab3@vocms0195.cern.ch#56952934.0#1603928202 201028_133011:sciaba_crab_HC-100-T2_FR_CCIN2P3-93379-20201028141902 121 0]...
FTS Status: 98%Transfer (from/to): 1025/679 files, 0.468/1.717 TB ok
Errors: src_missing_file: 1/0, src_error: 63/0, trn_timeout: 2/0, trn_error: 58/0 foreign: 44/12
Links: 42/44 ok, 0/0 warning, 2/0 error, 0/1 unknown, 2/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
99%Transfer (from/to): 1167/305 files, 1.769/0.544 TB ok
Errors: src_error: 54/0, trn_timeout: 1/0, trn_error: 12/0 foreign: 33/8
Links: 47/46 ok, 0/0 warning, 2/0 error, 0/1 unknown, 2/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
97%Transfer (from/to): 2536/305 files, 4.410/0.620 TB ok
Errors: src_error: 33/0, trn_timeout: 3/0, trn_error: 2/0 foreign: 11/47
Links: 46/44 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
99%Transfer (from/to): 1258/308 files, 1.492/0.627 TB ok
Errors: src_missing_file: 2/0, src_error: 54/0, trn_timeout: 1/0, trn_error: 5/0 foreign: 5/92
Links: 44/43 ok, 0/0 warning, 1/0 error, 0/2 unknown, 2/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
99%Transfer (from/to): 414/297 files, 0.422/0.626 TB ok
Errors: src_error: 51/0, trn_timeout: 1/0, trn_error: 3/0 foreign: 8/71
Links: 42/44 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
97%Transfer (from/to): 1522/332 files, 1.957/0.663 TB ok
Errors: src_missing_file: 12/0, src_error: 57/0, trn_timeout: 2/1, trn_error: 36/1 foreign: 23/72
Links: 47/48 ok, 1/1 warning, 1/0 error, 0/1 unknown, 3/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
96%Transfer (from/to): 1162/345 files, 1.024/0.717 TB ok
Errors: src_permission: 3/0, src_missing_file: 25/0, src_error: 34/0, trn_timeout: 7/4, trn_error: 9/9 foreign: 43/41
Links: 46/42 ok, 1/0 warning, 3/2 error, 0/1 unknown, 2/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
96%Transfer (from/to): 1077/523 files, 0.645/1.200 TB ok
Errors: src_missing_file: 33/0, src_error: 126/0, trn_timeout: 3/3, trn_error: 4/10 foreign: 44/41
Links: 43/44 ok, 2/0 warning, 2/2 error, 0/1 unknown, 2/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
97%Transfer (from/to): 1889/313 files, 0.531/0.641 TB ok
Errors: src_missing_file: 49/0, src_error: 80/0, trn_timeout: 1/2, trn_error: 2/5 foreign: 44/42
Links: 43/43 ok, 1/0 warning, 2/1 error, 1/1 unknown, 3/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
98%Transfer (from/to): 821/335 files, 0.552/0.693 TB ok
Errors: src_missing_file: 30/0, src_error: 63/0, trn_timeout: 1/2, trn_error: 3/4 foreign: 44/37
Links: 41/43 ok, 0/1 warning, 2/0 error, 1/1 unknown, 3/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
97%Transfer (from/to): 986/336 files, 0.496/0.698 TB ok
Errors: src_missing_file: 26/0, src_error: 24/0, trn_timeout: 3/0, trn_error: 1/7 foreign: 18/16
Links: 45/43 ok, 0/0 warning, 2/0 error, 0/1 unknown, 2/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
96%Transfer (from/to): 1199/369 files, 0.566/0.728 TB ok
Errors: src_missing_file: 30/0, src_error: 63/0, trn_timeout: 1/0, trn_error: 4/12 foreign: 32/17
Links: 43/43 ok, 1/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
98%Transfer (from/to): 1635/1289 files, 0.816/3.995 TB ok
Errors: src_missing_file: 15/0, src_error: 35/0, trn_timeout: 1/0, trn_error: 1/12 foreign: 7/13
Links: 40/44 ok, 0/1 warning, 1/0 error, 0/1 unknown, 1/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
96%Transfer (from/to): 1898/531 files, 0.511/1.490 TB ok
Errors: src_missing_file: 40/0, src_error: 59/0, trn_timeout: 2/0, trn_error: 3/5 foreign: 793/36
Links: 40/44 ok, 1/0 warning, 2/0 error, 0/1 unknown, 1/1 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
97%Transfer (from/to): 962/320 files, 0.744/1.188 TB ok
Errors: src_missing_file: 18/0, src_error: 63/0, trn_timeout: 2/0, trn_error: 2/1 foreign: 21/33
Links: 39/43 ok, 0/1 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
99%Transfer (from/to): 829/96 files, 1.259/0.156 TB ok
Errors: src_error: 51/0, trn_timeout: 3/0, trn_error: 5/0 foreign: 41/1
Links: 46/38 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint
ccsrmt2.in2p3.fr: ok/ok
Site Readiness:
52%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (206 Success ...),
FTS: ok (Links: 42/44 ok, 0/0 warning, 2/0 error, 0/1 unknown, 2/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
43%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (245 Success ...),
FTS: ok (Links: 47/46 ok, 0/0 warning, 2/0 error, 0/1 unknown, 2/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
28%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (104 Success ...),
FTS: ok (Links: 46/44 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
27%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (145 Success ...),
FTS: ok (Links: 44/43 ok, 0/0 warning, 1/0 error, 0/2 unknown, 2/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
38%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (257 Success ...),
FTS: ok (Links: 42/44 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
43%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (222 Success ...),
FTS: ok (Links: 47/48 ok, 1/1 warning, 1/0 error, 0/1 unknown, 3/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
34%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (119 Success ...),
FTS: ok (Links: 46/42 ok, 1/0 warning, 3/2 error, 0/1 unknown, 2/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
71%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (183 Success ...; 8 Success, no Chirp ExitCode ...),
FTS: ok (Links: 43/44 ok, 2/0 warning, 2/2 error, 0/1 unknown, 2/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
22%SAM: ok (15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (83 Success ...),
FTS: ok (Links: 43/43 ok, 1/0 warning, 2/1 error, 1/1 unknown, 3/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
56%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (179 Success ...),
FTS: ok (Links: 41/43 ok, 0/1 warning, 2/0 error, 1/1 unknown, 3/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
47%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (184 Success ...),
FTS: ok (Links: 45/43 ok, 0/0 warning, 2/0 error, 0/1 unknown, 2/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
62%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (249 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 43/43 ok, 1/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
62%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (251 Success ...),
FTS: ok (Links: 40/44 ok, 0/1 warning, 1/0 error, 0/1 unknown, 1/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
57%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (235 Success ...),
FTS: ok (Links: 40/44 ok, 1/0 warning, 2/0 error, 0/1 unknown, 1/1 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
47%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (257 Success ...),
FTS: ok (Links: 39/43 ok, 0/1 warning, 2/0 error, 0/1 unknown, 1/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
25%SAM: ok (15min evaluations: 88 ok, 0 warning, 4 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (258 Success ...),
FTS: ok (Links: 46/38 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint; ccsrmt2.in2p3.fr: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_FR_GRIF_IRFU
GGUS Tickets: 149150 149272
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m) 82%15min evaluations: 72 ok, 0 warning, 15 error, 9 unknown, 0 downtime (0h0m) 70%15min evaluations: 67 ok, 0 warning, 28 error, 1 unknown, 0 downtime (0h0m) 47%15min evaluations: 45 ok, 0 warning, 50 error, 1 unknown, 0 downtime (0h0m) 78%15min evaluations: 72 ok, 3 warning, 21 error, 0 unknown, 0 downtime (0h0m) 56%15min evaluations: 54 ok, 0 warning, 42 error, 0 unknown, 0 downtime (0h0m) 90%15min evaluations: 87 ok, 0 warning, 9 error, 0 unknown, 0 downtime (0h0m) 67%15min evaluations: 51 ok, 0 warning, 25 error, 20 unknown, 0 downtime (0h0m) 64%15min evaluations: 33 ok, 0 warning, 18 error, 45 unknown, 0 downtime (0h0m) 43%15min evaluations: 42 ok, 0 warning, 54 error, 0 unknown, 0 downtime (0h0m) 21%15min evaluations: 21 ok, 0 warning, 75 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%183 Success [crab3@vocms0199.cern.ch#17522347.0#1602641793 201014_015505:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93191-20201013222902 1 0]... 100%135 Success [crab3@vocms0196.cern.ch#56772379.0#1602718357 201014_182136:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93203-20201014201302 62 0]... 99%208 Success [crab3@vocms0155.cern.ch#60756492.0#1602805420 201015_165729:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93221-20201015184702 81 0]...
1 Failed, ExitCode 8028 [crab3@vocms0155.cern.ch#60781488.0#1602882207 201016_150714:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93234-20201016165102 71 0]...
99%147 Success [crab3@vocms0122.cern.ch#62705421.0#1602926769 201017_091000:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93234-20201016165102 3 0]...
1 Failed, ExitCode 8021 [crab3@vocms0199.cern.ch#17620089.0#1602952083 201017_150653:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93243-20201017165902 16 0]...
100%255 Success [crab3@vocms0199.cern.ch#17626804.0#1602977286 201017_150653:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93243-20201017165902 100 0]... 100%224 Success [crab3@vocms0137.cern.ch#56474694.0#1603064529 201018_140312:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93257-20201018155302 96 0]... 100%171 Success [crab3@vocms0144.cern.ch#60325222.0#1603149899 201019_131848:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93265-20201019150502 121 0]...
3 Success, no Chirp ExitCode [crab3@vocms0144.cern.ch#60377306.0#1603213890 201020_110505:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93277-20201020125702 73 0]...
100%163 Success [crab3@vocms0144.cern.ch#60388978.0#1603236696 201020_110505:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93277-20201020125702 149 0]...
28 Success, no Chirp ExitCode [crab3@vocms0144.cern.ch#60389468.0#1603238198 201020_110505:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93277-20201020125702 154 0]...
100%197 Success [crab3@vocms0194.cern.ch#57620960.0#1603323293 201021_093341:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93286-20201021111702 168 0]...
10 Success, no Chirp ExitCode [crab3@vocms0194.cern.ch#57620664.0#1603322997 201021_093341:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93286-20201021111702 167 0]...
100%170 Success [crab3@vocms0122.cern.ch#62821884.0#1603409094 201022_110329:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93307-20201022125502 148 0]... 100%191 Success [crab3@vocms0197.cern.ch#57318268.0#1603512491 201024_040157:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93315-20201023113502 1 0]... 100%266 Success [crab3@vocms0199.cern.ch#17825575.0#1603582263 201024_094936:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93329-20201024114302 164 0]... 100%220 Success [crab3@vocms0120.cern.ch#58844892.0#1603668412 201025_112520:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93337-20201025121702 144 0]... 100%223 Success [crab3@vocms0199.cern.ch#17894624.0#1603754860 201026_102140:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93350-20201026112102 157 0]... 100%215 Success [crab3@vocms0120.cern.ch#58946885.0#1603842108 201027_121026:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93360-20201027125102 138 0]... 100%233 Success [crab3@vocms0107.cern.ch#60195505.0#1603928357 201028_132754:sciaba_crab_HC-100-T2_FR_GRIF_IRFU-93379-20201028141902 122 0]...
FTS Status: 95%Transfer (from/to): 2775/2301 files, 0.535/1.161 TB ok
Errors: src_missing_file: 15/0, src_error: 15/0, trn_timeout: 22/0, trn_error: 144/11, dst_error: 0/1 foreign: 150/24
Links: 54/49 ok, 1/0 warning, 3/1 error, 0/1 unknown, 3/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
97%Transfer (from/to): 9722/12859 files, 1.677/3.408 TB ok
Errors: src_missing_file: 16/0, src_error: 3/0, trn_timeout: 13/4, trn_error: 25/16, dst_permission: 0/1, dst_path: 0/2, dst_error: 0/3 foreign: 46/10
Links: 52/49 ok, 0/0 warning, 2/1 error, 0/1 unknown, 2/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
98%Transfer (from/to): 1434/4442 files, 1.563/3.599 TB ok
Errors: src_missing_file: 15/0, trn_timeout: 5/2, trn_error: 3/16, dst_error: 0/1 foreign: 27/71
Links: 52/50 ok, 1/0 warning, 0/1 error, 1/1 unknown, 3/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
97%Transfer (from/to): 919/813 files, 0.550/1.873 TB ok
Errors: src_missing_file: 19/0, trn_timeout: 2/2, trn_error: 2/8 foreign: 33/15
Links: 50/47 ok, 0/0 warning, 0/1 error, 1/1 unknown, 3/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
97%Transfer (from/to): 351/344 files, 0.481/0.733 TB ok
Errors: src_missing_file: 12/0, trn_timeout: 3/1, trn_error: 3/7, dst_error: 0/1 foreign: 33/9
Links: 46/43 ok, 2/0 warning, 0/1 error, 1/1 unknown, 3/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
97%Transfer (from/to): 736/10671 files, 1.201/4.042 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 3/3, trn_error: 11/14, dst_error: 0/8 foreign: 30/18
Links: 47/49 ok, 2/1 warning, 0/1 error, 1/1 unknown, 4/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
96%Transfer (from/to): 5271/3663 files, 1.328/2.474 TB ok
Errors: src_permission: 3/0, src_missing_file: 12/0, src_error: 2/0, trn_timeout: 8/7, trn_error: 33/9, dst_error: 0/1 foreign: 39/18
Links: 52/48 ok, 3/0 warning, 1/2 error, 0/1 unknown, 3/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
92%Transfer (from/to): 2815/891 files, 1.109/1.839 TB ok
Errors: src_missing_file: 12/0, trn_timeout: 12/4, trn_user: 14/0, trn_error: 64/45 foreign: 86/17
Links: 53/49 ok, 0/0 warning, 3/4 error, 0/1 unknown, 3/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
95%Transfer (from/to): 2261/712 files, 1.090/1.571 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 7/6, trn_user: 2/0, trn_error: 44/35 foreign: 49/17
Links: 53/50 ok, 1/0 warning, 1/3 error, 0/1 unknown, 5/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
98%Transfer (from/to): 4654/1396 files, 0.916/3.437 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 4/3, trn_error: 8/11, dst_error: 0/1 foreign: 79/16
Links: 54/48 ok, 1/1 warning, 1/0 error, 0/1 unknown, 4/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
97%Transfer (from/to): 5762/567 files, 0.826/1.039 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 1/0, trn_error: 13/13 foreign: 28/14
Links: 53/44 ok, 0/0 warning, 2/0 error, 0/1 unknown, 3/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
98%Transfer (from/to): 1748/2087 files, 1.041/1.873 TB ok
Errors: src_missing_file: 18/0, src_error: 1/0, trn_timeout: 2/0, trn_error: 4/20, dst_error: 0/1 foreign: 33/18
Links: 51/52 ok, 1/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
98%Transfer (from/to): 781/4094 files, 0.919/4.901 TB ok
Errors: src_missing_file: 10/0, trn_timeout: 1/0, trn_error: 4/14 foreign: 23/15
Links: 52/49 ok, 2/1 warning, 0/0 error, 1/1 unknown, 1/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
100%Transfer (from/to): 469/3900 files, 0.539/5.184 TB ok
Errors: src_missing_file: 18/0, src_error: 1/0, trn_timeout: 2/10, trn_error: 3/21, dst_error: 0/2 foreign: 40/40
Links: 50/49 ok, 0/0 warning, 0/0 error, 1/2 unknown, 1/1 bad-endpoint
node12.datagrid.cea.fr: ok/ok
97%Transfer (from/to): 2130/728 files, 0.748/1.353 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 2/2, trn_error: 24/1 foreign: 198/31
Links: 54/47 ok, 1/0 warning, 2/0 error, 0/2 unknown, 2/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
98%Transfer (from/to): 463/688 files, 0.564/1.293 TB ok
Errors: src_missing_file: 18/0, trn_timeout: 29/2, trn_error: 45/0 foreign: 57/9
Links: 55/45 ok, 1/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint
node12.datagrid.cea.fr: ok/ok
Site Readiness:
59%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (183 Success ...),
FTS: ok (Links: 54/49 ok, 1/0 warning, 3/1 error, 0/1 unknown, 3/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
45%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (135 Success ...),
FTS: ok (Links: 52/49 ok, 0/0 warning, 2/1 error, 0/1 unknown, 2/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
80%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (208 Success ...; 1 Failed, ExitCode 8028 ...),
FTS: ok (Links: 52/50 ok, 1/0 warning, 0/1 error, 1/1 unknown, 3/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
46%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (147 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 50/47 ok, 0/0 warning, 0/1 error, 1/1 unknown, 3/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
44%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (255 Success ...),
FTS: ok (Links: 46/43 ok, 2/0 warning, 0/1 error, 1/1 unknown, 3/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
52%SAM: ok (15min evaluations: 91 ok, 0 warning, 0 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (224 Success ...),
FTS: ok (Links: 47/49 ok, 2/1 warning, 0/1 error, 1/1 unknown, 4/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
53%SAM: warning (15min evaluations: 72 ok, 0 warning, 15 error, 9 unknown, 0 downtime (0h0m)),
HC: ok (171 Success ...; 3 Success, no Chirp ExitCode ...),
FTS: ok (Links: 52/48 ok, 3/0 warning, 1/2 error, 0/1 unknown, 3/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
62%SAM: error (15min evaluations: 67 ok, 0 warning, 28 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (163 Success ...; 28 Success, no Chirp ExitCode ...),
FTS: ok (Links: 53/49 ok, 0/0 warning, 3/4 error, 0/1 unknown, 3/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
39%SAM: error (15min evaluations: 45 ok, 0 warning, 50 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (197 Success ...; 10 Success, no Chirp ExitCode ...),
FTS: ok (Links: 53/50 ok, 1/0 warning, 1/3 error, 0/1 unknown, 5/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
60%SAM: error (15min evaluations: 72 ok, 3 warning, 21 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (170 Success ...),
FTS: ok (Links: 54/48 ok, 1/1 warning, 1/0 error, 0/1 unknown, 4/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
36%SAM: error (15min evaluations: 54 ok, 0 warning, 42 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (191 Success ...),
FTS: ok (Links: 53/44 ok, 0/0 warning, 2/0 error, 0/1 unknown, 3/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
72%SAM: ok (15min evaluations: 87 ok, 0 warning, 9 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (266 Success ...),
FTS: ok (Links: 51/52 ok, 1/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
36%SAM: error (15min evaluations: 51 ok, 0 warning, 25 error, 20 unknown, 0 downtime (0h0m)),
HC: ok (220 Success ...),
FTS: ok (Links: 52/49 ok, 2/1 warning, 0/0 error, 1/1 unknown, 1/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
25%SAM: error (15min evaluations: 33 ok, 0 warning, 18 error, 45 unknown, 0 downtime (0h0m)),
HC: ok (223 Success ...),
FTS: ok (Links: 50/49 ok, 0/0 warning, 0/0 error, 1/2 unknown, 1/1 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
34%SAM: error (15min evaluations: 42 ok, 0 warning, 54 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (215 Success ...),
FTS: ok (Links: 54/47 ok, 1/0 warning, 2/0 error, 0/2 unknown, 2/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
15%SAM: error (15min evaluations: 21 ok, 0 warning, 75 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (233 Success ...),
FTS: ok (Links: 55/45 ok, 1/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint; node12.datagrid.cea.fr: ok/ok)
Life Status: WR WR WR
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_FR_GRIF_LLR
GGUS Tickets:
Downtimes:
SAM Status: 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 92 ok, 0 warning, 2 error, 2 unknown, 0 downtime (0h0m) 98%15min evaluations: 91 ok, 1 warning, 1 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 94 ok, 0 warning, 1 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%150 Success [crab3@vocms0155.cern.ch#60654830.0#1602636144 201013_232037:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93191-20201013222902 7 0]... 100%192 Success [crab3@vocms0197.cern.ch#57099140.0#1602717902 201014_181833:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93203-20201014201302 61 0]... 98%175 Success [crab3@vocms0120.cern.ch#58581556.0#1602801931 201015_165423:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93221-20201015184702 70 0]...
2 Failed, ExitCode 8028 [crab3@vocms0144.cern.ch#60214072.0#1602881533 201016_151105:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93234-20201016165102 68 0]...
100%127 Success [crab3@vocms0121.cern.ch#58895517.0#1602926391 201017_091341:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93234-20201016165102 1 0]... 100%212 Success [crab3@vocms0144.cern.ch#60253443.0#1602977290 201017_150714:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93243-20201017165902 100 0]... 100%193 Success [crab3@vocms0196.cern.ch#56922638.0#1603074855 201018_140823:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93257-20201018155302 76 0]... 100%176 Success [crab3@vocms0137.cern.ch#56537638.0#1603149681 201019_131528:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93265-20201019150502 121 0]...
7 Success, no Chirp ExitCode [crab3@vocms0137.cern.ch#56593671.0#1603220302 201020_111208:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93277-20201020125702 93 0]...
100%10 Success, no Chirp ExitCode [crab3@vocms0137.cern.ch#56605145.0#1603236510 201020_111208:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93277-20201020125702 147 0]...
169 Success [crab3@vocms0137.cern.ch#56605437.0#1603236802 201020_111208:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93277-20201020125702 148 0]...
100%154 Success [crab3@vocms0120.cern.ch#58714009.0#1603324279 201021_093002:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93286-20201021111702 172 0]...
20 Success, no Chirp ExitCode [crab3@vocms0120.cern.ch#58720322.0#1603337484 201021_093002:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93286-20201021111702 216 0]...
100%172 Success [crab3@vocms0194.cern.ch#57660045.0#1603409244 201022_110629:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93307-20201022125502 148 0]...
9 Success, no Chirp ExitCode [crab3@vocms0194.cern.ch#57664002.0#1603417342 201022_110629:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93307-20201022125502 175 0]...
100%145 Success [crab3@vocms0196.cern.ch#57181443.0#1603511999 201024_034849:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93315-20201023113502 2 0]... 100%254 Success [crab3@vocms0137.cern.ch#56785114.0#1603582682 201024_095122:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93329-20201024114302 165 0]... 100%222 Success [crab3@vocms0144.cern.ch#60569443.0#1603665607 201025_112343:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93337-20201025121702 135 0]... 100%207 Success [crab3@vocms0197.cern.ch#57454529.0#1603754467 201026_102959:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93350-20201026112102 154 0]... 100%251 Success [crab3@vocms0119.cern.ch#59561268.0#1603841063 201027_121304:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93360-20201027125102 134 0]... 100%243 Success [crab3@vocms0107.cern.ch#60195498.0#1603928163 201028_132502:sciaba_crab_HC-100-T2_FR_GRIF_LLR-93379-20201028141902 122 0]...
FTS Status: 99%Transfer (from/to): 7705/131 files, 0.618/0.257 TB ok
Errors: trn_timeout: 14/0, trn_error: 119/0 foreign: 356/0
Links: 50/28 ok, 0/0 warning, 1/0 error, 0/0 unknown, 3/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
98%Transfer (from/to): 10699/625 files, 2.328/0.234 TB ok
Errors: src_missing_file: 4/0, trn_error: 15/1, dst_error: 0/3 foreign: 72/28
Links: 54/40 ok, 0/1 warning, 1/0 error, 0/0 unknown, 3/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
100%Transfer (from/to): 6718/304 files, 8.738/0.330 TB ok
Errors: src_missing_file: 8/0, src_error: 1/0, trn_timeout: 3/0, trn_error: 62/0 foreign: 65/47
Links: 50/37 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
100%Transfer (from/to): 3646/159 files, 1.373/0.330 TB ok
Errors: trn_error: 5/0, dst_error: 0/2 foreign: 25/152
Links: 44/36 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
100%Transfer (from/to): 1674/139 files, 0.590/0.277 TB ok
Errors: trn_error: 1/0 foreign: 29/134
Links: 44/28 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
98%Transfer (from/to): 7422/156 files, 0.986/0.270 TB ok
Errors: src_missing_file: 3/0, trn_error: 7/2 foreign: 39/94
Links: 50/34 ok, 0/1 warning, 0/0 error, 0/0 unknown, 3/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
97%Transfer (from/to): 4775/289 files, 1.314/0.645 TB ok
Errors: src_permission: 2/0, trn_error: 35/3, dst_error: 0/2 foreign: 182/95
Links: 41/35 ok, 1/0 warning, 1/0 error, 0/0 unknown, 3/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
98%Transfer (from/to): 3191/386 files, 1.038/1.093 TB ok
Errors: trn_timeout: 3/1, trn_user: 38/0, trn_error: 2/1, dst_error: 0/1 foreign: 55/91
Links: 54/37 ok, 1/0 warning, 0/0 error, 0/0 unknown, 3/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
100%Transfer (from/to): 2391/344 files, 1.176/1.081 TB ok
Errors: trn_timeout: 11/0, trn_user: 1/0, trn_error: 116/3, dst_error: 0/1 foreign: 49/104
Links: 46/33 ok, 0/0 warning, 0/0 error, 0/1 unknown, 4/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
97%Transfer (from/to): 4062/510 files, 0.560/1.054 TB ok
Errors: trn_timeout: 24/0, trn_error: 34/14, dst_error: 0/1 foreign: 54/71
Links: 43/34 ok, 1/0 warning, 1/0 error, 0/0 unknown, 4/1 bad-endpoint
polgrid4.in2p3.fr: ok/ok
98%Transfer (from/to): 5494/7883 files, 0.549/2.196 TB ok
Errors: trn_timeout: 22/0, trn_error: 5/9, dst_error: 0/11 foreign: 20/10
Links: 45/35 ok, 0/0 warning, 1/0 error, 0/0 unknown, 2/1 bad-endpoint
polgrid4.in2p3.fr: ok/ok
94%Transfer (from/to): 2481/2132 files, 0.681/3.497 TB ok
Errors: src_error: 1/0, trn_error: 5/37, dst_permission: 0/2, dst_path: 0/1, dst_error: 0/4 foreign: 43/12
Links: 43/30 ok, 0/0 warning, 0/2 error, 0/0 unknown, 2/1 bad-endpoint
polgrid4.in2p3.fr: ok/ok
96%Transfer (from/to): 9907/1202 files, 2.439/1.236 TB ok
Errors: trn_timeout: 1/0, trn_error: 9/26, dst_permission: 0/1, dst_error: 0/1 foreign: 16/6
Links: 46/28 ok, 2/1 warning, 0/0 error, 0/0 unknown, 1/1 bad-endpoint
polgrid4.in2p3.fr: ok/ok
98%Transfer (from/to): 5663/375 files, 1.495/2.132 TB ok
Errors: src_permission: 1/0, trn_timeout: 1/0, trn_user: 25/0, trn_error: 12/10, dst_error: 0/2 foreign: 2302/8
Links: 44/27 ok, 2/0 warning, 0/0 error, 0/0 unknown, 1/1 bad-endpoint
polgrid4.in2p3.fr: ok/ok
100%Transfer (from/to): 5582/280 files, 1.668/2.132 TB ok
Errors: trn_timeout: 6/0, trn_user: 2/0, trn_error: 807/5 foreign: 814/26
Links: 52/30 ok, 3/0 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
98%Transfer (from/to): 2684/841 files, 1.818/7.143 TB ok
Errors: trn_user: 0/2, trn_error: 97/0 foreign: 90/20
Links: 56/39 ok, 1/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
polgrid4.in2p3.fr: ok/ok
Site Readiness:
21%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (150 Success ...),
FTS: ok (Links: 50/28 ok, 0/0 warning, 1/0 error, 0/0 unknown, 3/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
42%SAM: ok (15min evaluations: 92 ok, 0 warning, 2 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (192 Success ...),
FTS: ok (Links: 54/40 ok, 0/1 warning, 1/0 error, 0/0 unknown, 3/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
25%SAM: ok (15min evaluations: 91 ok, 1 warning, 1 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (175 Success ...; 2 Failed, ExitCode 8028 ...),
FTS: ok (Links: 50/37 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
15%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (127 Success ...),
FTS: ok (Links: 44/36 ok, 0/0 warning, 0/0 error, 0/0 unknown, 3/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
26%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (212 Success ...),
FTS: ok (Links: 44/28 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
25%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (193 Success ...),
FTS: ok (Links: 50/34 ok, 0/1 warning, 0/0 error, 0/0 unknown, 3/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
35%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (176 Success ...; 7 Success, no Chirp ExitCode ...),
FTS: ok (Links: 41/35 ok, 1/0 warning, 1/0 error, 0/0 unknown, 3/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
61%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (10 Success, no Chirp ExitCode ...; 169 Success ...),
FTS: ok (Links: 54/37 ok, 1/0 warning, 0/0 error, 0/0 unknown, 3/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
50%SAM: ok (15min evaluations: 94 ok, 0 warning, 1 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (154 Success ...; 20 Success, no Chirp ExitCode ...),
FTS: ok (Links: 46/33 ok, 0/0 warning, 0/0 error, 0/1 unknown, 4/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
70%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (172 Success ...; 9 Success, no Chirp ExitCode ...),
FTS: ok (Links: 43/34 ok, 1/0 warning, 1/0 error, 0/0 unknown, 4/1 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
67%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (145 Success ...),
FTS: ok (Links: 45/35 ok, 0/0 warning, 1/0 error, 0/0 unknown, 2/1 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
94%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (254 Success ...),
FTS: ok (Links: 43/30 ok, 0/0 warning, 0/2 error, 0/0 unknown, 2/1 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
78%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (222 Success ...),
FTS: ok (Links: 46/28 ok, 2/1 warning, 0/0 error, 0/0 unknown, 1/1 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
46%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (207 Success ...),
FTS: ok (Links: 44/27 ok, 2/0 warning, 0/0 error, 0/0 unknown, 1/1 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
56%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (251 Success ...),
FTS: ok (Links: 52/30 ok, 3/0 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
46%SAM: ok (15min evaluations: 93 ok, 0 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (243 Success ...),
FTS: ok (Links: 56/39 ok, 1/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; polgrid4.in2p3.fr: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_FR_IPHC
GGUS Tickets: 149273
Downtimes: Usbgse1.in2p3.fr/SE, sbgce1.in2p3.fr/CE, sbgse1.in2p3.fr/XRD Usbgse1.in2p3.fr/SE, sbgce1.in2p3.fr/CE, sbgse1.in2p3.fr/XRD
SAM Status: 83%15min evaluations: 76 ok, 4 warning, 16 error, 0 unknown, 0 downtime (0h0m) 89%15min evaluations: 86 ok, 0 warning, 10 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 50%15min evaluations: 48 ok, 0 warning, 48 error, 0 unknown, 0 downtime (0h0m) 68%15min evaluations: 66 ok, 0 warning, 30 error, 0 unknown, 0 downtime (0h0m) 98%15min evaluations: 87 ok, 0 warning, 1 error, 8 unknown, 0 downtime (0h0m) 65%15min evaluations: 63 ok, 0 warning, 33 error, 0 unknown, 0 downtime (0h0m) 83%15min evaluations: 80 ok, 0 warning, 16 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 71%15min evaluations: 69 ok, 0 warning, 27 error, 0 unknown, 0 downtime (0h0m) 66%15min evaluations: 64 ok, 0 warning, 32 error, 0 unknown, 0 downtime (0h0m) 93%15min evaluations: 83 ok, 0 warning, 6 error, 7 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%177 Success [crab3@vocms0195.cern.ch#56438374.0#1602632972 201013_232351:sciaba_crab_HC-100-T2_FR_IPHC-93191-20201013222902 4 0]... 100%312 Success [crab3@vocms0121.cern.ch#58795030.0#1602705067 201014_182458:sciaba_crab_HC-100-T2_FR_IPHC-93203-20201014201302 17 0]... 100%309 Success [crab3@vocms0121.cern.ch#58857582.0#1602804782 201015_170430:sciaba_crab_HC-100-T2_FR_IPHC-93221-20201015184702 77 0]... 100%154 Success [crab3@vocms0120.cern.ch#58619608.0#1602924768 201017_084703:sciaba_crab_HC-100-T2_FR_IPHC-93234-20201016165102 1 0]... 100%257 Success [crab3@vocms0119.cern.ch#59072754.0#1602977773 201017_151024:sciaba_crab_HC-100-T2_FR_IPHC-93243-20201017165902 101 0]... 100%186 Success [crab3@vocms0121.cern.ch#58934043.0#1603064871 201018_140644:sciaba_crab_HC-100-T2_FR_IPHC-93257-20201018155302 116 0]... 100%165 Success [crab3@vocms0155.cern.ch#60906244.0#1603151068 201019_131311:sciaba_crab_HC-100-T2_FR_IPHC-93265-20201019150502 126 0]... 100%211 Success [crab3@vocms0144.cern.ch#60388974.0#1603236541 201020_110234:sciaba_crab_HC-100-T2_FR_IPHC-93277-20201020125702 149 0]...
1 Success, no Chirp ExitCode [crab3@vocms0197.cern.ch#57234269.0#1603281702 201021_093533:sciaba_crab_HC-100-T2_FR_IPHC-93286-20201021111702 29 0]...
100%197 Success [crab3@vocms0197.cern.ch#57249681.0#1603322810 201021_093533:sciaba_crab_HC-100-T2_FR_IPHC-93286-20201021111702 166 0]...
1 Success, no Chirp ExitCode [crab3@vocms0106.cern.ch#47888620.0#1603340972 201022_033837:sciaba_crab_HC-100-T2_FR_IPHC-93286-20201021111702 10 0]...
100%183 Success [crab3@vocms0106.cern.ch#47928271.0#1603410334 201022_105936:sciaba_crab_HC-100-T2_FR_IPHC-93307-20201022125502 153 0]... 100%162 Success [crab3@vocms0120.cern.ch#58806962.0#1603512186 201024_035649:sciaba_crab_HC-100-T2_FR_IPHC-93315-20201023113502 1 0]... 100%256 Success [crab3@vocms0137.cern.ch#56785115.0#1603582793 201024_094816:sciaba_crab_HC-100-T2_FR_IPHC-93329-20201024114302 166 0]... 100%243 Success [crab3@vocms0194.cern.ch#57766521.0#1603669190 201025_112838:sciaba_crab_HC-100-T2_FR_IPHC-93337-20201025121702 146 0]... 100%125 Success [crab3@vocms0137.cern.ch#56903278.0#1603800320 201027_115916:sciaba_crab_HC-100-T2_FR_IPHC-93360-20201027125102 1 0]... 99%200 Success [crab3@vocms0137.cern.ch#56930671.0#1603841733 201027_115916:sciaba_crab_HC-100-T2_FR_IPHC-93360-20201027125102 139 0]...
1 Failed, ExitCode 8021 [crab3@vocms0155.cern.ch#61277246.0#1603900821 201028_133400:sciaba_crab_HC-100-T2_FR_IPHC-93379-20201028141902 29 0]...
100%207 Success [crab3@vocms0155.cern.ch#61289904.0#1603928130 201028_133400:sciaba_crab_HC-100-T2_FR_IPHC-93379-20201028141902 120 0]...
FTS Status: 96%Transfer (from/to): 1030/2585 files, 1.457/13.740 TB ok
Errors: src_missing_file: 30/0, src_error: 180/0, trn_timeout: 4/0, trn_error: 78/42, dst_error: 0/29 foreign: 76/23
Links: 47/43 ok, 5/6 warning, 3/1 error, 0/1 unknown, 2/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
97%Transfer (from/to): 903/695 files, 1.389/0.808 TB ok
Errors: src_missing_file: 24/0, src_error: 6/0, trn_timeout: 2/0, trn_error: 24/22, dst_permission: 0/4, dst_error: 0/9 foreign: 97/10
Links: 51/44 ok, 0/8 warning, 2/1 error, 0/1 unknown, 2/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
98%Transfer (from/to): 1606/549 files, 2.562/0.702 TB ok
Errors: src_missing_file: 29/0, trn_timeout: 3/0, trn_error: 7/17, dst_permission: 0/1, dst_path: 0/1, dst_error: 0/11 foreign: 22/46
Links: 56/50 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
97%Transfer (from/to): 1635/330 files, 1.976/0.674 TB ok
Errors: src_permission: 1/0, src_missing_file: 37/0, trn_timeout: 2/0, trn_error: 2/17, dst_permission: 0/1, dst_error: 0/17 foreign: 28/54
Links: 50/40 ok, 1/4 warning, 0/1 error, 1/1 unknown, 2/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
97%Transfer (from/to): 19177/319 files, 1.289/0.667 TB ok
Errors: src_missing_file: 24/0, src_error: 1/0, trn_timeout: 1/0, trn_error: 2/17, dst_permission: 0/5, dst_error: 0/10 foreign: 56/27
Links: 51/39 ok, 0/3 warning, 0/1 error, 1/1 unknown, 2/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
97%Transfer (from/to): 5432/321 files, 1.753/0.606 TB ok
Errors: src_missing_file: 36/0, src_error: 3/0, trn_timeout: 4/2, trn_error: 10/15, dst_permission: 0/1, dst_path: 0/1, dst_error: 0/23 foreign: 36/43
Links: 56/36 ok, 1/14 warning, 1/1 error, 0/1 unknown, 3/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
95%Transfer (from/to): 6348/826 files, 1.832/1.238 TB ok
Errors: src_missing_file: 24/0, src_error: 21/0, trn_timeout: 34/4, trn_error: 8/13, dst_permission: 0/3, dst_error: 0/26 foreign: 190/82
Links: 57/44 ok, 2/2 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
94%Transfer (from/to): 5631/591 files, 1.881/1.126 TB ok
Errors: src_permission: 1/0, src_missing_file: 24/0, src_error: 400/0, trn_timeout: 5/4, trn_error: 5/16, dst_permission: 0/1, dst_error: 0/15 foreign: 115/86
Links: 55/48 ok, 2/1 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
95%Transfer (from/to): 4481/899 files, 1.728/0.973 TB ok
Errors: src_missing_file: 36/0, src_error: 130/0, trn_timeout: 5/10, trn_error: 8/12, dst_error: 0/21 foreign: 118/84
Links: 54/46 ok, 1/5 warning, 1/2 error, 0/1 unknown, 4/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
97%Transfer (from/to): 3539/1399 files, 1.071/0.981 TB ok
Errors: src_missing_file: 36/0, src_error: 1/0, trn_timeout: 4/2, trn_error: 5/7, dst_error: 0/4 foreign: 88/86
Links: 52/45 ok, 3/1 warning, 0/0 error, 1/1 unknown, 2/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
97%Transfer (from/to): 9315/950 files, 0.839/1.132 TB ok
Errors: src_missing_file: 38/0, src_error: 1/0, trn_timeout: 3/0, trn_error: 20/16, dst_permission: 0/2, dst_error: 0/9 foreign: 45/23
Links: 53/45 ok, 1/1 warning, 1/0 error, 1/1 unknown, 3/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
98%Transfer (from/to): 1545/878 files, 1.098/2.003 TB ok
Errors: src_missing_file: 36/0, trn_timeout: 7/0, trn_error: 25/13, dst_permission: 0/3, dst_error: 0/3 foreign: 39/35
Links: 50/49 ok, 2/0 warning, 0/0 error, 1/1 unknown, 2/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
99%Transfer (from/to): 2625/2019 files, 1.642/5.348 TB ok
Errors: src_missing_file: 20/0, src_error: 1/0, trn_timeout: 3/0, trn_error: 5/14, dst_permission: 0/3, dst_error: 0/19 foreign: 4/30
Links: 53/46 ok, 2/5 warning, 0/0 error, 1/1 unknown, 1/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
97%Transfer (from/to): 2378/2010 files, 1.075/4.096 TB ok
Errors: src_permission: 1/0, src_missing_file: 37/0, src_error: 68/0, trn_timeout: 2/0, trn_error: 2/10, dst_permission: 0/3, dst_path: 0/1, dst_error: 0/11 foreign: 900/54
Links: 54/47 ok, 1/2 warning, 0/1 error, 1/2 unknown, 2/1 bad-endpoint
sbgse1.in2p3.fr: ok/ok
96%Transfer (from/to): 2415/424 files, 1.189/0.939 TB ok
Errors: src_missing_file: 38/0, trn_timeout: 2/0, trn_error: 16/7, dst_error: 0/4 foreign: 66/71
Links: 50/44 ok, 0/1 warning, 2/1 error, 0/2 unknown, 2/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
98%Transfer (from/to): 6648/722 files, 3.105/10.210 TB ok
Errors: src_missing_file: 145/0, src_error: 4/0, trn_timeout: 6/0, trn_user: 0/7, trn_error: 40/0, dst_error: 0/2 foreign: 13/29
Links: 54/41 ok, 1/1 warning, 0/0 error, 1/2 unknown, 1/0 bad-endpoint
sbgse1.in2p3.fr: ok/ok
Site Readiness:
59%SAM: warning (15min evaluations: 76 ok, 4 warning, 16 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (177 Success ...),
FTS: ok (Links: 47/43 ok, 5/6 warning, 3/1 error, 0/1 unknown, 2/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
62%SAM: warning (15min evaluations: 86 ok, 0 warning, 10 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (312 Success ...),
FTS: ok (Links: 51/44 ok, 0/8 warning, 2/1 error, 0/1 unknown, 2/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
52%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (309 Success ...),
FTS: ok (Links: 56/50 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
34%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (154 Success ...),
FTS: ok (Links: 50/40 ok, 1/4 warning, 0/1 error, 1/1 unknown, 2/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
28%SAM: error (15min evaluations: 48 ok, 0 warning, 48 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (257 Success ...),
FTS: ok (Links: 51/39 ok, 0/3 warning, 0/1 error, 1/1 unknown, 2/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
32%SAM: error (15min evaluations: 66 ok, 0 warning, 30 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (186 Success ...),
FTS: ok (Links: 56/36 ok, 1/14 warning, 1/1 error, 0/1 unknown, 3/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
61%SAM: ok (15min evaluations: 87 ok, 0 warning, 1 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (165 Success ...),
FTS: ok (Links: 57/44 ok, 2/2 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
55%SAM: error (15min evaluations: 63 ok, 0 warning, 33 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (211 Success ...; 1 Success, no Chirp ExitCode ...),
FTS: ok (Links: 55/48 ok, 2/1 warning, 0/2 error, 0/1 unknown, 2/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
69%SAM: warning (15min evaluations: 80 ok, 0 warning, 16 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (197 Success ...; 1 Success, no Chirp ExitCode ...),
FTS: ok (Links: 54/46 ok, 1/5 warning, 1/2 error, 0/1 unknown, 4/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
71%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (183 Success ...),
FTS: ok (Links: 52/45 ok, 3/1 warning, 0/0 error, 1/1 unknown, 2/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
65%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (162 Success ...),
FTS: ok (Links: 53/45 ok, 1/1 warning, 1/0 error, 1/1 unknown, 3/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
92%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (256 Success ...),
FTS: ok (Links: 50/49 ok, 2/0 warning, 0/0 error, 1/1 unknown, 2/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
81%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (243 Success ...),
FTS: ok (Links: 53/46 ok, 2/5 warning, 0/0 error, 1/1 unknown, 1/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
19%SAM: error (15min evaluations: 69 ok, 0 warning, 27 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (125 Success ...),
FTS: ok (Links: 54/47 ok, 1/2 warning, 0/1 error, 1/2 unknown, 2/1 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
53%SAM: error (15min evaluations: 64 ok, 0 warning, 32 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (200 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 50/44 ok, 0/1 warning, 2/1 error, 0/2 unknown, 2/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
59%SAM: ok (15min evaluations: 83 ok, 0 warning, 6 error, 7 unknown, 0 downtime (0h0m)),
HC: ok (207 Success ...),
FTS: ok (Links: 54/41 ok, 1/1 warning, 0/0 error, 1/2 unknown, 1/0 bad-endpoint; sbgse1.in2p3.fr: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_GR_Ioannina
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 87 ok, 0 warning, 0 error, 9 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 92 ok, 0 warning, 3 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 85%15min evaluations: 82 ok, 0 warning, 14 error, 0 unknown, 0 downtime (0h0m) 88%15min evaluations: 85 ok, 0 warning, 11 error, 0 unknown, 0 downtime (0h0m) 85%15min evaluations: 82 ok, 0 warning, 14 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%203 Success [crab3@vocms0144.cern.ch#60123158.0#1602617941 201013_074248:sciaba_crab_HC-93-T2_GR_Ioannina-93176-20201012103503 143 0]... 100%178 Success [crab3@vocms0121.cern.ch#58800367.0#1602717959 201014_075531:sciaba_crab_HC-93-T2_GR_Ioannina-93198-20201014092703 185 0]... 100%44 Success [crab3@vocms0119.cern.ch#59018841.0#1602799814 201015_064358:sciaba_crab_HC-93-T2_GR_Ioannina-93198-20201014092703 185 0]... ? ? ? 100%33 Success [crab3@vocms0119.cern.ch#59184328.0#1603167730 201020_035108:sciaba_crab_HC-93-T2_GR_Ioannina-93271-20201020054304 6 0]... 100%59 Success [crab3@vocms0119.cern.ch#59219511.0#1603192036 201020_035108:sciaba_crab_HC-93-T2_GR_Ioannina-93271-20201020054304 87 0]... 100%171 Success [crab3@vocms0121.cern.ch#58990910.0#1603325485 201021_233535:sciaba_crab_HC-93-T2_GR_Ioannina-93291-20201022012503 7 0]... 95%180 Success [crab3@vocms0196.cern.ch#57125298.0#1603409929 201022_213256:sciaba_crab_HC-93-T2_GR_Ioannina-93291-20201022012503 25 0]...
3 Failed, ExitCode 8021 [crab3@vocms0196.cern.ch#57125535.0#1603415029 201022_213256:sciaba_crab_HC-93-T2_GR_Ioannina-93291-20201022012503 42 0]...
6 Failed, ExitCode 8028 [crab3@vocms0120.cern.ch#58786548.0#1603485067 201023_153953:sciaba_crab_HC-93-T2_GR_Ioannina-93291-20201022012503 58 0]...
100%9 Success [crab3@vocms0199.cern.ch#17807556.0#1603504771 201024_012835:sciaba_crab_HC-93-T2_GR_Ioannina-93320-20201024031503 6 0]... ? 100%68 Success [crab3@vocms0119.cern.ch#59478245.0#1603690147 201026_045801:sciaba_crab_HC-93-T2_GR_Ioannina-93345-20201026055503 6 0]... 98%69 Success [crab3@vocms0119.cern.ch#59503422.0#1603738394 201026_045801:sciaba_crab_HC-93-T2_GR_Ioannina-93345-20201026055503 88 0]...
1 Failed, ExitCode 8021 [crab3@vocms0119.cern.ch#59507491.0#1603744700 201026_045801:sciaba_crab_HC-93-T2_GR_Ioannina-93345-20201026055503 109 0]...
100%244 Success [crab3@vocms0119.cern.ch#59516158.0#1603761815 201026_045801:sciaba_crab_HC-93-T2_GR_Ioannina-93345-20201026055503 166 0]... 100%213 Success [crab3@vocms0119.cern.ch#59588959.0#1603925455 201028_055942:sciaba_crab_HC-93-T2_GR_Ioannina-93369-20201028065303 202 0]...
FTS Status: 100%Transfer (from/to): 204/451 files, 0.430/0.997 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 11/0, trn_error: 3/1, dst_permission: 0/1, dst_error: 0/2 foreign: 311/64
Links: 48/52 ok, 0/0 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
100%Transfer (from/to): 190/398 files, 0.391/0.886 TB ok
Errors: trn_timeout: 2/1, trn_error: 2/4, dst_permission: 0/1, dst_error: 0/10 foreign: 1/44
Links: 46/50 ok, 2/4 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
98%Transfer (from/to): 201/484 files, 0.491/1.078 TB ok
Errors: trn_timeout: 3/0, trn_error: 2/11, dst_permission: 0/2, dst_error: 0/7 foreign: 1/43
Links: 46/51 ok, 1/2 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
98%Transfer (from/to): 206/506 files, 0.502/1.127 TB ok
Errors: trn_timeout: 1/9, dst_permission: 0/1, dst_error: 0/11 foreign: 0/19
Links: 48/52 ok, 0/1 warning, 0/0 error, 0/2 unknown, 0/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
100%Transfer (from/to): 198/504 files, 0.483/1.142 TB ok
Errors: trn_timeout: 1/0, trn_error: 2/1, dst_permission: 0/3, dst_error: 0/1 foreign: 0/17
Links: 48/53 ok, 0/0 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
98%Transfer (from/to): 193/987 files, 0.471/2.305 TB ok
Errors: trn_timeout: 4/2, trn_error: 1/5, dst_permission: 0/2, dst_path: 0/1, dst_error: 0/4 foreign: 0/19
Links: 44/50 ok, 4/2 warning, 0/0 error, 0/2 unknown, 0/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
96%Transfer (from/to): 204/516 files, 0.496/1.154 TB ok
Errors: src_missing_file: 1/0, src_error: 2/0, trn_timeout: 5/5, trn_error: 2/3, dst_permission: 0/2, dst_error: 0/3 foreign: 1/16
Links: 46/51 ok, 3/1 warning, 0/1 error, 0/2 unknown, 1/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
96%Transfer (from/to): 213/512 files, 0.497/1.151 TB ok
Errors: src_missing_file: 8/0, trn_timeout: 4/11, trn_error: 1/13, dst_permission: 0/1, dst_error: 0/2 foreign: 1/19
Links: 48/51 ok, 2/0 warning, 0/2 error, 0/2 unknown, 1/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
98%Transfer (from/to): 241/492 files, 0.498/1.123 TB ok
Errors: src_missing_file: 20/0, trn_timeout: 6/5, trn_error: 3/40, dst_permission: 0/2, dst_error: 0/8 foreign: 1/18
Links: 48/48 ok, 1/5 warning, 1/1 error, 0/2 unknown, 2/1 bad-endpoint
grid02.physics.uoi.gr: ok/ok
98%Transfer (from/to): 227/503 files, 0.429/1.129 TB ok
Errors: src_missing_file: 16/0, trn_timeout: 3/3, trn_error: 3/8, dst_permission: 0/3, dst_error: 0/4 foreign: 1/13
Links: 48/49 ok, 1/2 warning, 1/0 error, 0/2 unknown, 2/1 bad-endpoint
grid02.physics.uoi.gr: ok/ok
98%Transfer (from/to): 208/516 files, 0.503/1.151 TB ok
Errors: src_missing_file: 16/0, trn_timeout: 3/1, trn_error: 6/16, dst_permission: 0/1, dst_error: 0/3 foreign: 2/14
Links: 46/50 ok, 1/1 warning, 1/0 error, 0/2 unknown, 2/1 bad-endpoint
grid02.physics.uoi.gr: ok/ok
30%Transfer (from/to): 98/403 files, 0.237/0.877 TB ok
Errors: src_missing_file: 14/0, trn_timeout: 1/0, trn_error: 308/246, dst_permission: 0/2, dst_error: 0/7 foreign: 0/20
Links: 7/22 ok, 4/30 warning, 37/1 error, 0/1 unknown, 2/1 bad-endpoint
grid02.physics.uoi.gr: error/ok
64%Transfer (from/to): 163/450 files, 0.388/1.010 TB ok
Errors: src_missing_file: 17/0, trn_timeout: 2/0, trn_error: 205/132, dst_permission: 0/1, dst_error: 0/10 foreign: 1/15
Links: 8/31 ok, 33/22 warning, 9/0 error, 0/2 unknown, 1/1 bad-endpoint
grid02.physics.uoi.gr: warning/ok
98%Transfer (from/to): 209/474 files, 0.518/1.124 TB ok
Errors: src_missing_file: 13/0, src_error: 2/0, trn_timeout: 5/1, trn_error: 2/12, dst_permission: 0/2, dst_path: 0/1, dst_error: 0/6 foreign: 6/26
Links: 44/52 ok, 3/1 warning, 1/0 error, 0/2 unknown, 2/1 bad-endpoint
grid02.physics.uoi.gr: ok/ok
98%Transfer (from/to): 236/423 files, 0.439/0.939 TB ok
Errors: src_missing_file: 15/0, trn_timeout: 3/0, trn_error: 3/2, dst_error: 0/2 foreign: 11/32
Links: 44/50 ok, 2/0 warning, 1/0 error, 0/3 unknown, 2/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
98%Transfer (from/to): 244/325 files, 0.444/0.732 TB ok
Errors: src_missing_file: 16/0, trn_timeout: 2/0, trn_error: 2/8, dst_permission: 0/3, dst_error: 0/3 foreign: 9/19
Links: 46/51 ok, 1/1 warning, 1/0 error, 0/3 unknown, 2/0 bad-endpoint
grid02.physics.uoi.gr: ok/ok
Site Readiness:
29%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (203 Success ...),
FTS: ok (Links: 48/52 ok, 0/0 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
22%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (178 Success ...),
FTS: ok (Links: 46/50 ok, 2/4 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
4%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (44 Success ...),
FTS: ok (Links: 46/51 ok, 1/2 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: unknown,
FTS: ok (Links: 48/52 ok, 0/1 warning, 0/0 error, 0/2 unknown, 0/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
0%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: unknown,
FTS: ok (Links: 48/53 ok, 0/0 warning, 0/0 error, 0/2 unknown, 1/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: unknown,
FTS: ok (Links: 44/50 ok, 4/2 warning, 0/0 error, 0/2 unknown, 0/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
5%SAM: ok (15min evaluations: 87 ok, 0 warning, 0 error, 9 unknown, 0 downtime (0h0m)),
HC: ok (33 Success ...),
FTS: ok (Links: 46/51 ok, 3/1 warning, 0/1 error, 0/2 unknown, 1/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
11%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (59 Success ...),
FTS: ok (Links: 48/51 ok, 2/0 warning, 0/2 error, 0/2 unknown, 1/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
4%SAM: ok (15min evaluations: 92 ok, 0 warning, 3 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (171 Success ...),
FTS: ok (Links: 48/48 ok, 1/5 warning, 1/1 error, 0/2 unknown, 2/1 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
33%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (180 Success ...; 3 Failed, ExitCode 8021 ...; 6 Failed, ExitCode 8028 ...),
FTS: ok (Links: 48/49 ok, 1/2 warning, 1/0 error, 0/2 unknown, 2/1 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
4%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (9 Success ...),
FTS: ok (Links: 46/50 ok, 1/1 warning, 1/0 error, 0/2 unknown, 2/1 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
0%SAM: warning (15min evaluations: 82 ok, 0 warning, 14 error, 0 unknown, 0 downtime (0h0m)),
HC: unknown,
FTS: error (Links: 7/22 ok, 4/30 warning, 37/1 error, 0/1 unknown, 2/1 bad-endpoint; grid02.physics.uoi.gr: error/ok)
3%SAM: warning (15min evaluations: 85 ok, 0 warning, 11 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (68 Success ...),
FTS: warning (Links: 8/31 ok, 33/22 warning, 9/0 error, 0/2 unknown, 1/1 bad-endpoint; grid02.physics.uoi.gr: warning/ok)
14%SAM: warning (15min evaluations: 82 ok, 0 warning, 14 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (69 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 44/52 ok, 3/1 warning, 1/0 error, 0/2 unknown, 2/1 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
29%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (244 Success ...),
FTS: ok (Links: 44/50 ok, 2/0 warning, 1/0 error, 0/3 unknown, 2/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
20%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (213 Success ...),
FTS: ok (Links: 46/51 ok, 1/1 warning, 1/0 error, 0/3 unknown, 2/0 bad-endpoint; grid02.physics.uoi.gr: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_HU_Budapest
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 76 ok, 0 warning, 0 error, 20 unknown, 0 downtime (0h0m) 100%15min evaluations: 60 ok, 0 warning, 0 error, 36 unknown, 0 downtime (0h0m) 100%15min evaluations: 68 ok, 3 warning, 0 error, 25 unknown, 0 downtime (0h0m) 98%15min evaluations: 77 ok, 0 warning, 1 error, 18 unknown, 0 downtime (0h0m) 96%15min evaluations: 75 ok, 5 warning, 3 error, 13 unknown, 0 downtime (0h0m) 92%15min evaluations: 73 ok, 0 warning, 6 error, 17 unknown, 0 downtime (0h0m) 100%15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 74%15min evaluations: 71 ok, 0 warning, 24 error, 1 unknown, 0 downtime (0h0m) 73%15min evaluations: 67 ok, 0 warning, 24 error, 5 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%159 Success [crab3@vocms0195.cern.ch#56438091.0#1602631705 201013_083715:sciaba_crab_HC-94-T2_HU_Budapest-93187-20201013102502 178 0]... 100%146 Success [crab3@vocms0155.cern.ch#60704370.0#1602718320 201014_085045:sciaba_crab_HC-94-T2_HU_Budapest-93199-20201014103302 176 0]... 99%205 Success [crab3@vocms0107.cern.ch#59851274.0#1602805216 201015_081418:sciaba_crab_HC-94-T2_HU_Budapest-93218-20201015095902 185 0]...
1 Failed, ExitCode 8021 [crab3@vocms0120.cern.ch#58609450.0#1602875883 201016_093205:sciaba_crab_HC-94-T2_HU_Budapest-93230-20201016112502 117 0]...
100%178 Success [crab3@vocms0107.cern.ch#59887732.0#1602906107 201017_033539:sciaba_crab_HC-94-T2_HU_Budapest-93230-20201016112502 1 0]... 99%262 Success [crab3@vocms0122.cern.ch#62742103.0#1602977411 201017_071343:sciaba_crab_HC-94-T2_HU_Budapest-93240-20201017090502 195 0]...
1 Failed, ExitCode 8021 [crab3@vocms0199.cern.ch#17641345.0#1603052874 201018_085157:sciaba_crab_HC-94-T2_HU_Budapest-93253-20201018103501 139 0]...
98%202 Success [crab3@vocms0199.cern.ch#17648269.0#1603064576 201018_085157:sciaba_crab_HC-94-T2_HU_Budapest-93253-20201018103501 178 0]...
3 Failed, ExitCode 8021 [crab3@vocms0199.cern.ch#17648507.0#1603066375 201018_085157:sciaba_crab_HC-94-T2_HU_Budapest-93253-20201018103501 184 0]...
100%165 Success [crab3@vocms0144.cern.ch#60325291.0#1603150613 201019_081044:sciaba_crab_HC-94-T2_HU_Budapest-93262-20201019100501 185 0]... 100%221 Success [crab3@vocms0137.cern.ch#56605602.0#1603237005 201020_101547:sciaba_crab_HC-94-T2_HU_Budapest-93276-20201020120502 160 0]... 100%182 Success [crab3@vocms0122.cern.ch#62784942.0#1603323609 201021_085350:sciaba_crab_HC-94-T2_HU_Budapest-93285-20201021104102 177 0]... 100%212 Success [crab3@vocms0199.cern.ch#17771636.0#1603411612 201022_075520:sciaba_crab_HC-94-T2_HU_Budapest-93303-20201022093902 194 0]... 100%156 Success [crab3@vocms0121.cern.ch#59064780.0#1603508351 201024_024818:sciaba_crab_HC-94-T2_HU_Budapest-93313-20201023102702 2 0]... 100%267 Success [crab3@vocms0194.cern.ch#57744206.0#1603582685 201024_091633:sciaba_crab_HC-94-T2_HU_Budapest-93328-20201024105702 172 0]... 100%252 Success [crab3@vocms0144.cern.ch#60569641.0#1603668408 201025_075527:sciaba_crab_HC-94-T2_HU_Budapest-93334-20201025084902 186 0]... 100%216 Success [crab3@vocms0120.cern.ch#58885181.0#1603755413 201026_093011:sciaba_crab_HC-94-T2_HU_Budapest-93349-20201026102902 169 0]... 100%218 Success [crab3@vocms0195.cern.ch#56923739.0#1603841070 201027_082322:sciaba_crab_HC-94-T2_HU_Budapest-93356-20201027092102 180 0]... 94%240 Success [crab3@vocms0196.cern.ch#57346088.0#1603928149 201028_100747:sciaba_crab_HC-94-T2_HU_Budapest-93371-20201028105102 161 0]...
14 Failed, ExitCode 8001 [crab3@vocms0106.cern.ch#48174652.0#1604004259 201029_091302:sciaba_crab_HC-94-T2_HU_Budapest-93385-20201029095302 138 0]...
FTS Status: 97%Transfer (from/to): 897/306 files, 0.497/0.620 TB ok
Errors: src_error: 2/0, trn_timeout: 3/7, trn_error: 55/1 foreign: 23/8
Links: 48/45 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
grid143.kfki.hu: ok/ok
96%Transfer (from/to): 1189/330 files, 0.415/0.537 TB ok
Errors: trn_timeout: 1/19, trn_error: 11/0 foreign: 25/3
Links: 49/44 ok, 0/2 warning, 1/1 error, 0/1 unknown, 0/0 bad-endpoint
grid143.kfki.hu: ok/ok
96%Transfer (from/to): 888/339 files, 0.501/0.656 TB ok
Errors: src_missing_file: 1/0, src_error: 1/0, trn_timeout: 2/20, trn_error: 2/0, dst_error: 0/2 foreign: 5/26
Links: 48/44 ok, 0/2 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
grid143.kfki.hu: ok/ok
98%Transfer (from/to): 2732/725 files, 0.458/1.791 TB ok
Errors: src_error: 4/0, trn_timeout: 2/117, trn_user: 0/2, trn_error: 1/1 foreign: 10/20
Links: 48/36 ok, 1/6 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint
grid143.kfki.hu: ok/ok
98%Transfer (from/to): 1493/37780 files, 0.468/0.904 TB ok
Errors: src_error: 3/0, trn_timeout: 2/21, trn_user: 0/1, trn_error: 2/1, dst_error: 0/51 foreign: 4/22
Links: 48/50 ok, 0/2 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint
grid143.kfki.hu: ok/ok
81%Transfer (from/to): 1169/5693 files, 0.663/0.499 TB ok
Errors: src_error: 1/0, trn_timeout: 8/177, trn_error: 6/3, dst_error: 0/5 foreign: 9/17
Links: 45/18 ok, 2/25 warning, 1/5 error, 0/1 unknown, 1/0 bad-endpoint
grid143.kfki.hu: ok/ok
97%Transfer (from/to): 3081/848 files, 0.842/2.201 TB ok
Errors: src_error: 1/0, trn_timeout: 17/39, trn_error: 0/2, dst_permission: 0/2, dst_error: 0/70 foreign: 16/80
Links: 52/43 ok, 2/4 warning, 0/1 error, 0/1 unknown, 0/0 bad-endpoint
grid143.kfki.hu: ok/ok
94%Transfer (from/to): 707/1568 files, 0.608/4.534 TB ok
Errors: src_error: 36/0, trn_timeout: 6/41, trn_user: 0/1, trn_error: 1/0 foreign: 28/59
Links: 49/47 ok, 2/0 warning, 1/3 error, 0/1 unknown, 1/0 bad-endpoint
grid143.kfki.hu: ok/ok
98%Transfer (from/to): 858/29088 files, 0.559/12.157 TB ok
Errors: src_error: 15/0, trn_timeout: 7/10, trn_user: 0/1, trn_error: 5/0, dst_error: 0/23 foreign: 50/70
Links: 51/56 ok, 1/0 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint
grid143.kfki.hu: ok/ok
87%Transfer (from/to): 490/543 files, 0.516/5.195 TB ok
Errors: trn_timeout: 8/92, trn_user: 0/1, trn_error: 10/10 foreign: 50/44
Links: 48/29 ok, 5/13 warning, 0/4 error, 0/1 unknown, 2/1 bad-endpoint
grid143.kfki.hu: ok/ok
97%Transfer (from/to): 644/458 files, 0.641/0.917 TB ok
Errors: trn_timeout: 6/13, trn_error: 4/13 foreign: 41/12
Links: 48/43 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint
grid143.kfki.hu: ok/ok
97%Transfer (from/to): 1782/436 files, 0.756/0.822 TB ok
Errors: trn_timeout: 5/6, trn_error: 5/12 foreign: 77/10
Links: 47/43 ok, 1/0 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint
grid143.kfki.hu: ok/ok
96%Transfer (from/to): 795/1546 files, 0.640/4.520 TB ok
Errors: trn_timeout: 22/9, trn_error: 5/11, dst_path: 0/1, dst_error: 0/2 foreign: 26/8
Links: 48/44 ok, 1/0 warning, 1/1 error, 0/1 unknown, 1/1 bad-endpoint
grid143.kfki.hu: ok/ok
95%Transfer (from/to): 1761/819 files, 3.649/2.180 TB ok
Errors: src_error: 35/0, trn_timeout: 2/6, trn_error: 15/11, dst_error: 0/1 foreign: 695/13
Links: 48/44 ok, 3/1 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint
grid143.kfki.hu: ok/ok
89%Transfer (from/to): 1949/716 files, 3.196/2.561 TB ok
Errors: src_missing_file: 12/0, trn_timeout: 3/209, trn_user: 0/17, trn_error: 92/16 foreign: 49/24
Links: 41/45 ok, 2/6 warning, 4/4 error, 1/1 unknown, 2/0 bad-endpoint
grid143.kfki.hu: ok/ok
90%Transfer (from/to): 4149/1353 files, 3.551/4.172 TB ok
Errors: src_missing_file: 13/0, src_error: 5/0, trn_timeout: 1/26, trn_user: 0/29, trn_error: 99/10, dst_permission: 0/2, dst_path: 0/1, dst_error: 0/26 foreign: 71/34
Links: 40/49 ok, 7/4 warning, 5/2 error, 0/1 unknown, 2/0 bad-endpoint
grid143.kfki.hu: ok/ok
Site Readiness:
41%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (159 Success ...),
FTS: ok (Links: 48/45 ok, 0/0 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; grid143.kfki.hu: ok/ok)
41%SAM: ok (15min evaluations: 76 ok, 0 warning, 0 error, 20 unknown, 0 downtime (0h0m)),
HC: ok (146 Success ...),
FTS: ok (Links: 49/44 ok, 0/2 warning, 1/1 error, 0/1 unknown, 0/0 bad-endpoint; grid143.kfki.hu: ok/ok)
37%SAM: ok (15min evaluations: 60 ok, 0 warning, 0 error, 36 unknown, 0 downtime (0h0m)),
HC: ok (205 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 48/44 ok, 0/2 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; grid143.kfki.hu: ok/ok)
36%SAM: ok (15min evaluations: 68 ok, 3 warning, 0 error, 25 unknown, 0 downtime (0h0m)),
HC: ok (178 Success ...),
FTS: ok (Links: 48/36 ok, 1/6 warning, 0/0 error, 0/1 unknown, 1/0 bad-endpoint; grid143.kfki.hu: ok/ok)
43%SAM: ok (15min evaluations: 77 ok, 0 warning, 1 error, 18 unknown, 0 downtime (0h0m)),
HC: ok (262 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 48/50 ok, 0/2 warning, 0/1 error, 0/1 unknown, 1/0 bad-endpoint; grid143.kfki.hu: ok/ok)
49%SAM: ok (15min evaluations: 75 ok, 5 warning, 3 error, 13 unknown, 0 downtime (0h0m)),
HC: ok (202 Success ...; 3 Failed, ExitCode 8021 ...),
FTS: ok (Links: 45/18 ok, 2/25 warning, 1/5 error, 0/1 unknown, 1/0 bad-endpoint; grid143.kfki.hu: ok/ok)
61%SAM: ok (15min evaluations: 73 ok, 0 warning, 6 error, 17 unknown, 0 downtime (0h0m)),
HC: ok (165 Success ...),
FTS: ok (Links: 52/43 ok, 2/4 warning, 0/1 error, 0/1 unknown, 0/0 bad-endpoint; grid143.kfki.hu: ok/ok)
69%SAM: ok (15min evaluations: 92 ok, 0 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (221 Success ...),
FTS: ok (Links: 49/47 ok, 2/0 warning, 1/3 error, 0/1 unknown, 1/0 bad-endpoint; grid143.kfki.hu: ok/ok)
69%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (182 Success ...),
FTS: ok (Links: 51/56 ok, 1/0 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint; grid143.kfki.hu: ok/ok)
46%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (212 Success ...),
FTS: ok (Links: 48/29 ok, 5/13 warning, 0/4 error, 0/1 unknown, 2/1 bad-endpoint; grid143.kfki.hu: ok/ok)
57%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (156 Success ...),
FTS: ok (Links: 48/43 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint; grid143.kfki.hu: ok/ok)
77%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (267 Success ...),
FTS: ok (Links: 47/43 ok, 1/0 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint; grid143.kfki.hu: ok/ok)
77%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (252 Success ...),
FTS: ok (Links: 48/44 ok, 1/0 warning, 1/1 error, 0/1 unknown, 1/1 bad-endpoint; grid143.kfki.hu: ok/ok)
53%SAM: error (15min evaluations: 71 ok, 0 warning, 24 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (216 Success ...),
FTS: ok (Links: 48/44 ok, 3/1 warning, 0/1 error, 0/1 unknown, 2/1 bad-endpoint; grid143.kfki.hu: ok/ok)
53%SAM: error (15min evaluations: 67 ok, 0 warning, 24 error, 5 unknown, 0 downtime (0h0m)),
HC: ok (218 Success ...),
FTS: ok (Links: 41/45 ok, 2/6 warning, 4/4 error, 1/1 unknown, 2/0 bad-endpoint; grid143.kfki.hu: ok/ok)
85%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (240 Success ...; 14 Failed, ExitCode 8001 ...),
FTS: ok (Links: 40/49 ok, 7/4 warning, 5/2 error, 0/1 unknown, 2/0 bad-endpoint; grid143.kfki.hu: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_IN_TIFR
GGUS Tickets: 147831, 148835
Downtimes:
SAM Status: 97%15min evaluations: 77 ok, 15 warning, 2 error, 2 unknown, 0 downtime (0h0m) 98%15min evaluations: 70 ok, 23 warning, 1 error, 2 unknown, 0 downtime (0h0m) 77%15min evaluations: 45 ok, 29 warning, 21 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 81 ok, 15 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 89 ok, 5 warning, 0 error, 2 unknown, 0 downtime (0h0m) 96%15min evaluations: 69 ok, 6 warning, 3 error, 18 unknown, 0 downtime (0h0m) 100%15min evaluations: 73 ok, 4 warning, 0 error, 19 unknown, 0 downtime (0h0m) 94%15min evaluations: 85 ok, 0 warning, 5 error, 6 unknown, 0 downtime (0h0m) 95%15min evaluations: 82 ok, 0 warning, 4 error, 10 unknown, 0 downtime (0h0m) 100%15min evaluations: 80 ok, 6 warning, 0 error, 10 unknown, 0 downtime (0h0m) 100%15min evaluations: 71 ok, 0 warning, 0 error, 25 unknown, 0 downtime (0h0m) 100%15min evaluations: 77 ok, 4 warning, 0 error, 15 unknown, 0 downtime (0h0m) 100%15min evaluations: 86 ok, 0 warning, 0 error, 10 unknown, 0 downtime (0h0m) 100%15min evaluations: 79 ok, 4 warning, 0 error, 13 unknown, 0 downtime (0h0m) 95%15min evaluations: 79 ok, 2 warning, 4 error, 11 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%186 Success [crab3@vocms0121.cern.ch#58762110.0#1602632169 201013_221131:sciaba_crab_HC-99-T2_IN_TIFR-93182-20201013034702 12 0]... 97%198 Success [crab3@vocms0121.cern.ch#58800507.0#1602718972 201014_231211:sciaba_crab_HC-99-T2_IN_TIFR-93204-20201015010101 6 0]...
2 Failed, ExitCode 134 [crab3@vocms0121.cern.ch#58831198.0#1602772987 201014_231211:sciaba_crab_HC-99-T2_IN_TIFR-93204-20201015010101 186 0]...
4 Failed, ExitCode 65 [crab3@vocms0121.cern.ch#58829699.0#1602770581 201014_231211:sciaba_crab_HC-99-T2_IN_TIFR-93204-20201015010101 178 0]...
95%104 Success [crab3@vocms0137.cern.ch#56410917.0#1602805131 201015_231252:sciaba_crab_HC-99-T2_IN_TIFR-93224-20201016011101 5 0]...
4 Failed, ExitCode 8021 [crab3@vocms0137.cern.ch#56430689.0#1602844439 201015_231252:sciaba_crab_HC-99-T2_IN_TIFR-93224-20201016011101 136 0]...
1 Failed, ExitCode 65 [crab3@vocms0137.cern.ch#56433168.0#1602852544 201015_231252:sciaba_crab_HC-99-T2_IN_TIFR-93224-20201016011101 163 0]...
99%247 Success [crab3@vocms0121.cern.ch#58893098.0#1602897841 201017_011251:sciaba_crab_HC-99-T2_IN_TIFR-93237-20201017030301 2 0]...
1 Failed, ExitCode 65 [crab3@vocms0121.cern.ch#58893423.0#1602900540 201017_011251:sciaba_crab_HC-99-T2_IN_TIFR-93237-20201017030301 11 0]...
1 Failed, ExitCode 8021 [crab3@vocms0121.cern.ch#58910157.0#1602962354 201017_011251:sciaba_crab_HC-99-T2_IN_TIFR-93237-20201017030301 217 0]...
100%261 Success [crab3@vocms0107.cern.ch#59915540.0#1602978211 201017_192714:sciaba_crab_HC-99-T2_IN_TIFR-93237-20201017030301 51 0]... 99%238 Success [crab3@vocms0122.cern.ch#62748938.0#1603064847 201018_190120:sciaba_crab_HC-99-T2_IN_TIFR-93247-20201018025102 57 0]...
1 Failed, ExitCode 65 [crab3@vocms0195.cern.ch#56602195.0#1603131322 201019_031406:sciaba_crab_HC-99-T2_IN_TIFR-93259-20201019050502 180 0]...
97%199 Success [crab3@vocms0195.cern.ch#56623645.0#1603150642 201019_211119:sciaba_crab_HC-99-T2_IN_TIFR-93259-20201019050502 29 0]...
2 Failed, ExitCode 1 [crab3@vocms0195.cern.ch#56674964.0#1603208263 201020_022141:sciaba_crab_HC-99-T2_IN_TIFR-93269-20201020041302 159 0]...
1 Failed, ExitCode 81 [crab3@vocms0195.cern.ch#56678330.0#1603210964 201020_022141:sciaba_crab_HC-99-T2_IN_TIFR-93269-20201020041302 168 0]...
2 Failed, ExitCode 65 [crab3@vocms0195.cern.ch#56686764.0#1603226865 201020_022141:sciaba_crab_HC-99-T2_IN_TIFR-93269-20201020041302 221 0]...
1 Failed, ExitCode 134 [crab3@vocms0199.cern.ch#17663583.0#1603234642 201020_202123:sciaba_crab_HC-99-T2_IN_TIFR-93269-20201020041302 31 0]...
100%196 Success [crab3@vocms0199.cern.ch#17663670.0#1603236442 201020_202123:sciaba_crab_HC-99-T2_IN_TIFR-93269-20201020041302 37 0]... 96%232 Success [crab3@vocms0194.cern.ch#57620657.0#1603322952 201021_205253:sciaba_crab_HC-99-T2_IN_TIFR-93281-20201021044102 31 0]...
6 Failed, ExitCode 8021 [crab3@vocms0122.cern.ch#62807794.0#1603370697 201022_030333:sciaba_crab_HC-99-T2_IN_TIFR-93299-20201022050302 116 0]...
1 Failed, ExitCode 8001 [crab3@vocms0122.cern.ch#62816847.0#1603385994 201022_030333:sciaba_crab_HC-99-T2_IN_TIFR-93299-20201022050302 167 0]...
1 Failed, ExitCode 65 [crab3@vocms0122.cern.ch#62821877.0#1603408726 201022_210301:sciaba_crab_HC-99-T2_IN_TIFR-93299-20201022050302 27 0]...
98%883 Success [crab3@vocms0122.cern.ch#62821952.0#1603409926 201022_210301:sciaba_crab_HC-99-T2_IN_TIFR-93299-20201022050302 31 0]...
12 Failed, ExitCode 65 [crab3@vocms0196.cern.ch#57128746.0#1603428285 201023_022617:sciaba_crab_HC-99-T2_IN_TIFR-93310-20201023041902 24 0]...
1 Failed, ExitCode 10040 [crab3@vocms0196.cern.ch#57136333.0#1603447797 201023_022617:sciaba_crab_HC-99-T2_IN_TIFR-93310-20201023041902 89 0]...
2 Failed, ExitCode 8001 [crab3@vocms0196.cern.ch#57136371.0#1603448400 201023_022617:sciaba_crab_HC-99-T2_IN_TIFR-93310-20201023041902 91 0]...
2 Failed, ExitCode 1 [crab3@vocms0196.cern.ch#57141304.0#1603459524 201023_022617:sciaba_crab_HC-99-T2_IN_TIFR-93310-20201023041902 128 0]...
1 Failed, ExitCode 8028 [crab3@vocms0196.cern.ch#57151729.0#1603484110 201023_022617:sciaba_crab_HC-99-T2_IN_TIFR-93310-20201023041902 210 0]...
97%166 Success [crab3@vocms0119.cern.ch#59411704.0#1603505322 201024_015725:sciaba_crab_HC-99-T2_IN_TIFR-93321-20201024034102 2 0]...
3 Failed, ExitCode 65 [crab3@vocms0119.cern.ch#59414612.0#1603508621 201024_015725:sciaba_crab_HC-99-T2_IN_TIFR-93321-20201024034102 13 0]...
1 Failed, ExitCode 134 [crab3@vocms0119.cern.ch#59422808.0#1603516421 201024_015725:sciaba_crab_HC-99-T2_IN_TIFR-93321-20201024034102 39 0]...
99%227 Success [crab3@vocms0196.cern.ch#57196351.0#1603581938 201024_200936:sciaba_crab_HC-99-T2_IN_TIFR-93321-20201024034102 39 0]...
1 Failed, ExitCode 65 [crab3@vocms0196.cern.ch#57211976.0#1603665219 201025_204730:sciaba_crab_HC-99-T2_IN_TIFR-93332-20201025034302 21 0]...
100%137 Success [crab3@vocms0196.cern.ch#57213802.0#1603668520 201025_204730:sciaba_crab_HC-99-T2_IN_TIFR-93332-20201025034302 32 0]... 96%183 Success [crab3@vocms0137.cern.ch#56882956.0#1603755082 201026_022443:sciaba_crab_HC-99-T2_IN_TIFR-93342-20201026031501 133 0]...
5 Failed, ExitCode 65 [crab3@vocms0197.cern.ch#57459217.0#1603764803 201027_015717:sciaba_crab_HC-99-T2_IN_TIFR-93354-20201027024103 3 0]...
1 Failed, ExitCode 139 [crab3@vocms0197.cern.ch#57470455.0#1603789110 201027_015717:sciaba_crab_HC-99-T2_IN_TIFR-93354-20201027024103 84 0]...
96%221 Success [crab3@vocms0194.cern.ch#57879388.0#1603841914 201027_195734:sciaba_crab_HC-99-T2_IN_TIFR-93354-20201027024103 44 0]...
7 Failed, ExitCode 65 [crab3@vocms0155.cern.ch#61261924.0#1603877132 201028_005915:sciaba_crab_HC-99-T2_IN_TIFR-93363-20201028015502 101 0]...
1 Failed, ExitCode 74 [crab3@vocms0155.cern.ch#61259767.0#1603874432 201028_005915:sciaba_crab_HC-99-T2_IN_TIFR-93363-20201028015502 92 0]...
93%227 Success [crab3@vocms0107.cern.ch#60195113.0#1603927350 201028_190124:sciaba_crab_HC-99-T2_IN_TIFR-93363-20201028015502 52 0]...
14 Failed, ExitCode 65 [crab3@vocms0107.cern.ch#60195777.0#1603930950 201028_190124:sciaba_crab_HC-99-T2_IN_TIFR-93363-20201028015502 64 0]...
1 Failed, ExitCode 139 [crab3@vocms0155.cern.ch#61310518.0#1603967332 201029_023752:sciaba_crab_HC-99-T2_IN_TIFR-93383-20201029032502 94 0]...
2 Failed, ExitCode 134 [crab3@vocms0121.cern.ch#59326758.0#1604015026 201029_204252:sciaba_crab_HC-99-T2_IN_TIFR-93383-20201029032502 36 0]...
FTS Status: 89%Transfer (from/to): 5162/85217 files, 4.898/1.638 TB ok
Errors: src_missing_file: 527/0, src_error: 3/0, trn_timeout: 13/6, trn_error: 217/4893, dst_path: 0/6, dst_error: 0/64 foreign: 98/8
Links: 26/49 ok, 0/0 warning, 3/0 error, 0/0 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
86%Transfer (from/to): 3060/77925 files, 6.780/3.375 TB ok
Errors: src_missing_file: 600/0, src_error: 12/0, trn_timeout: 15/3, trn_error: 160/4554, dst_error: 0/73 foreign: 36/0
Links: 26/44 ok, 1/3 warning, 3/0 error, 0/0 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
84%Transfer (from/to): 3047/62434 files, 5.716/1.325 TB ok
Errors: src_missing_file: 280/0, src_error: 250/0, trn_timeout: 17/12, trn_error: 124/592, dst_permission: 0/15, dst_path: 0/3, dst_error: 0/96 foreign: 9/2
Links: 27/50 ok, 0/0 warning, 5/0 error, 0/0 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
95%Transfer (from/to): 2440/26750 files, 5.862/0.680 TB ok
Errors: trn_timeout: 146/5, trn_error: 49/5, dst_permission: 0/129, dst_path: 0/1, dst_error: 0/10 foreign: 4/9
Links: 21/43 ok, 0/3 warning, 0/2 error, 0/0 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
100%Transfer (from/to): 2777/19329 files, 6.122/0.587 TB ok
Errors: trn_timeout: 6/5, trn_user: 0/1403, trn_error: 65/1, dst_error: 0/3 foreign: 2/1
Links: 20/40 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
100%Transfer (from/to): 4348/27256 files, 6.430/0.680 TB ok
Errors: trn_timeout: 21/3, trn_error: 152/1, dst_error: 0/6 foreign: 20/0
Links: 31/43 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
se01.indiacms.res.in: ok/ok
74%Transfer (from/to): 3980/4821 files, 6.012/1.062 TB ok
Errors: trn_timeout: 37/1, trn_error: 129/0, dst_permission: 0/451, dst_path: 0/2, dst_error: 0/24 foreign: 4/18
Links: 28/27 ok, 0/2 warning, 1/19 error, 0/0 unknown, 0/0 bad-endpoint
se01.indiacms.res.in: ok/ok
92%Transfer (from/to): 7046/35016 files, 7.451/2.454 TB ok
Errors: src_missing_file: 16/0, src_error: 40/0, trn_timeout: 164/5, trn_error: 178/10, dst_permission: 0/747, dst_error: 0/3 foreign: 41/100
Links: 35/52 ok, 1/0 warning, 0/5 error, 0/0 unknown, 1/0 bad-endpoint
se01.indiacms.res.in: ok/ok
82%Transfer (from/to): 5687/37053 files, 7.977/5.440 TB ok
Errors: src_error: 123/0, trn_timeout: 83/14, trn_error: 287/1564, dst_permission: 0/1004, dst_error: 0/96 foreign: 76/404
Links: 36/42 ok, 0/4 warning, 0/11 error, 0/0 unknown, 2/0 bad-endpoint
se01.indiacms.res.in: ok/ok
73%Transfer (from/to): 8332/10118 files, 7.422/6.295 TB ok
Errors: src_error: 5/0, trn_timeout: 60/71, trn_error: 206/3, dst_permission: 0/1193, dst_path: 0/5, dst_error: 0/59 foreign: 118/73
Links: 32/31 ok, 2/1 warning, 1/21 error, 0/0 unknown, 2/0 bad-endpoint
se01.indiacms.res.in: ok/ok
92%Transfer (from/to): 6068/54534 files, 5.940/3.591 TB ok
Errors: src_error: 3/0, trn_timeout: 4/154, trn_error: 228/8, dst_permission: 0/1247, dst_path: 0/3, dst_error: 0/110 foreign: 69/27
Links: 29/52 ok, 0/0 warning, 1/4 error, 0/0 unknown, 2/0 bad-endpoint
se01.indiacms.res.in: ok/ok
64%Transfer (from/to): 4843/9419 files, 5.929/1.184 TB ok
Errors: src_error: 2/0, trn_timeout: 42/0, trn_error: 311/11, dst_permission: 0/3342, dst_path: 0/1, dst_error: 0/1 foreign: 103/18
Links: 37/26 ok, 0/3 warning, 1/25 error, 0/0 unknown, 2/0 bad-endpoint
se01.indiacms.res.in: ok/warning
46%Transfer (from/to): 18850/8071 files, 6.414/6.005 TB ok
Errors: src_error: 46/0, trn_timeout: 37/7, trn_user: 0/9, trn_error: 570/5, dst_permission: 0/2967, dst_error: 0/28 foreign: 53/9
Links: 32/14 ok, 0/3 warning, 1/30 error, 0/0 unknown, 0/0 bad-endpoint
se01.indiacms.res.in: ok/error
60%Transfer (from/to): 12553/9672 files, 5.019/5.108 TB ok
Errors: src_error: 110/0, trn_timeout: 52/17, trn_user: 0/4, trn_error: 418/0, dst_permission: 0/4761, dst_path: 0/27, dst_error: 0/6 foreign: 4171/31
Links: 30/28 ok, 1/3 warning, 1/20 error, 0/1 unknown, 2/0 bad-endpoint
se01.indiacms.res.in: ok/ok
51%Transfer (from/to): 832/8685 files, 1.164/5.885 TB ok
Errors: src_error: 1/0, trn_timeout: 33/175, trn_user: 0/600, trn_error: 135/23, dst_permission: 0/3790, dst_error: 0/5 foreign: 70/55
Links: 19/21 ok, 1/0 warning, 3/20 error, 0/1 unknown, 2/0 bad-endpoint
se01.indiacms.res.in: ok/warning
49%Transfer (from/to): 2054/20746 files, 4.718/4.573 TB ok
Errors: src_error: 3/0, trn_timeout: 20/12, trn_user: 0/141, trn_error: 321/3, dst_permission: 0/4953, dst_error: 0/151 foreign: 42/14
Links: 26/22 ok, 1/1 warning, 2/27 error, 0/0 unknown, 2/0 bad-endpoint
se01.indiacms.res.in: ok/error
Site Readiness:
77%SAM: ok (15min evaluations: 77 ok, 15 warning, 2 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (186 Success ...),
FTS: ok (Links: 26/49 ok, 0/0 warning, 3/0 error, 0/0 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
65%SAM: ok (15min evaluations: 70 ok, 23 warning, 1 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (198 Success ...; 2 Failed, ExitCode 134 ...; 4 Failed, ExitCode 65 ...),
FTS: ok (Links: 26/44 ok, 1/3 warning, 3/0 error, 0/0 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
31%SAM: error (15min evaluations: 45 ok, 29 warning, 21 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (104 Success ...; 4 Failed, ExitCode 8021 ...; 1 Failed, ExitCode 65 ...),
FTS: ok (Links: 27/50 ok, 0/0 warning, 5/0 error, 0/0 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
84%SAM: ok (15min evaluations: 81 ok, 15 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (247 Success ...; 1 Failed, ExitCode 65 ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 21/43 ok, 0/3 warning, 0/2 error, 0/0 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
91%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (261 Success ...),
FTS: ok (Links: 20/40 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
86%SAM: ok (15min evaluations: 89 ok, 5 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (238 Success ...; 1 Failed, ExitCode 65 ...),
FTS: ok (Links: 31/43 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
62%SAM: ok (15min evaluations: 69 ok, 6 warning, 3 error, 18 unknown, 0 downtime (0h0m)),
HC: ok (199 Success ...; 2 Failed, ExitCode 1 ...; 1 Failed, ExitCode 81 ...; 2 Failed, ExitCode 65 ...; 1 Failed, ExitCode 134 ...),
FTS: ok (Links: 28/27 ok, 0/2 warning, 1/19 error, 0/0 unknown, 0/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
67%SAM: ok (15min evaluations: 73 ok, 4 warning, 0 error, 19 unknown, 0 downtime (0h0m)),
HC: ok (196 Success ...),
FTS: ok (Links: 35/52 ok, 1/0 warning, 0/5 error, 0/0 unknown, 1/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
81%SAM: ok (15min evaluations: 85 ok, 0 warning, 5 error, 6 unknown, 0 downtime (0h0m)),
HC: ok (232 Success ...; 6 Failed, ExitCode 8021 ...; 1 Failed, ExitCode 8001 ...; 1 Failed, ExitCode 65 ...),
FTS: ok (Links: 36/42 ok, 0/4 warning, 0/11 error, 0/0 unknown, 2/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
71%SAM: ok (15min evaluations: 82 ok, 0 warning, 4 error, 10 unknown, 0 downtime (0h0m)),
HC: ok (883 Success ...; 12 Failed, ExitCode 65 ...; 1 Failed, ExitCode 10040 ...; 2 Failed, ExitCode 8001 ...; 2 Failed, ExitCode 1 ...; 1 Failed, ExitCode 8028 ...),
FTS: ok (Links: 32/31 ok, 2/1 warning, 1/21 error, 0/0 unknown, 2/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
67%SAM: ok (15min evaluations: 80 ok, 6 warning, 0 error, 10 unknown, 0 downtime (0h0m)),
HC: ok (166 Success ...; 3 Failed, ExitCode 65 ...; 1 Failed, ExitCode 134 ...),
FTS: ok (Links: 29/52 ok, 0/0 warning, 1/4 error, 0/0 unknown, 2/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
58%SAM: ok (15min evaluations: 71 ok, 0 warning, 0 error, 25 unknown, 0 downtime (0h0m)),
HC: ok (227 Success ...; 1 Failed, ExitCode 65 ...),
FTS: warning (Links: 37/26 ok, 0/3 warning, 1/25 error, 0/0 unknown, 2/0 bad-endpoint; se01.indiacms.res.in: ok/warning)
36%SAM: ok (15min evaluations: 77 ok, 4 warning, 0 error, 15 unknown, 0 downtime (0h0m)),
HC: ok (137 Success ...),
FTS: error (Links: 32/14 ok, 0/3 warning, 1/30 error, 0/0 unknown, 0/0 bad-endpoint; se01.indiacms.res.in: ok/error)
51%SAM: ok (15min evaluations: 86 ok, 0 warning, 0 error, 10 unknown, 0 downtime (0h0m)),
HC: ok (183 Success ...; 5 Failed, ExitCode 65 ...; 1 Failed, ExitCode 139 ...),
FTS: ok (Links: 30/28 ok, 1/3 warning, 1/20 error, 0/1 unknown, 2/0 bad-endpoint; se01.indiacms.res.in: ok/ok)
56%SAM: ok (15min evaluations: 79 ok, 4 warning, 0 error, 13 unknown, 0 downtime (0h0m)),
HC: ok (221 Success ...; 7 Failed, ExitCode 65 ...; 1 Failed, ExitCode 74 ...),
FTS: warning (Links: 19/21 ok, 1/0 warning, 3/20 error, 0/1 unknown, 2/0 bad-endpoint; se01.indiacms.res.in: ok/warning)
41%SAM: ok (15min evaluations: 79 ok, 2 warning, 4 error, 11 unknown, 0 downtime (0h0m)),
HC: ok (227 Success ...; 14 Failed, ExitCode 65 ...; 1 Failed, ExitCode 139 ...; 2 Failed, ExitCode 134 ...),
FTS: error (Links: 26/22 ok, 1/1 warning, 2/27 error, 0/0 unknown, 2/0 bad-endpoint; se01.indiacms.res.in: ok/error)
Life Status: WR WR WR WR WR
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_IT_Bari
GGUS Tickets: 148735 149080
Downtimes: Pce-04.recas.ba.infn.it/CE Pce-04.recas.ba.infn.it/CE Pce-04.recas.ba.infn.it/CE Pce-04.recas.ba.infn.it/CE Pce-04.recas.ba.infn.it/CE Pce-04.recas.ba.infn.it/CE Pce-04.recas.ba.infn.it/CE
SAM Status: 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%193 Success [crab3@vocms0119.cern.ch#58942629.0#1602632330 201013_232501:sciaba_crab_HC-93-T2_IT_Bari-93176-20201012103503 1 0]... 100%190 Success [crab3@vocms0106.cern.ch#47714386.0#1602718004 201014_073051:sciaba_crab_HC-93-T2_IT_Bari-93198-20201014092703 186 0]... 100%226 Success [crab3@vocms0144.cern.ch#60188874.0#1602802023 201015_063036:sciaba_crab_HC-93-T2_IT_Bari-93198-20201014092703 195 0]... 100%218 Success [crab3@vocms0122.cern.ch#62672889.0#1602889750 201016_210813:sciaba_crab_HC-93-T2_IT_Bari-93227-20201016044503 24 0]... 100%256 Success [crab3@vocms0144.cern.ch#60253560.0#1602977722 201017_151344:sciaba_crab_HC-93-T2_IT_Bari-93227-20201016044503 100 0]... 100%193 Success [crab3@vocms0119.cern.ch#59084664.0#1603064056 201018_232331:sciaba_crab_HC-93-T2_IT_Bari-93250-20201018072302 2 0]... 100%140 Success [crab3@vocms0155.cern.ch#60906655.0#1603152192 201019_172707:sciaba_crab_HC-93-T2_IT_Bari-93250-20201018072302 79 0]...
7 Success, no Chirp ExitCode [crab3@vocms0155.cern.ch#60958706.0#1603200023 201020_035424:sciaba_crab_HC-93-T2_IT_Bari-93271-20201020054304 113 0]...
100%221 Success [crab3@vocms0199.cern.ch#17663678.0#1603236753 201020_215624:sciaba_crab_HC-93-T2_IT_Bari-93271-20201020054304 19 0]...
10 Success, no Chirp ExitCode [crab3@vocms0199.cern.ch#17673995.0#1603259561 201020_215624:sciaba_crab_HC-93-T2_IT_Bari-93271-20201020054304 95 0]...
100%220 Success [crab3@vocms0121.cern.ch#58990619.0#1603324623 201021_234115:sciaba_crab_HC-93-T2_IT_Bari-93291-20201022012503 3 0]...
8 Success, no Chirp ExitCode [crab3@vocms0121.cern.ch#58991061.0#1603326125 201021_234115:sciaba_crab_HC-93-T2_IT_Bari-93291-20201022012503 8 0]...
100%221 Success [crab3@vocms0119.cern.ch#59367782.0#1603410903 201022_173344:sciaba_crab_HC-93-T2_IT_Bari-93291-20201022012503 76 0]... 100%246 Success [crab3@vocms0122.cern.ch#62849141.0#1603503228 201024_012240:sciaba_crab_HC-93-T2_IT_Bari-93320-20201024031503 2 0]... 100%267 Success [crab3@vocms0107.cern.ch#60081795.0#1603581968 201024_192501:sciaba_crab_HC-93-T2_IT_Bari-93320-20201024031503 48 0]... 100%142 Success [crab3@vocms0121.cern.ch#59139327.0#1603668811 201025_133215:sciaba_crab_HC-93-T2_IT_Bari-93320-20201024031503 120 0]... 100%209 Success [crab3@vocms0137.cern.ch#56882974.0#1603755423 201026_045719:sciaba_crab_HC-93-T2_IT_Bari-93345-20201026055503 134 0]... 100%209 Success [crab3@vocms0107.cern.ch#60175209.0#1603842053 201027_061453:sciaba_crab_HC-93-T2_IT_Bari-93345-20201026055503 209 0]... 100%212 Success [crab3@vocms0120.cern.ch#58995889.0#1603927713 201028_060219:sciaba_crab_HC-93-T2_IT_Bari-93369-20201028065303 209 0]...
FTS Status: 98%Transfer (from/to): 3294/22173 files, 0.794/1.726 TB ok
Errors: src_missing_file: 1/0, src_error: 32/0, trn_timeout: 28/9, trn_error: 334/8, dst_error: 0/81 foreign: 113/53
Links: 59/59 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 4625/33728 files, 2.167/1.076 TB ok
Errors: src_error: 42/0, trn_user: 1/0, trn_error: 78/0, dst_path: 0/2, dst_error: 0/103 foreign: 74/88
Links: 58/59 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
100%Transfer (from/to): 5429/19371 files, 12.241/1.386 TB ok
Errors: src_missing_file: 8/0, src_error: 52/0, trn_timeout: 3/1, trn_error: 5/9, dst_error: 0/120 foreign: 46/270
Links: 59/62 ok, 0/0 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 7558/3417 files, 6.020/1.640 TB ok
Errors: src_missing_file: 1/0, src_error: 60/0, trn_timeout: 1/0, trn_error: 11/0, dst_error: 0/21 foreign: 24/132
Links: 56/52 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 3155/432 files, 1.709/0.881 TB ok
Errors: src_error: 6/0, trn_timeout: 3/0, trn_error: 2/0, dst_error: 0/8 foreign: 20/122
Links: 57/53 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 2063/697 files, 2.165/0.944 TB ok
Errors: src_permission: 1/0, src_error: 22/0, trn_timeout: 11/3, trn_error: 42/2, dst_error: 0/11 foreign: 27/86
Links: 56/50 ok, 2/2 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
96%Transfer (from/to): 6214/1301 files, 2.524/3.317 TB ok
Errors: src_error: 39/0, trn_timeout: 16/4, trn_user: 2/0, trn_error: 5/2, dst_error: 0/11 foreign: 82/129
Links: 57/53 ok, 2/0 warning, 0/2 error, 0/1 unknown, 1/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 4838/6119 files, 1.495/1.902 TB ok
Errors: src_error: 281/0, trn_timeout: 27/4, trn_error: 4/1, dst_error: 0/26 foreign: 63/116
Links: 57/56 ok, 0/0 warning, 2/1 error, 0/1 unknown, 2/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 1181/14628 files, 0.920/6.069 TB ok
Errors: src_permission: 1/0, src_error: 138/0, trn_timeout: 36/7, trn_error: 10/1, dst_error: 0/178 foreign: 57/1450
Links: 58/55 ok, 1/0 warning, 0/0 error, 0/1 unknown, 4/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
95%Transfer (from/to): 1221/3248 files, 0.799/1.505 TB ok
Errors: src_error: 12/0, trn_timeout: 95/1, trn_user: 0/1, trn_error: 9/0, dst_error: 0/38 foreign: 32/112
Links: 54/55 ok, 2/1 warning, 2/0 error, 0/1 unknown, 3/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
96%Transfer (from/to): 4848/3251 files, 0.887/4.173 TB ok
Errors: src_error: 28/0, trn_timeout: 171/19, trn_error: 5/14, dst_error: 0/20 foreign: 20/66
Links: 58/56 ok, 1/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
96%Transfer (from/to): 3273/1193 files, 0.943/1.464 TB ok
Errors: src_error: 27/0, trn_timeout: 25/1, trn_error: 10/22, dst_error: 0/16 foreign: 73/23
Links: 53/50 ok, 2/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
96%Transfer (from/to): 4137/25360 files, 1.261/4.758 TB ok
Errors: src_error: 31/0, trn_timeout: 50/0, trn_error: 6/28, dst_error: 0/41 foreign: 65/101
Links: 56/57 ok, 1/1 warning, 1/0 error, 0/1 unknown, 0/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
96%Transfer (from/to): 3755/1601 files, 1.584/3.434 TB ok
Errors: src_error: 142/0, trn_timeout: 57/0, trn_error: 8/7, dst_error: 0/41 foreign: 2209/36
Links: 56/47 ok, 0/1 warning, 1/3 error, 0/2 unknown, 2/1 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
96%Transfer (from/to): 1938/2539 files, 1.569/2.955 TB ok
Errors: src_permission: 2202/0, src_error: 18/0, trn_timeout: 12/0, trn_user: 1/0, trn_error: 185/0, dst_error: 0/27 foreign: 75/51
Links: 55/57 ok, 1/0 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
98%Transfer (from/to): 1626/3610 files, 2.406/1.504 TB ok
Errors: src_error: 28/0, trn_timeout: 3/1, trn_error: 159/2, dst_permission: 0/1, dst_error: 0/20 foreign: 12/37
Links: 56/58 ok, 1/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
storm-se-01.ba.infn.it: ok/ok
Site Readiness:
90%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (193 Success ...),
FTS: ok (Links: 59/59 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
62%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (190 Success ...),
FTS: ok (Links: 58/59 ok, 0/0 warning, 1/0 error, 0/1 unknown, 2/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
86%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (226 Success ...),
FTS: ok (Links: 59/62 ok, 0/0 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
79%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (218 Success ...),
FTS: ok (Links: 56/52 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
69%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (256 Success ...),
FTS: ok (Links: 57/53 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
63%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (193 Success ...),
FTS: ok (Links: 56/50 ok, 2/2 warning, 0/0 error, 0/1 unknown, 3/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
54%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (140 Success ...; 7 Success, no Chirp ExitCode ...),
FTS: ok (Links: 57/53 ok, 2/0 warning, 0/2 error, 0/1 unknown, 1/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
88%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (221 Success ...; 10 Success, no Chirp ExitCode ...),
FTS: ok (Links: 57/56 ok, 0/0 warning, 2/1 error, 0/1 unknown, 2/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
87%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (220 Success ...; 8 Success, no Chirp ExitCode ...),
FTS: ok (Links: 58/55 ok, 1/0 warning, 0/0 error, 0/1 unknown, 4/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
82%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (221 Success ...),
FTS: ok (Links: 54/55 ok, 2/1 warning, 2/0 error, 0/1 unknown, 3/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
91%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (246 Success ...),
FTS: ok (Links: 58/56 ok, 1/0 warning, 1/0 error, 0/1 unknown, 3/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
94%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (267 Success ...),
FTS: ok (Links: 53/50 ok, 2/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
52%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (142 Success ...),
FTS: ok (Links: 56/57 ok, 1/1 warning, 1/0 error, 0/1 unknown, 0/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
86%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (209 Success ...),
FTS: ok (Links: 56/47 ok, 0/1 warning, 1/3 error, 0/2 unknown, 2/1 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
82%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (209 Success ...),
FTS: ok (Links: 55/57 ok, 1/0 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
79%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (212 Success ...),
FTS: ok (Links: 56/58 ok, 1/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; storm-se-01.ba.infn.it: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_IT_Legnaro
GGUS Tickets: 149019
Downtimes:
SAM Status: 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 94 ok, 1 warning, 1 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 87 ok, 0 warning, 0 error, 9 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 95%15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%217 Success [crab3@vocms0199.cern.ch#17521171.0#1602635338 201013_213547:sciaba_crab_HC-93-T2_IT_Legnaro-93176-20201012103503 18 0]... 100%162 Success [crab3@vocms0107.cern.ch#59802531.0#1602719105 201014_075240:sciaba_crab_HC-93-T2_IT_Legnaro-93198-20201014092703 190 0]... 100%185 Success [crab3@vocms0107.cern.ch#59851038.0#1602804950 201015_063956:sciaba_crab_HC-93-T2_IT_Legnaro-93198-20201014092703 203 0]... 100%70 Success [crab3@vocms0144.cern.ch#60242148.0#1602947239 201017_145626:sciaba_crab_HC-93-T2_IT_Legnaro-93227-20201016044503 2 0]... 100%258 Success [crab3@vocms0144.cern.ch#60253451.0#1602977546 201017_145626:sciaba_crab_HC-93-T2_IT_Legnaro-93227-20201016044503 103 0]... 100%166 Success [crab3@vocms0155.cern.ch#60808530.0#1603064253 201018_233135:sciaba_crab_HC-93-T2_IT_Legnaro-93250-20201018072302 1 0]... 99%176 Success [crab3@vocms0144.cern.ch#60325245.0#1603150174 201019_173318:sciaba_crab_HC-93-T2_IT_Legnaro-93250-20201018072302 71 0]...
1 Failed, ExitCode 1 [crab3@vocms0195.cern.ch#56639151.0#1603181608 201020_034717:sciaba_crab_HC-93-T2_IT_Legnaro-93271-20201020054304 53 0]...
100%7 Success, no Chirp ExitCode [crab3@vocms0119.cern.ch#59260312.0#1603236655 201020_214957:sciaba_crab_HC-93-T2_IT_Legnaro-93271-20201020054304 20 0]...
173 Success [crab3@vocms0119.cern.ch#59260360.0#1603237256 201020_214957:sciaba_crab_HC-93-T2_IT_Legnaro-93271-20201020054304 22 0]...
100%188 Success [crab3@vocms0194.cern.ch#57620940.0#1603323193 201021_232737:sciaba_crab_HC-93-T2_IT_Legnaro-93291-20201022012503 1 0]...
6 Success, no Chirp ExitCode [crab3@vocms0194.cern.ch#57625011.0#1603331897 201021_232737:sciaba_crab_HC-93-T2_IT_Legnaro-93291-20201022012503 30 0]...
100%192 Success [crab3@vocms0137.cern.ch#56703158.0#1603409812 201022_173035:sciaba_crab_HC-93-T2_IT_Legnaro-93291-20201022012503 73 0]... 100%189 Success [crab3@vocms0121.cern.ch#59061991.0#1603502849 201024_012127:sciaba_crab_HC-93-T2_IT_Legnaro-93320-20201024031503 1 0]... 100%239 Success [crab3@vocms0155.cern.ch#61162487.0#1603582079 201024_192145:sciaba_crab_HC-93-T2_IT_Legnaro-93320-20201024031503 49 0]... 100%238 Success [crab3@vocms0119.cern.ch#59470580.0#1603668478 201025_133126:sciaba_crab_HC-93-T2_IT_Legnaro-93320-20201024031503 119 0]... 100%233 Success [crab3@vocms0122.cern.ch#62955899.0#1603757156 201026_225509:sciaba_crab_HC-93-T2_IT_Legnaro-93345-20201026055503 14 0]... 100%239 Success [crab3@vocms0107.cern.ch#60175460.0#1603842819 201027_170218:sciaba_crab_HC-93-T2_IT_Legnaro-93345-20201026055503 82 0]... 100%255 Success [crab3@vocms0194.cern.ch#57913131.0#1603928415 201028_055914:sciaba_crab_HC-93-T2_IT_Legnaro-93369-20201028065303 212 0]...
FTS Status: 98%Transfer (from/to): 8660/1026 files, 1.616/3.836 TB ok
Errors: src_missing_file: 89/0, src_error: 1/0, trn_timeout: 47/0, trn_error: 283/0, dst_error: 0/1 foreign: 109/235
Links: 51/33 ok, 0/0 warning, 1/0 error, 0/0 unknown, 3/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
99%Transfer (from/to): 12084/1233 files, 5.569/2.833 TB ok
Errors: trn_timeout: 21/0, trn_error: 46/0 foreign: 64/328
Links: 52/40 ok, 0/0 warning, 1/0 error, 0/0 unknown, 3/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
100%Transfer (from/to): 16863/395 files, 15.623/0.497 TB ok
Errors: src_error: 3/0, trn_timeout: 2/0, trn_error: 6/0 foreign: 108/113
Links: 56/34 ok, 0/0 warning, 0/0 error, 0/2 unknown, 3/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
100%Transfer (from/to): 8791/256 files, 7.432/0.489 TB ok
Errors: src_error: 3/0, trn_timeout: 22/0, trn_error: 3/0, dst_error: 0/1 foreign: 30/152
Links: 43/24 ok, 0/0 warning, 0/0 error, 1/2 unknown, 2/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
100%Transfer (from/to): 2168/246 files, 2.510/0.484 TB ok
Errors: src_error: 2/0, trn_error: 2/0, dst_error: 0/1 foreign: 40/124
Links: 42/28 ok, 0/0 warning, 0/0 error, 0/2 unknown, 3/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
98%Transfer (from/to): 3005/467 files, 3.318/0.652 TB ok
Errors: src_missing_file: 2/0, src_error: 11/0, trn_timeout: 16/0, trn_error: 101/0 foreign: 49/151
Links: 51/36 ok, 0/0 warning, 1/0 error, 0/1 unknown, 4/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
99%Transfer (from/to): 7165/953 files, 4.394/7.260 TB ok
Errors: src_permission: 2/0, src_missing_file: 2/0, trn_timeout: 15/2, trn_error: 10/1, dst_error: 0/4 foreign: 50/301
Links: 49/35 ok, 2/1 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
100%Transfer (from/to): 8441/913 files, 1.274/4.142 TB ok
Errors: src_error: 358/0, trn_timeout: 3/0, trn_error: 4/0, dst_error: 0/2 foreign: 168/341
Links: 54/38 ok, 0/0 warning, 1/0 error, 1/0 unknown, 3/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
98%Transfer (from/to): 7910/2411 files, 4.641/10.483 TB ok
Errors: src_missing_file: 5/0, src_error: 139/0, trn_timeout: 1/9, trn_error: 6/9 foreign: 499/360
Links: 47/56 ok, 1/1 warning, 0/0 error, 1/0 unknown, 4/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
96%Transfer (from/to): 6999/683 files, 1.307/1.244 TB ok
Errors: src_missing_file: 14/0, trn_timeout: 203/0, trn_error: 14/5, dst_error: 0/2 foreign: 83/368
Links: 46/38 ok, 1/1 warning, 1/0 error, 1/1 unknown, 4/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
97%Transfer (from/to): 6264/813 files, 1.136/3.567 TB ok
Errors: src_missing_file: 9/0, trn_timeout: 128/3, trn_error: 12/0 foreign: 48/104
Links: 44/35 ok, 1/1 warning, 1/0 error, 1/2 unknown, 3/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
96%Transfer (from/to): 5961/1022 files, 0.877/4.709 TB ok
Errors: trn_timeout: 28/0, trn_error: 6/5, dst_permission: 0/2 foreign: 248/149
Links: 43/33 ok, 1/0 warning, 1/1 error, 1/2 unknown, 2/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
97%Transfer (from/to): 11220/1942 files, 3.707/6.109 TB ok
Errors: trn_timeout: 114/0, trn_error: 1/6 foreign: 163/78
Links: 45/37 ok, 0/0 warning, 1/1 error, 1/2 unknown, 0/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
97%Transfer (from/to): 12516/1490 files, 7.681/10.427 TB ok
Errors: src_error: 274/0, trn_timeout: 37/0, trn_user: 3/1, trn_error: 7/0, dst_error: 0/1 foreign: 10065/133
Links: 43/34 ok, 0/0 warning, 1/0 error, 0/4 unknown, 1/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
98%Transfer (from/to): 7338/591 files, 7.061/1.596 TB ok
Errors: src_permission: 1410/0, src_error: 15/0, trn_timeout: 17/0, trn_user: 2/0, trn_error: 17/0, dst_error: 0/1 foreign: 180/146
Links: 51/34 ok, 0/0 warning, 1/0 error, 1/2 unknown, 1/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
100%Transfer (from/to): 4226/792 files, 4.857/6.765 TB ok
Errors: trn_user: 0/3, trn_error: 924/0, dst_permission: 0/1 foreign: 83/106
Links: 54/35 ok, 0/0 warning, 0/0 error, 1/1 unknown, 2/0 bad-endpoint
t2-srm-02.lnl.infn.it: ok/ok
Site Readiness:
64%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (217 Success ...),
FTS: ok (Links: 51/33 ok, 0/0 warning, 1/0 error, 0/0 unknown, 3/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
57%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (162 Success ...),
FTS: ok (Links: 52/40 ok, 0/0 warning, 1/0 error, 0/0 unknown, 3/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
46%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (185 Success ...),
FTS: ok (Links: 56/34 ok, 0/0 warning, 0/0 error, 0/2 unknown, 3/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
16%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (70 Success ...),
FTS: ok (Links: 43/24 ok, 0/0 warning, 0/0 error, 1/2 unknown, 2/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
52%SAM: ok (15min evaluations: 94 ok, 1 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (258 Success ...),
FTS: ok (Links: 42/28 ok, 0/0 warning, 0/0 error, 0/2 unknown, 3/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
50%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (166 Success ...),
FTS: ok (Links: 51/36 ok, 0/0 warning, 1/0 error, 0/1 unknown, 4/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
65%SAM: ok (15min evaluations: 87 ok, 0 warning, 0 error, 9 unknown, 0 downtime (0h0m)),
HC: ok (176 Success ...; 1 Failed, ExitCode 1 ...),
FTS: ok (Links: 49/35 ok, 2/1 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
77%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (7 Success, no Chirp ExitCode ...; 173 Success ...),
FTS: ok (Links: 54/38 ok, 0/0 warning, 1/0 error, 1/0 unknown, 3/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
81%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (188 Success ...; 6 Success, no Chirp ExitCode ...),
FTS: ok (Links: 47/56 ok, 1/1 warning, 0/0 error, 1/0 unknown, 4/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
78%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (192 Success ...),
FTS: ok (Links: 46/38 ok, 1/1 warning, 1/0 error, 1/1 unknown, 4/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
82%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (189 Success ...),
FTS: ok (Links: 44/35 ok, 1/1 warning, 1/0 error, 1/2 unknown, 3/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
89%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (239 Success ...),
FTS: ok (Links: 43/33 ok, 1/0 warning, 1/1 error, 1/2 unknown, 2/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
81%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (238 Success ...),
FTS: ok (Links: 45/37 ok, 0/0 warning, 1/1 error, 1/2 unknown, 0/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
85%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (233 Success ...),
FTS: ok (Links: 43/34 ok, 0/0 warning, 1/0 error, 0/4 unknown, 1/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
84%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (239 Success ...),
FTS: ok (Links: 51/34 ok, 0/0 warning, 1/0 error, 1/2 unknown, 1/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
83%SAM: ok (15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (255 Success ...),
FTS: ok (Links: 54/35 ok, 0/0 warning, 0/0 error, 1/1 unknown, 2/0 bad-endpoint; t2-srm-02.lnl.infn.it: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_IT_Pisa
GGUS Tickets: 149184
Downtimes:
SAM Status: 96%15min evaluations: 92 ok, 0 warning, 3 error, 1 unknown, 0 downtime (0h0m) 98%15min evaluations: 88 ok, 0 warning, 1 error, 7 unknown, 0 downtime (0h0m) 100%15min evaluations: 84 ok, 0 warning, 0 error, 12 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 85 ok, 0 warning, 0 error, 11 unknown, 0 downtime (0h0m) 100%15min evaluations: 79 ok, 0 warning, 0 error, 17 unknown, 0 downtime (0h0m) 94%15min evaluations: 82 ok, 0 warning, 5 error, 9 unknown, 0 downtime (0h0m) 94%15min evaluations: 89 ok, 0 warning, 5 error, 2 unknown, 0 downtime (0h0m) 85%15min evaluations: 72 ok, 0 warning, 12 error, 12 unknown, 0 downtime (0h0m) 81%15min evaluations: 68 ok, 0 warning, 16 error, 12 unknown, 0 downtime (0h0m) 94%15min evaluations: 89 ok, 2 warning, 5 error, 0 unknown, 0 downtime (0h0m) 76%15min evaluations: 73 ok, 0 warning, 23 error, 0 unknown, 0 downtime (0h0m) 88%15min evaluations: 84 ok, 0 warning, 11 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 73 ok, 0 warning, 0 error, 23 unknown, 0 downtime (0h0m) 96%15min evaluations: 80 ok, 0 warning, 3 error, 13 unknown, 0 downtime (0h0m)
Hammer Cloud: 99%204 Success [crab3@vocms0194.cern.ch#57464359.0#1602631338 201013_205121:sciaba_crab_HC-93-T2_IT_Pisa-93176-20201012103503 23 0]...
1 Failed, ExitCode 47 [crab3@vocms0195.cern.ch#56457219.0#1602686146 201014_074111:sciaba_crab_HC-93-T2_IT_Pisa-93198-20201014092703 80 0]...
1 Failed, ExitCode 135 [crab3@vocms0195.cern.ch#56463689.0#1602696647 201014_074111:sciaba_crab_HC-93-T2_IT_Pisa-93198-20201014092703 115 0]...
100%154 Success [crab3@vocms0195.cern.ch#56475880.0#1602718554 201014_074111:sciaba_crab_HC-93-T2_IT_Pisa-93198-20201014092703 188 0]... 98%223 Success [crab3@vocms0120.cern.ch#58582767.0#1602803747 201015_063437:sciaba_crab_HC-93-T2_IT_Pisa-93198-20201014092703 200 0]...
3 Failed, ExitCode 47 [crab3@vocms0122.cern.ch#62649772.0#1602809636 201016_004244:sciaba_crab_HC-93-T2_IT_Pisa-93198-20201014092703 2 0]...
100%93 Success [crab3@vocms0194.cern.ch#57559427.0#1602946731 201017_145242:sciaba_crab_HC-93-T2_IT_Pisa-93227-20201016044503 1 0]... 100%249 Success [crab3@vocms0194.cern.ch#57567486.0#1602977939 201017_145242:sciaba_crab_HC-93-T2_IT_Pisa-93227-20201016044503 105 0]... 100%265 Success [crab3@vocms0197.cern.ch#57205282.0#1603062642 201018_053429:sciaba_crab_HC-93-T2_IT_Pisa-93250-20201018072302 211 0]... 100%160 Success [crab3@vocms0119.cern.ch#59177758.0#1603150521 201019_173348:sciaba_crab_HC-93-T2_IT_Pisa-93250-20201018072302 72 0]... 97%252 Success [crab3@vocms0197.cern.ch#57216994.0#1603235029 201020_215239:sciaba_crab_HC-93-T2_IT_Pisa-93271-20201020054304 14 0]...
2 Failed, ExitCode 10040 [crab3@vocms0197.cern.ch#57234276.0#1603281842 201020_215239:sciaba_crab_HC-93-T2_IT_Pisa-93271-20201020054304 170 0]...
5 Failed, ExitCode 47 [crab3@vocms0197.cern.ch#57234675.0#1603284239 201020_215239:sciaba_crab_HC-93-T2_IT_Pisa-93271-20201020054304 178 0]...
91%175 Success [crab3@vocms0106.cern.ch#47885022.0#1603323761 201021_233145:sciaba_crab_HC-93-T2_IT_Pisa-93291-20201022012503 2 0]...
16 Failed, ExitCode 47 [crab3@vocms0106.cern.ch#47886330.0#1603325861 201021_233145:sciaba_crab_HC-93-T2_IT_Pisa-93291-20201022012503 9 0]...
97%184 Success [crab3@vocms0199.cern.ch#17769946.0#1603409955 201022_173300:sciaba_crab_HC-93-T2_IT_Pisa-93291-20201022012503 73 0]...
5 Failed, ExitCode 47 [crab3@vocms0199.cern.ch#17772790.0#1603416257 201022_173300:sciaba_crab_HC-93-T2_IT_Pisa-93291-20201022012503 94 0]...
100%188 Success [crab3@vocms0194.cern.ch#57719553.0#1603503943 201024_012455:sciaba_crab_HC-93-T2_IT_Pisa-93320-20201024031503 4 0]... 99%249 Success [crab3@vocms0155.cern.ch#61162481.0#1603581741 201024_192607:sciaba_crab_HC-93-T2_IT_Pisa-93320-20201024031503 47 0]...
1 Failed, ExitCode 47 [crab3@vocms0155.cern.ch#61169764.0#1603614750 201024_192607:sciaba_crab_HC-93-T2_IT_Pisa-93320-20201024031503 157 0]...
100%238 Success [crab3@vocms0120.cern.ch#58844894.0#1603668551 201025_133251:sciaba_crab_HC-93-T2_IT_Pisa-93320-20201024031503 119 0]... 98%243 Success [crab3@vocms0119.cern.ch#59513174.0#1603754729 201026_225923:sciaba_crab_HC-93-T2_IT_Pisa-93345-20201026055503 5 0]...
4 Failed, ExitCode 47 [crab3@vocms0119.cern.ch#59534804.0#1603797039 201026_225923:sciaba_crab_HC-93-T2_IT_Pisa-93345-20201026055503 146 0]...
98%260 Success [crab3@vocms0144.cern.ch#60664442.0#1603841451 201027_171936:sciaba_crab_HC-93-T2_IT_Pisa-93345-20201026055503 74 0]...
3 Failed, ExitCode 47 [crab3@vocms0144.cern.ch#60668212.0#1603858257 201027_171936:sciaba_crab_HC-93-T2_IT_Pisa-93345-20201026055503 130 0]...
99%266 Success [crab3@vocms0199.cern.ch#17949643.0#1603928531 201028_055547:sciaba_crab_HC-93-T2_IT_Pisa-93369-20201028065303 213 0]...
1 Failed, ExitCode 47 [crab3@vocms0137.cern.ch#56997598.0#1603957116 201028_235233:sciaba_crab_HC-93-T2_IT_Pisa-93369-20201028065303 93 0]...
FTS Status: 95%Transfer (from/to): 11862/20336 files, 0.756/0.908 TB ok
Errors: src_missing_file: 38/0, src_error: 18/0, trn_timeout: 24/0, trn_error: 474/0, dst_path: 0/2, dst_error: 0/2 foreign: 77/4
Links: 41/44 ok, 2/0 warning, 3/0 error, 0/0 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
96%Transfer (from/to): 7773/11278 files, 0.848/3.490 TB ok
Errors: src_missing_file: 1/0, src_error: 13/0, trn_timeout: 9/39, trn_user: 0/2, trn_error: 161/1, dst_error: 0/1 foreign: 59/11
Links: 44/46 ok, 1/0 warning, 2/0 error, 0/0 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
97%Transfer (from/to): 6586/21255 files, 0.926/1.103 TB ok
Errors: src_missing_file: 1/0, src_error: 14/0, trn_timeout: 18/0, trn_error: 5/1, dst_error: 0/2 foreign: 358/29
Links: 43/50 ok, 0/0 warning, 1/0 error, 0/0 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
95%Transfer (from/to): 4622/618 files, 1.744/1.481 TB ok
Errors: src_missing_file: 1/0, src_error: 16/0, trn_timeout: 8/0, trn_error: 14/1 foreign: 14/10
Links: 34/40 ok, 1/1 warning, 1/0 error, 0/0 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
95%Transfer (from/to): 985/531 files, 0.475/1.041 TB ok
Errors: src_error: 15/0, trn_timeout: 4/0, trn_error: 4/0 foreign: 27/1
Links: 36/41 ok, 1/0 warning, 1/0 error, 0/0 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
93%Transfer (from/to): 1750/50156 files, 0.853/3.764 TB ok
Errors: src_error: 17/0, trn_timeout: 12/0, trn_error: 2/2, dst_path: 0/1, dst_error: 0/2 foreign: 28/3
Links: 42/46 ok, 1/0 warning, 2/0 error, 0/0 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
94%Transfer (from/to): 3965/54574 files, 1.648/1.958 TB ok
Errors: src_error: 17/0, trn_timeout: 32/0, trn_error: 4/1, dst_path: 0/2, dst_error: 0/3 foreign: 38/9
Links: 42/42 ok, 2/0 warning, 2/0 error, 0/0 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
96%Transfer (from/to): 7625/670 files, 1.688/1.552 TB ok
Errors: src_error: 145/0, trn_timeout: 13/0, trn_error: 2/0 foreign: 96/10
Links: 47/39 ok, 0/0 warning, 2/0 error, 0/0 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
95%Transfer (from/to): 5621/857 files, 0.806/5.287 TB ok
Errors: src_missing_file: 10/0, src_error: 114/0, trn_timeout: 10/0, trn_error: 7/1 foreign: 189/10
Links: 46/42 ok, 0/0 warning, 2/0 error, 0/0 unknown, 3/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
93%Transfer (from/to): 3583/888 files, 2.311/2.089 TB ok
Errors: src_error: 15/0, trn_timeout: 142/0, trn_error: 4/1 foreign: 45/9
Links: 43/43 ok, 1/0 warning, 3/0 error, 0/0 unknown, 3/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
92%Transfer (from/to): 4631/861 files, 0.544/4.854 TB ok
Errors: src_missing_file: 2/0, src_error: 13/0, trn_timeout: 161/1, trn_user: 0/8, trn_error: 11/0, dst_path: 0/1 foreign: 35/7
Links: 38/31 ok, 1/0 warning, 2/0 error, 0/0 unknown, 1/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
95%Transfer (from/to): 3432/1188 files, 1.078/11.636 TB ok
Errors: src_error: 19/0, trn_timeout: 85/0, trn_user: 0/1, trn_error: 2/6 foreign: 56/59
Links: 44/32 ok, 0/0 warning, 2/1 error, 0/0 unknown, 1/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
92%Transfer (from/to): 4942/577 files, 1.639/1.517 TB ok
Errors: src_error: 19/0, trn_timeout: 38/0, trn_error: 0/6 foreign: 52/22
Links: 39/29 ok, 0/1 warning, 3/0 error, 0/1 unknown, 0/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
93%Transfer (from/to): 4999/1849 files, 3.713/3.792 TB ok
Errors: src_error: 110/0, trn_timeout: 57/1, trn_user: 3/0, trn_error: 4/5 foreign: 4358/41
Links: 42/44 ok, 0/0 warning, 3/0 error, 0/1 unknown, 1/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
93%Transfer (from/to): 4958/3754 files, 3.716/1.398 TB ok
Errors: src_permission: 1098/0, src_error: 14/0, trn_timeout: 66/0, trn_user: 3/0, trn_error: 17/1 foreign: 472/53
Links: 44/50 ok, 1/0 warning, 2/0 error, 0/1 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
96%Transfer (from/to): 2212/3103 files, 2.381/6.220 TB ok
Errors: src_error: 14/0, trn_timeout: 5/0, trn_user: 0/2, trn_error: 17/4 foreign: 40/35
Links: 48/40 ok, 1/0 warning, 1/0 error, 0/0 unknown, 2/0 bad-endpoint
stormfe1.pi.infn.it: ok/ok
Site Readiness:
74%SAM: ok (15min evaluations: 92 ok, 0 warning, 3 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (204 Success ...; 1 Failed, ExitCode 47 ...; 1 Failed, ExitCode 135 ...),
FTS: ok (Links: 41/44 ok, 2/0 warning, 3/0 error, 0/0 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
50%SAM: ok (15min evaluations: 88 ok, 0 warning, 1 error, 7 unknown, 0 downtime (0h0m)),
HC: ok (154 Success ...),
FTS: ok (Links: 44/46 ok, 1/0 warning, 2/0 error, 0/0 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
66%SAM: ok (15min evaluations: 84 ok, 0 warning, 0 error, 12 unknown, 0 downtime (0h0m)),
HC: ok (223 Success ...; 3 Failed, ExitCode 47 ...),
FTS: ok (Links: 43/50 ok, 0/0 warning, 1/0 error, 0/0 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
33%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (93 Success ...),
FTS: ok (Links: 34/40 ok, 1/1 warning, 1/0 error, 0/0 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
65%SAM: ok (15min evaluations: 85 ok, 0 warning, 0 error, 11 unknown, 0 downtime (0h0m)),
HC: ok (249 Success ...),
FTS: ok (Links: 36/41 ok, 1/0 warning, 1/0 error, 0/0 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
68%SAM: ok (15min evaluations: 79 ok, 0 warning, 0 error, 17 unknown, 0 downtime (0h0m)),
HC: ok (265 Success ...),
FTS: ok (Links: 42/46 ok, 1/0 warning, 2/0 error, 0/0 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
64%SAM: ok (15min evaluations: 82 ok, 0 warning, 5 error, 9 unknown, 0 downtime (0h0m)),
HC: ok (160 Success ...),
FTS: ok (Links: 42/42 ok, 2/0 warning, 2/0 error, 0/0 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
78%SAM: ok (15min evaluations: 89 ok, 0 warning, 5 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (252 Success ...; 2 Failed, ExitCode 10040 ...; 5 Failed, ExitCode 47 ...),
FTS: ok (Links: 47/39 ok, 0/0 warning, 2/0 error, 0/0 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
40%SAM: warning (15min evaluations: 72 ok, 0 warning, 12 error, 12 unknown, 0 downtime (0h0m)),
HC: ok (175 Success ...; 16 Failed, ExitCode 47 ...),
FTS: ok (Links: 46/42 ok, 0/0 warning, 2/0 error, 0/0 unknown, 3/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
38%SAM: warning (15min evaluations: 68 ok, 0 warning, 16 error, 12 unknown, 0 downtime (0h0m)),
HC: ok (184 Success ...; 5 Failed, ExitCode 47 ...),
FTS: ok (Links: 43/43 ok, 1/0 warning, 3/0 error, 0/0 unknown, 3/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
74%SAM: ok (15min evaluations: 89 ok, 2 warning, 5 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (188 Success ...),
FTS: ok (Links: 38/31 ok, 1/0 warning, 2/0 error, 0/0 unknown, 1/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
66%SAM: error (15min evaluations: 73 ok, 0 warning, 23 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (249 Success ...; 1 Failed, ExitCode 47 ...),
FTS: ok (Links: 44/32 ok, 0/0 warning, 2/1 error, 0/0 unknown, 1/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
62%SAM: warning (15min evaluations: 84 ok, 0 warning, 11 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (238 Success ...),
FTS: ok (Links: 39/29 ok, 0/1 warning, 3/0 error, 0/1 unknown, 0/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
81%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (243 Success ...; 4 Failed, ExitCode 47 ...),
FTS: ok (Links: 42/44 ok, 0/0 warning, 3/0 error, 0/1 unknown, 1/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
68%SAM: ok (15min evaluations: 73 ok, 0 warning, 0 error, 23 unknown, 0 downtime (0h0m)),
HC: ok (260 Success ...; 3 Failed, ExitCode 47 ...),
FTS: ok (Links: 44/50 ok, 1/0 warning, 2/0 error, 0/1 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
80%SAM: ok (15min evaluations: 80 ok, 0 warning, 3 error, 13 unknown, 0 downtime (0h0m)),
HC: ok (266 Success ...; 1 Failed, ExitCode 47 ...),
FTS: ok (Links: 48/40 ok, 1/0 warning, 1/0 error, 0/0 unknown, 2/0 bad-endpoint; stormfe1.pi.infn.it: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_IT_Rome
GGUS Tickets:
Downtimes:
SAM Status: 100%15min evaluations: 46 ok, 44 warning, 0 error, 6 unknown, 0 downtime (0h0m) 100%15min evaluations: 91 ok, 1 warning, 0 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m) 95%15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 100%198 Success [crab3@vocms0120.cern.ch#58494207.0#1602632348 201013_024732:sciaba_crab_HC-93-T2_IT_Rome-93176-20201012103503 173 0]... 98%144 Success [crab3@vocms0120.cern.ch#58527619.0#1602719910 201014_074902:sciaba_crab_HC-93-T2_IT_Rome-93198-20201014092703 192 0]...
3 Failed, Removed due to wall clock limit [crab3@vocms0106.cern.ch#47742963.0#1602768611 201015_063850:sciaba_crab_HC-93-T2_IT_Rome-93198-20201014092703 82 0]...
99%117 Success [crab3@vocms0106.cern.ch#47771145.0#1602804323 201015_063850:sciaba_crab_HC-93-T2_IT_Rome-93198-20201014092703 201 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0106.cern.ch#47753227.0#1602789917 201015_063850:sciaba_crab_HC-93-T2_IT_Rome-93198-20201014092703 153 0]...
99%207 Success [crab3@vocms0155.cern.ch#60784787.0#1602909566 201017_042845:sciaba_crab_HC-93-T2_IT_Rome-93227-20201016044503 2 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0155.cern.ch#60793709.0#1602959678 201017_042845:sciaba_crab_HC-93-T2_IT_Rome-93227-20201016044503 169 0]...
97%177 Success [crab3@vocms0155.cern.ch#60797688.0#1602977245 201017_223619:sciaba_crab_HC-93-T2_IT_Rome-93227-20201016044503 10 0]...
4 Failed, Removed due to wall clock limit [crab3@vocms0155.cern.ch#60795704.0#1602968376 201017_042845:sciaba_crab_HC-93-T2_IT_Rome-93227-20201016044503 198 0]...
100%156 Success [crab3@vocms0155.cern.ch#60819433.0#1603078344 201018_052946:sciaba_crab_HC-93-T2_IT_Rome-93250-20201018072302 133 0]... 99%129 Success [crab3@vocms0196.cern.ch#56987549.0#1603150377 201019_102632:sciaba_crab_HC-93-T2_IT_Rome-93250-20201018072302 157 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0155.cern.ch#60962024.0#1603202052 201020_035817:sciaba_crab_HC-93-T2_IT_Rome-93271-20201020054304 119 0]...
99%222 Success [crab3@vocms0199.cern.ch#17663667.0#1603236347 201020_215930:sciaba_crab_HC-93-T2_IT_Rome-93271-20201020054304 17 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0199.cern.ch#17662389.0#1603232447 201020_215930:sciaba_crab_HC-93-T2_IT_Rome-93271-20201020054304 4 0]...
100%209 Success [crab3@vocms0119.cern.ch#59319852.0#1603325039 201021_233808:sciaba_crab_HC-93-T2_IT_Rome-93291-20201022012503 5 0]... 100%211 Success [crab3@vocms0197.cern.ch#57279688.0#1603409408 201022_175352:sciaba_crab_HC-93-T2_IT_Rome-93291-20201022012503 67 0]... 100%231 Success [crab3@vocms0197.cern.ch#57313466.0#1603503187 201024_011648:sciaba_crab_HC-93-T2_IT_Rome-93320-20201024031503 3 0]... 100%268 Success [crab3@vocms0194.cern.ch#57744199.0#1603582414 201024_191738:sciaba_crab_HC-93-T2_IT_Rome-93320-20201024031503 51 0]... 98%239 Success [crab3@vocms0194.cern.ch#57766430.0#1603668437 201025_132616:sciaba_crab_HC-93-T2_IT_Rome-93320-20201024031503 120 0]...
3 Failed, ExitCode 1 [crab3@vocms0122.cern.ch#62914674.0#1603699969 201026_050201:sciaba_crab_HC-93-T2_IT_Rome-93345-20201026055503 38 0]...
100%242 Success [crab3@vocms0121.cern.ch#59180466.0#1603755248 201026_225810:sciaba_crab_HC-93-T2_IT_Rome-93345-20201026055503 7 0]... 100%247 Success [crab3@vocms0155.cern.ch#61253675.0#1603841398 201027_170332:sciaba_crab_HC-93-T2_IT_Rome-93345-20201026055503 77 0]... 100%267 Success [crab3@vocms0155.cern.ch#61288886.0#1603927633 201028_055605:sciaba_crab_HC-93-T2_IT_Rome-93369-20201028065303 210 0]...
FTS Status: 95%Transfer (from/to): 809/374 files, 0.323/0.734 TB ok
Errors: src_missing_file: 5/0, trn_timeout: 20/0, trn_error: 20/9 foreign: 66/13
Links: 43/51 ok, 3/0 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
98%Transfer (from/to): 2488/371 files, 1.974/0.661 TB ok
Errors: trn_timeout: 6/0, trn_error: 27/6 foreign: 100/5
Links: 50/49 ok, 3/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
98%Transfer (from/to): 4206/383 files, 5.421/0.802 TB ok
Errors: trn_timeout: 149/0, trn_error: 48/9 foreign: 83/12
Links: 44/50 ok, 7/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
98%Transfer (from/to): 2952/483 files, 3.002/1.271 TB ok
Errors: trn_timeout: 108/0, trn_error: 22/10 foreign: 37/11
Links: 35/52 ok, 5/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
97%Transfer (from/to): 902/365 files, 0.722/0.770 TB ok
Errors: trn_error: 9/10 foreign: 38/14
Links: 40/47 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
97%Transfer (from/to): 1114/450 files, 0.826/0.933 TB ok
Errors: src_missing_file: 2/0, trn_timeout: 3/3, trn_error: 21/10 foreign: 33/14
Links: 44/52 ok, 0/1 warning, 0/1 error, 0/1 unknown, 3/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
96%Transfer (from/to): 2896/406 files, 1.020/0.868 TB ok
Errors: src_permission: 3/0, trn_timeout: 17/3, trn_error: 0/8 foreign: 16/23
Links: 46/43 ok, 1/1 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
96%Transfer (from/to): 1236/447 files, 0.841/0.929 TB ok
Errors: src_error: 122/0, trn_timeout: 1/5, trn_error: 3/10 foreign: 42/21
Links: 46/47 ok, 0/0 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
95%Transfer (from/to): 1330/500 files, 0.802/1.130 TB ok
Errors: src_error: 53/0, trn_timeout: 6/6, trn_error: 4/7 foreign: 26/21
Links: 42/46 ok, 0/1 warning, 0/1 error, 0/1 unknown, 4/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
92%Transfer (from/to): 927/941 files, 0.569/2.213 TB ok
Errors: trn_timeout: 69/3, trn_error: 9/8 foreign: 26/25
Links: 39/47 ok, 1/1 warning, 3/0 error, 0/1 unknown, 3/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
95%Transfer (from/to): 736/408 files, 0.632/0.801 TB ok
Errors: src_missing_file: 1/0, trn_timeout: 32/1, trn_error: 20/9 foreign: 17/8
Links: 39/47 ok, 2/0 warning, 2/0 error, 0/1 unknown, 2/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
97%Transfer (from/to): 3503/526 files, 0.890/1.133 TB ok
Errors: trn_timeout: 67/0, trn_error: 7/16 foreign: 85/7
Links: 47/49 ok, 2/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
95%Transfer (from/to): 2878/930 files, 0.768/2.742 TB ok
Errors: trn_timeout: 84/0, trn_error: 6/12 foreign: 75/8
Links: 41/47 ok, 1/0 warning, 1/1 error, 0/1 unknown, 1/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
97%Transfer (from/to): 1396/576 files, 0.772/1.996 TB ok
Errors: src_error: 31/0, trn_timeout: 40/0, trn_error: 3/5, dst_permission: 0/1 foreign: 1130/9
Links: 38/47 ok, 0/0 warning, 1/0 error, 0/1 unknown, 1/1 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
95%Transfer (from/to): 2482/454 files, 1.034/1.026 TB ok
Errors: src_permission: 767/0, trn_timeout: 10/0, trn_user: 2/0, trn_error: 19/0 foreign: 91/18
Links: 41/49 ok, 0/0 warning, 2/0 error, 0/1 unknown, 2/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
98%Transfer (from/to): 1708/480 files, 1.039/1.156 TB ok
Errors: trn_error: 48/1, dst_permission: 0/2 foreign: 49/9
Links: 47/53 ok, 2/0 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint
cmsrm-se01.roma1.infn.it: ok/ok
Site Readiness:
49%SAM: ok (15min evaluations: 46 ok, 44 warning, 0 error, 6 unknown, 0 downtime (0h0m)),
HC: ok (198 Success ...),
FTS: ok (Links: 43/51 ok, 3/0 warning, 1/1 error, 0/1 unknown, 2/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
50%SAM: ok (15min evaluations: 91 ok, 1 warning, 0 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (144 Success ...; 3 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 50/49 ok, 3/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
32%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (117 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 44/50 ok, 7/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
62%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (207 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 35/52 ok, 5/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
42%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (177 Success ...; 4 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 40/47 ok, 0/0 warning, 0/1 error, 0/1 unknown, 2/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
37%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (156 Success ...),
FTS: ok (Links: 44/52 ok, 0/1 warning, 0/1 error, 0/1 unknown, 3/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
45%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (129 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 46/43 ok, 1/1 warning, 1/1 error, 0/1 unknown, 1/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
70%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (222 Success ...; 1 Failed, Removed due to wall clock limit ...),
FTS: ok (Links: 46/47 ok, 0/0 warning, 1/2 error, 0/1 unknown, 2/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
72%SAM: ok (15min evaluations: 94 ok, 0 warning, 0 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (209 Success ...),
FTS: ok (Links: 42/46 ok, 0/1 warning, 0/1 error, 0/1 unknown, 4/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
58%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (211 Success ...),
FTS: ok (Links: 39/47 ok, 1/1 warning, 3/0 error, 0/1 unknown, 3/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
59%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (231 Success ...),
FTS: ok (Links: 39/47 ok, 2/0 warning, 2/0 error, 0/1 unknown, 2/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
88%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (268 Success ...),
FTS: ok (Links: 47/49 ok, 2/0 warning, 1/1 error, 0/1 unknown, 3/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
77%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (239 Success ...; 3 Failed, ExitCode 1 ...),
FTS: ok (Links: 41/47 ok, 1/0 warning, 1/1 error, 0/1 unknown, 1/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
70%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (242 Success ...),
FTS: ok (Links: 38/47 ok, 0/0 warning, 1/0 error, 0/1 unknown, 1/1 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
74%SAM: ok (15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (247 Success ...),
FTS: ok (Links: 41/49 ok, 0/0 warning, 2/0 error, 0/1 unknown, 2/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
74%SAM: ok (15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (267 Success ...),
FTS: ok (Links: 47/53 ok, 2/0 warning, 0/0 error, 0/1 unknown, 2/0 bad-endpoint; cmsrm-se01.roma1.infn.it: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_KR_KISTI
GGUS Tickets:
Downtimes:
SAM Status: 99%15min evaluations: 94 ok, 1 warning, 1 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 92 ok, 0 warning, 2 error, 2 unknown, 0 downtime (0h0m) 96%15min evaluations: 91 ok, 0 warning, 3 error, 2 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m) 95%15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 97%15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 93 ok, 0 warning, 2 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m) 96%15min evaluations: 92 ok, 0 warning, 3 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 94%15min evaluations: 90 ok, 0 warning, 5 error, 1 unknown, 0 downtime (0h0m)
Hammer Cloud: 99%211 Success [crab3@vocms0195.cern.ch#56438160.0#1602632014 201013_195532:sciaba_crab_HC-99-T2_KR_KISTI-93182-20201013034702 43 0]...
1 Failed, ExitCode 8021 [crab3@vocms0197.cern.ch#57061293.0#1602646331 201014_023649:sciaba_crab_HC-99-T2_KR_KISTI-93192-20201014030101 6 0]...
100%173 Success [crab3@vocms0122.cern.ch#62601302.0#1602718826 201014_232421:sciaba_crab_HC-99-T2_KR_KISTI-93204-20201015010101 3 0]... 100%222 Success [crab3@vocms0107.cern.ch#59849683.0#1602804458 201015_232144:sciaba_crab_HC-99-T2_KR_KISTI-93224-20201016011101 1 0]... 100%260 Success [crab3@vocms0119.cern.ch#59062728.0#1602897611 201017_011359:sciaba_crab_HC-99-T2_KR_KISTI-93237-20201017030301 1 0]... 100%186 Success [crab3@vocms0121.cern.ch#58913633.0#1602977404 201017_192912:sciaba_crab_HC-99-T2_KR_KISTI-93237-20201017030301 48 0]... 100%193 Success [crab3@vocms0196.cern.ch#56923045.0#1603078099 201019_031709:sciaba_crab_HC-99-T2_KR_KISTI-93259-20201019050502 2 0]... 100%160 Success [crab3@vocms0195.cern.ch#56623481.0#1603149814 201019_211748:sciaba_crab_HC-99-T2_KR_KISTI-93259-20201019050502 25 0]... 100%221 Success [crab3@vocms0137.cern.ch#56604089.0#1603235369 201020_201803:sciaba_crab_HC-99-T2_KR_KISTI-93269-20201020041302 34 0]... 100%195 Success [crab3@vocms0107.cern.ch#59964159.0#1603322710 201021_204923:sciaba_crab_HC-99-T2_KR_KISTI-93281-20201021044102 31 0]... 99%240 Success [crab3@vocms0106.cern.ch#47927701.0#1603408875 201022_210508:sciaba_crab_HC-99-T2_KR_KISTI-93299-20201022050302 27 0]...
1 Failed, ExitCode 8021 [crab3@vocms0197.cern.ch#57295482.0#1603479170 201023_022649:sciaba_crab_HC-99-T2_KR_KISTI-93310-20201023041902 197 0]...
100%139 Success [crab3@vocms0196.cern.ch#57180085.0#1603504720 201024_014719:sciaba_crab_HC-99-T2_KR_KISTI-93321-20201024034102 2 0]... 100%251 Success [crab3@vocms0121.cern.ch#59092621.0#1603581214 201024_195214:sciaba_crab_HC-99-T2_KR_KISTI-93321-20201024034102 40 0]... 100%242 Success [crab3@vocms0107.cern.ch#60101103.0#1603667728 201025_204905:sciaba_crab_HC-99-T2_KR_KISTI-93332-20201025034302 29 0]... 100%241 Success [crab3@vocms0197.cern.ch#57454528.0#1603754461 201026_202509:sciaba_crab_HC-99-T2_KR_KISTI-93342-20201026031501 35 0]... 100%248 Success [crab3@vocms0122.cern.ch#62978091.0#1603841245 201027_200112:sciaba_crab_HC-99-T2_KR_KISTI-93354-20201027024103 41 0]... 100%249 Success [crab3@vocms0119.cern.ch#59590505.0#1603927425 201028_185725:sciaba_crab_HC-99-T2_KR_KISTI-93363-20201028015502 53 0]...
FTS Status: 98%Transfer (from/to): 1015/511 files, 0.739/1.091 TB ok
Errors: trn_timeout: 0/5, trn_error: 12/6 foreign: 38/29
Links: 60/51 ok, 0/2 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
98%Transfer (from/to): 1402/499 files, 0.557/0.996 TB ok
Errors: src_permission: 6/0, src_error: 10/0, trn_timeout: 3/7, trn_error: 2/12, dst_permission: 0/4, dst_error: 0/4 foreign: 22/43
Links: 59/53 ok, 0/0 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
96%Transfer (from/to): 1111/569 files, 0.718/1.178 TB ok
Errors: src_permission: 4/0, src_error: 8/0, trn_timeout: 4/48, trn_error: 1/8, dst_permission: 0/3, dst_error: 0/1 foreign: 28/30
Links: 57/52 ok, 2/1 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
100%Transfer (from/to): 504/662 files, 0.668/1.652 TB ok
Errors: src_error: 6/0, trn_timeout: 0/12, trn_error: 2/3, dst_error: 0/6 foreign: 8/3
Links: 58/52 ok, 0/2 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
98%Transfer (from/to): 576/604 files, 0.801/1.272 TB ok
Errors: src_permission: 1/0, trn_timeout: 2/1, trn_error: 1/6, dst_error: 0/1 foreign: 30/1
Links: 57/54 ok, 1/0 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
97%Transfer (from/to): 1034/582 files, 0.692/1.288 TB ok
Errors: trn_timeout: 10/12, trn_error: 28/7, dst_error: 0/2 foreign: 9/5
Links: 56/51 ok, 1/1 warning, 1/1 error, 0/0 unknown, 2/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
96%Transfer (from/to): 1316/929 files, 0.957/5.879 TB ok
Errors: src_permission: 2/0, src_missing_file: 4/0, src_error: 5/0, trn_timeout: 5/6, trn_error: 3/9, dst_permission: 0/1, dst_error: 0/4 foreign: 9/6
Links: 55/52 ok, 5/1 warning, 0/1 error, 0/0 unknown, 2/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
98%Transfer (from/to): 1163/858 files, 0.923/1.562 TB ok
Errors: src_permission: 5/0, src_error: 31/0, trn_timeout: 12/14, trn_error: 2/12, dst_permission: 0/3 foreign: 13/9
Links: 58/53 ok, 2/0 warning, 0/1 error, 0/0 unknown, 2/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
97%Transfer (from/to): 746/1157 files, 0.948/5.863 TB ok
Errors: src_permission: 6/0, src_error: 22/0, trn_timeout: 2/11, trn_error: 2/19, dst_permission: 0/4, dst_error: 0/3 foreign: 43/7
Links: 57/55 ok, 2/1 warning, 0/1 error, 0/0 unknown, 4/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
98%Transfer (from/to): 654/650 files, 0.766/1.567 TB ok
Errors: src_permission: 5/0, src_error: 2/0, trn_timeout: 8/13, trn_error: 4/17, dst_permission: 0/1 foreign: 61/9
Links: 59/50 ok, 1/2 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
98%Transfer (from/to): 2036/659 files, 0.751/3.085 TB ok
Errors: src_permission: 16/0, src_missing_file: 2/0, trn_timeout: 2/3, trn_error: 2/12, dst_permission: 0/4, dst_error: 0/2 foreign: 39/9
Links: 60/50 ok, 0/1 warning, 0/0 error, 0/0 unknown, 2/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
98%Transfer (from/to): 1017/775 files, 0.735/4.252 TB ok
Errors: src_permission: 2/0, src_missing_file: 14/0, trn_error: 4/25, dst_permission: 0/3, dst_error: 0/1 foreign: 152/6
Links: 55/50 ok, 2/0 warning, 0/1 error, 0/0 unknown, 2/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
98%Transfer (from/to): 1067/993 files, 0.871/2.691 TB ok
Errors: src_permission: 3/0, src_missing_file: 14/0, src_error: 10/0, trn_timeout: 3/1, trn_error: 4/21, dst_permission: 0/8, dst_error: 0/1 foreign: 106/4
Links: 56/50 ok, 4/2 warning, 0/0 error, 0/0 unknown, 0/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
98%Transfer (from/to): 2295/565 files, 3.004/1.458 TB ok
Errors: src_permission: 7/0, src_missing_file: 14/0, src_error: 136/0, trn_timeout: 3/3, trn_error: 7/13 foreign: 2282/41
Links: 57/51 ok, 1/2 warning, 0/0 error, 0/0 unknown, 2/1 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
96%Transfer (from/to): 1183/431 files, 2.416/0.855 TB ok
Errors: src_permission: 7/0, src_missing_file: 19/0, src_error: 6/0, trn_timeout: 2/4, trn_error: 29/14 foreign: 117/53
Links: 55/48 ok, 2/1 warning, 0/2 error, 0/1 unknown, 1/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
96%Transfer (from/to): 655/720 files, 2.548/2.933 TB ok
Errors: src_permission: 7/0, src_missing_file: 13/0, src_error: 1/0, trn_timeout: 1/15, trn_user: 1/0, trn_error: 20/15, dst_permission: 0/4 foreign: 90/15
Links: 56/52 ok, 2/1 warning, 1/1 error, 0/0 unknown, 2/0 bad-endpoint
cms-t2-se01.sdfarm.kr: ok/ok
Site Readiness:
61%SAM: ok (15min evaluations: 94 ok, 1 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (211 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 60/51 ok, 0/2 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
43%SAM: ok (15min evaluations: 92 ok, 0 warning, 2 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (173 Success ...),
FTS: ok (Links: 59/53 ok, 0/0 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
66%SAM: ok (15min evaluations: 91 ok, 0 warning, 3 error, 2 unknown, 0 downtime (0h0m)),
HC: ok (222 Success ...),
FTS: ok (Links: 57/52 ok, 2/1 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
57%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (260 Success ...),
FTS: ok (Links: 58/52 ok, 0/2 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
47%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (186 Success ...),
FTS: ok (Links: 57/54 ok, 1/0 warning, 0/1 error, 0/0 unknown, 1/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
50%SAM: ok (15min evaluations: 94 ok, 2 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (193 Success ...),
FTS: ok (Links: 56/51 ok, 1/1 warning, 1/1 error, 0/0 unknown, 2/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
63%SAM: ok (15min evaluations: 88 ok, 0 warning, 0 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (160 Success ...),
FTS: ok (Links: 55/52 ok, 5/1 warning, 0/1 error, 0/0 unknown, 2/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
82%SAM: ok (15min evaluations: 92 ok, 0 warning, 4 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (221 Success ...),
FTS: ok (Links: 58/53 ok, 2/0 warning, 0/1 error, 0/0 unknown, 2/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
69%SAM: ok (15min evaluations: 93 ok, 0 warning, 0 error, 3 unknown, 0 downtime (0h0m)),
HC: ok (195 Success ...),
FTS: ok (Links: 57/55 ok, 2/1 warning, 0/1 error, 0/0 unknown, 4/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
68%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (240 Success ...; 1 Failed, ExitCode 8021 ...),
FTS: ok (Links: 59/50 ok, 1/2 warning, 0/0 error, 0/0 unknown, 3/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
54%SAM: ok (15min evaluations: 94 ok, 0 warning, 2 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (139 Success ...),
FTS: ok (Links: 60/50 ok, 0/1 warning, 0/0 error, 0/0 unknown, 2/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
70%SAM: ok (15min evaluations: 93 ok, 0 warning, 2 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (251 Success ...),
FTS: ok (Links: 55/50 ok, 2/0 warning, 0/1 error, 0/0 unknown, 2/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
71%SAM: ok (15min evaluations: 95 ok, 0 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (242 Success ...),
FTS: ok (Links: 56/50 ok, 4/2 warning, 0/0 error, 0/0 unknown, 0/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
69%SAM: ok (15min evaluations: 92 ok, 0 warning, 3 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (241 Success ...),
FTS: ok (Links: 57/51 ok, 1/2 warning, 0/0 error, 0/0 unknown, 2/1 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
68%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (248 Success ...),
FTS: ok (Links: 55/48 ok, 2/1 warning, 0/2 error, 0/1 unknown, 1/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
69%SAM: ok (15min evaluations: 90 ok, 0 warning, 5 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (249 Success ...),
FTS: ok (Links: 56/52 ok, 2/1 warning, 1/1 error, 0/0 unknown, 2/0 bad-endpoint; cms-t2-se01.sdfarm.kr: ok/ok)
Life Status:
Prod Status:
CRAB Status:
14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30
Oct

= ok / enabled   ? = unknown / not set   D = Scheduled Downtime
= warning / drain, test   WR = Waiting Room state   P = Partial Downtime   information as of
= error / disabled   M = Morgue state   U = Ad Hoc Downtime   2020-Oct-30 12:30:13 UTC

 

 

T2_PK_NCP
GGUS Tickets: 148185
Downtimes:
SAM Status: 100%15min evaluations: 89 ok, 6 warning, 0 error, 1 unknown, 0 downtime (0h0m) 98%15min evaluations: 77 ok, 14 warning, 1 error, 4 unknown, 0 downtime (0h0m) 100%15min evaluations: 69 ok, 27 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m) 96%15min evaluations: 85 ok, 8 warning, 3 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 86 ok, 0 warning, 2 error, 8 unknown, 0 downtime (0h0m) 99%15min evaluations: 74 ok, 21 warning, 1 error, 0 unknown, 0 downtime (0h0m) 100%15min evaluations: 82 ok, 13 warning, 0 error, 1 unknown, 0 downtime (0h0m) 100%15min evaluations: 66 ok, 30 warning, 0 error, 0 unknown, 0 downtime (0h0m) 88%15min evaluations: 85 ok, 0 warning, 11 error, 0 unknown, 0 downtime (0h0m) 99%15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m) 91%15min evaluations: 54 ok, 34 warning, 8 error, 0 unknown, 0 downtime (0h0m) 90%15min evaluations: 73 ok, 14 warning, 9 error, 0 unknown, 0 downtime (0h0m) 97%15min evaluations: 89 ok, 4 warning, 2 error, 1 unknown, 0 downtime (0h0m) 96%15min evaluations: 73 ok, 20 warning, 3 error, 0 unknown, 0 downtime (0h0m)
Hammer Cloud: 96%153 Success [crab3@vocms0107.cern.ch#59769606.0#1602629403 201013_211126:sciaba_crab_HC-99-T2_PK_NCP-93182-20201013034702 17 0]...
6 Failed, ExitCode 8021 [crab3@vocms0121.cern.ch#58770325.0#1602654576 201014_040323:sciaba_crab_HC-99-T2_PK_NCP-93192-20201014030101 17 0]...
93%3 Failed, ExitCode 47 [crab3@vocms0122.cern.ch#62601525.0#1602719388 201014_231847:sciaba_crab_HC-99-T2_PK_NCP-93204-20201015010101 6 0]...
215 Success [crab3@vocms0122.cern.ch#62602599.0#1602721909 201014_231847:sciaba_crab_HC-99-T2_PK_NCP-93204-20201015010101 6 2]...
7 Failed, ExitCode 8021 [crab3@vocms0122.cern.ch#62610601.0#1602738889 201014_231847:sciaba_crab_HC-99-T2_PK_NCP-93204-20201015010101 71 0]...
3 Failed, Removed due to wall clock limit [crab3@vocms0122.cern.ch#62614351.0#1602748495 201014_231847:sciaba_crab_HC-99-T2_PK_NCP-93204-20201015010101 103 0]...
1 Failed, ExitCode 8028 [crab3@vocms0107.cern.ch#59843565.0#1602789759 201015_172145:sciaba_crab_HC-99-T2_PK_NCP-93204-20201015010101 24 0]...
85%168 Success [crab3@vocms0107.cern.ch#59849672.0#1602804120 201015_231610:sciaba_crab_HC-99-T2_PK_NCP-93224-20201016011101 1 0]...
2 Failed, ExitCode 8021 [crab3@vocms0107.cern.ch#59852674.0#1602817925 201015_231610:sciaba_crab_HC-99-T2_PK_NCP-93224-20201016011101 47 0]...
27 Failed, Removed due to wall clock limit [crab3@vocms0107.cern.ch#59852716.0#1602819121 201015_231610:sciaba_crab_HC-99-T2_PK_NCP-93224-20201016011101 51 0]...
96%251 Success [crab3@vocms0120.cern.ch#58612816.0#1602897121 201017_010616:sciaba_crab_HC-99-T2_PK_NCP-93237-20201017030301 1 0]...
3 Failed, ExitCode 47 [crab3@vocms0120.cern.ch#58618468.0#1602916024 201017_010616:sciaba_crab_HC-99-T2_PK_NCP-93237-20201017030301 64 0]...
2 Failed, ExitCode 8021 [crab3@vocms0120.cern.ch#58621772.0#1602931930 201017_010616:sciaba_crab_HC-99-T2_PK_NCP-93237-20201017030301 117 0]...
3 Failed, Removed due to wall clock limit [crab3@vocms0120.cern.ch#58621346.0#1602928326 201017_010616:sciaba_crab_HC-99-T2_PK_NCP-93237-20201017030301 105 0]...
1 Failed, ExitCode 8006 [crab3@vocms0120.cern.ch#58630044.0#1602958335 201017_010616:sciaba_crab_HC-99-T2_PK_NCP-93237-20201017030301 205 0]...
95%258 Success [crab3@vocms0144.cern.ch#60253358.0#1602976676 201017_190157:sciaba_crab_HC-99-T2_PK_NCP-93237-20201017030301 51 0]...
7 Failed, ExitCode 47 [crab3@vocms0106.cern.ch#47845579.0#1602990041 201018_010445:sciaba_crab_HC-99-T2_PK_NCP-93247-20201018025102 23 0]...
2 Failed, ExitCode 8021 [crab3@vocms0106.cern.ch#47849531.0#1603018848 201018_010445:sciaba_crab_HC-99-T2_PK_NCP-93247-20201018025102 119 0]...
3 Failed, Removed due to wall clock limit [crab3@vocms0106.cern.ch#47846564.0#1603008944 201018_010445:sciaba_crab_HC-99-T2_PK_NCP-93247-20201018025102 86 0]...
98%181 Success [crab3@vocms0107.cern.ch#59936453.0#1603063006 201018_191602:sciaba_crab_HC-99-T2_PK_NCP-93247-20201018025102 48 0]...
2 Failed, ExitCode 8021 [crab3@vocms0119.cern.ch#59086044.0#1603078848 201019_031943:sciaba_crab_HC-99-T2_PK_NCP-93259-20201019050502 4 0]...
99%129 Success [crab3@vocms0155.cern.ch#60905920.0#1603150158 201019_213328:sciaba_crab_HC-99-T2_PK_NCP-93259-20201019050502 23 0]...
1 Failed, ExitCode 47 [crab3@vocms0155.cern.ch#60977351.0#1603209836 201020_022230:sciaba_crab_HC-99-T2_PK_NCP-93269-20201020041302 164 0]...
90%224 Success [crab3@vocms0119.cern.ch#59260000.0#1603235968 201020_202323:sciaba_crab_HC-99-T2_PK_NCP-93269-20201020041302 35 0]...
21 Failed, ExitCode 8021 [crab3@vocms0195.cern.ch#56701494.0#1603258596 201021_025048:sciaba_crab_HC-99-T2_PK_NCP-93281-20201021044102 33 0]...
4 Failed, Removed due to wall clock limit [crab3@vocms0195.cern.ch#56703253.0#1603261299 201021_025048:sciaba_crab_HC-99-T2_PK_NCP-93281-20201021044102 42 0]...
98%180 Success [crab3@vocms0194.cern.ch#57620388.0#1603322610 201021_205731:sciaba_crab_HC-99-T2_PK_NCP-93281-20201021044102 29 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0194.cern.ch#57627486.0#1603340356 201022_031316:sciaba_crab_HC-99-T2_PK_NCP-93299-20201022050302 13 0]...
2 Failed, ExitCode 8021 [crab3@vocms0194.cern.ch#57653452.0#1603384165 201022_031316:sciaba_crab_HC-99-T2_PK_NCP-93299-20201022050302 159 0]...
85%202 Success [crab3@vocms0197.cern.ch#57279362.0#1603408347 201022_212131:sciaba_crab_HC-99-T2_PK_NCP-93299-20201022050302 22 0]...
8 Failed, ExitCode 8021 [crab3@vocms0195.cern.ch#56794735.0#1603429700 201023_022224:sciaba_crab_HC-99-T2_PK_NCP-93310-20201023041902 33 0]...
27 Failed, Removed due to wall clock limit [crab3@vocms0195.cern.ch#56793602.0#1603424900 201023_022224:sciaba_crab_HC-99-T2_PK_NCP-93310-20201023041902 17 0]...
100%199 Success [crab3@vocms0195.cern.ch#56823823.0#1603504680 201024_015156:sciaba_crab_HC-99-T2_PK_NCP-93321-20201024034102 1 0]... 96%241 Success [crab3@vocms0137.cern.ch#56785087.0#1603581405 201024_195559:sciaba_crab_HC-99-T2_PK_NCP-93321-20201024034102 40 0]...
6 Failed, ExitCode 47 [crab3@vocms0137.cern.ch#56785646.0#1603586804 201024_195559:sciaba_crab_HC-99-T2_PK_NCP-93321-20201024034102 58 0]...
3 Failed, ExitCode 8021 [crab3@vocms0106.cern.ch#48015085.0#1603615799 201025_024908:sciaba_crab_HC-99-T2_PK_NCP-93332-20201025034302 72 0]...
73%196 Success [crab3@vocms0197.cern.ch#57397309.0#1603667903 201025_210650:sciaba_crab_HC-99-T2_PK_NCP-93332-20201025034302 26 0]...
29 Failed, ExitCode 8021 [crab3@vocms0199.cern.ch#17860775.0#1603684665 201026_022156:sciaba_crab_HC-99-T2_PK_NCP-93342-20201026031501 19 0]...
42 Failed, Removed due to wall clock limit [crab3@vocms0199.cern.ch#17861052.0#1603685564 201026_022156:sciaba_crab_HC-99-T2_PK_NCP-93342-20201026031501 22 0]...
95%234 Success [crab3@vocms0107.cern.ch#60134812.0#1603753000 201026_202535:sciaba_crab_HC-99-T2_PK_NCP-93342-20201026031501 30 0]...
8 Failed, ExitCode 8021 [crab3@vocms0137.cern.ch#56894034.0#1603770093 201027_014518:sciaba_crab_HC-99-T2_PK_NCP-93354-20201027024103 23 0]...
1 Failed, Removed due to wall clock limit [crab3@vocms0137.cern.ch#56894660.0#1603777293 201027_014518:sciaba_crab_HC-99-T2_PK_NCP-93354-20201027024103 47 0]...
1 Failed, ExitCode 47 [crab3@vocms0137.cern.ch#56907733.0#1603813901 201027_014518:sciaba_crab_HC-99-T2_PK_NCP-93354-20201027024103 169 0]...
95%222 Success [crab3@vocms0121.cern.ch#59241666.0#1603842369 201027_195014:sciaba_crab_HC-99-T2_PK_NCP-93354-20201027024103 47 0]...
1 Failed, ExitCode 47 [crab3@vocms0194.cern.ch#57892362.0#1603863109 201028_010550:sciaba_crab_HC-99-T2_PK_NCP-93363-20201028015502 53 0]...
9 Failed, ExitCode 8021 [crab3@vocms0194.cern.ch#57899129.0#1603883517 201028_010550:sciaba_crab_HC-99-T2_PK_NCP-93363-20201028015502 121 0]...
91%224 Success [crab3@vocms0194.cern.ch#57912866.0#1603926824 201028_191741:sciaba_crab_HC-99-T2_PK_NCP-93363-20201028015502 47 0]...
12 Failed, ExitCode 8021 [crab3@vocms0194.cern.ch#57919038.0#1603945499 201029_022859:sciaba_crab_HC-99-T2_PK_NCP-93383-20201029032502 23 0]...
9 Failed, Removed due to wall clock limit [crab3@vocms0194.cern.ch#57919793.0#1603946997 201029_022859:sciaba_crab_HC-99-T2_PK_NCP-93383-20201029032502 28 0]...
FTS Status: 0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: src_error: 1/0, trn_error: 2/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 1/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 3/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 3/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 4/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
No inforrmation available 0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 3/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 1/0 files, 0.000/0.000 TB ok
Errors: trn_error: 2/0
Links: 1/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: warning/unknown
0%Transfer (from/to): 4/0 files, 0.006/0.000 TB ok
Errors: trn_error: 4/0
Links: 2/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
pcncp22.ncp.edu.pk: warning/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 3/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 2/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 4/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: src_error: 1/0, trn_error: 2/0
Links: 0/0 ok, 1/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: warning/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 2/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 4/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
0%Transfer (from/to): 0/0 files, 0.000/0.000 TB ok
Errors: trn_error: 2/0
Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint
pcncp22.ncp.edu.pk: unknown/unknown
Site Readiness:
0%SAM: ok (15min evaluations: 89 ok, 6 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (153 Success ...; 6 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 77 ok, 14 warning, 1 error, 4 unknown, 0 downtime (0h0m)),
HC: ok (3 Failed, ExitCode 47 ...; 215 Success ...; 7 Failed, ExitCode 8021 ...; 3 Failed, Removed due to wall clock limit ...; 1 Failed, ExitCode 8028 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 69 ok, 27 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: warning (168 Success ...; 2 Failed, ExitCode 8021 ...; 27 Failed, Removed due to wall clock limit ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (251 Success ...; 3 Failed, ExitCode 47 ...; 2 Failed, ExitCode 8021 ...; 3 Failed, Removed due to wall clock limit ...; 1 Failed, ExitCode 8006 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 96 ok, 0 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (258 Success ...; 7 Failed, ExitCode 47 ...; 2 Failed, ExitCode 8021 ...; 3 Failed, Removed due to wall clock limit ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 85 ok, 8 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (181 Success ...; 2 Failed, ExitCode 8021 ...)
0%SAM: ok (15min evaluations: 86 ok, 0 warning, 2 error, 8 unknown, 0 downtime (0h0m)),
HC: ok (129 Success ...; 1 Failed, ExitCode 47 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 74 ok, 21 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (224 Success ...; 21 Failed, ExitCode 8021 ...; 4 Failed, Removed due to wall clock limit ...),
FTS: unknown (Links: 1/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: warning/unknown)
0%SAM: ok (15min evaluations: 82 ok, 13 warning, 0 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (180 Success ...; 1 Failed, Removed due to wall clock limit ...; 2 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 2/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; pcncp22.ncp.edu.pk: warning/unknown)
0%SAM: ok (15min evaluations: 66 ok, 30 warning, 0 error, 0 unknown, 0 downtime (0h0m)),
HC: warning (202 Success ...; 8 Failed, ExitCode 8021 ...; 27 Failed, Removed due to wall clock limit ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: warning (15min evaluations: 85 ok, 0 warning, 11 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (199 Success ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 95 ok, 0 warning, 1 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (241 Success ...; 6 Failed, ExitCode 47 ...; 3 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 2/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 54 ok, 34 warning, 8 error, 0 unknown, 0 downtime (0h0m)),
HC: error (196 Success ...; 29 Failed, ExitCode 8021 ...; 42 Failed, Removed due to wall clock limit ...),
FTS: unknown (Links: 0/0 ok, 1/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: warning/unknown)
0%SAM: ok (15min evaluations: 73 ok, 14 warning, 9 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (234 Success ...; 8 Failed, ExitCode 8021 ...; 1 Failed, Removed due to wall clock limit ...; 1 Failed, ExitCode 47 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 89 ok, 4 warning, 2 error, 1 unknown, 0 downtime (0h0m)),
HC: ok (222 Success ...; 1 Failed, ExitCode 47 ...; 9 Failed, ExitCode 8021 ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
0%SAM: ok (15min evaluations: 73 ok, 20 warning, 3 error, 0 unknown, 0 downtime (0h0m)),
HC: ok (224 Success ...; 12 Failed, ExitCode 8021 ...; 9 Failed, Removed due to wall clock limit ...),
FTS: unknown (Links: 0/0 ok, 0/0 warning, 0/0 error, 0/0 unknown, 1/0 bad-endpoint; pcncp22.ncp.edu.pk: unknown/unknown)
Life Status: WR WR WR WR WR WR WR