2004 CDF E-Log -- Day shift. Sun Feb 22, 2004
SciCo DAQ Ace Monitoring Ace CO (Operations Manager)
Beate Heinemann Vadim Khotilovich Natasa Miladinovic Silvia Amerio Rob Harr


Start of Shift Notes:  

store 3252: scraping ongoing 
plan: take data without Silicon
 Sun Feb 22 08:14:08 scraping done at 8.08. Lostp=7 kHz, Lostpb=0.7 kHz, B0LUM=58.5E30  - Beate
Sun Feb 22 08:14:59 Run 179285 Activated at 2004.02.22 08:14:36 - RunControl
Sun Feb 22 08:15:32 Run 179285 ACTIVATE: PHYSICS_HIGHLUM_2_02 [1,420,427] - Vadim x2080
Sun Feb 22 08:37:13
 - natasha
-- Sun Feb 22 08:37:37 comment by...natasha --  shot setup plots.
Sun Feb 22 08:56:30 SL7 sense wire 9 quadrant b is quite active this morning. I lowered the SL7 S9 high voltage by 40v for the entire superlayer and will watch the behavior. - R. Wagner :: (run 179285)
Sun Feb 22 09:06:46
Channel 62 shows a very low occupancy, not reported in reference plot.
 - Silvia
-- Sun Feb 22 14:08:38 comment by...Silvia --  Channel 62 has recovered.
Sun Feb 22 09:47:51 Had TOF trip -- no tweety bird alarm. Went downstairs and found Smacs frozen, and while I was there the PC itself got hung. Reset the PC, restarted Smacs, and reset trip. It took awhile, but now everything seems fine. - natasha
Sun Feb 22 09:58:39
 - natasha
Sun Feb 22 10:58:36 
L2 decision timeout was HRRed: 

(MLE) b0l2de00:SpyAlpha:10:57:43 AM-> 
CListMon: Dumping CLIST data: 
Word       upper 32 bits  lower 32 bits 
 0: 0x805b0401	0x200c004b  
 1: 0x005b0401	0x000c004b  
 2: 0x009b0405	0x201d0072  
 3: 0x809b0405	0x001d0072  
 4: 0x839a3006	0x2061005a  
 5: 0x039a3006	0x0061005a  
ClistMon: done. 

L2 Decision Timeout.[RXPT]
 - Vadim :: (run 179285)
Sun Feb 22 11:11:28 PSM alarm: 1RR18D_1 (CMX W muon TDCs). Cleared itself soon after. This happens relatively often (in average once per my shift or so). - natasha
Sun Feb 22 11:18:39
 - natasha
Sun Feb 22 11:38:28 
Event Builder Error was HRRed: 
 SCPU_TRACER_EVENT_ID Error !!!  
 Hardware EVB has detected a problem with data in  
 SCPU b0eb15 (forwarded by FER crate CCAL_03).  
 Datataking is paused: events are not being processed.
 - Vadim :: (run 179285)
Sun Feb 22 12:36:06 Run 179285 Terminated at 2004.02.22 12:35:36 - RunControl
Sun Feb 22 12:36:35 Run 179285 TERMINATE: will change the trigger table - Vadim x2080
Sun Feb 22 12:41:32 Run 179286 Activated at 2004.02.22 12:40:34 - RunControl
Sun Feb 22 12:41:34 Run 179286 ACTIVATE: PHYSICS_2_02 [2,424,431] - Vadim x2080
Sun Feb 22 13:00:07 Got a L2 Decision Timeout from b0l2de00. During HRR the b0cot18 was not responding. Had to shepherd it. After the run recovery got "FERML_TDC_NOT_READY_GLOBAL !!! - Timeout on global TDC Done for crate b0cot18." - it was not responding again. An additional shepherding helped. - Vadim :: (run 179285)
Sun Feb 22 13:34:01
 - natasha
Sun Feb 22 13:40:29 
SCPU_TRACER_EVENT_ID Error was HRRed: 

0l3pcom1.fnal.gov:main:1:37:30 PM->Host b0eb15.fnal.gov, task tRec_0 
SCPU-P1-E-TracerEventId: Event 723826, crate 3, channel 2 has either bad Tracer ID or bad markers
around Tracer word. 

 Tracer word event ID is 2, should be 2. 
Tracer word = 0x54e20103 (I think). 
Channel data = 0x00000152 0x00000000 0x43454d44 0x00000002 0x00000000 0x00000004 0x00000001
0x00000000 ... 

... 0x01a51179 0x01813279 0x01913579 0x00000000 0xaaaaaaaa 0x01111551 0x54e20103 0x80000000 -->   
 Additional Information:  

 Attention!!!. SCPU_TRACER_EVENT_ID Error !!!  
 Hardware EVB has detected a problem with data quality in  
 SCPU b0eb15 (forwarded by FER crate CCAL_02).
 - Vadim :: (run 179285)
Sun Feb 22 13:43:31 
L2 Decision Timeout was HRRed. 

(MLE) b0l2de00:SpyAlpha:1:42:28 PM-> 
CListMon: Dumping CLIST data: 
Word       upper 32 bits  lower 32 bits 
 0: 0x80338401	0x20000012  
 1: 0x00338401	0x00000012  
 2: 0x07338401	0x20000012  
 3: 0x07338401	0x00000012  
ClistMon: done.
 - Vadim :: (run 179285)
Sun Feb 22 15:03:30 owl shift CO had changed a lot of YMON plots without consulting experts: Silvia changed them all back - Beate
Sun Feb 22 15:05:19
 - natasha
Sun Feb 22 15:45:58 b0cot13 was not responding and I tried to shepherd it. Several attempts ended in "shepherd was successful" but after the run recovery we had "done timeout in COT_13" pop-up and no daq. Called the experts. The advice to do RESET first and then SHEPHERD the crate helped. - Vadim :: (run 179285)
Sun Feb 22 15:53:12 Shift Summary: 
Shift Summary: 
============= 
- TOF tripped and no bird alarm from IFIX: reset on PC downstairs and on 
IFIX took about 15 minutes total 
- owl shift CO had changed a lot of YMON plots without consulting experts: 
we changed them all back 
- some trouble when starting a new run after switching trigger table but 
shepharding helped 
- problem with crate B0COT13: expert coming in now
Totals
Date:2004.02.22
Shift:day
Delivered luminosity:1154.2 nb-1
Acquired luminosity:1033.6 nb-1
Efficiency: 89.6

End of Shift Numbers
CDF Run II 

Runs                   179285, 179286
Delivered Luminosity   1154.2  
Acquired Luminosity    1033.6  
Efficiency             89.6
 - Beate
Sun Feb 22 15:55:50
Run Number Data Type Physics Table Begin Time End Time Live Time L1 Accepts L2 Accepts L3 Accepts Live Lumi, nb-1 GR SC RC
179285 x2BC55 BEAM PHYSICS_HIGHLUM_2_02 [1,420,427] 08:14:36 12:35:36 04:06:30 108,458,042 4,259,987 666,347 689.343 1 1 1
179286 x2BC56 BEAM PHYSICS_2_02 [2,424,431] 12:40:34 02:52:30 172,953,005 2,239,494 383,032 366.567 1
Totals 15:55:01 06:59:00 281,411,047 6,499,481 1,049,379 1055.911
 - End of Shift Report
Sun Feb 22 16:00:32 Shift Summary: 
see above
 - beate
Sun Feb 22 16:01:25 Shift Summary: 
see above
 - beate