Start of Shift Notes:  

Store # 3273 in progress. Lum=1.7E31 

These are I_AVDD_B5W1L2 and I_AVDD_B4W3L2 cells - they stay pink after unmarking and HRRing.
The second one was like that since long time, but the first one is new. Will page silicon.


There were two more pink cells in SVX: S_AVDD_B2W7L4 and S_AVDD_B4W8L3 but they are doing well after
unmarking

I spoke with silicon expert.  No SVXMon cells are yellow, so for the time being, we will just
continue monitoring.

Got the following error:
 Attention !!!. CER_SVXMON_HALT_RECOVER_RUN_ERROR !!! 
 Stuck Cellid S/B1/W5/L4/C7-13 . 
HRR worked.

HVAC alarm. Cryo is investigating: 
EF-2 (EF-2 Flow) > 400 CFM now we have 375. 
It seems to be related to the storm passing trough! 
I told the cryo tech to keep us informed. 

There are a number of consecutive hot channels in CES East raw ADC counts, wedge 21.  The
number of hot channels (~14) is less than the maximum allowed for good run (32) in CO check list.  I
will continue to monitor the situation.


Also, low band in wedge 20 & 21 in CPR East.

History_I_AVDD_B5W0L0 got pink and unmarking, and HRRing doesn't help. SVXMon doesn't seam to be complaining... I guess we need to page again

While discussing with the Cryo tech, reporting that Bill 
Noe has lowered the alarm for COT COTBUBSUP (LL from 13 
to 12 scfm), the Ace smelt something bad and I went upstairs 
to check the L3 room. I found some water spilling from the 
ceiling. Cryo tech put some  temporary plastic and is advising 
the building manager.

We went upstairs again. The temperature is growing. 
We have 28 degrees in L3 room and Transformer b0-14ABC 
looks really warm. Building manager is on the way.

Under the directions of OPmanager we paged also L3 and DAQ
people just to inform that of the situation. Derwin Allen and
Steve Hahn were also informed. Fortunately the Building Manager
arrived convinving us that 82F is the "normal" temperature.
Hope everything goes fine.

Attention !!!. CER_SVXMON_HALT_RECOVER_RUN_ERROR !!! 
 Stuck Cellid S/B1/W5/L4/C7-13 . 
 AUTO HRR worked.

At the previous CO's request, I write this note is to introduce DQMon -- the software to
monitor the consumers that may eventually replace the CO.  DQMon has been running since Diego's
shift yesterday in a trial/test period.  According to Diego, it crashed once during his shift.  I
noticed a few read errors and other minor things, but the software ran all night.

Temperature plot for 1st, 2nd, 3rd floor. Apparently, temperature excursions up to 83 F. have not been uncommon over the last week.

Shift started with store # 3273 (Lum 1.7E31) and run
179644 in progress; running with COT in Slightly Degraded Mode PHYSICS_2_02[2,424,4]. Initial/final
Shift Luminosity 1.7E31/1.26E31.  


- After the usual midnight heartbit problem, we got a 25'  
delay in recovering a TOF HV trip. ACE fixed it by restarting "without preset  parameters" under
direction of the TOF expert  

on call. 

- Silicon:  
 IMON problem with one ISL channel (I_AVDD_B5W1L1), no  
 problems by SVXMON; Two auto-HRR on CelliD: B1/w5/L4/C7-13.  

- DQMon test looks fine (it often complains that "Ymon ouput seems to be empty"). 

- Alarms: 
  i) 2:30 COT  flow rate alarm for COT-BUBSUP.   
  The flow rate reached the low limit of 13.0 scfm and  
  remained in this condition for the whole duration of  
  the shift. Bill Noe lowered the setting to 12.0 scfm.  

  ii) 5:00 HVAC alarm. Low flow rare on EF-2, related  
  to the storm; 

  iii) 5:05 ACEs/C0s were smelling  "electrical" odors in  
the control room and  e went upstairs to check L3 room.  
We found some water leaking from the ceiling on top of a Electrical panel. The Cryo tech covered it
with some  

plastic and we informed OPS and Building manager. 

Runs                   179644
Delivered Luminosity   409  
Acquired Luminosity    381  
Efficiency             93

L2 Decision Timeout ERROR: 

like last week already: 

L1Mon: saw 210 L1 DMA transfers, expect 1 (buffer number 0) 
L1Mon: Dumping data for  1 word. 
Word       upper 32 bits  lower 32 bits 
   0: 0x00000000	0x01000000  
   1: 0x00000000	0x40001818  
   2: 0x0083b477	0xa8948879  

.... 
  418: 0x0083b477	0xa8948879  
  419: 0x8083b477	0x88948879  
L1Mon: done.