APACHE POINT OBSERVATORY SDSS 2.5M OBSERVING LOG Tuesday March 9, 2004 (MJD 53074) ---=== OBSERVING TEAM ===--- Swing: Pete Newman Night: Dan Long (first half), Atsuko Nitta, Jurek Krzesinski John Barentine (most of the night) Supoport: Craig Loomis (in person and on the phone) Hercules ---=== OBSERVING PLAN ===--- Shakedown. Pointing model and shakeall system. ---=== OBSERVING SUMMARY ===--- o Dan created a new inst block for the engcam. o Mirrors were homed and relaxed. o Documentation changes were checked (including the changes made tonight). We are now running v1_88 of sdssProcedures. o New pointing model taken and implemented. o Collimation checked with imager. o Both imgaer and spectro systems were checked on sky. The pointing proved to be good in imaging, but we had to do 15"E offset in spectro to acquire the field. IOP/SOP ------- o biasGen and biasChekc was carried out during last shakeup. So we did not do it. o setRunAndFrame works the way it should. We can now increment the run number. o smear button is gone from the SOPGUI. o v3_133_0 is declared current. TPM ---- o TPM documentation does not exist on host, but on a NMSU machine in Las Cruces. We updated the PR asking the page to be moved to sdsshost and also requested a search function so that one can easily look up info one neds. engCrew must take a look at this www site to see if they like it or not. o TPM's new display on the dewpoint exists and seem to run fine. o Failed testing PR5185. This PR can be easily tested by the engCrew during the day. Please give instruction on how to test to the engCrew. Telescope ----------- o M2 AxisE not reaching the full step. We started to see error message in TCC about "one or more axes did not end on a full step". We moved it to the nearest full step, but the next move failed to end on a full step. French knows about this and will work on it today. o We saw some AZ aborts which made it a bit difficult to go to field. French thinks this might be related to the TCC not centering the telescope inside the windbaffle as well as it should. o We saw several aborts the last hour of the night when we were shaking spectro. French thought it might be due to the telescope not lining up properly when brakes come on. He is going to look into this today. ---=== OBSERVING LOG ===--- Swing shift =========== Spectro focus and collimation not checked as the engineering camera is mounted, but collimator mirror positions were confirmed unchanged (within a few ticks) from last night's adjustments at temperatures within a couple of degrees of current ambient. The primary mirror MIG values were out of tolerance at the start of night. The primary position probably needs to be relaxed. Night ======= Upon firing up iop we saw error message that logsForMJDExist in endNight not being able to find a 20-day old direcotry. The reason we saw this is because Pete dutifully cleaned up /astrolog directory. Since rsync job that copies the sdHdrFix files copied and called the sdHdr-MJD.par files /astrolog/MJD files when there were no /astrolog/MJD directories, logsForMJDExist was unhappy to find there was a /astrolog/53054 FILE, but no /astrolog/MJD/53054 directory with proper files it expected to find. Scot and Pete found the source of the problem and Scot will check in the fix for this. Meanwhile, we found that it is best to do the follwing when we clean up disks. 1. clean sdsshost:/data/spectro/MJD. 2. clean sos:/data/spectro/MJD. 3. clean /astrolog/MJD. so that we do not get rsync copying the sdHdrFix files to /astrolog that we do not need. PRs were filed against iop and SoS. Atsuko changed the procedure to clean disks in above order. We also noted that when one does a "tb" immidiately after starting up iop, we only get the info on failure of "summarizeManyNights" (see problem section). Creating help string for this command seems to fail every time we start iop which is why we get this. But this made it not possible to get the tb of the source of the error on logForMJDExists. Luckily, the error message on the screen was informative enough for Scot and Pete to figure the problem. PR5905 and 5906 were filed. Upon opening and connecting the spectro autofill system, we could not engage conenctor on the sp2 side. It turns out that connector's C-clip came off. This caused the connector not to be in the right place. Jurek placed the C-clip back on the right place. new TPM (v3_38_0) ------------------- It is disappointing that moving TPM off sdsshost was not done during the past bright time as planned. Apparently, it does not matter if one does "setup -t tpm" or" setup tpm". One only gets one version. Doing "setup tpm v##" will give you an error like the following: ~ Host[18:32]setup tpm v2_38_0 INFORMATIONAL: Product 'tpm' (with qualifiers ''), has no v2_38_0 version (or may not exist) o PR3993 documentation: Why is the documentation located on the NMSU machine at Las Cruces instead of sdsshost? enCrwe must look at this to make sure they like the documentation here. We asked in the PR that we would like to have a search function added so that we can easily pull out the info we need. o Enclosure dew point depression display-- this is under Temperatures. Seems to be working. o PR5185 -- Some tpData values appear to be repeated. We tried issuging the following from watcher to see if we can test this PR, but we got an error. Please give instruction on how this is to be tested. Also, this can be tested during the day by the engineering crew. Mirror homing & relaxing ------------------------------- Homing and Relaxing of the mirrors were completed after we opened. TPM is currently not showing MIG values for M2 except for Axis A. Checking the instBlock ------------------------ The engcam image of the star did not make us think there was any collimation problem. This is the first time we (non-Dans) are creating a new instBlock. Dan was kind enough to come tonight to help us through this. Basically, wee offset the star at 9 different positions and find out its position with gcam dofind. We then have to feed the results to a program called Igor that is on the mac in 3.5m control room. From the data, it looks as if the camera was rotated 180 degree from where it used to be! AHHHHHH! How did this happen??????? 03:28Z Scot gave us a new version of iop v3_133_0. This version now tells the observer which tcl files are being sourced. If any particular tcl code fails, we will know. The first tb upon starting the iop is now about plcVersion_button. (Scot fixed it so that we don't get error about the summarizeManyNightts but we now get tb info on a new command...) Back to the engCam instblock-- The center of the chip has shifted 20pix (which is consistent with what we got from last shakedown). Dan tried to run Igor on 3.5m control room Mac. The result was bad. The software crashed the mac. We tried again, but could not successfully start the software. So we decided to run the application on Dan's mac, but it would not run either. Dan decided to hand edit the instrument block to acommodate the changes we measured. There were two sperate place where the rotation was defined and he added 180degrees to the current number. We verified his changes were correct by offseting the fk5 star on the chip. We then had to figure out how to implement the center offsets. This was done by many many trials. I am very grateful that Dan came in today because we would not have been able to get this done without him. 05:08Z gimg0048 -- it took 40s before the frame was displayed! Craig investigates. 05:55Z Dan completes the instBlock building! We start the pointing model! We can now safely take the pointing model. While we were taking the pointing model, the focus needed to be adjusted. Pointing model ------------------ 72 point model was taken without any problem. We got RMS=2.27" after removing 4 bad points. All the bad points are North and low in alt. After implementing the model, we took another small one to check on our pointing. While we were checking: 08:36Z We get too large to correct on both AZ and ALT resulting in the fk5 star not to be in the image. We refiducialized both axis. IOP/SOP v3_133_0 ------------------ o IOP setRunAndFram test: We took a bias run before and after the command to make sure we increment the run number correctly. Run 4491 bias im>setRunAndFrame [incRunNumber 3] 1 The next run was: Run4495 bias --- so it skips 3 and then another. Upon checking the apacheWheel document, we found a "1" missing at the end of the "seRunAndFrame" command. We added it to the documentation and checked it in. o SOPGUI no longer has "smear" button. The colors in the GUI is set correctly too. After completing the small pointind model to verify that all is well. We switched to imager to check the collimation 09:57Z Run 4496 25N lambda=-10 When trying to slew, Jurek's TCC connection from IOP closed but iop issued "startDa -tcc" on its on. We then completed scanStripe successfully. We checked collimation which looked good and ran skippy to make sure it runs. skippy returned that the nuErr is close to 0, but muErr is about 14". The rotator was in spec. TCC was sending error messages of: 0 0 W Modu="mir_o_MoveOneGalil"; Text=" Sec returned an extra message" 0 0 W Received="?GOCORR one or more axes did not end on a full step 0, 0, 0, 0, 1" Russet told us how to fix this (which is now folklored) and we found that we were off by 1 microstep. We moved axis E the closest full step. We then tried to move one step and we saw the message again that axis E did not make it to the full step. Since the stellar images looked fine, the effect of this is not large and the commanded and actual positions of M2 looks good. French who woke up at 3am APO time and walked in the control room when we were having this problem so he knows about this problem and he will work on it during the day. 10:45Z We switch to spectro to test the spectro. The locking pin seems a bit sticky and hard topin the telescope. We asked French he could look into it. We found out that we could not get images with the guider. We saw messages in TCC about not being able to define camera6. It looked as if guider camera was not recognized. We called Craig and found that the problem was due to two things. 1. There was a blank line after "SynSys" in PXL. 2. The parallan cables are labelled wrong and we needed to swap them. When we plugged the paralan cables to the spectro guider at the telescope, we made sure we conencted A cable to A connector and B cable to B connector. This did not work. We ended up swapping the cables up in the computer room tomake the communication work. If we plug the engCam back on (connecting A-A and B-B at the telescope end), then we will have to swap the cables back at the control room. We have noticed tonight taht we have to connect when connecting for the engCam, the A cables on the engCam side and the guider box side are different colors. So connecting A-A and B-B results in connecting red-black cables instead of red-red and black-black. It will be nice to have a consistent scheme. We have asked French if he could make sure all is consistent. cart 4 plate 1353 --------------------- We had alt and az abort while slewing to the field. We cleared both axis and tried again, but az brake came back on. We tried clearing and moving in MCP and TCC and found that we could move in positive direction from MCP every other time or so while it aborted in TCC going the same direction. We asked French for help. After moving back and forth using MCP and TCC, French rhought that TCC was not centering the telescope inside the wind baffle properly, especially after an abort happens. So the magicwas to clear the amps, and brak in MCP after an abort, then go back to TCC and slew the telescope. We had to do fk5 to acquire the field. The fk5 was 15"East (which perhaps is in agreement with nuErr=14" we saw earlier in the imaging data). We hoped for better pointing. We recorded the offsets and focus and stopped since we were already 30min past start of twilight. 12:40Z Closed. endNight ran successfully. We declared the new version of iop v3_133_0 current. We did not make the MIGS from tonight the monical values since we cannot get M2 mig values. But the mirror numbers after the homing/relaxing are recorded in the log section. It looks like we lsot comminication to M2 MIGS sometime during the night since the mirror numbers from the afternoon has valid MIG values. ---=== IMAGING RUN SUMMARY ===--- Run Time Stripe Lambda Last Flavor Comments Start End Begin End Frame ------------------------------------------------------------------------- 4489 23:22Z 23:23Z 100 O -132.35 -132.10 16 ignore doghouse 4490 23:27Z 23:41Z 100 O -130.91 -127.62 35 ignore doghouse 4495 06:41Z 07:08Z 100 O -22.26 -15.43 54 ignore 4496 09:59Z 10:41Z 25 N -8.47 -0.72 83 engineering ---=== IMAGING RUN DETAILS ===--- ---=== SKIPPY RESULTS ===--- Run Frame nFrames stars muErr muRms nuErr nuRms rot az el --------------------------------------------------------------------------- 4496 26 4 29 -14.600 0.133 0.700 0.174 -0.00186 289 56 4496 30 4 51 -14.200 0.105 0.400 0.121 -0.00296 289 57 ---=== LTMATCH RESULTS ===--- Run Field nFields alt az nGood rowMean rowSig colMean colSig rot ------------------------------------------------------------------------ 4496 35 1 57 251 7 -0.072 0.203 1.137 0.099 -0.00382 4496 35 1 57 251 9 -0.577 0.176 0.913 0.081 -0.00307 4496 35 1 57 251 12 -0.635 0.231 0.824 0.188 -0.00277 4496 35 1 57 251 15 -0.756 0.310 0.767 0.156 -0.00258 4496 35 1 57 251 8 -1.036 0.266 0.711 0.153 -0.00239 4496 54 1 57 250 15 0.295 0.085 -0.588 0.153 0.00198 4496 54 1 57 250 13 0.139 0.105 -0.516 0.116 0.00174 4496 54 1 57 250 9 0.093 0.098 -0.464 0.192 0.00156 4496 54 1 57 250 11 -0.115 0.133 -0.561 0.159 0.00189 4496 54 1 57 250 11 -0.265 0.119 -0.571 0.117 0.00192 4496 65 1 58 250 9 0.130 0.153 -0.377 0.156 0.00127 4496 65 1 58 250 17 -0.029 0.143 -0.371 0.150 0.00125 4496 65 1 58 250 7 -0.076 0.126 -0.518 0.163 0.00174 4496 65 1 58 250 14 -0.221 0.089 -0.321 0.203 0.00108 4496 65 1 58 250 6 -0.287 0.099 -0.343 0.159 0.00115 ---=== SPECTROSCOPY DATA SUMMARY ===--- Summary Checked (y/n):y QA Procedures Done (y/n):n UT Exp Time flavor comment (S/N)^2 totals ========================================== b1 r1 b2 r2 ----- sequence 25508, plate -9999 ------- 23:24 25508 0.0 bias ----- sequence 25509, plate -9999 ------- 05:06 25509 0.0 bias ---=== TELESCOPE OFFSETS AND SCALE I ===--- Time Instrument Az Alt Rot Scale pos offset pos offset pos offset ------------------------------------------------------------------------------ 12:29Z 4 1353 253.69 -0.0005 71.80 0.0041 85.97 0.0098 0.999920 ---=== TELESCOPE OFFSETS AND SCALE II ===--- ---=== DATA TAPE SUMMARY ===--- Goes: JL Stays: JL ---=== FOCUS LOG ===--- setmir piston Temp Wind Time Inst scale M1 M2 Foc Az Alt (C) MPH Dir filt fwhm ------------------------------------------------------------------------------ 03:39Z engcam 1.00000 0 -2317 550 -30 68.9 2.5 9 108 12:31Z 4 1353 0.99992 790 1782 0 254 71.5 5.3 12 229 gdr 1.5 ---=== WEATHER LOG ===--- Wind Time Temp F Dewp F MPH Direction Dust DIMM Sky 23:09Z 48 21 8 126 (SE) -9999 - 23:41Z 46 20 11 137 (SE) -9999 - 00:13Z 46 20 9 135 (SE) -9999 - 00:45Z 44 19 6 106 (ESE) -9999 - 01:17Z 41 20 9 83 (E) -9999 - 02:30Z 38 18 10 124 (SE) -9999 - 03:02Z 37 18 12 120 (ESE) -9999 - 03:35Z 37 19 12 126 (SE) -9999 - 04:07Z 37 17 5 121 (ESE) -9999 - 04:39Z 37 16 10 139 (SE) -9999 - 05:12Z 38 13 8 158 (SSE) -9999 - 05:45Z 37 14 17 152 (SSE) -9999 - 06:17Z 38 15 14 172 (S) -9999 - 06:49Z 38 19 14 171 (S) -9999 - 07:21Z 39 19 11 179 (S) -9999 - 07:53Z 39 20 11 207 (SSW) -9999 - 08:26Z 39 20 10 189 (S) -9999 - 08:58Z 39 20 9 197 (SSW) -9999 - 09:30Z 39 21 4 191 (S) -9999 - 10:02Z 39 23 10 205 (SSW) -9999 - 10:35Z 39 24 10 213 (SSW) -9999 - 11:06Z 38 23 8 208 (SSW) -9999 - 11:39Z 40 23 10 218 (SW) -9999 - 12:11Z 41 23 8 209 (SSW) -9999 - 12:44Z 41 21 9 218 (SW) -9999 - 13:15Z 39 21 7 208 (SSW) -9999 - 13:48Z 40 22 10 203 (SSW) -9999 - ---=== TELESCOPE STATUS ===--- Doors cracked fans on:00:25Z Opened: 01:15Z Closed: 12:40Z Telescope is at stow with spectro autofill connected. No interlock bypassed. ---=== SOFTWARE USED ===--- IOP/SOP: v3_131_0 Test version v3_133_0 Declared current Watcher: v2_29_0 MCP: v5_25_0 TPM: tpm_v2_38_0 AstroDa: v14_47 TCC: TCC 2.7.2 November 11 2003 sdssProcedures: v1_87 --> v1_88 SoS: v4_10_7 hoggPT: v1_6_9 plate-mapper: v4_3_1 ---=== MIRROR NUMBERS ===--- Before relaxtion of primary: PRIMARY: -------- Scale: 1.000000 MIGS TONIGHT NOMINAL Axial A 0.5490 0.5420 Axial B 0.6240 0.6390 Axial C 1.0990 1.0900 Trans D -8.4450 -8.4610 Lateral E 10.7823 10.8966 Lateral F 10.7696 10.8712 GALILS Commanded: 4600. -2850. 850. -9250. 18400. 17850. Actual: 4600. -2866. 866. -9275. 18411. 17825. SETMIR VALUES PriDesOrient: 0.00 0.00 15.20 829.90 1.60 PriOrient: 0.00 0.00 14.91 830.49 3.19 SECONDARY: ---------- Focus: 0.00 Air Temp.: 7.8 Alt.: 29.994731 MIGS TONIGHT NOMINAL Axial A 1.5140 1.5160 Axial B 1.1090 1.1180 Axial C 1.1120 1.1210 Trans D -0.0040 -0.0050 GALILS Commanded: 1628380. 1548065. 1574805. -3900. -8750. Actual: 1628641. 1548187. 1574504. -3899. -8726. SETMIR VALUES SecDesOrient: 1257.00 0.00 -25.00 0.00 146.27 SecOrient: 1256.98 -0.16 -24.92 0.31 146.66 After relaxing the mirrors: PRIMARY: -------- Scale: 0.999920 MIGS TONIGHT NOMINAL Axial A 1.3390 0.5420 Axial B -0.1630 0.6390 Axial C 1.8840 1.0900 Trans D -8.4580 -8.4610 Lateral E 10.8204 10.8966 Lateral F 10.8458 10.8712 GALILS Commanded: -7800. -15250. -11550. -9250. 18450. 17850. Actual: -7796. -15262. -11529. -9275. 18425. 17839. SETMIR VALUES PriDesOrient: 789.73 0.00 15.20 829.90 1.60 PriOrient: 790.01 0.00 14.91 830.80 3.19 SECONDARY: ---------- Focus: 0.00 Air Temp.: 4.9 Alt.: 29.601680 MIGS TONIGHT NOMINAL Axial A 0.8670 1.5160 Axial B 0.0000 1.1180 Axial C 0.0000 1.1210 Trans D 0.0000 -0.0050 GALILS Commanded: 2452484. 2371861. 2398399. -3800. -8600. Actual: 2452448. 2371994. 2398311. -3817. -8623. SETMIR VALUES SecDesOrient: 1910.90 0.00 -25.00 0.00 146.27 SecOrient: 1910.90 -0.06 -25.04 -0.10 145.83 ---=== PROBLEMS IN DETAIL ===--- Here is the beginning of the iop failure message: --------------------------------------------------- Source of highCommand.tcl failed! Error was: no files matched glob pattern "/astrolog/53054/*" while executing "glob ${logDir}/*" invoked from within "llength [glob ${logDir}/*]..." invoked from within "if { ([llength [glob ${murmurDir}/*.log]] > 0) && ([llength [glob ${logDir}/*]] > 0) } { return 1 } " invoked from within "if { [file exists $murmurDir] && [file exists $logDir] } { if { ([llength [glob ${murmurDir}/*.log]] > 0) && ([llength [glob ${logDir}/*]] > 0) } { ..." (procedure "logsForMJDExist" line 8) invoked from within "logsForMJDExist $mjd" invoked from within "if {[logsForMJDExist $mjd]} { return $mjd }" ("loop" body line 2) invoked from within "loop mjd $firstMJDToTry 52000 -1 { if {[logsForMJDExist $mjd]} { return $mjd } }" (procedure "MJDOfMostRecentLogsOnDiskBefore" line 7) invoked from within "MJDOfMostRecentLogsOnDiskBefore [mjd4Gang]" invoked from within "set oldMjd [MJDOfMostRecentLogsOnDiskBefore [mjd4Gang]]..." (procedure "endNight" line 3) invoked from within "endNight -help" ("eval" body line 1) invoked from within "eval $p -help" invoked from within "ftclHelpDefine $help_class $p " [eval $p -help]..." ("foreach" body line 2) invoked from within "foreach p $proc_list { ftclHelpDefine $help_class $p " [eval $p -help]"; }" invoked from within "if [info exists proc_list] { foreach p $proc_list { ftclHelpDefine $help_class $p " [eval $p -help]"; } unset proc_list }" (procedure "set_ftclHelp" line 4) invoked from within "set_ftclHelp iop scanHelp_procs " (file "/p/iop/v3_131_0/etc/highCommand.tcl" line 2804) invoked from within "source $env(IOP_DIR)/etc/$file" The first TB always give the same message ---------------------------------------------- im> tb invalid command name "summarizeManyNights" while executing "summarizeManyNights -help" ("eval" body line 1) invoked from within "eval summarizeManyNights -help" invoked from within "ftclHelpDefine iop summarizeManyNights " [eval summarizeManyNights -help]..." im> Max accel. errors seen in Watcher ------------------------------------- altitude (addoffset: Max accl. for altitude exceeded: 133/1000 (2004-03-10 03:24:18Z sdssmcp): 2004-03-10 03:24:36Z ) azimuth (addoffset: Max accl. for azimuth exceeded: -259/1000 (2004-03-10 03:25:17Z sdssmcp): 2004-03-10 03:25:34Z ) rotator (addoffset: Max accl. for rotator exceeded: -281/1000 (2004-03-10 03:25:17Z sdssmcp): 2004-03-10 03:25:34Z ) azimuth (addoffset: Max accl. for azimuth exceeded: 1879/1000 (2004-03-10 10:04:23Z sdssmcp): 2004-03-10 10:04:32Z ) rotator (addoffset: Max accl. for rotator exceeded: 1610/1000 (2004-03-10 10:04:24Z sdssmcp): 2004-03-10 10:04:42Z ) TPM Errors ------------ dewar (Spectro Dewar Scale Communications Fault: 2004-03-10 00:34:37Z) m1 temp (Excessive Front-Back Difference (Entire Mirror):Excessive Front-Back Difference (Left Half):Excessive Front-Back Difference (Right Half):Excessive Front-Back Difference (Lower Half):Excessive Front-Back Difference (Upper Half): 2004-03-10 01:52:13Z ) env temp (Excessive Return - Ambient Difference:: 2004-03-10 01:20:28Z) tracking (Excessive Az Tracking Error:: 2004-03-10 06:11:22Z) m2 temp (Excessive Front-Back Difference (Left Half):Excessive Front-Back Difference (Right Half):: 2004-03-10 01:20:28Z ) m2 mig (Communications Fault: 2004-03-10 01:21:14Z)