{"id":3126,"date":"2026-11-12T20:54:16","date_gmt":"2026-11-12T11:54:16","guid":{"rendered":"https:\/\/www.nro.nao.ac.jp\/?page_id=3126"},"modified":"2026-11-13T16:44:15","modified_gmt":"2026-11-13T07:44:15","slug":"projects-45m-trouble","status":"publish","type":"page","link":"https:\/\/www.nro.nao.ac.jp\/en\/projects\/45m\/projects-45m-trouble\/","title":{"rendered":"NRO45m instrumental failures (Last update Nov. 12th, 2026)"},"content":{"rendered":"\n<h3 class=\"wp-block-heading\" id=\"i-0\">[Trouble ID 2026-1] SAM45 spectrometer (<span class=\"keiko_red\">Occurred on Nov. 6th \u3001ongoing<\/span>)<\/h3>\n\n\n\n<p class=\"is-style-sango-paragraph-memo-alt wp-block-paragraph\">Cause of the issue<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Malfunction of DFP#1 motherboard <\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-exclamation-alt wp-block-paragraph\">Scope of impact<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">All users<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-bad-alt wp-block-paragraph\">Summary of impact<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A05\u201308 and A21-24 are unavailable<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Need to uncheck the corresponding arrays in the device table<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-callout-alt wp-block-paragraph\">Current status<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">SAM45 trouble ongoing<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We are preparing to replace arrays A05\u201308 and A21\u201324 with the new YATSUGATAKE spectrometer as soon as possible.<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-idea-alt wp-block-paragraph\">Details of the issue<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">On November 4, the motherboard of DFP#1 failed, causing the <code>clearSAM<\/code> command to stop working. During troubleshooting, we found that DFP#1 was not responding to ping requests.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Upon inspecting the hardware, we found that the orange LED (UP) next to the LAN port remained lit even after the LAN cable was disconnected. This is a typical symptom of motherboard failure, which has occurred at least three times in the past.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Since we have already run out of spare motherboards, we implemented an emulator to replace DFP#1. SAM45 resumed operations on November 6 with 3\/4 of its original arrays available.&nbsp;<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"i-1\">[Trouble ID 2026-2] Hanging up of FOREST tuning script  (<span class=\"keiko_blue\"><span class=\"keiko_red\">Occurred on Nov. 7th<\/span><\/span>\u3001<span class=\"keiko_blue\">Resolved on Nov. 9th<\/span>)<\/h3>\n\n\n\n<p class=\"is-style-sango-paragraph-memo-alt wp-block-paragraph\">Cause of the issue<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The device control server for the FOREST receiver froze.<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-exclamation-alt wp-block-paragraph\">Scope of impact<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">All FOREST users<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-bad-alt wp-block-paragraph\">Summary of impact<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Unable to use FOREST<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-callout-alt wp-block-paragraph\">Current status<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The issue has been resolved, and FOREST has resumed normal operations.<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-idea-alt wp-block-paragraph\">Details of the issue<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">On November 7, we received a report that the FOREST receiver could not be tuned. An investigation was conducted on November 9.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We found that the server software running on the FOREST device control computer had frozen. This software is responsible for controlling the receiver devices in response to commands from the tuning script client.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The issue was resolved by restarting the server software, and FOREST resumed normal operations on November 9.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"i-2\">[Trouble ID 2026-3] [Trouble ID 2026-3] Abnormally High Tsys in H40 (<span class=\"keiko_blue\"><span class=\"keiko_red\">Occurred on Nov. 8<\/span>,<span class=\"keiko_red\"> <\/span>Resolved on Nov. 10<\/span>)<\/h3>\n\n\n\n<p class=\"is-style-sango-paragraph-memo-alt wp-block-paragraph\">Cause of the issue<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A significant amount of frost had accumulated on the receiver\u2019s RF window.<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-bad-alt wp-block-paragraph\">Scope of impact<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Observations using H40 were unavailable. Please use Z45 instead for the pointing observations.<br><\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-callout-alt wp-block-paragraph\">Current status<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The issue has been resolved, and H40 has resumed normal operations.<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-idea-alt wp-block-paragraph\">Details of the issue<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">On November 8, we received a report of abnormal spectra from the H40 receiver. An investigation conducted on November 9 revealed that a significant amount of frost had accumulated on the receiver\u2019s RF window.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Frost accumulation has also been observed in previous years, and we have routinely performed warm-up and re-cooling procedures to remove it. However, these procedures have typically been required only once every six months.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Since only about three months had passed since the start of operations, we had not yet anticipated significant frost accumulation this season. We suspect that the unusually rapid accumulation was caused by prolonged operation under high-humidity conditions, possibly due to the heavy rainfall in September.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">We warmed up the receiver on November 9 and cooled it down again today (November 10). We have just confirmed through test observations that the receiver is now producing normal spectra.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"i-3\">[Trouble ID 2026-4] Time Offset in the Standard Clock (<span class=\"keiko_red\"><span class=\"keiko_blue\">Occurred on Nov. 10, Resolved on Nov. 10<\/span><\/span>)<\/h3>\n\n\n\n<p class=\"is-style-sango-paragraph-memo-alt wp-block-paragraph\">Cause of the issue<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The cause remains unknown, and we are monitoring the system for any recurrence.<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-bad-alt wp-block-paragraph\">Scope of impact<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><br>No impact on single-dish observations. VLBI observations may potentially be affected.<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-callout-alt wp-block-paragraph\">Current Status<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The clock is operating properly now.<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-idea-alt wp-block-paragraph\">Details of the issue<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">On November 7, we synchronized the standard clock, which is based on a hydrogen maser. However, on November 10, just three days later, we found that the clock had drifted by approximately 0.385 seconds.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Since this is an unusually large time offset for such a short period, we synchronized the clock again on November 10 and are closely monitoring its stability.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The cause of the issue remains unknown and is currently under investigation. Although this issue is not expected to have a significant impact on single-dish observations, it may affect VLBI observations. We are therefore continuing our efforts to identify and resolve the problem.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"i-4\">[Trouble ID 2026-5] \u30a2\u30f3\u30c6\u30ca\u4e3b\u93e1\u306e\u30c8\u30e9\u30d6\u30eb (<span class=\"keiko_blue\"><span class=\"keiko_red\">Nov. 11th \u767a\u751f<\/span><\/span>\u3001<span class=\"keiko_blue\">Nov. 11th\u306b<\/span>\u89e3\u6d88)<\/h3>\n\n\n\n<p class=\"is-style-sango-paragraph-memo-alt wp-block-paragraph\">Cause of the issue<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Unknown<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-bad-alt wp-block-paragraph\">Scope of impact<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">No impact on users<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-callout-alt wp-block-paragraph\">Current status<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><br>Although the DPA fault indicator is still displayed on the telescope control panel, we have confirmed that it does not affect telescope motion. Since the issue is likely related to the display system, we are continuing our investigation in collaboration with Mitsubishi.<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-idea-alt wp-block-paragraph\">Details of the issue<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">On November 10, a DPA fault was detected on the antenna control panel, although no corresponding error was displayed on the COSMOS antenna console.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">This error typically occurs when communication with the antenna motors fails, for example, due to a loss of power to the motors.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">However, we confirmed that the antenna could still be driven normally according to the commanded movements, and no obvious abnormalities were found in the voltage readings between the control system and the motors. Since observations could also be carried out as usual, we decided to continue operations while closely monitoring the situation.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"i-5\">[Trouble ID 2026-6] Abnormal Signal Intensity in H40 (<span class=\"keiko_blue\"><span class=\"keiko_red\">Occurred on Nov. 11<\/span>, Cause Identified on Nov. 12; No Issues Found with the H40 Receiver Itself<\/span>)<\/h3>\n\n\n\n<p class=\"wp-block-paragraph\">Since the issue was found to be caused by Trouble ID 2026-7, described below, troubleshooting of the H40 receiver itself was closed on November 12.<\/p>\n\n\n\n<h3 class=\"wp-block-heading\" id=\"i-6\">[Trouble ID 2026-7] Abnormal Signal Intensity in SAM45 Array 16 (<span class=\"keiko_red\">Exact Onset Unknown; Identified on Nov. 11<\/span>, <span class=\"keiko_blue\">Faulty Component Replaced on Nov. 12<\/span>)<\/h3>\n\n\n\n<p class=\"is-style-sango-paragraph-memo-alt wp-block-paragraph\">Cause of the issue<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Failure of the programmable attenuator in the common IF system.<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-bad-alt wp-block-paragraph\">Scope of impact<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Abnormal Ta* and Tsys values in SAM45 arrays 16 and 32.<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-callout-alt wp-block-paragraph\">\u73fe\u5728\u306e\u30b9\u30c6\u30fc\u30bf\u30b9<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Data obtained with SAM45 arrays A16\/32 during this observing season may have calibration scaling issues. If you notice any abnormalities in your data, please contact us.<\/p>\n\n\n\n<p class=\"is-style-sango-paragraph-idea-alt wp-block-paragraph\">\u8a73\u7d30<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At Nobeyama, OCTAD, the sampler used in SAM45, is a 3-bit sampler with a very limited dynamic range. Therefore, during HOT measurements, a programmable attenuator in the common IF system is used to reduce the signal level so that it falls within the dynamic range of OCTAD. The applied attenuation is then corrected for in software during data processing.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">During our investigation of the H40 issue reported yesterday, we discovered a malfunction in the programmable attenuator for array 16 in the common IF system. Specifically, we found that the attenuator failed to apply the required attenuation when its setting was 4 dB.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">When an H40 observation script is executed, an initial signal-level adjustment is performed before observations begin. Since the appropriate attenuation setting for H40 was 4 dB, the level adjustment could not be completed, preventing observations from proceeding. Other receivers were able to operate normally because their initial attenuation settings were different from 4 dB.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">However, if the appropriate attenuation setting was 4 dB during HOT measurements or other calibration procedures, the required attenuation may not have been applied, potentially resulting in incorrect Ta* calibration.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Therefore, we kindly ask all users who have conducted observations using SAM45 arrays 16 and\/or 32 during the current observing season to check their data for any abnormal Ta* values. If you find any abnormalities, please report them to the observatory.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><\/p>\n","protected":false},"excerpt":{"rendered":"<p>[Trouble ID 2026-1] SAM45 spectrometer (Occurred on Nov. 6th \u3001ongoing) Cause of the issue Malfunction of DFP#1 &#8230; <\/p>\n","protected":false},"author":3,"featured_media":3129,"parent":1928,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"page-1column.php","meta":{"_locale":"en_GB","_original_post":"https:\/\/www.nro.nao.ac.jp\/?page_id=3115","footnotes":""},"class_list":["post-3126","page","type-page","status-publish","has-post-thumbnail","en-GB","entry"],"_links":{"self":[{"href":"https:\/\/www.nro.nao.ac.jp\/wp-json\/wp\/v2\/pages\/3126","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.nro.nao.ac.jp\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/www.nro.nao.ac.jp\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/www.nro.nao.ac.jp\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/www.nro.nao.ac.jp\/wp-json\/wp\/v2\/comments?post=3126"}],"version-history":[{"count":2,"href":"https:\/\/www.nro.nao.ac.jp\/wp-json\/wp\/v2\/pages\/3126\/revisions"}],"predecessor-version":[{"id":3134,"href":"https:\/\/www.nro.nao.ac.jp\/wp-json\/wp\/v2\/pages\/3126\/revisions\/3134"}],"up":[{"embeddable":true,"href":"https:\/\/www.nro.nao.ac.jp\/wp-json\/wp\/v2\/pages\/1928"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.nro.nao.ac.jp\/wp-json\/wp\/v2\/media\/3129"}],"wp:attachment":[{"href":"https:\/\/www.nro.nao.ac.jp\/wp-json\/wp\/v2\/media?parent=3126"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}