GBT OPERATIONS PROCEDURES

Number: HDWR-01

Title: Spectrometer Restart

Last Revision: 27 MAR 03

General

This note details the procedures to follow to get the spectrometer working again when it is not operating properly. The general approach is to try the simplest thing first, and if that doesn't work try something a little more drastic, and if that doesn't work,... 

The procedures, from least drastic to most drastic, are the following:

Procedure 1: Do a Manager Reset. See Procedure 1 details below.

Procedure 2: Stop and start the Spectrometer Task. See Procedure 2 details below.

Procedure 3: Reboot the Sparc computer. See Procedure 3 details below.

Procedure 4: Cycle the hardware power. See Procedure 4 details below.

Procedure 5: Cycle the hardware and reset the Sparc. See Procedure 5 details below.

Info

To reiterate, try Procedure 1 first. If it works, then go back to observing. If it does not help, try Procedure 2, etc... If all these fail, call for help. Please log what you did as that may help improve the system in the future. Specifically record which procedures you executed to get the system going again; this will give us some insight into whether we should change the order of the procedures.

Procedure 1: Manager Reset

Note

This procedure is executed from the CLEO spectrometer screen.

STEP

ACTION

1

If hung in a state other than Ready, do an Abort on the Scan Coordinator. Wait up to 1 minute for it to go to the Ready state.

2

If it does not go to the Ready state go to Procedure 2.

3

If it does go to the ready state, from the Manager tab command a "Reset Parameters". This will set up the hardware from scratch. Wait for this to complete (3 minutes or less).

4

If there are no error messages go back to observing. If there are error messages other than "balancing" ones, go to Procedure 2.

Procedure 2: Restart the Spectrometer Task

Note:

This procedure is executed from an Xterm talking to the Sparc computer in the spectrometer.

STEP

ACTION

1

$ telnet gbtrbeq 4 (If you get "connection refused" follow the procedure below to reset the gbtrbeq port)
Hit <RETURN>. If you don't get a login prompt, some is already logged in. Type "logout".
It should now ask for login. If it doesn't, call for help. If it does, log in as monctrl.

2

$ source /home/gbt/gbt.bash

3

$ TaskMaster gbt-spec-ws stop 2
4

$ ps -u monctrl ("Spectrometer should NOT be listed in the processes)
If spectrometer is still running.......kill -9 <pid>
If it won't die go to Procedure 3.
If it does die:
5

$ TaskMaster gbt-spec-ws start 2
6

$ TaskMaster gbt-spec-ws status

The Spectrometer task status should be Start. If not, go to procedure 3.
If so, quit and re-start the CLEO spectrometer screen. It should come back to ready in two or three minutes. Spectrometer error messages, except for "balancing" ones, should also clear. If so, logout and quit the telnet session as follows:
7

$logout
8

$<CTRL>] (control and closed-square-bracket simultaneously)

9

$quit

Resume observations

Procedure 3: Reboot the Sparc Computer

Note:

This procedure is executed from an Xterm talking with the Sparc computer in the spectrometer. You should get to this procedure only from procedure 2 above.

STEP

ACTION

1

Type su root 
Type password

2

Type sync;sync;init 6 
When computer is finished rebooting:

3

On the computer at the gbt-spec-ws console login: type "monctrl"
Enter the password

4

Type "source /home/gbt/gbt.bash"

5

Type "TaskMaster gbt-spec-ws systemstart /home/gbt/etc/config/gbt-spec-wsProc.conf"

6

Quit and re-start the cleo spectrometer screen. It should come back to ready in two or three minutes. Spectrometer error messages, except for "balancing" ones, should also clear. If so, logout and quit the telnet session as follows:

7

$logout

8

$<CTRL>] (control and closed-square-bracket simultaneously)

9

$quit

If not, go to Procedure 4.

Procedure 4: Cycle the hardware power

Note:

This procedure is executed from the spectrometer front panel.

STEP

ACTION

1

On the spectrometer turn the "System" switch to OFF.

2

On the spectrometer turn the "System Monitor" switch to OFF.

Count to ten...

3

On the spectrometer turn the "System Monitor" switch to ON.

4

On the spectrometer turn the "System" switch to ON.

It should come back to ready in two or three minutes. Spectrometer error messages, except for "balancing" ones, should also clear. If not, go to Procedure 5.

Procedure 5: Restart the software and cycle the hardware power

Note:

This procedure is executed from an Xterm talking with the Sparc computer in the spectrometer and from the spectrometer front panel.

STEP

ACTION

1

On the spectrometer turn the "System" switch to OFF.

2

On the spectrometer turn the "System Monitor" switch to OFF.

3

Type "telnet gbtrbeq 4" Hit <RETURN>. 

If you don't get a login prompt, someone is already logged in. Type "logout".
It should now ask for login. If it does not, call for help. If it does:

4

Type "root"

Type the password

5

At the $ Type "sync;sync;init 6 " and return

When computer is finished rebooting:

6

On the computer at the gbt-spec-ws console login: type "monctrl"
Type password

7

Type "source /home/gbt/gbt.bash"

8

On the spectrometer turn the "System Monitor" switch to ON.

9

On the spectrometer turn the "System" switch to ON.

10

On the computer as monctrl immediately start the software with the command:

"TaskMaster gbt-spec-ws systemstart /home/gbt/etc/config/gbt-spec-wsProc.conf"

 
It should come back to ready in two or three minutes. Spectrometer error messages, except for "balancing" ones, should also clear. If not call for help.

 

Resetting the "gbtrbeq" port

Note:
Perform this procedure when you receive a "connection refused" message upon attempting to telnet to gbtrbeq 4. This will reset the port and make it accessible.
Info:
Operators need to type in all text that is in bold font in this procedure.

STEP

ACTION

1

$ telnet gbtrbeq <RETURN>

password: iolan <RETURN>

2

set term ansi <RETURN>

This will open a new display and the first connection listed on the display will be highlighted

These displays can be navigated with the "up" and "down" arrow keys
3

Hit <RETURN> on connection one
4

Hit <RETURN> on admin mode
5

"Arrow down" to "password" and type iolan
6

"Arrow down" to "Kill" and type number "4"  for the port number
7

"Arrow down" to "Quit" and hit <RETURN>

8

Connection 1 will be highlighted. Hit <RETURN>

9

"Arrow down" to "Log Out". Hit <RETURN>

 

Contact persons:

Rich Lacasse

Holly Chen

 

 

Prepared By: Eric Knapp

Last modified: 27 MAR 03