GBT OPERATIONS PROCEDURES

Number: OP-05

Title: M&C System Software Procedures

Last Revision: 16 JAN 02

Warning

A complete shutdown and restart should be done for extreme situations only and as a last resort. Personnel from the computing division should be consulted prior to this action.

Info

This procedure can be accomplished from either Unix or Linux workstations and can be utilized to stop and restart individual managers on their respective machines.

Important M&C processes are located on four workstations and are organized as follows:

TaskMaster Computer

YGOR Managers

vortex

Archivist

BCPM

DCR Server

Holography FITS Server

IF Manager

LO1 Coordinator

Measurements

Message Mux

Reset Box

Scan Coordinator

SiteTime Coordinator

Watchdog Server

Weather Coordinator

All sampler2log tasks

gemini

Spectral Processor

gbt-spec-ws

Spectrometer

virgo

Antenna

 

        M&C System Shutdown/Startup Procedure

    Shutdown:

STEP

ACTION

1

From a Unix or Linux workstation, open four Xterm windows. (For an individual manager only one is required.)

2

Name the windows vortex, virgo, gbt-spec-ws, and gemini (wt vortex; wt virgo; wt gbt-spec-ws; wt gemini).   NOTE: The "wt"command is not available on Linux machines.

3

 In the vortex window enter: slogin vortex (followed by the password for the name you're logged in as)

At the prompt enter: su monctrl (follow by the password (see password list)).

Set your environment by entering: source  /home/gbt/gbt.bash

4

Complete step three for virgo, gbt-spec-ws, and gemini in their respective windows. Insert the applicable 'hostname' as required.

5

 Use the system stop command to complete a shutdown. In the vortex window enter:

TaskMaster vortex systemstop (stops the processes running on this system)

Individual processes are recognized by their process number. This can be viewed by :

TaskMaster 'hostname' status in the respective window

To stop the process: TaskMaster 'hostname' stop 'process number'

6

Complete step five for virgo, gbt-spec-ws, and gemini in their respective windows. Insert the correct 'hostname' as required.

7

The shutdown is now complete and can be verified by running the command TaskMaster 'hostname' status in each respective window. Insert the correct 'hostname' as required.
    Startup:

STEP

ACTION

1

 Use the system start command to complete a restart. In the vortex window enter:

TaskMaster vortex systemstart   /home/gbt/etc/config/vortexProc.conf  (starts the processes running on this system)(Individual process have their own config file and can be viewed in this directory)

Confirm the processes were started by entering:

TaskMaster vortex status  (in the Last Action column, "start" should be shown for each applicable process (see listing under Info section)).

2

Complete step one for virgo, gbt-spec-ws, and gemini in their respective windows. Insert the correct 'hostname' as required.

3

Reset the singleboard computers:

  • Launch the CLEO Reset Box application (CLEO launch® Utilities/Tools® Reset Box). The application will appear in a few moments.

  • Click on the reset buttons labeled gbteio1, gbteio2, gbtdcr, and gbtspsbc

4

The startup is complete. Monitor the message window and/or Manager Control application as needed to verify all required systems are up and ok.

        Switching M&C System Software Versions

STEP

ACTION

1

Close all user programs/applications (Cleo, GO, etc.)

 

From a Unix or Linux workstation, open an Xterm window to confirm the current running version of M&C software and login as monctrl:

  • At the prompt enter:  gbtversion    (displays the current software version running)

  • Login as monctrl:  su monctrl (follow by the password (see password list))

  • Name the window monctrl:  wt monctrl

2

Open four additional Xterm windows. Name the windows vortex, virgo, gbt-spec-ws, and gemini ( wt vortex;  wt virgo;  wt gbt-spec-ws;  wt gemini)

3

 In the vortex window enter: slogin vortex (followed by the password for the name you're logged in as)

At the prompt enter: su monctrl (follow by the password (see password list))

Set your environment by entering: source  /home/gbt/gbt.bash

4

 Use the 'status' command to check the status of processes running. Enter:

TaskMaster vortex status  (displays a status summary)

5

 Use the system stop command to complete a shutdown. Enter:

TaskMaster vortex systemstop (stops the processes running on this system)

6

Complete steps 3-5 for virgo, gbt-spec-ws, and gemini in their respective windows. Insert the correct 'hostname' as required.

7

From the window labeled monctrl:

  • Confirm the desired M&C software versions exists. Enter:   ls  /home/gbtversions (displays versions available)

  • Change to the correct directory. Enter:  cd  /home/gbt (selects directory)

  • Change to the desired version. Enter:  setVersion  x.x.x  (substitute the "x" for the numbered version desired)

  • Confirm your software version change. Enter:  gbtversion  (displays current running version)

  • (Optional) To avoid carrying over messages from the previous version, remove them by deleting the message file cache. Enter:  rm  /home/gbtlogs/Messages/vortex.stateCache

8

Restart the GBT M&C software. Using the appropriate 'hostname' in the vortex, virgo, gbt-spec-ws, and gemini windows, enter:

  • TaskMaster 'hostname' systemstart  (restarts processes hosted on this workstation)

  • TaskMaster 'hostname' status  (displays status to confirm processes have started)

9

Restart select single board computers. 

  • Launch the CLEO Reset Box application: CLEO launch®I.F./L.O.®Reset Box

  • Click on the reset buttons labeled gbteio1, gbteio2, gbtdcr, and gbtspsbc   

10

The software version change is complete. Monitor the message window and/or Manager Control application as necessary to verify all required systems are back up and ok.

Prepared by: Dave Rose

Modified by: Eric Knapp

Last modified: 16 JAN 02