# # Instructions for installing and configuring the radar processing # software, release-1.0. # 15 February 2012 M. Leidner # release-1.0 of the software and these instructions assume quite # a bit. Here's the current list (the goal is to trim these down # a lot in future releases): # # - the target install server has contact with the BSD subversion # server, terra.aer.com; # - the target server has Sun Grid Engine installed in /home/sgrid # and configured with at least one multi-job queue called, # "radarOps"; # - a functioning LDM feed of radar data from NSSL, hosted in # /usr/local/ldm/data/wmo/yyyy.mm.dd/ on the target server; # - an IDL run-time license installed in # /usr/local/itt/idl/idl/bin/idl # on the target server; # - a "bizops" or similar unix user on the target machine, # independent of any individual user, who will own, run and manage # the installed software; # - the target machine system time is based on Greenwhich Mean Time # (GMT). ##################################################################### Step 1. Make a location for the installation on the target machine. ssh bizops@machine # for an operational install: machine> cd /projects/radar machine> mkdir ops # or, for a testbed install: machine> cd /projects/radar machine> mkdir -p testbeds/ ##################################################################### Step 2. Check out a working copy of the software of interest from SVN on the target machine. # for an operational install: machine> cd /projects/radar machine> svn checkout https://terra.aer.com/subversion/BSD/radar/tags/release-1.0 ops # or, for a testbed install: machine> cd /projects/radar/testbeds machine> svn checkout https://terra.aer.com/subversion/BSD/radar/tags/release-1.0 ##################################################################### Step 3. Make the IDL runtime executables at AER, and install on the target machine. Step 3a. Check out a working copy of the software of interest from SVN on a local AER machine with an IDL license. aer> cd aer> mkdir -p radar/ops aer> cd radar aer> svn checkout https://terra.aer.com/subversion/BSD/radar/tags/release-1.0 ops Step 3c. Compile the IDL codes. idl < build.rt-tile_summary idl < build.rt-sew_tiles Step 3d. Secure copy (scp) the IDL executables to the target machine. # for an operational install: scp -pr tile_summary.sav bizops@machine:/projects/radar/ops/nmq/idl/src/ scp -pr sew_tiles.sav bizops@machine:/projects/radar/ops/nmq/idl/src/ # or, for a testbed install: scp -pr tile_summary.sav bizops@machine:/projects/radar/testbeds//nmq/idl/src/ scp -pr sew_tiles.sav bizops@machine:/projects/radar/testbeds//ops/nmq/idl/src/ ##################################################################### Step 4. Configure software on target machine. Step 4a. If necessary, configure paths on the target machine in the shell scripts that run the system to suit the needs of the installation. # This is only necessary of you are creating a testbed install. # The shell scripts and software are set up for operational use. # look for occurrences of '#--- config --- #' in the code; # as in, grep '#--- config --- #' *.csh to see all occurrences. # Change paths to line up with your installation location # in the following 4 files (these scripts are set up for # operational use): aer> cd /projects/radar//nmq/csh aer> radar_top_level.csh aer> tile_summary.csh aer> generate_products.csh aer> generate_pyShapefiles.csh cd /projects/radar/testbeds//nmq/csh chmod +x *csh # for some reason, these scripts are not coming out # of CVS with the execute bit set. Step 4b. Install cron jobs to run processing. # Here is a copy of an operational crontab # (this is a copy of file nmq/doc/cronjobs.txt): # ---------------------------------------------------------- # m h dom mon dow command # Get SPC text reports for Travelers 15 * * * * /home/bizops/spc/getSPCyest.sh >> /home/bizops/spc/data/spcLog.txt 2>&1 # Morning processing of Travelers 20 12 * * * /home/bizops/spc/nosendStormData.sh 45 12 * * * /home/bizops/spc/sendDailyData.sh #/home/wramstro/spc/archiveDailyData.sh 00 11 * * * /home/bizops/spc/archiveDailyData.sh # LDM Radar Checking 10 * * * * /home/bizops/bin/hourlyRadarCheck.sh 30 20 * * * /home/bizops/bin/dailyRadarCheck.sh # 4x/day radar data processing; produces tile summaries and CONUS # NetCDF and shapefile products 15 06,12,18,00 * * * /bin/csh /projects/radar/ops/nmq/csh/radar_top_level.csh 360 0 15 05,11,17,23 * * * /bin/csh /projects/radar/ops/nmq/csh/radar_top_level.csh 360 1 # 24x/day composite reflectivity processing; produces CONUS NetCDF # and shapefiles 08 * * * * /bin/csh /projects/radar/ops/nmq/csh/radar_top_level.csh 60 0 00 02,08,14,20 * * * /opt/local/bin/python /projects/radar/ops/nmq/py/gatherNsend.py rad /projects/radar/testbeds/leidner/nmq/py/gatherNsend.cfg >> /home/bizops/gatherNsend.out # 4x/day rain product delivery 00 00,06,12,18 * * * /opt/local/bin/python /projects/radar/ops/nmq/py/gatherNsend.py rain /projects/radar/testbeds/leidner/nmq/py/gatherNsend.cfg >> /home/bizops/gatherNsend.out # 1x/day spc data delivery 45 12 * * * /opt/local/bin/python /projects/radar/ops/nmq/py/gatherNsend.py spc /projects/radar/ops/nmq/py/gatherNsend.cfg # clean operational radar processing directories 00 02 * * * /bin/bash --login -c '/usr/local/ldm/bin/scour -v -x /projects/radar/ops/ldm/etc/scour-ops.conf > /projects/radar/ops/ldm/etc/scour.log' ##################################################################### Step 5. Configure product delivery (ftp parameters). # Edit nmq/py/gatherNsend.cfg to make sure that target delivery # ftp user and password are correct. These settings will vary # on every machine. ##################################################################### Step 6. try out the software on the target machine! # The crontab entries should start producing data within the hour. # To test immediately, try some of the commands below, but make sure # you have sufficient LDM data present (in /usr/local/ldm/data/wmo/) # for the dates/times of interest to run such tests! TBD: give examples of how to run at the command line for various products; e.g., 1-hour radar reflectivity, 06-12Z radar products for a given day, 18-00Z rainfall, etc.