C. Fairall

June 2, 1999

Daily Operations

1. Arise, whizz, eat breakie, stagger down to lab

2. Copy yesterday's files from Dilbert to Crazyhorse

Open a terminal on Crazyhorse

Get to home/jeh/data

execute: bdf

execute: cp /dilbert/data/P?_ddd?? . Where ddd is the julian day yesterday

Go out and run the washers on the hygrometers

When you get back, execute a bdf and note in log book number of mb copied

Go to a matlab window and run 'strip_cmp', giving it ddd when prompted

3. FTP files from Crazyhorse to DAS01

Get on DAS01 and double click ftp.exe icon (set up to start you in d:/hp_data local dir)

execute: open 205.156.17.143,

Name: jeh	pswd: 2dogit

execute: prompt, bin, cd data

you can do a pwd to verify you are in /home/jeh/data

execute: mget P?_ddd??

[after strip_cmp is done, repeat and do a mget P1_sddd?? If you need to]

4. Daily file processing from DAS01

Open a matlab window

Run the following programs which read in the hourly hp_das files, decode, and write 1-min resolution daily files to d:\hp_ascii:

read_hp_day	(slow campbell data, writes proc_hpddd.txt)

read_shp_day	(ship SCS data, writes proc_scsddd.txt)

read_son_day	(sonic anemometer, writes proc_sonddd.txt)

Run the following programs which read in the above ascii files, interpolate to common time base, compute averages, and write daily files at 5-min and 30-min time	resolution files:

timatch_5	(writes proc_fluxddd.txt)

timatch_30	(writes flux_hfddd.txt)

5. Other processing

I maintained a qpro file where I appended each flux_hf.txt file at the end and did some manipulations and graphs, etc. For example, converted the lame gps lat/lon format to decimal. These are stored in the qpro directory. I also would occasionally write a pure txt file from that could be read back into matlab for processing of the entire time series to that point (could have done all this in matlab, but didn't). There is a matlab program jasm_26 which will read this file and run the coare flux algorithm and do some diurnal plots; it also computes daily means of many quantities of interest. Also, after running that program there is one called jasm_plt that makes some graphs, but many may not work for your julian days..

Archiving Operations

We have been doing archiving on several media:

1 CD-rom, written from DAS01 every two days of the raw hp_das files.

2 datapes, written from crazyhorse every 5 days of the raw hp_das files.

JAZ drive, we write a zipped session every week to 10 days from DAS01 of the raw hp_das files. The files are copied from d:/hp_data to

Files are deleted from crazyhorse and dilbert about every 5 days. We only delete files that have been backed up to CD and datape.

Files are deleted from hp_data on DAS01 after writing the zip session. Not all files are deleted.

Adaptations of JEH Processing Programs

I have attempted to adapt previous programs used by your openfastex program to work with this setup. I have produced 2 versions of each: the '3' version is intended to be run from the keyboard to view the output of some instrument. Thus, it has plots of simple time series and, in some cases, spectral graphics. The '4' version have the graphs and the spectral computations commented out and are intended to be run as subroutines as part of the openfastex analysis program. Here is a short list:

opencamp1r3, 4	Reads fast campbell, and decodes Licor and Oak ridge data (uses licorcalc).

openmotion1r3,4	Reads motion campbell (same as original)

openophir3,4	Reads ophir (slightly modified from original)

openradiom3,4	Reads slow campbell (vectorized read version)

openscs4	Reads ship scs data (vectorized read version openship); didn't write a plot version

opensons3,4	Reads sonic data (slightly modified from original)

fasthum	A fast humidity diagnosis program to be run mostly on crazyhorse. It plots the ophir, oak ridge, and licor together.

Strip_cmp	A program that runs on crazyhorse to strip out unneeded zeros from the campbell file to save storage space. You won't need if you change hp_das.

Specsmooth	Your version of specsmooth would not run. I got it to work by adding a variable (sample rate).

Fastexrate	I have not worked on this program. It will need to be modified for the present setup.

.

Notes.

The vectorized versions of radiom and scs run much faster than originals, but may have problems with bad data or restarts of the program. The data read parts are taken from the read_hp_day and read_shp_day programs. It might be necessary to edit the file to get them to work properly or to improve the software (primarily a problem with radiom version and the slow campbell data).

Opencamp1r3,4. Note that licorcalc returns dry CO2 ppm (with pressure broadening and dilution corrections applied) and water vapor specific humidity while the ophir and oak ridge give water vapor in g/m^3. I have dilution-corrected the oak ridge CO2 for water vapor (using its own signal) but not for temperature; that will require sonic T. I have also converted it to ppm. The '3' version uses nominal density of air for plotting purposes, but the '4' version should include data from measured sources (i.e., openradiom). The version that runs on DAS01 uses the stripped files (P1_sddd); if you stop writing those files, you must change the fopen statement.

Openophnir3,4. I have added calibration coefficients for serial numbers 89111 and 89113 into the routine with a switch. You will have to put new coefficients in for the unit you bring.

Because my various read programs create mean and bulk flux files, I suggest converting the fastexrate program to just do covariance fluxes and spectral calculations.