JM's Independent Pipeline Test
From Tauwiki
Contents
|
[edit] Mar. 25, 2009 (Registration test)
[edit] Catalogs
RA Dec Cts/s
- 0.1 0.3 500
- 0.2 0.4 104
- 0.3 0.1 60
- 0.1 -0.3 500
- 0.2 -0.4 104
- 0.3 -0.1 60
[edit] Count rate
[edit] Expected
I would expect the total number of counts per frame to be 166 with a standard deviation of 12.88
[edit] Actual
176 with a standard deviation of 12.86.
This drops to 22.88 +- 4.87 at frame 818, presumably when the two bright stars leave the field of view.
[edit] Bright Stars
Note that the first pixel is 0,0
- 401, 171, 64
- 401, 854, 55
- 287, 57, 16
The actual centroided values are
- 401.4627, 170.9918
- 401.6975, 853.7193
- 287.4009, 56.9240
I haven't actually checked these but they look reasonable.
[edit] Conversion to RA, Dec
- Proj: TAN
- CRPIX: 511, 511
- CDELT: 1, 1 Instead of the pixel size?
- CDFIRST: [[-8.7889e-4, 0], [0, 8.7889e-4]]
- CRVAL1, CRVAL2: 0, 0.
Output (RA DEC)
- 0.09668, -.2997
- 0.09668, 0.3015
- 0.19687, -0.3990
[edit] CD Matrix
Agrees reasonably well with the IDL procedure. Could be rounding off errors.
[edit] Dec. 29, 2008 (Registration test)
[edit] Catalogs
| RA | Dec | Counts/sec |
|---|---|---|
| 0.6632 | 0.4 | 104. |
| 0.9698 | 0.5 | 60 |
| 0.76 | 0.6 | 60 |
[edit] Positions
- Level 1b data matches catalog x,y data in first extension.
[edit] Nov. 28, 2008
[edit] Java Version
$java -version java version "1.5.0_16" Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_16-b06-275) Java HotSpot(TM) Client VM (build 1.5.0_16-132, mixed mode, sharing) $
[edit] create_level0_data
Assume that this program works with correct output. We can check more easily with downstream programs anyway.
[edit] Output
..::create_level0_data v2.2.4::.. [Build 20081127]
Start of create_level0_data : Fri Nov 28 11:11:11 IST 2008
Number of major frames : 2227984
Number of preamble filler frames : 195
Number of intermediate filler frames : 0
Number of log frames : 12
Number of counts discarded from end of file : 1
Number of telemetry frames : 235
End of create_level0_data : Fri Nov 28 11:34:03 IST 2008
[edit] UVS_ingest_data.jar
[edit] Output
..::UVS_Ingest_data v1.0.3::.. [Build 20081127]
This module reads level1 data and seperates out Telemetry and Science data
Writing the file : /Users/jayanth/user/tauvex/software/test/science_data0 Closing the file : /Users/jayanth/user/tauvex/software/test/science_data0
EOF Found
Telemetry file written to : /Users/jayanth/user/tauvex/software/test/telemetry_data
Number of Major Frames : 2228426
Number of Science Major Frames : 2228191
Number of Telemetry Major Frames : 235
Total time for executation in millis : 22814 UVS_Ingest_data[v.1.0.3]: Ended Successfully.
[edit] Problems
There are more major frames than in create_level_0. This has been explained by saying that "Science major frames" actually means "frames in science data file"
[edit] UVS_create_level1a
[edit] Output
reads level0 data and creates FitsBinary Table
Writing Start log...
Reading Key parameter table...
Reading Exception log file...
Number of Exceptions Occured : 15
Number of Exceptions Recorded : 3
Reading Event log file...
Number of Events Occured : 8
Number of Events Recorded : 4
[End Of File Reached]
Writing End log..
Reading Key parameter table...
Reading Exception log file...
Number of Exceptions Occured : 5
Number of Exceptions Recorded : 2
Reading Event log file...
Number of Events Occured : 6
Number of Events Recorded : 3
Number of Science Frames : 2228191
Total time for execution in milliseconds : 192554
UVS_create_level1a[v.1.0]: Ended Successfully.
[edit] Things to Check
- Total number of counts: 17823232. One count was discarded from the original ascii file.
- number of counts in first frame: 9524
- number of counts in frame 200: 9789
- number of extensions: 1922. There are 1920 frames in the original data plus startlog and endlog
- Dec of 45. RA from 0 to 1.02284. 1920 frames * 0.128s * 0.004167
- Difference between extensions: 5.3e-4 = .004167*.128
[edit] Problems
UVS_create_level1a[v.1.0] Warning !
Telemetry Frames expired
Filling remaining science frames with last telemetry frame's info.
It would probably be better to cut the science data at the end of the telemetry.
[edit] UVS_calc_xy v1.1: Level_1b
UVS_calc_xy[v.1.1]: Starting module UVS_calc_xy...
Input FITS binary table file name = root_T1_1a.fits Output FITS binary table file name = root_T1_1b.fits
Total time for execution in milliseconds : 36435 UVS_calc_xy[v.1.1]: Ended Successfully. $java -jar $UVS_DIR/UVS_apply_cal.jar root_T1_1b.fits root_T1_1c.fits
[edit] UVS_apply_cal: Level_1c
..::UVS_apply_cal v1.0::.. [Build 20081127]
Module to apply calibration to FITS data
STARTOBS = 2008-07-21T22:53:0.0 FLUX1CAL = Date: Sun Jun 01 06:08:23 IST 2008...Value: 1 FLUX2CAL = Date: Wed Dec 31 06:08:23 IST 2008...Value: 1
Total time for execution in milliseconds : 20605 UVS_apply_cal[v.1.0]: Ended Successfully.
[edit] UVS_flat_field: Level_1d
..::UVS_flat_field v1.0::.. [Build 20081127]
This method will apply the flat fielding to the data and update CALIB column
STARTOBS = 2008-07-21T22:53:0.0 FLATCAL = calib/tauvex_flatfield_T1_3.fits--Tue Jul 01 06:08:23 IST 2008
Total time for execution in milliseconds : 29062 UVS_flat_field[v.1.0]: Ended Successfully. $
[edit] UVS_geom_corr: Level_1e
[edit] Output
..::UVS_geom_corr v1.0::.. [Build 20081127]
Calculates correction value for geometric distortion in x and y values
UVS_geom_corr[v.1.0]: Starting module UVS_geom_corr...
Input FITS binary table file name = root_T1_1d.fits Output FITS binary table file name = root_T1_1e.fits
STARTOBS = 2008-07-21T22:53:0.0
Geometric distortion file = calib/UVS_Pipeline_distcoeff_T1_2.txt--Thu May 01 06:08:23 IST 2008
filename : UVS_Pipeline_distcoeff_T1_2.txt distfile : calib/UVS_Pipeline_distcoeff_T1_2.txt Total time for execution in milliseconds : 703113 UVS_geom_corr[v.1.0]: Ended Successfully.
In this particular case the distortion in both x and y is 1 so there is no change in the parameters. Works as expected.
[edit] UVS_calc_radec: Level_1f
[edit] Output
..::UVS_calc_radec v1.0::.. [Build 20081127]
Calculates RA, DEC values from X, Y and GLON, GLAT values from RA, DEC
UVS_calc_radec[v.1.0]: Starting module UVS_calc_radec...
Input FITS binary table file name = root_T1_1e.fits Output FITS binary table file name = root_T1_1f.fits
Total time for execution in milliseconds : 108648 UVS_calc_radec[v.1.0]: Ended Successfully. $
[edit] UVS_register_data: Level 1g
[edit] Output
Performs data registration
UVS_register_data[v.1.0]: Starting module UVS_register_data...
Input FITS binary table file name = root_T1_1f.fits Output FITS binary table file name = root_T1_1g.fits
Total number of BTHDUs = 1920 RA and DEC cent - initial values RA_CENT = 0.0 DEC_CENT = 45.0 y1[i] is out of range 1024 y1[i] is out of range 1024 ... Total time for execution in milliseconds : 228521 UVS_register_data[v.1.0]: Ended Successfully. $
[edit] UVS_create_image
[edit] Output
..::UVS_create_image v3.0::.. [Build 20081127]
Takes level1g as the input and creates an image
Input Fits binary table name = root_T1_1g.fits Output Image file name = image.fits
Total number of BTHDUs = 1920 RASTART= 0.0 RAEND= 1.02284 DECSTART= 45.0
Total time for execution in milliseconds : 75361 UVS_create_image[v.3.0]: Ended Successfully. $
[edit] Oct. 20, 2008
[edit] Java Version
$java -version java version "1.5.0_16" Java(TM) 2 Runtime Environment, Standard Edition (build 1.5.0_16-b06-275) Java HotSpot(TM) Client VM (build 1.5.0_16-132, mixed mode, sharing) $
[edit] create_level0_data
Assume that this program works with correct output. We can check more easily with downstream programs anyway.
[edit] UVS_ingest_data.jar
We can also assume that this program works.
[edit] UVS_create_level1a
[edit] Total number of frames
1920 frames in original file.
1919 HDUs in Level1a file (plus 0 header and endlog)
[edit] Total number of counts
17823234 counts in ascii file
only 17823232 counts in FITS file
This is ok because some number of counts are left out of the file. Only complete major frames are written and excess files are removed. This only happens with the simulation data and will not happen with the flight data.
[edit] UVS_calc_xy v1.1: Level_1b
Positions of first extension checked. There is a small difference in positions but this is probably because of the conversion to W, S, Z and then back again. I've checked the number of counts in the first extension which also matches.
[edit] UVS_apply_cal: Level_1c
So far so good
[edit] UVS_flat_field: Level_1d
Again, okay so far
[edit] UVS_geom_corr: Level_1e
In this particular case the distortion in both x and y is 1 so there is no change in the parameters. Works as expected.
[edit] UVS_calc_radec: Level_1f
The conversion from ra and dec to x and y is correct.
[edit] UVS_register_data: Level 1g
to be tested
