Sections below: Float counts | Meta Files | Tech files | Plots & listings | Surface Pressure | TNPD


Argo file format and Surface Pressure correction compliance Audit


Argo Technical and Meta file compliance Audit

This page is automatically created by code which scans all files in the Argo USGODAE GDAC.

This analysis was based on GDAC as at 30-Oct-2010

Float counts in DACs

DAC details [explanations]
DAC nameAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDI
# floats3471318116334037394030062185142119
# Projects8647121831332
# PIs17558121552251
# Models14345321852535

Floats in multiple DACS
DACAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDI
# floats3471318116334037394030062185142119
dups in GTS8131-2----53
other dups---------99


Meta files

Meta files [explanations]
DAC nameAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDI
# floats3471318116334037394030062185142119
# meta files3471318116334037394030062185133119
broken A----372------
broken B--15-1------
Bad launch info3----------

PLATFORM_MODEL
The strings found in the PLATFORM_MODEL fields
Strings have been converted to lower case and blanks removed to assist match-ups
field contentsAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
Empty Field----372------372
apex----1-183--905279
provor--133--31-3-2676
palace_n/a17----------17
solo_sbe1360----------1360
apex_sbe1512------5280--1644
soloof_fsi28----------28
solo_fsi272----------272
apexir_sbe185----------185
soloir_sbe75----------75
apex_seascan10----------10
apex_n/a2----------2
solo_sbe41cp1----------1
solo2ir_sbe1----------1
provor_seascan1----------1
provor_n/a6----------6
provor_sbe1------1012--23
apex-sbe-292-327-78281-8843391652
martec-fsi-21---------21
martec-sbe-5---------5
provor ctf2--62--------62
apex sbe apf7--93--------93
provor ctf3--38--------38
provor cts2--168--------168
apex sbe apf8--215--------215
nemo--88--------88
nemo 2.5--4--------4
provor cts3--170--------170
apex sbe 41 apf8--7--------7
arvor iridium--4--------4
provor cts3 do--16--------16
arvor--4--------4
provor cts3 4.82--20--------20
apex sbe41 apf8--48--------48
apex apf9a f/w w--6--------6
apex apf9a f/w--48--------48
metocean 1--1--------1
provor cts3 do 9--15--------15
apex-apf8c--7--------7
provor t--35--------35
provor 1--2--------2
apex sbe apf8b s--3--------3
apex sbe apf8b--14--------14
apex sbe apf8 s--10--------10
apex sbe apf8 sn--11--------11
apex sbe apf8 2--1--------1
apex sbe apf8--1--------1
apex sbe-43f apf--3--------3
apex apf9a f/w s--3--------3
apex-apf9--18--------18
apex 19--1--------1
provor bioargo--1--------1
2625--1--------1
apex-apf8--5--------5
apex-apf9a--1--------1
apex-apf9i--3--------3
apex sbe-41-alac--3--------3
apex sbe-1-alace--1--------1
apex sbe -41-ala--2--------2
apex sbe-41 ap--2--------2
apex sbe-41 apf--8--------8
apex sbe-41 a--1--------1
provor ct--5--------5
apex sbe -41 apf--1--------1
r1-sbe---10-2-----12
palace-----4-----4
alace_r1-fsi-----2-----2
r1-sbe profiler-----1-----1
r1-td-----9-----9
provor-sbe-----83-----83
ninja-tsk-----3-----3
ninja-sbe-----12-----12
tem. profiler-----1-----1
apex-sbe-aandera-----7-----7
provor-sbe cts-3-----13-----13
ninja-sbe-flntu-----2-----2
nemo-sbe-----9-----9
apex-fsi-----3-----3
pops-sbe-----2-----2
apex-td profiler-----4-----4
pops-provor-sbe-----1-----1
p-alace------4----4
apex-sbe/optode------1----1
provor_fsi--------2--2
260apex----------1414
apex-sbe_do----------3535

Basic MODEL
Grouping PLATFORM_MODEL fields by stanard float types
Basic typeAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
Unknown--3-37264--914408
apex1709292515327179626552168133794337
solo1737----------1737
provor8-5453-96311017-26736
nemo--92--9-----101
ninja-----17-----17
martec-26---------26
palace17----4-----21
arvor--8--------8
r1---10-12-----22

PLATFORM_MODEL field - APF9 Status [explanations]
AOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
Not APEX176226647133721443510179263061
APEX not APF9--415--------415
APEX unknown170929222327179626552168133933858
APEX APF9--79--------79
Manual list*301--12-------313

SENSOR pressure field
* Sensor names converted to lower case and blanks removed to assist match-ups
*AOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
Empty Field-3871--5300---1191298
druck67--274----88--429
mp40-c-2000-g14----------14
n/a1473-81--------1554
sbe41333----395-2492--844
sbe1----------1
2900psia1194-79----38---1311
sbe41cp377-16--15-----408
sstd10----------10
2000dbar1----------1
1500psia1----------1
sbe-41-290---------290
ectp202mar-21---------21
sbe-41cp-4---------4
sbe41cp-2900psia--13--------13
sbe41cp?2900psia--61--------61
none--6--------6
3000psia--8--------8
xxxx--7--------7
sbe41cp2900psia--3--------3
1600psia--3--------3
paine---36-------36
amatek---19-------19
paine3000psia---2----3--5
kistler---9-------9
straingauge_sbe41-----400-----400
straingauge-----26-----26
straingauge_sbe41cp-----92-----92
straingauge_ctd-f01-----3-----3
sbe41,2900psias/n4867-----1-----1
sbe41,3000psias/n2657701518-----1-----1
sbe37-----2-----2
fsi41--------2--2
sbecp41---------133-133

SENSOR pressure Maker field
* names converted to lower case and blanks removed to assist match-ups
*AOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
Empty Field-3872--9----1191003
micron14----------14
paines91----------91
sbe1116-1---3002492133-1666
n/a96-74--------170
druck2059-170----38---2267
2900psia67----------67
kistler4----------4
seascan11----------11
ametec12----------12
paine1-4--------5
seabird-294-340----91--725
fsi-21---1--2--24
martec--7--------7
sea-birdelectronics--3--------3
ametek--7--------7
xxxx--9--------9
none--1--------1
sea-birdelectronics,inc._druck-----546-----546
sea-birdelectronics,inc.-----164-----164
sea-birdelectronics,inc.(druck)-----85-----85
sea-birdelectronics,inc._kistler-----53-----53
falmouthscientific,inc.-----4-----4
sea-birdelectronics,inc._paine-----13-----13
sea-birdelectronics,inc._ametek-----59-----59
thetsurumi-seikico.,ltd.-----3-----3
notspecified-----1-----1
sea-birdelectronics,inc-----1-----1
sea-birdelectronics,inc._-----1-----1

SENSOR pressure Serial Number field
S/NAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
# floats3471318116334037394030062185142119
No decodable number34713181163340373940300621851421197413

tech files

Tech files [explanations]
FormatAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
No profiles140188253731154726119790
Missing------------
Old61------7---68
Old - Bad------------
New32703001081335-92929551178116-6555
New, no Surf Pres------------
New, Bad format76-80--154----175
V 2.332703001081335-92929551178116-6555

Surface Pressure Offset parameter name
AOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
Old format
Other2-21-6141-115132
surface_pressure601---------61
surface_offset------------
pressure_sensor_offset------------
start_surface_pressure1----------1
pressure_offset_(counts)1----------1
pressure_offset_(dbar)-------7---7
New format
Missing88-834-154----194
pres_surfaceoffsettruncatedplus5dbar_dbar1034244410218-67121842139104-3080
pres_surfaceoffsetnottruncated_dbar130351586117-1364693912-2299
pres_surfaceoffsetbeforereset_dbar45----3-----48
pres_surfaceoffsetafterreset_dbar761----------761
pres_offsetadjustment_dbar65----------65
pres_surfaceoffsetbeforereset_1dbarresolution_dbar-5---51-----56
pres_surfacecomplement_dbar--16--------16
pres_surfaceoffsettruncated_dbar-----2-----2
pres_surfaceoffsettruncatedplus3dbar_dbar-----1-----1
pres_surfaceoffsetbeforereset_1cbarresolution_dbar-----42-----42
pres_surfaceoffsetnottrancated_dbar-----6-----6
pres_surfaceoffsetnottruncatedplus5dbar_dbar-----4-----4
pressure_offset_dbar------27----27
% ok SP values [explanation]799798100-969799100100--

Surface Pressure Offset parameter name vs model
apexsoloprovornemoninjamartecpalacearvorr1UnknownAll models
Other87133------11121
surface_pressure1348--------61
surface_offset-----------
pressure_sensor_offset-----------
start_surface_pressure------1---1
pressure_offset_(counts)-1--------1
pressure_offset_(dbar)--7-------7
Missing134121349514216--388416
pres_surfaceoffsettruncatedplus5dbar_dbar3066-1-----1213079
pres_surfaceoffsetnottruncated_dbar10116955416-1948962293
pres_surfaceoffsetbeforereset_dbar-45--3-----48
pres_surfaceoffsetafterreset_dbar-761--------761
pres_offsetadjustment_dbar-65--------65
pres_surfaceoffsetbeforereset_1dbarresolution_dbar--51--5----56
pres_surfacecomplement_dbar16---------16
pres_surfaceoffsettruncated_dbar---------2-
pres_surfaceoffsettruncatedplus3dbar_dbar--------1-1
pres_surfaceoffsetbeforereset_1cbarresolution_dbar--42-------42
pres_surfaceoffsetnottrancated_dbar6---------6
pres_surfaceoffsetnottruncatedplus5dbar_dbar4---------4
pressure_offset_dbar--27-------27

Plots and listings analysing the Surface Pressure Offset correction for all floats for each DAC are accessed through the Plots Index Tables. Separate tables link to all floats, or only floats with apparent SP correction anomalies, or only floats with apparent TNPD.

Note: The following analyses were based on assumptions about behaviour of different types of floats, where "type" was here primarily defined by the Surface Pressure Offset parameter name. Some of these assumptions will be wrong, and some types are not analysed at all because I am unsure of their behaviour. It is probably necessary to also take basic float model (eg Apex or SOLO) into account to fully determine the pressure correction treatment required for a float, but it would be better if this could be fully determined by just the parameter name. My assumptions are recorded in this table.

Surface Pressure Offset

We have attempted to test for correct Surface Pressure (SP) correction of profile pressure.

The difference between PRES and PRES_ADJUSTED is the DAC-applied pressure correction (assuming PRES is the raw P as reported by the float.)

Correct application of this test depends on being able to deduce the correct float type and P adjustment from the meta and tech files. However this is not always possible due to missing or non-standard entries in these files.

Our computed pressure correction is 

     p_calc = PRES - (SP - adjustment)
where adjustment is the known SP adjustment for a given float type (usually 5dbar). For Apex floats the SP reported with a profile actually relates to the previous profile, because it was recorded just as the float begins to descend. RT profile pressure can only be adjusted with the SP reported with the same profile, but in DM profiles the correct SP is used (ie for profile N, 
     p_calc(N) = PRES(N) - (SP(N+1) - adjustment)
So, in the provided plots , the "Calculated Surface Pressure" (CSP) is 
     For DM profiles:     CSP = SP(N+1) - adjustment
     For RT profiles:     CSP = SP(N) - adjustment
For this reason, CSP will differ from Raw Surface Pressure by the "offset", and will be displaced by one profile for DM profiles. The "DAC adjustment" should however agree with the CSP.

Interpretting the plots: For complete agreement in pressure correction, the "DAC Adjustment" (blue squares), should agree with the CSP (red stars). Missing "DAC Adjustment" symbols can occur where there is no PRES_ADJUSTED profile (eg if QC=4). Missing CSP symbols can occur where the DAC has provided an SP estimate (possibly by interpolation) but the automated process has not [due to different processing or because the tech files are not quite up-to-date.]

Disagreement is likewise visible where "MPP minus CSP" (cyan diamond) does not overlay "Min Adjusted Pressure" (magenta square). The latter quantity is just the near-surface PRES_ADJUSTED value.

A light gray background is used where disagreement is between 0.1 and 1.0 dbar. This occurs frequently due to DAC smoothing of the SP series, or for other reasons.

A dark gray background indicates disagreement greater than 1.0 dbar. Some of these cases are due to deficiencies in our automatic procedures, but some others appear to be related to processing faults at the DACs.

See the table which summarizes the results of this pressure correction audit for all DACs.

Lists: for each DAC a text file (accessable through the Plots Index Tables) lists the result of checking the surface pressure correction for every float. The floats are grouped by PI. The lists give the number of DM profiles, total number of profiles, assumed surface pressure offset, and counts of profiles which agree exactly or disagree with my automated correction. Please note that in many cases the disagreement is because your DAC correction is a better choice than my automated one.

Format example: 

     5900033 DM 264/295 SPoffs=5 Diffs(dbar) =0[271] <1 [0] >1 [ 1 *]

Of 295 profiles for this float, 264 have been DM processed. 271 profiles exactly agree with my automated correction, 0 disagree by a small amount, but 1 disagrees by more than 1 dbar.

TNPD

Truncated Negative Drifting Pressure (TNPD) is a term used to describe Apex floats which truncate negative surface pressure values (all firmware prior to APF9) and the pressure sensor develops a strong negative drift. The usual cause of strong negative drift in these sensors is the "microleak" fault associated with Druck sensors. The pressure in profiles affected by TNPD cannot be corrected for surface pressure offset.

The first step in detecting TNPD is to determine if a float is of the type where such an fault might occur. We have attempted to do this using the tech and meta files alone, but this is not always possible.

The next step is to find where the reported SP (corrected for 5dbar adjustment if necessary) has "flat spots" on zero, indicating that negative values are being truncated. Previously a float with 80% SP=0 was declared to be TNPD. We now say that any susceptible float is in a TNPD state after the last believable positive SP value. This is because the strong negative drift condition is typically monotonic, so if such a condition has commenced then typical variability will not give rise to small positive SP values.

The main difficulty of this approach [assuming the basic assumptions are correct] is determining when isolated positive values are natural perturbations about a small negative value, or when they are just sensor error spikes. In the present analysis I have used (for the first time) the crude test that a positive value > 1dbar which has 2 zero values immediately either side of it, is a spike that can be ignored. [This differs to the standard despiking process used to prepare the SP series for pressure correction because here we just want a simple way of assessing where an SP series is devoid of true +ve values.] Obviously this is very imperfect - there is no substitute for skilled DM analysis, and in very many cases the DAC will be right and our algorithm will be wrong.

Another deficiency of our algorithm is that it is [apparently] extremely unlikely that microleaking will start after years of correct operation. For example, if SP is 0 for the last 5 of 200 profiles then the algorithm says TNPD commenced at profile 196. The time of onset of TNPD is examined in this set of TNPD plots. That page also includes plots which examining whether, for different sensor types, a large negative drift can be followed by recovery to plausible positive SP values.

The surface pressure plots provided indicate where TNPD commences, according to the above algorithm. Where some of the float series has been DM processed, extra information is provided for the DM profiles in an extra frame at the top of the figure.

Extra information in upper frame on plots
Name Colour/Where Meaning
P Adj QCtop halfprofile minimum PRES_ADJUSTED_QC for each DM profile, value indicated by scale on left of frame
DMLower middleDM processed profiles
TNPD CommentNear bottom Has correct pressure SCIENTIFIC_CALIB_COMMENT for a TNPD profile
P ERR 2.4bottomprofile min PRES_ADJUSTED_ERROR==2.4
P ERR 20bottomprofile min PRES_ADJUSTED_ERROR==20

See the table which summarizes the results of this TNPD treatment audit for all DACs.

Lists: for each DAC two text files (accessable through the Plots Index Tables) list the result of checking for TNPD. The floats are grouped by PI. The "short" list gives the cycle number ("pn") where TNPD appears to start, and counts of profiles which appear to require the TNPD comment string and do not have it ("missed"), or do have the comment string ("good"), or have a comment string which is not precisely the standard string ("imperfect"). The list also notes where we have NOT detected TNPD but have found the TNPD comment string.

 
Legal Notice and Disclaimer | Copyright | Privacy | Page author: Jeff Dunn | Contact: Jeff.Dunn@csiro.au