Sections below: Float counts | Meta Files | Tech files | Plots & listings | Surface Pressure | TNDP


Argo file format and Surface Pressure correction compliance Audit


Argo Technical and Meta file compliance Audit

This page is automatically created by code which scans all files in the Argo USGODAE GDAC.

This analysis was updated on 10-Oct-2010

Float counts in DACs

DAC details [explanations]
DAC nameAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDI
# floats3416312107733637393629862185142119
# Projects8746221831332
# PIs17555121552251
# Models14343321852535

Floats in multiple DACS
DACAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDI
# floats3416312107733637393629862185142119
dups in GTS8131-2----53
other dups---------99


Meta files

Meta files [explanations]
DAC nameAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDI
# floats3416312107733637393629862185142119
# meta files3416312107733637393629862185133119
broken A--1-372------
broken B--16-1------
Bad launch info3----------

PLATFORM_MODEL
The strings found in the PLATFORM_MODEL fields
Strings have been converted to lower case and blanks removed to assist match-ups
field contentsAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
Empty Field--1-372------373
apex--1-1-183--905280
provor--173--31-3-2680
palace_n/a17----------17
solo_sbe1343----------1343
apex_sbe1488------5280--1620
soloof_fsi28----------28
solo_fsi272----------272
apexir_sbe178----------178
soloir_sbe68----------68
apex_seascan10----------10
apex_n/a2----------2
solo_sbe41cp1----------1
solo2ir_sbe1----------1
provor_seascan1----------1
provor_n/a6----------6
provor_sbe1------1012--23
apex-sbe-286-323-78179-8843391639
martec-fsi-22---------22
martec-sbe-4---------4
provor ctf2--61--------61
apex sbe apf7--91--------91
provor ctf3--38--------38
provor cts2--160--------160
apex sbe apf8--204--------204
nemo--73--------73
nemo 2.5--4--------4
provor cts3--155--------155
apex sbe 41 apf8--7--------7
arvor iridium--4--------4
provor cts3 do--13--------13
arvor--4--------4
provor cts3 4.82--20--------20
apex sbe41 apf8--45--------45
apex apf9a f/w w--6--------6
apex apf9a f/w--48--------48
metocean 1--1--------1
provor cts3 do 9--14--------14
apex-apf8c--4--------4
provor t--30--------30
apex sbe apf8b s--3--------3
apex sbe apf8b--14--------14
apex sbe apf8 s--10--------10
apex sbe apf8 sn--11--------11
apex sbe apf8 2--1--------1
apex sbe apf8--1--------1
apex sbe-43f apf--3--------3
apex apf9a f/w s--3--------3
apex-apf9--4--------4
apex 19--1--------1
provor bioargo--1--------1
2625--1--------1
apex sbe-41-alac--3--------3
apex sbe-1-alace--1--------1
apex sbe -41-ala--2--------2
apex sbe-41 ap--2--------2
apex sbe-41 apf--8--------8
apex sbe-41 a--1--------1
provor ct--5--------5
apex sbe -41 apf--1--------1
r1-sbe---10-2-----12
palace-----4-----4
alace_r1-fsi-----2-----2
r1-sbe profiler-----1-----1
r1-td-----9-----9
provor-sbe-----83-----83
ninja-tsk-----3-----3
ninja-sbe-----12-----12
tem. profiler-----1-----1
apex-sbe-aandera-----7-----7
provor-sbe cts-3-----13-----13
ninja-sbe-flntu-----2-----2
apex-fsi-----3-----3
pops-sbe-----2-----2
apex-td profiler-----4-----4
pops-provor-sbe-----1-----1
nemo-sbe-----6-----6
p-alace------4----4
apex-sbe/optode------1----1
provor_fsi--------2--2
260apex----------1414
apex-sbe_do----------3535

Basic MODEL
Grouping PLATFORM_MODEL fields by stanard float types
Basic typeAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
Unknown--4-37264--914409
apex1678286474323179526352168133794252
solo1713----------1713
provor8-5143-96311017-26705
nemo--77--6-----83
ninja-----17-----17
martec-26---------26
palace17----4-----21
arvor--8--------8
r1---10-12-----22

PLATFORM_MODEL field - APF9 Status [explanations]
AOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
Not APEX173826602133721413510179262989
APEX not APF9--391--------391
APEX unknown167828623323179526352168133933815
APEX APF9--61--------61
Manual list*301--12-------313

SENSOR pressure field
* Sensor names converted to lower case and blanks removed to assist match-ups
*AOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
Empty Field-5825--5298---1191252
druck67--293----88--448
mp40-c-2000-g14----------14
n/a1449-80--------1529
sbe41333----392-2492--841
sbe1----------1
2900psia1163-79----38---1280
sbe41cp377-8--14-----399
sstd10----------10
2000dbar1----------1
1500psia1----------1
sbe-41-284---------284
ectp202mar-21---------21
sbe-41cp-2---------2
sbe41cp-2900psia--3--------3
sbe41cp?2900psia--48--------48
none--6--------6
3000psia--8--------8
1600psia--3--------3
paine3000psia---13----3--16
amatek---19-------19
kistler---9-------9
paine---2-------2
straingauge_sbe41-----400-----400
straingauge-----26-----26
straingauge_sbe41cp-----92-----92
straingauge_ctd-f01-----3-----3
sbe41,2900psias/n4867-----1-----1
sbe41,3000psias/n2657701518-----1-----1
sbe37-----2-----2
fsi41--------2--2
sbecp41---------133-133

SENSOR pressure Maker field
* names converted to lower case and blanks removed to assist match-ups
*AOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
Empty Field-3828--9----119959
micron14----------14
paines91----------91
sbe1117-1---2982492133-1665
n/a96-74--------170
druck2003-136----38---2177
2900psia67----------67
kistler4----------4
seascan11----------11
ametec12----------12
paine1-4--------5
seabird-288-336----91--715
fsi-21---1--2--24
martec--6--------6
sea-birdelectronics--3--------3
ametek--7--------7
xxxx--2--------2
none--1--------1
sea-birdelectronics,inc._druck-----546-----546
sea-birdelectronics,inc.-----164-----164
sea-birdelectronics,inc.(druck)-----85-----85
sea-birdelectronics,inc._kistler-----49-----49
falmouthscientific,inc.-----4-----4
sea-birdelectronics,inc._paine-----13-----13
sea-birdelectronics,inc._ametek-----59-----59
thetsurumi-seikico.,ltd.-----3-----3
notspecified-----1-----1
sea-birdelectronics,inc-----1-----1
sea-birdelectronics,inc._-----1-----1

SENSOR pressure Serial Number field
S/NAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
# floats3416312107733637393629862185142119
No decodable number4307106503737801421141191193077

tech files

Tech files [explanations]
FormatAOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
No profiles134181953731954726119729
Missing------------
Old61------7---68
Old - Bad------------
New32212941058331-91729351178116-6459
New, no Surf Pres------------
New, Bad format92-75--1531----213
V 2.332212941058331-91729351178116-6459

Surface Pressure Offset parameter name
AOMLBODCCORIOLISCSIROGTSJMAMEDSCSIOINCOISKMAKORDITOTAL
Old format
Other2-23-10141-115138
surface_pressure601---------61
surface_offset------------
pressure_sensor_offset------------
start_surface_pressure1----------1
pressure_offset_(counts)1----------1
pressure_offset_(dbar)-------7---7
New format
Missing104-772-1531----229
pres_surfaceoffsettruncatedplus5dbar_dbar1034244402218-67521842139104-3076
pres_surfaceoffsetnottruncated_dbar126350569113-1874493912-2286
pres_surfacebeforeresetpreviouscycle_dbar2----------2
pres_surfaceoffsetafterreset_dbar761----------761
pres_offsetadjustment_dbar58----------58
pres_surfaceoffsetbeforereset_dbar21----------21
pres_surfacecomplement_dbar--16--------16
pres_surfaceoffsettruncatedplus3dbar_dbar-----1-----1
pres_surfaceoffsettruncatedplus51.2dbar_dbar-----38-----38
pres_surfaceoffsettruncatedplus10dbar_dbar-----3-----3
% ok SP values [explanation]71979810009690991001000-

Surface Pressure Offset parameter name vs model
apexsoloprovornemoninjamartecpalacearvor. r1 .UnknownAll models
Other89133------11134
surface_pressure1348--------61
surface_offset-----------
pressure_sensor_offset-----------
start_surface_pressure------1---1
pressure_offset_(counts)-1--------1
pressure_offset_(dbar)--7-------7
Missing135118339314216--388799
pres_surfaceoffsettruncatedplus5dbar_dbar3058-1-----1213072
pres_surfaceoffsetnottruncated_dbar9956895286-1948962264
pres_surfacebeforeresetpreviouscycle_dbar-45--3-----48
pres_surfaceoffsetafterreset_dbar-761--------761
pres_offsetadjustment_dbar-63--------63
pres_surfaceoffsetbeforereset_dbar--51--5----56
pres_surfacecomplement_dbar16---------16
pres_surfaceoffsettruncatedplus3dbar_dbar---------22
pres_surfaceoffsettruncatedplus51.2dbar_dbar--------1-1
pres_surfaceoffsettruncatedplus10dbar_dbar--42-------42

Plots and listings analysing the Surface Pressure Offset correction for all floats for each DAC are accessed through the Plots Index Tables. Separate tables link to all floats, or only floats with apparent SP correction anomalies, or only floats with apparent TNDP.

Note: The following analyses were based on assumptions about behaviour of different types of floats, where "type" was here primarily defined by the Surface Pressure Offset parameter name. Many of these assumptions will be wrong, and many types are not analysed at all because I could not even guess the behaviour. My assumptions are recorded in this table.

Surface Pressure Offset

We have attempted to test for correct Surface Pressure (SP) correction of profile pressure.

The difference between PRES and PRES_ADJUSTED is the DAC-applied pressure correction (assuming PRES is the raw P as reported by the float.)

Correct application of this test depends on being able to deduce the correct float type and P adjustment from the meta and tech files. However this is not always possible due to missing or non-standard entries in these files.

Our computed pressure correction is 

     p_calc = PRES - (SP - adjustment)
where adjustment is the known SP adjustment for a given float type (usually 5dbar). For Apex floats the SP reported with a profile actually relates to the previous profile, because it was recorded just as the float begins to descend. RT profile pressure can only be adjusted with the SP reported with the same profile, but in DM profiles the correct SP is used (ie for profile N, 
     p_calc(N) = PRES(N) - (SP(N+1) - adjustment)
So, in the provided plots , the "Calculated Surface Pressure" (CSP) is 
     For DM profiles:     CSP = SP(N+1) - adjustment
     For RT profiles:     CSP = SP(N) - adjustment
For this reason, CSP will differ from Raw Surface Pressure by the "offset", and will be displaced by one profile for DM profiles. The "DAC adjustment" should however agree with the CSP.

Interpretting the plots: For complete agreement in pressure correction, the "DAC Adjustment" (blue squares), should agree with the CSP (red stars). Missing "DAC Adjustment" symbols can occur where there is no PRES_ADJUSTED profile (eg if QC=4). Missing CSP symbols can occur where the DAC has provided an SP estimate (possibly by interpolation) but the automated process has not [due to different processing or because the tech files are not quite up-to-date.]

Disagreement is likewise visible where "MPP minus CSP" (cyan diamond) does not overlay "Min Adjusted Pressure" (magenta square). The latter quantity is just the near-surface PRES_ADJUSTED value.

See the table which summarizes the results of this pressure correction audit for all DACs.

TNDP

Truncated Negative Drifting Pressure (TNDP) is a term used to describe Apex floats which truncate negative surface pressure values (all firmware prior to APF9) and the pressure sensor develops a strong negative drift. The usual cause of strong negative drift in these sensors is the "microleak" fault associated with Druck sensors. The pressure in profiles affected by TNDP cannot be corrected for surface pressure offset.

The first step in detecting TNDP is to determine if a float is of the type where such an fault might occur. We have attempted to do this using the tech and meta files alone, but this is not always possible.

The next step is to find where the reported SP (corrected for 5dbar adjustment if necessary) has "flat spots" on zero, indicating that negative values are being truncated. Previously a float with 80% SP=0 was declared to be TNDP. We now say that any susceptible float is in a TNDP state after the last believable positive SP value. This is because the strong negative drift condition is typically monotonic, so if such a condition has commenced then typical variability will not give rise to small positive SP values.

The main difficulty of this approach [assuming the basic assumptions are correct] is determining when isolated positive values are natural perturbations about a small negative value, or when they are just sensor error spikes. In the present analysis I have used (for the first time) the crude test that a positive value > 1dbar which has 2 zero values immediately either side of it, is a spike that can be ignored. [This differs to the standard despiking process used to prepare the SP series for pressure correction because here we just want a simple way of assessing where an SP series is devoid of true +ve values.] Obviously this is very imperfect - there is no substitute for skilled DM analysis, and in very many cases the DAC will be right and our algorithm will be wrong.

Another deficiency of our algorithm is that is [apparently] extremely unlikely that microleaking will start after years of correct operation. For example, if SP is 0 for the last 5 of 200 profiles then the algorithm says TNDP commenced at profile 196.

The surface pressure plots provided indicate where TNDP commences, according to the above algorithm. Where some of the float series has been DM processed, extra information is provided for the DM profiles in an extra frame at the top of the figure.

Extra information in upper frame on plots
Name Colour/Where Meaning
P Adj QCtop halfprofile minimum PRES_ADJUSTED_QC for each DM profile, value indicated by scale on left of frame
DMLower middleDM processed profiles
TNDP CommentNear bottom Has correct pressure SCIENTIFIC_CALIB_COMMENT for a TNDP profile
P ERR 2.4bottomprofile min PRES_ADJUSTED_ERROR==2.4
P ERR 20bottomprofile min PRES_ADJUSTED_ERROR==20

See the table which summarizes the results of this TNDP treatment audit for all DACs.

 
Legal Notice and Disclaimer | Copyright | Privacy | Page author: Jeff Dunn | Contact: Jeff.Dunn@csiro.au