[Firex-aq] FW: FIREX-AQ Data Release and Merge

[Crawford, James H. (LARC-E303)]

Dear FIREX-AQ Investigators,

We have just removed the password protection for all of the publication quality data.  Only a few dataIDs remain to be updated. These will be automatically released to the public when they are replaced by publication quality data..

We have updated the 1 sec., 10 sec., and 60 sec. merges (revision RE).  We will move to version R0 only when all data is publication quality. The 1 sec. and 10 sec. merges are based on the data submitted before last Friday.   As requested by several PIs, we have updated the merge code to generate project merges, much like the ones we did for previous missions.  We plan to create merges based on time stamps for WAS, TOGA, SAGA-MC, SAGA-Aero, and Shuka's plume times.  Please let us know if you would like to include other time bases. The merges to dataset timebases will be uploaded in the next couple of days.

Two major changes are made to correct previous problems:
1) We only merge data for the time period covered by the nav files. This avoids problems when a PI reports data outside the takeoff/landing times.
2) All merge files list the same variables in the same order. In the past this has not been the case.

These merges are still protected by password as 1) they contain some field data and 2) there are minor issues in the merge code.  One issue we are working on is to handle the time stamp of the 1 sec data, because a few investigators report mid-second rather than on the second which introduces a half-second time shift. This would normally not be a problem, but is important for this campaign in the smoke-influenced parts of the data. This problem will be corrected in the next version.

Also, be aware that despite the fact that PIs have time synced their data to CO, we have found that time shifts for individual plumes can still be as large as 2 seconds for some variables.  This suggests that when doing plume analysis, users should still check the time shift for each plume, and not just assume that all the data in the merge is perfectly aligned.

Thanks!

Gao and Michael
-------------- next part --------------
An HTML attachment was scrubbed...
URL: <http://espo.nasa.gov/pipermail/firex-aq/attachments/20200331/1c318fc2/attachment.html>