Here’s the FOI decision regarding raw data from Canberra Dec 2014.The BOM stated that “in accordance with records management practices”, the field books for early 2013 at Canberra Airport were “disposed of” twelve months after the observations were taken.How can the CSIRO hope to produce reliable climate modelling with any number of climate scientists when the BOM cannot produce reliable temperature data?  Letter from Anthony Rea, Assistant Director Oberving System Strategy, Bureau of Meteorology, 23 December 2014.  The Bureau of Meteorology Budget was 5.3 million in 2015-16.Distributed Stream Processing frameworks are being commonly used with the evolution of Internet of Things(Io T).He asked for six months of data from Sydney and Canberra Airports and was told it would cost him 0.That’s quite a barrier, and that was only to access the Sydney records.The electronic ones can pick up very short bursts of heat – so they can measure extremes of temperatures that the old mercury or liquid thermometers would not pick up, unless the spike of heat lasted for a few minutes.It is difficult (impossible) to believe that across the whole temperature range that these two different instruments would always behave in the exact same way.
Stream processing systems have become important, as applications like media broadcasting, sensor network monitoring and on-line data analysis increasingly rely on realtime stream processing.
Look at what happened to the Canberra ones — the data was gone.
No one could analyze it, no matter how much they were willing to pay.
A four-terabyte external hard drive costs a couple of hundred dollars and would probably store a whole years worth of text files.
For just 0.02% of their budget they could buy one every day.