Archive for March, 2017

How Temperature is “Measured” in Australia: Part 2

March 21, 2017

By Ken Stewart, ably assisted by Chris Gillham, Phillip Goode, Ian Hill, Lance Pidgeon, Bill Johnston, Geoff Sherrington, Bob Fernley-Jones, and Anthony Cox.

In the previous post of this series I explained how the Bureau of Meteorology presents summaries of weather observations at 526 weather stations around Australia, and questioned whether instrument error or sudden puffs of wind could cause very large temperature fluctuations in less than 60 seconds observed at a number of sites.

The maximum or minimum temperature you hear on the weather report or see at Climate Data Online is not the hottest or coldest hour, or even minute, but the highest or lowest ONE SECOND VALUE for the whole day.  There is no error checking or averaging.

A Bureau officer explains:

Firstly, we receive AWS data every minute. There are 3 temperature values:
1. Most recent one second measurement
2. Highest one second measurement (for the previous 60 secs)
3. Lowest one second measurement (for the previous 60 secs)

Relating this to the 30 minute observations page: For an observation taken at 0600, the values are for the one minute 0559-0600.

Automatic Weather Station instruments were introduced from the late 1980s, with the AWS becoming the primary temperature instrument at a large number of sites from November 1 1996.  They are now universal.

An AWS temperature probe collects temperature data every second; there are 60 datapoints per minute.  The values given each half hour (and occasionally at times in between) at each station’s Latest Weather Observations page are samples: spot temperatures for the last second of the last minute of that half hour, and the Low Temp or High Temp values on the District Summary page are the lowest and highest one second readings within that minute of reporting.  The remaining seconds of data are filtered out.  There is no averaging to find the mean over say one minute or ten minutes.  There is NO error checking to flag rogue values.  The maximum temperatures are dutifully reported in the media, especially if some record has been broken.  Quality Control does not occur for two or three months at least, which then just quietly deletes spurious values, long after record temperatures have been spruiked in the media.

In How Temperature is “Measured” in Australia: Part 1 I demonstrated how this method has resulted in large differences recorded in the exact same minutes at a number of stations.

What explanation is there for these differences? 

The Bureau will insist they are due to natural weather conditions.  Some rapid temperature changes are indeed due to weather phenomena.  Here are some examples.

In semi-desert areas of far western Queensland, such as in this example from Urandangi, temperatures rise very rapidly in the early morning.

Fig. 1:  Natural rapid temperature increase

urandangi

For 24 minutes the temperature was increasing at an average of more than 0.2C per minute.  That is the fastest I’ve seen, and entirely natural- yet at Hervey Bay on 22 February the temperature rose more than two degrees in less than a minute, before 6 a.m., many times faster than it did later in the morning.

Similarly, on Wednesday 8 March, a cold change with strong wind and rain came through Rockhampton.  Luckily the Bureau recorded temperatures at 4:48 and 4:49 p.m., and in that minute there was a drop of 1.2C.

Fig. 2:  Natural rapid temperature decrease

Rocky 8 March

That was also entirely natural, and associated with a weather event.

For the next plots, which show questionable readings, I have supplemented BOM data with data from an educational site run by the UK Met Office, WOW (Weather Observations Worldwide).  The Met gets data from the BOM at about 10 minutes before the hour, so we have an additional source which increases the sample frequency.  The examples selected are all well-known locations in Queensland, frequently mentioned on ABC TV weather.  They have been selected purely because they are examples of large one minute changes.

This plot is from Thangool Airport near Biloela, southwest of Rockhampton, on Friday 10 March.  The weather was fine, sunny, and hot, with no storms or unusual weather events.

Fig. 3:  Temperature spike and rapid fall at Thangool

Thangool 10 march

This one is for Coolangatta International Airport on the Gold Coast on 20th February.

Fig. 4:  Temperature spike and rapid fall at Coolangatta

Coolangatta 20 Feb bom met

And Maryborough Airport on 15th February:

Fig. 5:  Temperature spike and rapid fall at Maryborough (Qld)

Mboro 15 Feb

Figure 5(b):  The weirdest spike and fall:  Coen Airport 21 March 

Coen 21 March

Thanks to commenter MikeR for finding that one.

All of these were in fine sunny conditions in the hottest part of the day.  It is difficult to imagine a natural meteorological event that would cause such rapid fluctuations- in particular rapid falls- as in the above examples.  It is possible they were caused by some other event such as jet blast or prop wash blowing hotter air over the probe during aircraft movement, quickly replaced by air at the ambient surrounding temperature.  It is either that or random instrument error.  Either way, the result is the same: rogue outliers are being captured as maxima and minima.

How often does this happen?

Over one week I collected 200 instances where the High Temps and Low Temps could be directly checked as they occurred in the same minute as the 30 minute observation.

The results are astounding.  The differences occurring in readings in the same minute are scattered across the range of temperatures.  Most High Temp discrepancies are of 0.1 or 0.2 degrees, but there is a significant number (39% of the sample) with 0.3C to 0.5C decreases in less than one minute, and five much larger.

Fig. 6:  Temperature change within one minute from maximum

Count diffs hi T graph

Notice that 95% of the differences were from 0.1C to 0.5C, which suggests that one minute ranges of up to 0.5C are common and expected, while values above this are true outliers.  The Bureau claims (see below) that in 90% of cases AWS probes have a tolerance of +/-0.2C, whereas the 2011 Review Panel mentioned the “the present +/- 0.5 °C”.  Is the tolerance really +/-0.5C?

Fig. 7:  Temperature change within one minute from minimum

Count diffs lo T graph

There was one instance where there was no difference.  The vast majority have a -0.1C difference, which is within the instruments’ tolerance.

This next plot shows the differences (temperature falls in one minute from the second with the highest reading to that of the final second) ordered from greatest to least.

Fig. 8:  Ordered count of temperature falls

Count diffs hi T

The few outliers are obvious.  More than half the differences are of 0.1C or 0.2C.

One minute temperature rises:

Fig. 9:  Ordered count of temperature rises

Count diffs lo T

Note the outlier at -2.1C: that was Hervey Bay Airport.  Also note only one example with no difference, and the majority at -0.1C.

Is there any pattern to them? 

The minimum temperature usually occurs around sunrise, although in summer this varies, but very rarely when the sun is high in the sky.  Therefore rapid temperature rise at this time will be relatively small, as the analysis shows: 80% of the differences between the Low Temps and corresponding final second observations were zero or one tenth of a degree, and 91% two tenths of a degree or less.  As the instrument tolerance of AWS sensors is supposed to be +/- 0.2C, the vast majority of Low Temps are within this range.  Therefore, the Low Temps are not significantly different from the Latest Observation figures.  Yet as it is the Lowest Temperature that is being recorded, all but one example have the Low Temp, and therefore daily minimum, cooler than the final second observation.  9% are outside the +/-0.2C range and show real discrepancy, i.e. very rapid temperature rise within one minute, that is worth investigating.  Remember, the fastest morning rise I’ve found averaged about 0.2C per minute.

The High Temps have 56% of discrepancies within the +/-0.2C tolerance range.  Day time temperatures are much more subject to rapid rise and fall of temperatures.  The 44% of discrepancies of 0.3C or more are worth investigation.  Many are likely due to small localized air temperature changes, the AWS probes being very sensitive to this, but the rapid decreases shown in the examples above, as well as the rapid rises in the Low Temp examples, mean that random noise is likely to be a factor as well.

Have they affected climate analysis? 

Comparison of values at identical times has shown that out of 200 cases, all but one had higher or lower temperatures at some previous second than at the last second of that minute, with a significant number of High Temp observations (39% of the sample) with 0.3C to 0.5C decreases in less than one minute, and five much larger.  There is a very high probability that similar differences occur at every station in every state, every day.

In more than half of the sample of High Temps, and over 90% of the Low Temps, the discrepancy was within the stated instrumental tolerance range, and therefore the values are not significantly different, but the higher or lower reading becomes the maximum or minimum, with no tolerance range publicised.

This would of course be an advantage if greater extremes were being looked for.

Nearly 10 percent of minimum temperatures were followed by a rise of more than 0.2C, and 44 percent of maxima were followed by a fall of more than 0.2C.  While many of these may have entirely natural causes, none of the very large discrepancies examined had an identifiable meteorological cause.   It is questionable whether mercury-in-glass or alcohol-in-glass thermometers used in the past would have responded as rapidly as this.  This must make claims for record temperatures questionable at best.

If you think that the +/- 0.2C tolerance makes no difference in the big picture, as positives will balance negatives and errors will resolve to a net of zero, think again.  Maximum temperature is the High Temp value for the day, and 44% of the discrepancies were more than +0.2C.  If random instrument error is the problem causing the apparent temperature spikes, (and downwards spikes in the hot part of the day are not reported unless they show up in the final second of the 30 minute reporting period), only the highest upwards spike, with or without positive error, is reported.  Negative error can never balance any positive error.

Further, these very precise but questionable values then become part of the climate monitoring system, either directly if they are for ACORN stations, or indirectly if they are used to homogenise “neighbouring” ACORN stations. They also contribute to temperature maps, showing for example how hot New South Wales was in summer.

Again, temperature datasets in the ACORN network are developed from historic, not very precise, but (we hope) fairly accurate data from slow response mercury-in-glass or alcohol-in-glass thermometers observed by humans, merged with very precise but possibly unreliable, rapid response, one second data from Automatic Weather Systems.  The extra precision means that temperatures measured by AWS probes are likely to be some tenths of a degree higher or lower than LIG thermometers in similar conditions, and the higher proportion of High Temp differences shown above, relative to Low Temp differences, will lead to higher maxima and means in the AWS era.  Let’s consider maxima trends:

Fig. 10:  Australian maxima 1910-2016

graph max trend

There are no error bars in any BOM graph.  Maxima across Australia as a whole have increased by about 0.9 C per 100 years according to the Bureau, based on analysis of ACORN data.  Even if across the whole network of 526 automatic stations the instrument error is limited to +/- 0.2C, that is 22.2% of the claimed temperature trend.  In the past, indeed as recently as 2011 (see below), instrument error was as high as +/-0.5C, or about half of the 107 year temperature increase.  No wonder the Bureau refuses to show error bands in its climate analyses.

There have been NO comparison studies published of AWS probes and LIG thermometers side by side.  Can temperatures recorded in the past from liquid-in-glass thermometers really be compared with AWS one second data?  The following quotes are from 2011, when an Independent Review Panel gave its assessment of ACORN before its introduction.

Report of the Independent Peer Review Panel p8 (2011)

Recommendations: The Review Panel recommends that the Bureau of Meteorology should implement the following actions:

A1 Reduce the formal inspection tolerance on ACORN-SAT temperature sensors significantly below the present ±0.5 °C. This future tolerance range should be an achievable value determined by the Bureau’s Observation Program, and should be no greater than the ±0.2 °C encouraged by the World Meteorological Organization.

A2 Analyse and document the likely influence if any of the historical ±0.5 °C inspection tolerance in temperature sensors, on the uncertainty range in both individual station and national multidecadal temperature trends calculated from the ACORN-SAT temperature series.

And the BoM Response: (2012)

… … …   An analysis of the results of existing instrument tolerance checks was also carried out. This found that tolerance checks, which are carried out six-monthly at most ACORN-SAT stations, were within 0.2 °C in 90% of cases for automatic temperature probes, 99% of cases for mercury maximum thermometers and 96% of cases for alcohol minimum thermometers.

These results give us a high level of confidence that measurement errors of sufficient size to have a material effect on data over a period of months or longer are rare.

This confirms LIG thermometers have more reliable accuracy than automatic probes, and that 10% of AWS probes are not sufficiently accurate, with higher error rates.  That is, at more than 50 sites.  If they are in remote areas, their inaccuracy will have an additional large effect on the climate signal.   It is to be hoped that Alice Springs, which contributes 7-10% of the national climate signal, is not one of them.

Conclusion

It is very likely that the 199 one minute differences found in a sample of 200 high and low temperature reports are also occurring every day at every weather station across Australia.  It is very likely that nearly half of the High Temp cases will differ by more than 0.2 degree Celsius.

Maxima and minima reported by modern temperature probes are likely to be some tenths of a degree higher or lower than those reported historically using Liquid-In-Glass thermometers.

Daily maximum and minimum temperatures reported at Climate Data Online are just noise, and cannot be used to determine record high or low temperatures.

These problems are affecting climate analyses directly if they are at ACORN sites, or indirectly, if they are used to homogenise ACORN sites, and may distort regional temperature maps.

Instrument error may account for between 22% and 55% of the national trend for maxima.

A Wish List of Recommendations (never likely to be adopted):

That the more than 50 sites at which AWS probes are not accurate to +/- 0.2 degree Celsius be identified and replaced with accurate probes as a matter of urgency.

That the Bureau show error bars on all of its products, in particular temperature maps and time series, as well as calculations of temperature trends.

That the Bureau of Meteorology recode its existing three criteria filter, to zero-out spurious spikes and preferably send them as fault flags into a separate file in order to improve Quality Control.

That the Bureau replace its one second spot maxima and minima  reports with a method similar to wind speed reports: the average over 10 minutes.  That would be a much more realistic measure of temperature.

The Pause Update: February 2017

March 4, 2017

The complete UAH v6.0 data for February have been released. I present all the graphs for various regions, and as well summaries for easier comparison. I also include graphs for the North and South Temperate regions (20-60 North and South), estimated from Polar and Extra-Tropical data.

The Pause has ended globally and for all regions including the USA and the Southern Hemisphere, except for Southern Extra-Tropics, South Temperate, South Polar, and Australia. The 12 month mean to February 2017 for the Globe is +0.44 C.

These graphs show the furthest back one can go to show a zero or negative trend (less than 0.1 +/-0.1C per 100 years) in lower tropospheric temperatures. I calculate 12 month running means to remove the small possibility of seasonal autocorrelation in the monthly anomalies. Note: The satellite record commences in December 1978- now 38 years and three months long- 459 months. 12 month running means commence in November 1979. The y-axes in the graphs below are at December 1978, so the vertical gridlines denote Decembers. The final plotted points are February 2017.
[CLICK ON IMAGES TO ENLARGE]

Globe:

feb-17-globe

The Pause has ended. A trend of +0.39 C/100 years (+/- 0.1C) since March 1998 is creeping up, but the 12 month means have peaked and are heading down.

And, for the special benefit of those who think that I am deliberately fudging data by using 12 month running means, here is the plot of monthly anomalies:

feb-17-globe-monthly

Northern Hemisphere:

feb-17-nh

The Northern Hemisphere Pause has well and truly ended.

Southern Hemisphere:

feb-17-sh

The Pause has ended- just.

Tropics:

feb-17-tropics

The Pause in the Tropics (20N to 20S) has ended and the minimal trend is now +0.4C/ 100 years. 12 month means are dropping fast.

Northern Extra Tropics:

feb-17-next

Northern Temperate Region:

feb-17-n-temp

Using estimates calculated from North Polar and Northern Extra-Tropics data, the slowdown is obvious.

Southern Extra Tropics:

feb-17-sext

The Pause has weakened and may soon disappear.

Southern Temperate Region:

feb-17-s-temp

Using estimates calculated from South Polar and Southern Extra-Tropics data, the Pause is shorter than for Southern Extra-Tropics.

Northern Polar:

feb-17-np

The trend has increased rapidly and will continue to do so even though 12 month means have started to fall.

Southern Polar:

feb-17-sp

The South Polar region has been cooling (-0.2C) for the entire record. With 12 month means still rising, this cooling trend will slow over the next few months.

USA 49 States:

feb-17-usa49

The Pause has ended. It will not re-appear for some time.

Australia:

feb-17-oz

The Pause is still 21 years 5 months.

The next graphs summarise the above plots. First, a graph of the relative length of The Pause in the various regions:

feb-17-pause-length

Note that the Pause has ended by my criteria in all regions of Northern Hemisphere, and consequently the Globe, and the Tropics, but all southern regions have a Pause for over half the record, including the South Polar region which has been cooling for the whole record. Note that the Tropic influence has been enough to end the Pause for the Southern Hemisphere.

The variation in the linear trend for the whole record, 1978 to the present:

feb-17-trends-78

Note the decrease in trends from North Polar to South Polar.

And the variation in the linear trend since June 1998, which is about halfway between the global low point of December 1997 and the peak in December 1998:

feb-17-trends-98

The imbalance between the two hemispheres is obvious. The lower troposphere over Australia has been strongly cooling for 18 years and 9 months- just shy of half the record.
The Pause has disappeared from the USA and the Southern Hemisphere, but not the Southern Extra-Tropics, South Temperate, and South Polar regions, or Australia. El Nino tropical heat is rapidly decreasing, with all northern means falling, but will continue to affect the Southern Hemisphere in coming months.  Global TLT anomalies have increased a little.   The next few months will be interesting.

 

 

How Temperature Is “Measured” in Australia: Part 1

March 1, 2017

By Ken Stewart, ably assisted by Chris Gillham, Phillip Goode, Ian Hill, Lance Pidgeon, Bill Johnston, Geoff Sherrington, Bob Fernley-Jones, and Anthony Cox.

The Bureau of Meteorology maintains the Southern Oscillation Index (SOI), one of the most useful climate and weather records in the world.  In About SOI,  the Bureau says:

 Daily or weekly values of the SOI do not convey much in the way of useful information about the current state of the climate, and accordingly the Bureau of Meteorology does not issue them. Daily values in particular can fluctuate markedly because of daily weather patterns, and should not be used for climate purposes.

It is a pity that the BOM doesn’t follow this approach with temperature, and in fact goes to the opposite extreme.

Record temperatures, maximum and minimum temperatures, and monthly, seasonal, and annual analyses are based not on daily values but on ONE SECOND VALUES.

The Bureau reports daily maximum and minimum temperatures at Climate Data Online,   but also gives a daily summary for each site in more detail on the State summary observations page , and a continuous 72 hour record of 30 minute observations (examples below), issued every 30 minutes, with the page automatically refreshed every 10 minutes, also handily graphed .  These last two pages have the previous 72 hours of readings, after which they disappear for good.  However, the State summary page, also refreshed every 10 minutes, is for the current calendar day only.

This screenshot shows part of the Queensland observations page for February 26, showing the stations in the North Tropical Coast and Tablelands district.

Fig. 1:  District summary page

mareeba-example

Note especially the High Temp of 30.5C at 01:26pm.  Clicking on the station name at the left takes us to the Latest Weather Observations for Mareeba page:

Fig. 2:  Latest Observations for Mareeba

mareeba detail example.jpg

Notice that temperature recordings are shown every 30 minutes, on the hour and half hour.

In Figure 1 I have circled the Low Temp and High Temp for Mareeba.  Except in unusual circumstances, High Temp and Low Temp values become the maximum and minimum temperatures and are listed on the Climate Data Online page, and for stations that are part of the ACORN network, become part of the official climate record.  It is most important that these High Temp and Low Temp values, the highest and lowest recorded temperatures of each day, should be accurate and trustworthy.

But frequently they are higher or lower than the half hourly observations, as in the Mareeba example (0.6C higher), and I wanted to know why.  In this post I show some recent examples, with the explanation from the Bureau.

Perhaps the difference between the Latest Weather Observations and maximum temperature reported at Climate Data Online is due to brief spikes in temperature in between the reported temperatures of the latest observations, such as in this example from Amberley RAAF on February 12.

Fig. 3:  Amberley RAAF temperatures, 12 February 2017

amberley-12-feb

A probable cause would be that the Automatic Weather Station probe is extremely sensitive to sudden changes in temperature as breezes blow warmer or cooler air around or a cloud passes over the sun.

However, this may not be the whole story.

Occasionally the report time for the High Temp or Low Temp is exactly on the hour or half hour, and therefore can be directly compared with the temperature shown for that time at the station’s page.

These progressive Low and/or High Temps on the half hour or hour occur and can be observed throughout the day at various times, as well as at the end of the reporting period.

For example, here is a mid-afternoon screenshot of the Queensland- Wide Bay and Burnett district summary for Wednesday 15th February.  I have highlighted the High Temp value for Maryborough at 1:00pm.

Fig. 4:  District summary at 2:00pm for Maryborough 15 February 2017

obs-mboro-15th

In the Latest Observations for Maryborough, I have highlighted the 1:00pm reading.

Fig. 5: Latest Observations at Maryborough at 01:00pm on 15 February

obs-mboro-15th-detail

The difference is +1.5 degrees.  Here I have graphed the results.

Fig. 6:  Maryborough 15 February

mboro-15th-graph

That’s a 1.5 degree difference at the exact same minute.

Here is a screenshot of Latest Observations values at Hervey Bay Airport on Wednesday 22 February.  Low Temp for the morning of 23.2C was reached at 6.00 a.m.

Fig. 7:  Hervey Bay, 06:00am  22 February 2017

hervey-bay-22nd

Note that at 6.00am, just after sunrise, the Latest Observations page shows that the temperature was 25.3 degrees.  The daily Low Temp was reported as 23.2 degrees at 6.00am – 2.1 degrees cooler.  This graph will show the discrepancy more plainly.

Fig. 8:  Hervey Bay temperatures 22 February

hervey-bay-22nd-graph

What possible influence would cause a dawn temperature to drop 2.1 degrees?

I sent a query to the Bureau about Hervey Bay, and the explanation from the Bureau’s officer was enlightening:

Firstly, we receive AWS data every minute. There are 3 temperature values:
1. Most recent one second measurement
2. Highest one second measurement (for the previous 60 secs)
3. Lowest one second measurement (for the previous 60 secs)

Relating this to the 30 minute observations page: For an observation taken at 0600, the values are for the one minute 0559-0600.

I’ve looked at the data for Hervey Bay at 0600 on the 22nd February.
25.3, 25.4, 23.2 .

The temperature reported each half hour on the station Latest Observations page is the instantaneous temperature at that exact second, in this case 06:00:00, and the High Temp or Low Temp for the day is the highest or lowest one second temperature out of every minute for the whole day so far.  There is no filtering or averaging.

The explanation for the large discrepancy was that “Sometimes the initial heating from the sun causes cooler air closer to the ground to mix up to the temperature probe (1.2m above ground).”

However, in Figure 7 above it can be seen that the wind was south east at 17 km/hr, gusting to 26 km/hr, and had been like that all night, over flat ground at the airport, so an unmixed cooler surface layer mixing up to the probe seems very unlikely.

You will also note that the temperatures in the final second of every half hour period from 12.30 to 6.30 ranged from 25C to 25.5C, yet in some second in the final minute before 6.00 a.m. it was at 23.2C.  I have shown these values in the graph below.

Fig. 9:  Hervey Bay 05:59 to 06:00am

hervey-bay-22nd-at-6am

The orange row shows the highest temperature for this last minute at 25.4C at some unknown second, the blue row the lowest temperature for this minute (and for the morning) at 23.2C at some unknown second, and the spot temperature of 25.3C at exactly 06:00:00am.  The black lines show the upper and lower values of half hourly readings between 12:30 and 06:30: the high temp and 06:00am readings are within this range.

23.2C looks a lot like instrument error, and not subject to any filtering.

Further, there are only two possibilities:  either from a low of 23.2C, the temperature rose 2.2 degrees to 25.4C, then down to 25.3C; or else from a high of 25.4C it fell 2.2 degrees to 23.2C, then rose 2.1 degrees to 25.3C, all in the 60 seconds or less prior to 06:00:00 a.m.

How often does random instrument error affect the High and Low Temps reported at the other 526 stations?  Like Thargomindah, where on February 12 the High Temp was 2.3 degrees to 2.5 degrees higher than the temperatures 15 minutes before and after?

Fig. 10:  Thargomindah temperatures 12 February 2017

thargomindah-12-feb

Or was this due to a sudden rise and fall caused by a puff of wind, even a whirl-wind?

Who knows?  The Bureau certainly doesn’t.

 

In Part 2, I will look at patterns arising from analysis of 200 High and Low Temps occurring in the same minute as the half hourly values, and implications this has for our climate record.