Bureau of Meteorology (BoM) ID 15602, Latitude -22.95o, Longitude 136.1442o; temperature from January 1966 to December 2024.
Dr Bill Johnston
Keywords: BoM; homogenisation reference sites; data quality
Having completed analysis of Tmax data for the Jervois weather station using BomWatch protocols, (Report available here), I asked several online AI-reviewers to provide a short- and medium-length independent overview and summary.
I specifically searched for online AI-reviewers requiring no login and no upfront $$$. Selfish I know, but I receive no reimbursement for the many hours, weeks and months it may take to research and analyse a weather station. BomWatch protocols are transparent, objective and replicable, which is the hallmark of the scientific method.
AI-reviewers were:
https://www.portfoliopals.net/summascript/
https://noiz.io/free-ai-tools/doc-summarizer/
While all Reviewers provided similar overviews, the summary provided by NoteGPT was less accurate and missed the Report’s main focus.
The medium version of the review by https://www.portfoliopals.net/summascript/ seemed accurate and well structured. Highlighting specific aspects in logical order (context and background, key findings and analysis, implications and reflection, and conclusions) helped organise one’s thoughts.
Their 106-word summary can be quoted directly, and only requires light editing:
This report by Dr. Bill Johnston evaluates the reliability of maximum temperature (Tmax) data from the isolated Jervois weather station in Australia, used to homogenise ACORN-SAT records at Rabbit Flat, Alice Springs, and Boulia. Findings reveal the Jervois dataset is of poor quality, marked by missing observations, probable watering, and unexplained step-changes in 1979 and 2017 causing a spurious warming trend of 0.225°C per decade. Dr. Johnston argues, “The overall trend… was thus spuriously due to non-climate factors,” challenging the validity of adjustments based on Jervois data. This critique raises broader concerns about data integrity in climate monitoring and the scientific rigor behind national temperature records.
Some reviewers misinterpreted the role of BomWatch protocols in undertaking multi-faceted analysis of single-site datasets; failed to highlight the metadata problem and that maximum temperature (Tmax) and its relationship with rainfall was a key statistical metric.
Due its clarity, the medium length summary from https://docxsummarizer.com/ also rated highly as it overviewed the objectives, provided a brief outline of the site, the analysis, and main conclusions. Their unedited report is as follows:
Assessment of Jervois Temperature Data and Its Role in Australian Climate Homogenisation
This report investigates the quality and suitability of maximum temperature (Tmax) data from the isolated Jervois weather station in the Northern Territory, Australia, for use in homogenising key sites within the Australian Climate Observations Reference Network – Surface Air Temperature (ACORN-SAT). Jervois, positioned some 246 km northwest of Alice Springs, is not itself an ACORN-SAT site but its data have been employed to adjust Tmax records for Rabbit Flat, Alice Springs, and Boulia. This practice prompted scrutiny due to existing concerns regarding the accuracy and completeness of Jervois temperature observations.
Analysis of annual Tmax and rainfall data from 1966 to 2024 revealed significant shortcomings. The dataset was segmented into three distinct periods marked by abrupt step-changes in 1979 and 2017, with temperature increases of approximately 0.52°C and 0.83°C respectively. Notably, these changes are attributed to non-climatic factors such as missing observations, site watering, and instrument changes rather than genuine climate trends. The reported overall warming trend of 0.225°C per decade thus appears spurious, driven by data inconsistencies rather than atmospheric change. As the report states, “as no trend remained in MLR residuals, it could not be claimed that the Jervois climate has warmed due to CO₂, coalmining, electricity generation or anything else.” Rainfall exerted a significant cooling effect on Tmax, reducing temperatures by 0.294°C per 100 mm of rain, explaining over half of the Tmax variability alongside the identified step-changes.
Compounding concerns are metadata inaccuracies, including erroneous site coordinates and undocumented instrument transitions. These undermine confidence in the station’s data quality and the validity of its use in homogenisation processes. The report’s author, Dr Bill Johnston, concludes that given the “poor” quality of Jervois data, its use for homogenising ACORN-SAT sites “has no statistical or scientific merit,” and calls for the abandonment of the ACORN-SAT project in its entirety.
This detailed examination illuminates challenges in climate data homogenisation where underlying observational inconsistencies distort perceived warming trends. As climate policy and public discourse increasingly rely on precise temperature records, the integrity of such datasets is paramount. The findings here serve as a cautionary note on the risks of incorporating flawed data in climate analyses and stress the importance of rigorous, transparent data quality assessments to maintain scientific credibility in climate monitoring efforts.
Points to note.
The Report itself was developed and constructed entirely using human intelligence. Information about the site was sought from BoM metadata, the National Archives of Australia, Google earth Pro satellite images, and Google (see for example, https://walerdatabase.online/jinka-and-jervois-stations/, and of historical interest https://cifhs.com/ntrecords/ntcensus/jervois.html). Analysis was undertaken hands-on. Use of R packages, and detection of shifts in Tmax ~ rainfall residuals using Sequential Step-change Analysis of Regime Shifts (STARS), required human judgement, which is unlikely to be replicated by AI.
Is using AI to review a complex report ethical?
It is important to acknowledge all sources of information, programs etc. used in compiling research reports. Likewise, to acknowledge the contribution of peers and colleagues. In that it is adding value to words and complex analyses that some may find daunting to read, provided it’s use is acknowledged, summarising the main points using AI-tools is no different.
With the caveat that AI-reviews be replicated across multiple tools, they also provide a rapid form of ‘peer review’, even though they ought not be thought of as actual peers. AI-reviewers also cannot step far beyond the boundaries of the report on which reviews are based. Further, if the report itself or the methodology on which it is based is faulty, while seeming authoritative and authentic, reviews generated using AI are also likely to be faulty.
It would also be cheating (i.e., academic misconduct) to take a publication or report, create summaries using AI, and combine and publish the result as one’s own work. Most universities publish guidelines on the use of AI in academic studies that set clear boundaries around what is, and what is not acceptable (e.g., https://www.teqsa.gov.au/students/artificial-intelligence-advice-students).
(18 July 2025)