KING'S BENCH DIVISION
PLANNING COURT
SITTING IN LEEDS
B e f o r e :
____________________
CLIFTON NEIGHBOURHOOD FORUM |
Claimant |
|
- and - |
||
CALDERDALE COUNCIL |
Defendant |
|
- and - |
||
SECRETARY OF STATE FOR LEVELLING UP, HOUSING AND COMMUNITIES |
Interested Party |
____________________
Ian Ponter (instructed by Calderdale Council) for the Defendant
Stephanie Hall (instructed by GLD) for the Interested Party
Hearing date: 26.4.24
____________________
Crown Copyright ©
FORDHAM J:
Introduction
The Strategic Model
"Observed" and "Modelled"
WSP's "Validation" Reports
Green and Blue
DfT Criteria and the GEH Statistic
Modelling Standards. 3.5.1 Guidance in the Practitioner tier of TAG describes best practice in model development. As part of producing an appropriate analytical tool, it is important that models are based on up-to-date evidence and are demonstrated to produce realistic results when tested. Without this assurance, results from a model may not be sufficiently robust to be used to adequately assess impacts of a potential intervention. 3.5.2 Obtaining this assurance is done via model validation. This ensures that sufficiently accurate traffic and passenger flows are reproduced on the transport network in the model base year and that the model responds appropriately to changes in costs when used to forecast i.e. that changes in behaviour (demand) are realistic. TAG contains suggested benchmark criteria in order to test this realism. However, the key concern of the analyst is to ensure that the model is fit for the purpose to which it is being applied and that there is appropriate evidence to support the conclusion that it is. 3.5.3 The achievement of the validation acceptability guidelines described in TAG does not guarantee that a model is 'fit for purpose' and, likewise, a failure to meet the specified validation standards does not mean that a model is not 'fit for purpose'. A model which meets the specified validation standards may not be fit for particular purposes and, conversely, a model which fails to meet to some degree the validation standards may be usable for certain applications. The test of fitness for purpose of a model is: can robust conclusions be drawn from the model outputs?
TTHC's Critiques
WSP's Responses
Law
Positively prepared – the plan should be prepared based on a strategy which seeks to meet objectively assessed development and infrastructure requirements, including unmet requirements from neighbouring authorities where it is reasonable to do so and consistent with achieving sustainable development. Justified – the plan should be the most appropriate strategy, when considered against the reasonable alternatives, based on proportionate evidence. Effective – the plan should be deliverable over its period and based on effective joint working on cross-boundary strategic priorities. Consistent with national policy – the plan should enable the delivery of sustainable development in accordance with the policies in the Framework.
(7) Under NPPF §158 a local authority should ensure that the Local Plan is based on adequate, up-to-date and relevant evidence about the economic, social and environmental characteristics and prospects of the area. (8) Under Government Planning Policy Guidance (PPG) on Transport Evidence Bases in Plan Making and Decision Taking (13 March 2015): (i) establishing a robust transport evidence base for Local Plans is important to support their preparation facilitate their approval (§1); (ii) WebTAG "principles", "objectives" and "methods" should be adopted in the transport assessment of a Local Plan, ensuring proposed land allocation impact is considered with a comparative analysis of transport effects, albeit that for most Local Plan assessments the full methodology recommended by WebTAG will not be appropriate but may provide some useful guidance, whereas in assessments involving major new transport infrastructure WebTAG methods should be employed (§10). (9) The Transport Analysis Guidance (May 2018) identifies (at §3.5.3) as the test of fitness for purpose of a model, whether robust conclusions can be drawn from the model outputs (§10 above).
The Inspector's Paragraph 127
127. [i] The Strategic Model was used to assess the likely cumulative effect of the Local Plan's proposals on the highway network and to identify key interventions. [ii] The Strategic Model primarily uses 2014 as a base year and is due to be replaced by an updated multi-modal transport model. [iii] However, the Council's review of the validation levels of the Strategic Model against DfT criteria indicate[s] that it remains appropriate for strategic planning purposes. [iv] In addition, evidence of observed trends in traffic flows in Calderdale do not show significant changes between 2014 and 2019. [v] Furthermore, the Strategic Model uses data collected over long periods of time and in this respect I consider it provides a representative picture. [vi] Taking account of all evidence before me I am satisfied that the Strategic Model does not significantly underestimate traffic levels in Brighouse and is robust and proportionate for preparation of the Local Plan. [vii] Further detailed transport assessment work relating to specific sites will be required as part of the planning application process.
On the Face of Paragraph 127
Reference-Points
i) The model primarily uses 2014 as a base year and is due to be replaced by an updated multi-modal transport model. This is at [ii]. One criticism being made of the Strategic Model was that it represents a base year of 2014 (with some elements being from the original version in 2008), and as such was now beyond its useful life. This criticism was recorded in the 2021 Technical Note at p.2. Linked to this, a criticism was being made that the Strategic Model was further discredited as it had been identified, in an approval for funding, as subject to replacement by a multi-modal model. This criticism was recorded in the 2021 Technical Note at p.1. This approval for funding was the decision accepting the recommendation in the 2018 WYCA Report. The Forum's position was that this approval for funding confirmed the unsuitability of the Strategic Model, recorded in the 2022 Transport Position Statement at §1.5. It is clear that the Inspector considered that these raised relevant question marks, which needed an answer.
ii) However, the Council's review of the validation levels of the Strategic Model against DfT criteria indicate[s] that it remains appropriate for strategic planning purposes. This is at [iii]. It was in response to the recorded criticisms (including those at §20i above). WSP explained that the Strategic Model had been "validated against the criteria set by DfT for model validation across the model area which covers the Calderdale district"; that WSP had "reviewed the validation levels of the model and this was reported in Technical Note 10, showing that overall there was no particular issue in the Brighouse area for validation against journey times or traffic volumes" (2021 Technical Note at p.7). What was "reported in" Technical Note 10 under "Model review" – which had been "concluded from Sections 2 to 4" of that document – was that the "Strategic Model is a robust tool for the assessment of the local plan based on the validation results, comparison to Kirklees model and previous usage" (2018 Technical Note p.16). It is clear that the Inspector considered that she could rely on the indicated strategic appropriateness from this review of validation levels.
iii) In addition, evidence of observed trends in traffic flows in Calderdale do not show significant changes between 2014 and 2019. This is at [iv]. In response to the recorded criticisms (including those at §20i above), WSP explained that the Council "regularly count traffic on roads around the district"; that "the trends between 2014 (or the closest year observed) and 2019 (the latest year pre-pandemic) have been examined to understand if there have been any significant changes that would indicate that the model is under-representing the level of traffic as is claimed", and that the "conclusion" which "this note has demonstrated" was that "there has been little change in traffic flows between the base year of the [Strategic Model] and 2019" (2021 Technical Note pp. 2 and 7). It is clear that the Inspector considered that she could rely on this evidence of observed trends in traffic flows.
iv) Furthermore, the Strategic Model uses data collected over long periods of time and in this respect I consider it provides a representative picture. This is at [v]. In response to the recorded criticisms, WSP explained that: for journey times "the data used for the model was extracted from Trafficmaster GPS data from a sample of vehicles over an entire month of weekdays", in "June 2014 as this is a neutral time for traffic", and as "representative of average conditions for the year"; and for traffic flows the automatic traffic counter surveys had been "carried out for at least two weeks to give more representative observations" (2021 Technical Note p.6). This was describing the data used for the Validation Reports. It was responding to TTHC's observed journey time and traffic flow data, in the 2017 Transport Representation, based on "2 journey time runs per peak period for each day" and traffic flows in "one week in September" (2021 Technical Note p.6). It is clear that the Inspector considered that she could rely on the Strategic Model observed data collection as representative.
v) Taking account of all evidence before me I am satisfied that the Strategic Model does not significantly underestimate traffic levels in Brighouse and is robust and proportionate for preparation of the Local Plan. This is at [vi]. As everyone agrees, the evidence that was before the Inspector included from the Forum, the contents of the 2017 Transport Representation; the 2019 Transport Representation and the 2022 Transport Position Statement, as well as the contents of the 2021 Solicitors' Letter and the 2018 WYCA Report. It also included, from the Council, the contents of the 2015 Validation Report, the 2016 Validation Report, the 2016 Technical Note, the 2018 Technical Note and the 2021 Technical Note. TTHC's position was that the Strategic Model was a model which "substantially underestimates the levels of congestion in and around Brighouse and which WYCA agrees is a model no longer fit for purpose" (2022 Transport Position Statement §1.12). The latter point was another reference to the 2018 WYCA Report. WSP's position was the review of validation levels reported in the 2018 Technical Note showed that "overall there was no particular issue in the Brighouse area for validation against journey times or traffic volumes"; that "validation of the model is of an acceptable level for a Strategic Model and that there is no inherent weakness in the Brighouse area"; and that "the modelling methodology is robust and proportionate for the task of providing input to the Local Plan decision making process" (2021 Technical Note p.7). It is clear that the Inspector did not accept TTHC's criticism that the Strategic Model substantially (significantly) underestimated traffic levels in Brighouse; and she was satisfied that WSP had shown that the Strategic Model was robust and proportionate for preparation of the Local Plan.
The Forum's 'Unanswered' Points
The Inspector does not grapple at all with the following points underpinning the conclusion on robustness: (1) The conclusions of WYCA that the Strategic Model will not stand up to scrutiny … (2) That the Council, through WSP, do not dispute that the Strategic Model shows lower levels of traffic than observed for validation. (3) That the Council's evidence is that the WebTAG acceptability criteria are not met. And that the additional validation put forward through comparison with neighbouring Kirklees Council is also not passed. (4) In light of failing the WebTAG acceptability criteria, how can robust conclusions still be drawn from the Strategic Model to justify the Plan and conclude it is sound.
i) The conclusions of WYCA that the Transport Model will not stand up to scrutiny. This was the 2018 WYCA Report. It was part of "all evidence before me" (at [vi]). It was relied on by TTHC and the Forum as to outdatedness and multi-modal replacement, raising questions, as was recognised by the Inspector (at [ii]): see §20i above. It was alongside the "significantly underestimate" point (at [vi]), in the context of fitness for purpose: see §20v above. It was in law unnecessary for the Inspector to say more. She identified her answers to the questions which had been raised. The 2018 WYCA Report was one item of evidence. The points made about it were one strand of argument.
ii) I add this. I find it unsurprising that the Inspector did not say more. I make these observations by way of footnotes. (1) The 2018 WYCA Report did not involve any freestanding evidence base or analysis. (2) It was about a "multi-modal model" in the context of a programme incorporating multiple modes of transport – including "public transport, highway and active pedestrian and cycling modes" – rather than being about highways and vehicles (2018 WYCA Report §2.39). (3) The "issues" were about suitability to support the development and appraisal of full business cases" for 6 listed projects (§2.38). (4) Those issues raised "concerns" about whether analytical works would "stand up to scrutiny" at a public inquiry in relation to one of these projects (§2.40). (5) The Inspector was concerned with modelling for adoption of the Local Plan and specifically recognised (Report §127 at [vii]) that full detailed transport assessment work would be needed as part of any project-specific planning application. (6) In the event, even WYCA continued – at least to 2021 – to use the Strategic Model for assessing WYCA transport schemes (2021 Technical Note p.1). (7) WSP carried out a "further check" exercise using modelled flows from the unapproved "2019 base year multi-modal model", for key locations in Brighouse, which WSP said "further demonstrates" that the Strategic Model "is not underplaying traffic levels as suggested" (2021 Technical Note p.5).
iii) That the Council, through WSP, do not dispute that the Strategic Model shows lower levels of traffic than observed for validation. This too was part of "all evidence before me" (Report §127 at [vi]). It was discussed at 2021 Technical Note p.7. This was being relied on by the Forum and TTHC in points made when TTHC "reviewed the validation of the [Strategic Model] against the traffic counts recorded in 2014 and highlight that generally the model shows lower levels of traffic than observed". WSP explained that "this fact is not disputed" but went on to make the very points which the Inspector recorded (Report §127 at [iii]) about the review of the validation levels of the Strategic Model against DfT criteria indicating that it remained appropriate for strategic planning purposes. I have already summarised the reference-point material (§20ii above). TTHC was pointing to data within the Validation Reports themselves, comparing observed traffic levels against modelled traffic levels. WSP's answer was to point to the overall validation judgments, against the DfT criteria. As has been seen, the Inspector considered that she could rely on the indicated strategic appropriateness from this review of validation levels.
iv) That the Council's evidence is that the WebTAG acceptability criteria are not met. And that the additional validation put forward through comparison with neighbouring Kirklees Council is also not passed. In light of failing the WebTAG acceptability criteria, how can robust conclusions still be drawn from the Strategic Model to justify the Plan and conclude it is sound. These two points go together. This too was part of "all evidence before me" (Report §127 at [vi]). This was another point about comparing observation data with modelled data, looking at the Validation Reports themselves and WSP's review of validation of levels. The reference to comparison with Kirklees is to an exercise within the 2021 Technical Note p.1, from the 2018 Technical Note pp.4-7, which included a comparison using the GEH Statistic and comparing modelled traffic flows at 9 key routes, including "further investigation" said by WSP to show "very similar flows" and where there was a discrepancy, the Strategic Model was validating well and more accurate than the Kirklees model. As to the WebTAG acceptability criteria "not being met" – and "failing" those criteria – this was a point about link flows and the GEH Statistic. Both TTHC and WSP drilled down into this picture. It was addressed in the 2018 Technical Note at p.4 (§§2.14 and 2.15), where WSP had said
VALIDATION LINK FLOW PERFORMANCE. 2.14. In the AM peak the counts to the west of Elland show a number of high GEH values, otherwise the sites which do not meet the DfT criteria set out in WebTAG are very close to passing. 2.15. In the PM peak, a similar pattern is shown with most failures against the DfT criteria showing a GEH of less than 10. A few counts show higher GEH values in central Elland.
v) Again, the questions were being answered in the very points which the Inspector recorded (Report §127 at [iii]), about the review of the validation levels of the Strategic Model against DfT criteria indicating that it remained appropriate for strategic planning purposes (§20ii above). Again, TTHC was pointing to data within the Validation Reports themselves, here where the GEH Statistic was applied to various "validation links". WSP's answer was to point to the overall validation judgments, against the DfT criteria. Again, as has been seen, the Inspector considered that she could rely on the indicated strategic appropriateness from this review of validation levels.
vi) Again, I find it unsurprising that the Inspector did not say more. I make these observations by way of footnote. (1) The 2015 Validation Report had set out the picture regarding link flow calibration and validation (§6.4), applying the GEH Statistic (§6.4.2), and setting out traffic flow tables viewed against the GEH Statistic, for calibration links and validation links including in AM Peak and PM Peak (pp.37-40) and reasoned conclusions were set out as why the results were of a sufficient standard to provide confidence that the Strategic Model was replicating existing traffic conditions (§§6.7.1 to 6.7.2). (2) The 2016 Validation Report revisited that picture (§6.5), with corresponding tables (pp.39-44), and included this about whether the GEH Statistic was a litmus test (§6.5.5):
A GEH value greater than 10 indicates that closer attention is required as the match between observed and modelled flows is poor, while a GEH of less than 5 indicates a very good fit.
That report went on to make observations about the picture "when calibration and validation links are combined" (§6.5.11); about link validation falling "just outside WebTAG criteria", with "not very many links with large differences in flow" and with a "good overall fit" when calibration and validation results are combined (§6.5.31); and about a picture which shows that the model provides a satisfactory representation of existing traffic conditions (§6.7.1). (3) Those Validation Reports provided the source material on which the TTHC criticism and WSP response were based. (4) The 'litmus test' point is addressed in the DfT Transport Analysis Guidance (May 2018) at §3.5.3 (see §10 above) and in the PPG (13 March 2015) at §10 (see §13(8)(ii) above).
Conclusions