Segmented regression

Example

For the blue figure at the right that gives the relation between yield of mustard (Yr = Ym, t/ha) and soil salinity (x = Ss, expressed as electric conductivity of the soil solution EC in dS/m) it is found that:

BP = 4.93, A₁ = 0, K₁ = 1.74, A₂ = −0.129, K₂ = 2.38, R₁² = 0.0035 (insignificant), R₂² = 0.395 (significant) and:

• Ym = 1.74 t/ha for Ss < 4.93 (breakpoint)
• Ym = −0.129 Ss + 2.38 t/ha for Ss > 4.93 (breakpoint)

indicating that soil salinities < 4.93 dS/m are safe and soil salinities > 4.93 dS/m reduce the yield @ 0.129 t/ha per unit increase of soil salinity.

The figure also shows confidence intervals and uncertainty as elaborated hereunder.

Test procedures

The following statistical tests are used to determine the type of trend:

1. significance of the breakpoint (BP) by expressing BP as a function of regression coefficients A₁ and A₂ and the means Y₁ and Y₂ of the y-data and the means X₁ and X₂ of the x data (left and right of BP), using the laws of propagation of errors in additions and multiplications to compute the standard error (SE) of BP, and applying Student's t-test
2. significance of A₁ and A₂ applying Student's t-distribution and the standard error SE of A₁ and A₂
3. significance of the difference of A₁ and A₂ applying Student's t-distribution using the SE of their difference.
4. significance of the difference of Y₁ and Y₂ applying Student's t-distribution using the SE of their difference.
5. A more formal statistical approach to test for the existence of a breakpoint, is via the pseudo score test which does not require estimation of the segmented line.

In addition, use is made of the correlation coefficient of all data (Ra), the coefficient of determination or coefficient of explanation, confidence intervals of the regression functions, and ANOVA analysis.

The coefficient of determination for all data (Cd), that is to be maximized under the conditions set by the significance tests, is found from:

• ${\displaystyle C_d=1-\frac{\sum (y-Y_r{)}^2}{\sum (y-Y_a{)}^2}}$

where Yr is the expected (predicted) value of y according to the former regression equations and Ya is the average of all y values.

The Cd coefficient ranges between 0 (no explanation at all) to 1 (full explanation, perfect match).
In a pure, unsegmented, linear regression, the values of Cd and Ra² are equal. In a segmented regression, Cd needs to be significantly larger than Ra² to justify the segmentation.

The optimal value of the breakpoint may be found such that the Cd coefficient is maximum.

No-effect range

Segmented regression is often used to detect over which range an explanatory variable (X) has no effect on the dependent variable (Y), while beyond the reach there is a clear response, be it positive or negative. The reach of no effect may be found at the initial part of X domain or conversely at its last part. For the "no effect" analysis, application of the least squares method for the segmented regression analysis may not be the most appropriate technique because the aim is rather to find the longest stretch over which the Y-X relation can be considered to possess zero slope while beyond the reach the slope is significantly different from zero but knowledge about the best value of this slope is not material. The method to find the no-effect range is progressive partial regression over the range, extending the range with small steps until the regression coefficient gets significantly different from zero.

In the next figure the break point is found at X=7.9 while for the same data (see blue figure above for mustard yield), the least squares method yields a break point only at X=4.9. The latter value is lower, but the fit of the data beyond the break point is better. Hence, it will depend on the purpose of the analysis which method needs to be employed.

Software implementations

• In Python - there is the piecewise-regression package.
• In R - there is the segmented package.