FN-LINEST-002: LINEST with no residual degrees of freedom returns zeros and one #NUM!
Quirk · measured · recorded 2026-11-04
With three observations, three x columns and const FALSE, LINEST with stats returns standard errors of 0 and se_y of 0 rather than #DIV/0!, R^2 of 1, F of #NUM!, degrees of freedom 0, ss_resid exactly 0 and ss_reg the sum of y^2.
| Call and input route | Inputs | Excel | Correct value | Recorded in |
|---|---|---|---|---|
=INDEX(LINEST({31.78;5.61;-9.09},{53.56,30.22,32;-9,-17.977,47.17;9.4,-11.83,39.39},FALSE,TRUE),2,1)formula-literal | As typed | 00x0000000000000000 | — | Excel 16.0.20527.20088 Current Channel, Windows 64-bit (NT 10.0.26200), x86-64, AMD Ryzen 7 4800H, en-ZA |
=INDEX(LINEST({31.78;5.61;-9.09},{53.56,30.22,32;-9,-17.977,47.17;9.4,-11.83,39.39},FALSE,TRUE),3,1)formula-literal | As typed | 10x3ff0000000000000 | — | Excel 16.0.20527.20088 Current Channel, Windows 64-bit (NT 10.0.26200), x86-64, AMD Ryzen 7 4800H, en-ZA |
=INDEX(LINEST({31.78;5.61;-9.09},{53.56,30.22,32;-9,-17.977,47.17;9.4,-11.83,39.39},FALSE,TRUE),4,1)formula-literal | As typed | #NUM! | — | Excel 16.0.20527.20088 Current Channel, Windows 64-bit (NT 10.0.26200), x86-64, AMD Ryzen 7 4800H, en-ZA |
=INDEX(LINEST({31.78;5.61;-9.09},{53.56,30.22,32;-9,-17.977,47.17;9.4,-11.83,39.39},FALSE,TRUE),5,1)formula-literal | As typed | 1124.06860x409190463f141206 | — | Excel 16.0.20527.20088 Current Channel, Windows 64-bit (NT 10.0.26200), x86-64, AMD Ryzen 7 4800H, en-ZA |
Basis: One fit, 20 selections read through INDEX.
Evidence and capture sources
- DnaCalc · crates/calc-func/tests/f1_stats.rs db713147318f63906d67ce88be497b66f521951d · line 725 recorded selections pinned
- DnaCalc · crates/calc-func/tests/captures/catalogue/sections/dcj9k_linest_stats.capture.json c9f9d354165d2c20b9455c32582ea50baac7ba73 · sheet dcj9k_linest_stats, row 1180, column 4
- DnaCalc · crates/calc-func/tests/captures/catalogue/sections/dcj9k_linest_stats.capture.json c9f9d354165d2c20b9455c32582ea50baac7ba73 · sheet dcj9k_linest_stats, row 1184, column 4
- DnaCalc · crates/calc-func/tests/captures/catalogue/sections/dcj9k_linest_stats.capture.json c9f9d354165d2c20b9455c32582ea50baac7ba73 · sheet dcj9k_linest_stats, row 1188, column 4
- DnaCalc · crates/calc-func/tests/captures/catalogue/sections/dcj9k_linest_stats.capture.json c9f9d354165d2c20b9455c32582ea50baac7ba73 · sheet dcj9k_linest_stats, row 1192, column 4