(Difference between revisions)
| Revision as of 10:39, 22 September 2006 Peter (Talk | contribs) ← Previous diff |
Revision as of 10:40, 22 September 2006 Peter (Talk | contribs) (→Using Yield functions) Next diff → |
||
| Line 2: | Line 2: | ||
| The present note tries to summarise some of the considerations which the crop forecaster should keep in mind when deriving multiple regression equations (so-called Yield Functions) which will eventually be used for forecasting crop yields. The process by which the coefficients of a yield function are derived are known as calibration15. The rules below are purely empirical or based on common sense: | The present note tries to summarise some of the considerations which the crop forecaster should keep in mind when deriving multiple regression equations (so-called Yield Functions) which will eventually be used for forecasting crop yields. The process by which the coefficients of a yield function are derived are known as calibration15. The rules below are purely empirical or based on common sense: | ||
| - | * Use only variables which are known to be meaningful for the crop under consideration. When there are good reasons to suspect that the response of | + | * Use only variables which are known to be meaningful for the crop under consideration. When there are good reasons to suspect that the response of crop production to a given variable is not linear, use a quadratic term in addition to the linear term. |
| - | crop production to a given variable is not linear, use a quadratic term in addition to the linear term. | + | |
| * Retain only those variables for which the coefficients are significantly different from 0. This is to say that the regression coefficients must be significantly larger (absolute values) than their standard errors. This can be tested statistically (ratio of coefficient to its error), but common sense is usually enough. | * Retain only those variables for which the coefficients are significantly different from 0. This is to say that the regression coefficients must be significantly larger (absolute values) than their standard errors. This can be tested statistically (ratio of coefficient to its error), but common sense is usually enough. | ||
| - | * The sign of the coefficients must correspond to what is known about the response of the crop to the variable considered. This applies also to the | + | * The sign of the coefficients must correspond to what is known about the response of the crop to the variable considered. This applies also to the quadratic terms. |
| - | quadratic terms. | + | |
| * The coefficients must be spatially coherent, which is to say that they must vary smoothly over adjacent districts | * The coefficients must be spatially coherent, which is to say that they must vary smoothly over adjacent districts | ||
| * The quality of a regression equation is given, in addition to the statistics (R, R2, coefficients significantly different from 0), by the average error of estimated yields. | * The quality of a regression equation is given, in addition to the statistics (R, R2, coefficients significantly different from 0), by the average error of estimated yields. | ||
Revision as of 10:40, 22 September 2006
Using Yield functions
The present note tries to summarise some of the considerations which the crop forecaster should keep in mind when deriving multiple regression equations (so-called Yield Functions) which will eventually be used for forecasting crop yields. The process by which the coefficients of a yield function are derived are known as calibration15. The rules below are purely empirical or based on common sense:
- Use only variables which are known to be meaningful for the crop under consideration. When there are good reasons to suspect that the response of crop production to a given variable is not linear, use a quadratic term in addition to the linear term.
- Retain only those variables for which the coefficients are significantly different from 0. This is to say that the regression coefficients must be significantly larger (absolute values) than their standard errors. This can be tested statistically (ratio of coefficient to its error), but common sense is usually enough.
- The sign of the coefficients must correspond to what is known about the response of the crop to the variable considered. This applies also to the quadratic terms.
- The coefficients must be spatially coherent, which is to say that they must vary smoothly over adjacent districts
- The quality of a regression equation is given, in addition to the statistics (R, R2, coefficients significantly different from 0), by the average error of estimated yields.
- Trends MUST be removed before carrying out the regression work proper. The trends need not be linear.
- Be aware of the fact that there are two types of variables: continuous quantitative ones (e.g. minimum temperature affecting crops through night-time
respiration) and qualitative ones (e.g. male sterility induced by high temperatures).
- Always use a variable which stands for the local yield potential
- A yield function does not have to be linear. In some cases, a multiplicative function can be more appropriate.
Some additional advice
- Compute the correlation matrix between all variables to get a better feel for the redundancy of the information;
- Plot the yield against time, to get an idea of the shape of the trend and decide on which function should be used for the time trend;
- Run a Principal Components analysis on the calibration matrix to realise how redundant your data set actually is, and to identify the most important factors. Run the PCA twice (1) excluding the yield as a variable, to get a feel for the variable groupings and redundancy and (2) with yield to identify the variables which are associated with the yield, as well as those that are irrelevant;
- Pay attention to the fact that the weather variables may play a secondary rôle, and ignore them altogether. For coffee in Mexico, it was shown that the most important variables influencing yields included altitude above sea level, number of weeding rounds, age of the plantation and type of smallholding (Becerril- Roman and Ortega-Obregon, 1979);
- After removing the trend, plot de-trended yield against each individual variable to see the shape of the regression curve and the strength of the statistical correlation, if any relation is clearly non-linear, add a quadratic term16 to account for curvilinearity;
- As far as possible, ignore redundant variables or use the regression through a principal component analysis. Always prefer techniques with (manual or
“automatic”) addition of variables to techniques with deletion of variables;
- Use techniques to ensure the stability of the coefficients (randomly or systematically eliminating up to 50% of the observation points of the time
series);
- Use jack-knifing to determine the actual accuracy of the method;
- Yield functions typically “expire” after a couple of years, after which they need recalibrating. A yield function older than 3 years is definitely worthless!