| 摘要 |
<P>PROBLEM TO BE SOLVED: To reduce an influence of coefficient values of the respective terms in a correction formula to output by a rounding error in a sensor which calibrates sensor output by using a high-order correction formula having a plurality of terms. <P>SOLUTION: A method for calibrating detection output of a sensor includes: a first process of calculating the respective output signal values of a detection element in a plurality of mutually different amounts of physical quantity of a measured object as data; a second process of calculating correction coefficients of the respective terms of a high-order correction formula for correcting output signals of the detection element on the basis of the measurement data calculated by the first process; a third process of performing rounding processing for rounding a value less than the number of effective digits to the number of effective digits by round-off so that the correction coefficients of the respective terms calculated by the second process become the predetermined number of effective digits, and substituting the correction coefficients to which the rounding processing is finished to the correction coefficient of the correction formula; and a fourth process of investigating whether or not a quantization error of the correction formula can be made small by adjusting the correction coefficient for at least one of other correction coefficients except the correction coefficient of the highest-order term among the correction coefficients replaced by the third process. <P>COPYRIGHT: (C)2013,JPO&INPIT |
