发明名称 DATA PROCESSING METHOD/SYSTEM/DEVICE AND PROGRAM STORAGE DEVICE
摘要 PROBLEM TO BE SOLVED: To realize the conversion domain correction of a real domain error in the processing of conversion data and the like by giving a step for generating real domain data in the system of a highly precise number and a step of converting the highly precise number into an integer, clipping it to a permission range and forming conversion data. SOLUTION: Conversion data A110 is transferred to inverse conversion 120 and highly precise real domain data 130 is generated. Highly precise data 130 is converted into an integer, is clipped (140) and integer domain data (namely, conversion data) 150 is generated. Conversion into the integer and a clipping stage 140 are executed before an operation for receiving integer input 150, data output 330 from an operation after conversion into the integer contains at least small inaccuracy by the error of the result. The inaccuracy is corrected in a conversion domain by subtracting conversion data 150 from the highly precise number 130 and forming a highly precise error 1120.
申请公布号 JP2000151416(A) 申请公布日期 2000.05.30
申请号 JP19990310801 申请日期 1999.11.01
申请人 INTERNATL BUSINESS MACH CORP <IBM> 发明人 JOAN LABARNE MITCHELL;MARTIN JAMES BRIGHT
分类号 H04N7/26;G06T9/00;H03M7/30;H04N1/41;(IPC1-7):H03M7/30;H04N7/24 主分类号 H04N7/26
代理机构 代理人
主权项
地址