Scatter Plots for x86 FPU Error Data


These plots were with gnuplot 4.6 and data gathered using the included utility. First run gather-data.bat to generate data files. Then run plot.bat to make the plots. The argument ranges chosen are based on Appendix G of the 1995 Pentium Processor Family Developerís Manual Volume 3: Architecture and Programming Manual (download). Additional ranges of interest are included.

Here are the results from Intel Core i7-2600 and AMD A6-3650. The AMD transcendental instructions have behavior similar to those found in Intel processors, though the non-trig AMD transcendental instructions are slightly more accurate.