[metapost] Units unaccuracy with numbersystem set to double

Daniel H. Luecking luecking at uark.edu
Mon Apr 7 20:12:15 CEST 2014

Friday, April 04, 2014 8:59 AM, Franck Pastor [franck.pastor at mac.com] wrote

>It looks like it is the way to go for the "cm" definition. And "mm" would be 
>ideally defined as 360/127 or cm/10 if I understand correctly…

Since cm is produced from (rounded) calculations of 3600/127, cm/10 would 
be another rounded calculation  on top of that. This has the possibility of 
compounding errors. Better would be mm=360/127, which performs a 
rounded computation of an exact value.

Daniel H. Luecking
Department of Mathematical Sciences
University of Arkansas
Fayetteville, Arkansas

More information about the metapost mailing list