All Forums  Origin Forum for Programming  LabTalk Forum  system.numeric issues

Note: You must be registered in order to post a reply.
To register, click here. Registration is FREE!

Screensize: 640 x 480 800 x 600 1024 x 768 1280 x 1024 UserName: Password: Anti-Spam Code: Format Mode: Basic  Help  Prompt  Format: Font Andale Mono Arial Arial Black Book Antiqua Century Gothic Comic Sans MS Courier New Georgia Impact Lucida Console Script MT Bold Stencil Tahoma Times New Roman Trebuchet MS Verdana   Size 1 2 3 4 5 6   Color Black Red Yellow Pink Green Orange Purple Blue Beige Brown Teal Navy Maroon LimeGreen Message: * HTML is OFF * Forum Code is ON Smilies [quote][i]Originally posted by andrewdsto[/i] [br]Origin Ver. 8.5 pro and Service Release 1 (Select Help-->About Origin): Operating System:windows xp pro, 64 bit Hello, I have an issue with they system.numeric setting I used to be able (version 8.0) to simply set the system.numeric.numdecplaces to a value and the program would round of all my numbers to the required level. This does not seem to be happening in version 8.5. for example, if i run the following code: xval=12345.6789; SYSTEM.NUMERIC.NUMDECDIGITS=7; type "xval= $(xval)"; xval=; type; /// SYSTEM.NUMERIC.NUMDECDIGITS=3; type "xval= $(xval)"; xval=; type; /// System.sigDigitsL=; System.sigDigitsU=; type; /// type "xval= $(xval)"; xval=; SYSTEM.NUMERIC.NUMDECDIGITS=; I return the following: xval= 12345.6789 xval=12345.6789 xval= 12345.6789 xval=12345.6789 System.sigDigitsL=-3 System.sigDigitsU=3 xval= 12345.6789 xval=12345.6789 SYSTEM.NUMERIC.NUMDECDIGITS=3 In version 8.0, this would return the correct number of decimals ie: 3 decimal places, I can set this in the options also, and cahnge it to decimal places or significant digits, but there is no change in the numerical output precision. However, If I use the following xval=123.456789; type "xval= $(xval)"; xval=; type; /// xval=; type "xval= $(xval, %3.3f)"; type "xval= $(xval, %3d)"; type "xval= $(xval, *6)"; type "xval= $(xval, .3)"; it returns: xval= 123.456789 xval=123.456789 xval=123.456789 xval= 123.457 xval= 123 xval= 123.457 xval= 123.457 which is the correct decimal places or significant digits I would like to know if this is a bug or am i using this wrong, as indicated it would work in V8.0 by setting the SYSTEM.NUMERIC.NUMDECDIGITS to the required precision. Note that these the changes in the system variables is reflected in the options dialog box after the code is ran. So it is seeing these values it just is not applying them. I can use the 'C' formatting method as indicated in the second lot of code above but it requires a rewrite of my existing prorams, when all I had to do before was set the system variable. thanks Andrew [/quote]   Check here to include your profile signature. Check here to subscribe to this topic.