The Origin Forum
File Exchange
Try Origin for Free
The Origin Forum
Home | Profile | Register | Active Topics | Members | Search | FAQ | Send File to Tech support
Username:
 Password:
Save Password
Forgot your Password? | Admin Options

 All Forums
 Origin Forum for Programming
 Forum for Origin C
 Too may digits returned with atof		  New Topic  Reply to Topic
 Printer Friendly
Author Previous Topic Topic Next Topic Lock Topic Edit Topic Delete Topic New Topic Reply to Topic

peter.cook

UK
356 Posts
Posted - 03/03/2006 :  4:15:13 PM  Show Profile  Edit Topic  Reply with Quote  View user's IP address  Delete Topic
Origin Version (Select Help-->About Origin): 7.5 SR5
Operating System: Win2000

Hi,

Using an external C++ dll I have eg

(eg dValue = 65.23456)

sprintf(Numchar,"%.2f",dValue);
dValue=atof(Numchar);

my problem is that Numchar may be represented by eg '65.23' but after atof dValue may occasionally end up as eg 65.2300000001.

Similarly I can get eg 98.89999999999 from 98.9

Any hints as to how to avoid this 'precision' problem?

Thanks,

Cheers,

Pete
  Previous Topic Topic Next Topic Lock Topic Edit Topic Delete Topic New Topic Reply to Topic
 New Topic  Reply to Topic
 Printer Friendly
Jump To:
The Origin Forum © 2020 Originlab Corporation Go To Top Of Page
Snitz Forums 2000