 |
 | Home | Contact Us | FAQ | Search & Site Map | Link to Us |
 | Sign In | Join | Other 45 Sites in Network |
VB Forum / General 2 / November 2006debug.print 183 - 173.55
i have visual basig 6 if i type in the debug window it gives me a strange result debug.print 183 - 173.55 9.44999999999999 why this result instead of 9.45 the same is happening if i do a = 183 b = 173.55 c = a-b debug.print c if i do 183 - 174.55 or 183 - 180.55 the same strange thing happen. ( with .449999999 instead of .45 )why and how to avoid this? if you try this with windows standard calculator it gives the right answer. ty >i have visual basig 6 > [quoted text clipped - 4 lines] > > why this result instead of 9.45 This question is as old as floating point math itself > if you try this with windows standard calculator it gives the right > answer. The Calculator knows how to work with floating point numbers. Weird floating point problem http://groups.google.com.my/group/microsoft.public.vb.general.discussion/msg/74b 7abbe3645bd1b  SignatureKen Halter - MS-MVP-VB - Please keep all discussions in the groups.. In Loving Memory - http://www.vbsight.com/Remembrance.htm hmm strange problem , i didnt knew about that, i solved the problem using the round function round(c,2) , ty. > >i have visual basig 6 > > [quoted text clipped - 13 lines] > > Weird floating point problem http://groups.google.com.my/group/microsoft.public.vb.general.discussion/msg /74b7abbe3645bd1b > -- > Ken Halter - MS-MVP-VB - Please keep all discussions in the groups.. > In Loving Memory - http://www.vbsight.com/Remembrance.htm If you're doing this in VB instead of via a query, you can also force this to a Currency data type through a variety of methods...the simplest one (to use your example) is: debug.print 183@ - 173.55@ (Technically only one of the @'s is needed, but it's best to be thorough.) If you don't mind fairly slow code, you can also use the Decimal data type: debug.print CDec(183) - CDec(173.55) Rob > hmm strange problem , i didnt knew about that, i solved the problem using > the round function round(c,2) , ty. [quoted text clipped - 23 lines] >> Ken Halter - MS-MVP-VB - Please keep all discussions in the groups.. >> In Loving Memory - http://www.vbsight.com/Remembrance.htm > If you're doing this in VB instead of via a query, you can also force this Sorry about the reference to a query...most of my groups are Access groups and I hadn't clued in that I was now in the realms of VB only. :) Rob |
Reply to this Message |
 Sign In
 Join
 My Latest Posts My Monitored Threads My Blog My Photo Gallery My Profile My Homepage Start New Thread Enable EMail Alerts Rate this Thread
|
©2009 Advenet LLC Privacy Policy - Terms of Use
This website includes both content owned or controlled by Advenet as well as content owned or controlled by third parties.