NORM1 is a float, but

IWETHEY v. 0.3.0 | TODO

1,095 registered users | 0 active users | 0 LpH | Statistics
Login | Create New User

Welcome to IWETHEY!

Post #129,880

by jb4

12/9/03 2:33:27 PM

NORM1 is a float, but

everything on the right of the equal sign is an int (actually, a 32 bit signed value. So all this stuff:

(m * ((4 * m * m) - 1) * (2 * m + 3) * (m + 1) / 3)

is being calculated int he integer domain, then is (implicitly) casted to float by the = operator. That's why "it's being treated as an integer and overflowing."

HTH

jb4
"There are two ways for you to have lower Prescription-drug costs. One is you could hire Rush Limbaugh's housekeeper ... or you can elect me President."
John Kerry

Post #129,890

by Another Scott

12/9/03 2:41:18 PM

Thanks!

I'm not used to worrying about such things. I appreciate the info!

Cheers,
Scott.

Newbie C++ Builder problem with overflow. - (Another Scott) - (25) - Dec. 8, 2003, 10:04:54 AM EST

Re: Newbie C++ Builder problem with overflow. - (deSitter) - (19) - Dec. 8, 2003, 10:28:17 AM EST

Second paragraph in deS msg explains it - (Arkadiy) - (1) - Dec. 8, 2003, 10:59:38 AM EST

Thanks! That did it. - (Another Scott) - Dec. 8, 2003, 11:05:23 AM EST

You're speaking over my head. - (Another Scott) - (16) - Dec. 8, 2003, 11:03:45 AM EST

Re: You're speaking over my head. - (deSitter) - (15) - Dec. 8, 2003, 11:33:39 AM EST

Thanks for the tips. Greatly appreciated. -NT - (Another Scott) - Dec. 8, 2003, 01:19:00 PM EST

Actually, Ross... - (jb4) - (13) - Dec. 9, 2003, 02:36:10 PM EST

Re: Actually, Ross... - (deSitter) - (12) - Dec. 9, 2003, 03:34:17 PM EST

Hrm? - (jb4) - (11) - Dec. 9, 2003, 04:40:26 PM EST

Re: Hrm? - (deSitter) - (10) - Dec. 9, 2003, 06:27:16 PM EST

So what iron is that running on? - (jb4) - (9) - Dec. 10, 2003, 01:59:06 PM EST

Re: So what iron is that running on? - (deSitter) - Dec. 10, 2003, 02:56:53 PM EST

Also 12 on HPQ Presario 5831 (500 MHz Athlon)/gcc 2.95.4 -NT - (scoenye) - (7) - Dec. 10, 2003, 05:01:56 PM EST

Re: Also 12 on HPQ Presario 5831 (500 MHz Athlon)/gcc 2.95.4 - (jb4) - (6) - Dec. 10, 2003, 05:08:44 PM EST

Re: Also 12 on HPQ Presario 5831 (500 MHz Athlon)/gcc 2.95.4 - (deSitter) - (5) - Dec. 10, 2003, 06:02:45 PM EST

Sorry Ross: No Sale - (jb4) - (2) - Dec. 10, 2003, 06:42:47 PM EST

Re: Sorry Ross: No Sale - (deSitter) - (1) - Dec. 10, 2003, 08:43:13 PM EST

Please stand by... - (jb4) - Dec. 12, 2003, 06:14:33 PM EST

Doesn't compile here - (pwhysall) - (1) - Dec. 13, 2003, 01:35:08 AM EST

Gotta add -lm for math library -NT - (deSitter) - Dec. 13, 2003, 12:37:09 PM EST

Somewhat related: Borland Builder-IDE "style" issue. - (CRConrad) - (2) - Dec. 9, 2003, 05:58:54 AM EST

Well, I'm trying to reuse some earlier code. - (Another Scott) - Dec. 9, 2003, 09:46:50 AM EST

Dude.... - (jb4) - Dec. 9, 2003, 02:36:55 PM EST

NORM1 is a float, but - (jb4) - (1) - Dec. 9, 2003, 02:33:27 PM EST

Thanks! - (Another Scott) - Dec. 9, 2003, 02:41:18 PM EST

iwethey.org

I KNOW I shouldn’t think about it, I’ll scare myself to death but after seventeen hours in the air, I can’t get the worst case scenario out of my head.

No, not a plane crash. I’m convinced that I am breathing more farts than air.
266 ms