jmp-l
[Top] [All Lists]

jmp incorrectly calculates mean

To: jmp-l@lists.biostat.wustl.edu
Subject: jmp incorrectly calculates mean
From: Ronald Cross <roncross@cox.net>
Date: Tue, 27 Dec 2005 22:18:29 -0800
Hi all, I am using JMP 4.0.4 for mac running a G4 powerbook with 1GByte of RAM with a 1GHz power pc processor on OS X 10.4.3. However, this version of jmp runs under OS 9 (classic). I have noticed that when I do a fit y by x plot and display the mean and standard deviation, it incorrectly calculate the mean of each level where y is continuous, numeric and x in nominal. It appears to be a round off error of some sort. For example, when I use table summary on the same data, the mean will be roughly 1.4, but in the mean and std dev display of the fit y by x plot, it appears as a 1 and have a std dev of 0. Std dev is 0 for all levels since all numbers are rounded off to the same whole number.

I have look in the column info section of the data column and best is selected as the format. It doesn't occur for all columns and I am not sure why I am seeing it on some columns and not others.

Any ideas on solving this would be appreciated.

thx
RLC

<Prev in Thread] Current Thread [Next in Thread>