s-news
[Top] [All Lists]

Re: NLS r-squared

To: "Tim Hesterberg" <timh@insightful.com>
Subject: Re: NLS r-squared
From: "Douglas Bates" <bates@stat.wisc.edu>
Date: Wed, 26 Dec 2007 09:50:34 -0600
Cc: "Monroe, Dean" <dean.monroe@okstate.edu>, s-news@lists.biostat.wustl.edu
Dkim-signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=gamma; h=domainkey-signature:received:received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; bh=wAv9MWM7uTE+Mf9GVV6CgH718Nlas1lYkYASRvK0250=; b=d5RJo+n2FDAmVVo0gCRiUciL0K2j0xDcMxR3pmKsg2gFS8/pKl3XWESASoBfMec1btnQYOpd342lEOnCaGpWiYD8yZmBjP9G3xRrhaoNO+4viU1b+9k6o4qcfMH5lIFWuvaxONVlDnTirzk3hB2lFth6KalHV0Bz3nFf0ICin2M=
Domainkey-signature: a=rsa-sha1; c=nofws; d=gmail.com; s=gamma; h=message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=tkZKJEs/gTSGtd5p70zuTMcFyzaExFVDETpaChmc7HG626oSB3kT49EAu97E4+5HwRjVP1xLHqm53t78zvSvS9vPITmrxXSpEvm28TJx8qLe8VcNsWKgv00qsirXxR9/Uo7kozLW/IXhV4U23Vv8+TOxmdo0rUpLLQuqQ7M2pNU=
In-reply-to: <ulk7pw5ix.fsf@insightful.com>
References: <52947139674D104092570C35D355F65C1661C7@EXE3.ad.okstate.edu> <ulk7pw5ix.fsf@insightful.com>
On Dec 20, 2007 1:05 PM, Tim Hesterberg <timh@insightful.com> wrote:
> >I have ran into a situation with an editor: he decidedly wants an
> >R-squared value for one of my Non-linear regression trials.  It was
> >my understanding that r-squared was not suited for non-linear
> >reporting, plus it is not reported in splus.
>
> It would be appropriate to report R^2, as a descriptive measure of
> goodness of fit of the regression.

You would need to be careful about the definition of R^2.  If the
constant model is not contained in the nonlinear model then the
definition of R^2 given below is not appropriate.  This does happen
for many nonlinear regression models, including many pharmacokinetic
models, such as the SSfol (self-starting first-order elimination with
logarithms of rate constants) model.  These models cannot be reduced
to an arbitrary constant, even in the limit as one or more of the
parameters goes to +/- infinity.  In these cases the  only sensible
definition of R^2 would be relative to the model in which all the
fitted values are zero (similar to the case of R^2 in a linear
regression model without an intercept term).  It was because it is not
easy (if, indeed, it is possible at all) to distinguish such cases,
that John Chambers and I did not include an R^2 value in the original
version of the nls summary written for S many years ago.

> Be careful about using the R^2 in a hypothesis test for significance
> of the regression - the distribution of the R^2 statistic in nonlinear
> regression may not be the same as in linear regression.
>
> >I have been using r^2= 1- (sse/sst) is this a suitable method for NLS?
>
> That gives raw R^2.
>
> It would be better to report an adjusted R^2, adjusted using the estimated
> degrees of freedom of the nonlinear regression or smoother.

<Prev in Thread] Current Thread [Next in Thread>