s-news
[Top] [All Lists]

Re: SD for MLE

To: Ping Zhang <pingzhang@avaya.com>
Subject: Re: SD for MLE
From: Sundar Dorai-Raj <sundar.dorai-raj@PDF.COM>
Date: Wed, 20 Oct 2004 07:56:34 -0700
Cc: s-news@lists.biostat.wustl.edu
In-reply-to: <1098282561.1181.7.camel@pzhang-pcl.research.avayalabs.com>
Organization: PDF Solutions, Inc.
References: <1098282561.1181.7.camel@pzhang-pcl.research.avayalabs.com>
Reply-to: sundar.dorai-raj@PDF.COM
User-agent: Mozilla/5.0 (Windows; U; Windows NT 5.0; en-US; rv:1.4) Gecko/20030624 Netscape/7.1 (ax)


Ping Zhang wrote:
I wonder if anyone out there could either your wisdom or experience about the following:

If I had to calculate MLE using generic optimization algorithms, what does one usually do with calculating standard errors? I know we could do bootstrap or jackknife. Or if one is brave enough, one could derive the 2nd order derivatives and start from there, i.e. SE = ( -L2 )^{-1}, where L2 is the 2nd order derivative. Can't we use (L'L)^{-1} instead, where L is the 1st order derivative? Any general suggestions?



Which "generic optimization algorithms" are you using? Both nlminb and optim from MASS will provide the hessian. The latter will even provide the hessian when the analytical gradients are not provided. Then the inverse of the hessian gives you the covariance matrix provided you are minimising a -logLik.

--sundar


<Prev in Thread] Current Thread [Next in Thread>
  • SD for MLE, Ping Zhang
    • Re: SD for MLE, Sundar Dorai-Raj <=