Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Confidence intervals should respect bounds #30

Open
nhejazi opened this issue Feb 4, 2018 · 2 comments
Open

Confidence intervals should respect bounds #30

nhejazi opened this issue Feb 4, 2018 · 2 comments
Assignees
Labels

Comments

@nhejazi
Copy link
Collaborator

nhejazi commented Feb 4, 2018

Construction of Wald-style confidence intervals (as done in confint.survtmle) may require some adjustment, as it is possible for the routine to produce intervals that cross zero. This appears to be in conflict with the concept/definition of cumulative incidence, which is lower bounded by zero (right? @benkeser). In the README example, this does not appear to be a problem for confint.survtmle as this generates an interval around only the cumulative incidence estimate at the last time point; however, when the same approach is applied to earlier time points (as in the new routine confint.tp.survtmle), negative values may arise. Of course, a quick fix is to simply replace such values with zero, but this then leads to uneven intervals, which are possibly theoretically problematic. There likely are some relevant theoretical insights that I am neglecting here as well as options for correcting this behavior if it is indeed undesirable (e.g., confidence intervals for non-negative random quantities).

@benkeser
Copy link
Owner

benkeser commented Feb 5, 2018

The easiest solution is to construct confidence intervals on the logit scale and back-transform, i.e.,
$ expit(logit(\hat{F}) \pm 1.96 * \hat{se}(logit(\hat{F}))) $ ,
where $\hat{se}(logit(\hat{F}))$ is the estimated standard error of $logit(\hat{F})$, computed using the delta method. There may be an example of this in the drtmle vignette -- I can't remember.

@nhejazi
Copy link
Collaborator Author

nhejazi commented Feb 14, 2018

Looks like there's some explanation and an implementation here in the drtmle vignette: https://benkeser.github.io/drtmle/articles/using_drtmle.html#confidence-intervals. Would be best to complete the initial confidence interval estimation implementation as well as extensions of this implementation for arbitrary contrasts ASAP, so as to avoid holding up a CRAN re-release.

@nhejazi nhejazi changed the title Confidence intervals don't respect bounds Confidence intervals should respect bounds Feb 14, 2018
@nhejazi nhejazi self-assigned this Apr 13, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Projects
None yet
Development

No branches or pull requests

2 participants