Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Feature] Enable experiment modification #16

Open
4 tasks
Tracked by #15
Joshuaalbert opened this issue Aug 2, 2023 · 0 comments
Open
4 tasks
Tracked by #15

[Feature] Enable experiment modification #16

Joshuaalbert opened this issue Aug 2, 2023 · 0 comments

Comments

@Joshuaalbert
Copy link
Owner

Joshuaalbert commented Aug 2, 2023

It's currently impossible to change an experiment once created. However, this is often necessary in evolving situations, e.g. as new data becomes available. We can adopt an opportunistic strategy.

Solution we'd like

  • Enable adding new parameters
  • Enable changing existing parameters
    Note when a parameter changes, we may not be able to interpret trials anymore. In these cases, these trials remain but get isolated as in violation and do not contribute to analysis. In this case, we need to be able to:
  • Count valid trials, instead of len of trial map.
  • Be able to determine trial validity, viz determine parameter and parameter value validity.
@Joshuaalbert Joshuaalbert changed the title Enable experiment modification to change bounds. [Feature] Enable experiment modification Aug 2, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant