Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Data Perf Beta [May 4th] #227

Open
bitfort opened this issue Mar 30, 2022 · 2 comments
Open

Data Perf Beta [May 4th] #227

bitfort opened this issue Mar 30, 2022 · 2 comments
Projects
DataPerf / DynaBench / MLCube integra...
Milestone
DataPerf Beta

Comments

@bitfort
Copy link

bitfort commented Mar 30, 2022

No description provided.

@bitfort bitfort created this issue from a note in DataPerf / DynaBench / MLCube integration (To do) Mar 30, 2022
@bitfort bitfort added this to the DataPerf Beta milestone Mar 30, 2022
@relja128
Copy link

relja128 commented Apr 6, 2022

  • Containerized the benchmarks from Alpha
  • Containers have to be runnable at home and on DynaBench 2.0. DB2.0 may not be ready by this point, but containers should be aligned with DB2.0 efforts
  • Needs to run on top of MLCube
  • [Nice to have] Users should be able to submit scores and have them show up on DynaBench. This may not be the focus of this taskforce, but the people involved will likely work on this

@relja128
Copy link

relja128 commented May 4, 2022

We didn't have external participants, Colby will test manually.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
DataPerf / DynaBench / MLCube integra...
In progress
Milestone
DataPerf Beta
Development

No branches or pull requests
2 participants
@bitfort @relja128