Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Spreadsheet view refactor to use @mui/x-data-grid component and volatile storage #4047

Draft
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

cmdcolin
Copy link
Collaborator

@cmdcolin cmdcolin commented Nov 6, 2023

Currently, the spreadsheet view stores all data in the mobx-state-tree. This has a small convenience, but it lags very strongly for any reasonably sized data file loaded into it. A 33Mb VCF takes slows down a lot, taking up a lot of memory (which is a known issue mobxjs/mobx-state-tree#1683). This PR changes to loading directly from a volatile. With this PR, it loads the 33Mb VCF almost very fast, and takes up much less memory

There will require work to make this attain feature parity with existing spreadsheet view, but I believe it will be a valuable change

@github-actions github-actions bot added the needs label triage Needs a label to show in changelog (breaking, enhancement, bug, documentation, or internal) label Nov 6, 2023
@cmdcolin cmdcolin added enhancement New feature or request and removed needs label triage Needs a label to show in changelog (breaking, enhancement, bug, documentation, or internal) labels Nov 6, 2023
@cmdcolin cmdcolin marked this pull request as draft November 6, 2023 14:51
@cmdcolin
Copy link
Collaborator Author

cmdcolin commented Nov 6, 2023

possible alternative: leave the existing spreadsheet view as-is to avoid any breaking behavior, and make this a new view type, however, then we have two things for ongoing maintenance

@cmdcolin
Copy link
Collaborator Author

cmdcolin commented Nov 6, 2023

small bonus endeavor: adding #788 splitting out VCF INFO column into multiple filterable/sortable columns

screenshot shows this
image

@cmdcolin cmdcolin force-pushed the spreadsheetview_volatile branch 2 times, most recently from 83c55ee to f7dd8e3 Compare December 3, 2023 15:22
@cmdcolin cmdcolin force-pushed the spreadsheetview_volatile branch 2 times, most recently from 8e1da47 to 7f7c6f8 Compare December 13, 2023 19:19
@cmdcolin cmdcolin force-pushed the spreadsheetview_volatile branch 2 times, most recently from dd4d2f9 to dbe6b86 Compare February 21, 2024 19:50
@cmdcolin cmdcolin force-pushed the spreadsheetview_volatile branch 2 times, most recently from 66f78f6 to cae4f0e Compare March 14, 2024 17:48
Remove

[skip ci] Volatile

[skip ci] Parse out INFO field

[skip ci] Misc

Misc

Restyling

Refactoring

More misc

Misc

Misc

Misc

Misc

New

Refname renaming fix for breakpoint split view

Breakpoint split view

Misc

[skip ci] Refactors

Use 7.0.0

Updates

Misc

Misc
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

1 participant