Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate and improve constraint_connection_flow_capacity_indices #925

Open
abelsiqueira opened this issue Mar 7, 2024 · 2 comments
Open
Labels
Type: improvement Improve something that already exists Zone: model implementation How the formulation is implemented in code

Comments

@abelsiqueira
Copy link
Contributor

@suvayu and I ran the example included in #896 with log_level=3 and the largest memory hog is constraint_connection_flow_capacity. Looking into the profile, the function constraint_connection_flow_capacity_indices seems to be one of the main culprits - which aligns with what @manuelma and @Tasqu found out some time ago.

Running

m = run_spineopt(url_in, url_out)
@time v = SpineOpt.constraint_connection_flow_capacity_indices(m) |> collect

reports a 4.431 GB memory use for a sizeof(v) = 17385984 (~17 MB) object, so we think this and other similar functions are a good place to start exploring and improving.

@manuelma, @Tasqu, are you working on this? How can we coordinate this to avoid duplicating work?

@clizbe clizbe added Zone: model implementation How the formulation is implemented in code Type: improvement Improve something that already exists labels Mar 8, 2024
@Tasqu
Copy link
Collaborator

Tasqu commented Mar 11, 2024

@abelsiqueira at the moment, I'm not working on actively on SpineOpt at all. I'm busy with other project work in the foreseeable future.

@manuelma
Copy link
Collaborator

@abelsiqueira I think it's safe to go ahead, no need for coordination from my part at this point. Good luck!

@Tasqu Tasqu mentioned this issue Mar 14, 2024
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Type: improvement Improve something that already exists Zone: model implementation How the formulation is implemented in code
Projects
None yet
Development

No branches or pull requests

4 participants