Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

A ready to use example: generate polymer and run simulation #5

Open
wants to merge 11 commits into
base: master
Choose a base branch
from

Conversation

Roy-Kid
Copy link
Contributor

@Roy-Kid Roy-Kid commented Mar 4, 2024

No description provided.

Copy link
Collaborator

@skrawcz skrawcz Mar 5, 2024

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You want to use CMDLineExecutionManager as the execution manager -- like I'm doing here https://github.com/DAGWorks-Inc/hamilton/blob/d3c08a5a65413f11609917a452680d8624f52563/examples/cmdline_orchestrator/run.py. And I suggest using multithreading rather then multiprocessing.

Right now it relies on a tag cmdline to be on the function. We could instead set a property on the decorated functions or something to check for. But this will enable things to run in parallel, because they will be sent over to the remote executor to run.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants