Multi job runner + SDK main macro#346
Merged
Merged
Conversation
tbraun96
force-pushed
the
multi-job-runner
branch
from
09a7e1f to
2026675
Compare
Serial-ATA
reviewed
Oct 15, 2024
| gadget_sdk::logging::setup_log(); | ||
| // Load the environment and create the gadget runner | ||
| let config: gadget_sdk::config::ContextConfig = gadget_sdk::structopt::StructOpt::from_args(); | ||
| let env = gadget_sdk::config::load(config.clone()).expect("Failed to load environment"); |
Contributor
There was a problem hiding this comment.
Why is there an optional env parameter to sdk::main? Is there a situation where you wouldn't want one? It gets loaded here anyway.
Being able to rename it would also be nice: #[sdk::main(env = my_env)]
Move autogen struct construction into single location
tbraun96
force-pushed
the
multi-job-runner
branch
from
eab6d0f to
5cb9074
Compare
drewstone
reviewed
Oct 16, 2024
Contributor
|
CI also failing here still @tbraun96 |
Serial-ATA
reviewed
Oct 16, 2024
drewstone
added a commit
that referenced
this pull request
Oct 19, 2024
* chore: bump rustdoc-types (#348) Also pin to the latest nightly * fix: load substrate signer from env correctly (#349) * fix: add `data_dir` back to `GadgetConfiguration` (#350) It was (mistakenly?) removed in #333. Went ahead and added a default path for blueprint manager as well. * Multi job runner + SDK main macro (#346) * feat: use aggregator and separate out from the blueprint job * fix: uncomment generate_json (#358) * fix: updates using aggregator * fix: solve registry error in aggregator * fix: prevent duplicates * fix: got test working * fix: fmt and clippy cleanup * feat(cli): support custom repo and path sources (#360) * feat: added test in eigen IS blueprint, cleaned up testing code for it * Event Workflows (phase 1: Custom listeners) (#359) * Add wrapper types + trait structure to enforce structure for event flows * Decoupling/refactor and ensure integration test passes * periodic web poller working and further refactor of macro code * Everything compiling, integration test passes * fix(sdk)!: downgrade substrate dependencies for now It's currently impossible to use some APIs downstream, since they expose `sp_core` (v0.34.0) types instead of the `sdk::keystore::sp_core_subxt` (v0.31.0) types. Cargo will refuse to build blueprints using them. I just got rid of the `sdk::keystore::sp_core_subxt` hack and downgraded all of the dependencies necessary (I think). This won't be an issue once #318 is taken care of. * feat(sdk): re-export `libp2p` --------- Co-authored-by: Alex <69764315+Serial-ATA@users.noreply.github.com> Co-authored-by: Thomas Braun <38082993+tbraun96@users.noreply.github.com> Co-authored-by: Tjemmmic <mdtjemmes@proton.me>
drewstone
added a commit
that referenced
this pull request
Oct 23, 2024
* feat: add eigenlayer context * merge: combine context and proc macro tests * fix: removing unused code and fixing test * fix: move static vars to the lib * fix: move static vars to the lib * chore: debug * fix: lint and fmt to keep things clean * chore: add logging for debugging * fix: identified issue * fix: start on proc macro for abi grabbing * fix: compiles and deploys tasks, event listener not firing * chore: separate event listener files out * fix: spelling and blocks to mine * fix: more logging * chore: remove logs, evm event listener is broke * fix: remove one loop from event listening flow, polling seems to work, event catching not * Fix: Got back to original signing bug * Fix: Fixed address change - back to signature invalid revert * Fix: Correctly pulls task index from events * fix: use EL convert to g1/g2 point * Use incredible squaring aggregator (#364) * chore: bump rustdoc-types (#348) Also pin to the latest nightly * fix: load substrate signer from env correctly (#349) * fix: add `data_dir` back to `GadgetConfiguration` (#350) It was (mistakenly?) removed in #333. Went ahead and added a default path for blueprint manager as well. * Multi job runner + SDK main macro (#346) * feat: use aggregator and separate out from the blueprint job * fix: uncomment generate_json (#358) * fix: updates using aggregator * fix: solve registry error in aggregator * fix: prevent duplicates * fix: got test working * fix: fmt and clippy cleanup * feat(cli): support custom repo and path sources (#360) * feat: added test in eigen IS blueprint, cleaned up testing code for it * Event Workflows (phase 1: Custom listeners) (#359) * Add wrapper types + trait structure to enforce structure for event flows * Decoupling/refactor and ensure integration test passes * periodic web poller working and further refactor of macro code * Everything compiling, integration test passes * fix(sdk)!: downgrade substrate dependencies for now It's currently impossible to use some APIs downstream, since they expose `sp_core` (v0.34.0) types instead of the `sdk::keystore::sp_core_subxt` (v0.31.0) types. Cargo will refuse to build blueprints using them. I just got rid of the `sdk::keystore::sp_core_subxt` hack and downgraded all of the dependencies necessary (I think). This won't be an issue once #318 is taken care of. * feat(sdk): re-export `libp2p` --------- Co-authored-by: Alex <69764315+Serial-ATA@users.noreply.github.com> Co-authored-by: Thomas Braun <38082993+tbraun96@users.noreply.github.com> Co-authored-by: Tjemmmic <mdtjemmes@proton.me> * fix: remappings out of date * fix: remove eigenlayer-middleware from tangle blueprint git modules * chore: close handles once test completes, rpc server still not shutting down * fix: remove broken invalid test cases * fix: proc macro doc fixes to avoid more maintenance --------- Co-authored-by: Tjemmmic <mdtjemmes@proton.me> Co-authored-by: Alex <69764315+Serial-ATA@users.noreply.github.com> Co-authored-by: Thomas Braun <38082993+tbraun96@users.noreply.github.com>
drewstone
added a commit
that referenced
this pull request
Oct 25, 2024
* feat: add eigenlayer context * merge: combine context and proc macro tests * fix: removing unused code and fixing test * fix: move static vars to the lib * fix: move static vars to the lib * chore: debug * fix: lint and fmt to keep things clean * chore: add logging for debugging * fix: identified issue * fix: start on proc macro for abi grabbing * fix: compiles and deploys tasks, event listener not firing * chore: separate event listener files out * fix: spelling and blocks to mine * fix: more logging * chore: remove logs, evm event listener is broke * fix: remove one loop from event listening flow, polling seems to work, event catching not * Fix: Got back to original signing bug * Fix: Fixed address change - back to signature invalid revert * Fix: Correctly pulls task index from events * fix: use EL convert to g1/g2 point * feat: use aggregator and separate out from the blueprint job * fix: updates using aggregator * fix: solve registry error in aggregator * fix: prevent duplicates * fix: got test working * fix: fmt and clippy cleanup * feat: added test in eigen IS blueprint, cleaned up testing code for it * feat: convert aggregator process_new_jobs to blueprint * Use incredible squaring aggregator (#364) * chore: bump rustdoc-types (#348) Also pin to the latest nightly * fix: load substrate signer from env correctly (#349) * fix: add `data_dir` back to `GadgetConfiguration` (#350) It was (mistakenly?) removed in #333. Went ahead and added a default path for blueprint manager as well. * Multi job runner + SDK main macro (#346) * feat: use aggregator and separate out from the blueprint job * fix: uncomment generate_json (#358) * fix: updates using aggregator * fix: solve registry error in aggregator * fix: prevent duplicates * fix: got test working * fix: fmt and clippy cleanup * feat(cli): support custom repo and path sources (#360) * feat: added test in eigen IS blueprint, cleaned up testing code for it * Event Workflows (phase 1: Custom listeners) (#359) * Add wrapper types + trait structure to enforce structure for event flows * Decoupling/refactor and ensure integration test passes * periodic web poller working and further refactor of macro code * Everything compiling, integration test passes * fix(sdk)!: downgrade substrate dependencies for now It's currently impossible to use some APIs downstream, since they expose `sp_core` (v0.34.0) types instead of the `sdk::keystore::sp_core_subxt` (v0.31.0) types. Cargo will refuse to build blueprints using them. I just got rid of the `sdk::keystore::sp_core_subxt` hack and downgraded all of the dependencies necessary (I think). This won't be an issue once #318 is taken care of. * feat(sdk): re-export `libp2p` --------- Co-authored-by: Alex <69764315+Serial-ATA@users.noreply.github.com> Co-authored-by: Thomas Braun <38082993+tbraun96@users.noreply.github.com> Co-authored-by: Tjemmmic <mdtjemmes@proton.me> * fix: merge fix-el branch * feat: use aggregator blueprint * fix: remappings out of date * fix: remove eigenlayer-middleware from tangle blueprint git modules * chore: close handles once test completes, rpc server still not shutting down * fix: remove broken invalid test cases * fix: proc macro doc fixes to avoid more maintenance * chore: merge main * fix: move helpers to separate file * fix: moving helpers along w/ eigenlayer context * fix: get both blueprints running * fix: expose addresses better * feat: test exits successfully and all pieces work seamlessly * fix: add helper * fix: clippy and fmt * fix: context derive test * fix: context derive test --------- Co-authored-by: Tjemmmic <mdtjemmes@proton.me> Co-authored-by: Alex <69764315+Serial-ATA@users.noreply.github.com> Co-authored-by: Thomas Braun <38082993+tbraun96@users.noreply.github.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
No description provided.