[feat] adds simulation to block loop #71

dylanlott · 2025-04-15T19:36:49Z

[feat] adds simulation to block loop

This PR adds simulation to the block builder loop.

Updates the builder to use a SlotCalculator for managing slot timings.
Removes the tx and bundle poller from the block builder and instead leans into the actor model and feeds them in via channels to the simulation process.
This PR relies on the signet-sdk Sim Crate PR

Configuration

Deploying this PR will require additional environment variables to be set

CONCURRENCY_LIMIT to limit how many concurrent simulations the block builder runs.
START_TIMESTAMP to set the starting timestamp of the chain for anchoring slot calculation.

Testing

This code is still being tested before final merge.

The current test plan is to

Build a Docker image of the builder with this branch
Update environment variables to include the above values
Deploy the test image to Pecorino
Add a bundle to the cache and see if it is picked up
See what, if any, errors spring up
Land blocks and see that the block building rate is not decreased with new timing updates

- shifts the tx-poller to a more actor oriented approach by streaming transactions out of the cache. - transaction deduplication and validation is intended to be carried out by the simulator.

- improves poll interval handling - removes arcs - updates comments - adds file level comment

* fix: break loop on closure and improve tracing * refactor: break out the task future

- improves poll interval handling - cleans up and updates comments - removes arc usage

- adds init4 metrics - updates provider types to account for alloy changes

- align to alloy @ 0.12.6 - transfer off of zenith-rs and use signet-sdk instead

dylanlott · 2025-04-15T19:39:59Z

chore: refactor test utils #72
[feat] adds simulation to block loop #71 👈 (View in Graphite)
main

This stack of pull requests is managed by Graphite. Learn more about stacking.

src/consts.rs

src/config.rs

bin/builder.rs

src/config.rs

src/tasks/block.rs

prestwich · 2025-04-30T13:54:11Z

src/tasks/block.rs

+    ///
+    /// An `Instant` representing the deadline.
+    pub fn calculate_deadline(&self) -> Instant {
+        let now = SystemTime::now();


i don't like that we're constantly mixing timestamps and Duration/Instant. it makes it very hard to reason about the logic. cc @anna-carroll can we add more convenience functions to SlotCalculator to make these easier? what are the common actions we want to take using a calculator?

Created ENG-1019 to capture this.

src/tasks/block.rs

src/test_utils.rs

- sets the builder main function to use multi-threaded runtime - this allows us to avoid a potential panic and enables a safe `unwrap`

Cargo.toml

prestwich · 2025-05-06T16:25:31Z

src/tasks/block.rs

+                BASEFEE_DEFAULT
+            }
+        };
+        tracing::debug!(basefee = basefee, "setting basefee");


nit don't need the = unless you're modifying something:
debug!(basefee, "setting basefee");

prestwich · 2025-05-06T16:26:15Z

src/tasks/block.rs

-    }
+/// Different error types that the Simulator handles
+#[derive(Debug, Error)]
+pub enum SimulatorError {


type seems unnecessary for now?

prestwich

i think we should merge this today and then iterate

dylanlott and others added 15 commits April 3, 2025 09:45

updates the tx-poller to stream transactions

ef6b734

- shifts the tx-poller to a more actor oriented approach by streaming transactions out of the cache. - transaction deduplication and validation is intended to be carried out by the simulator.

refactors

1ad6e14

- improves poll interval handling - removes arcs - updates comments - adds file level comment

Fix: various updates to the tx poller (#67)

b5a5cf4

* fix: break loop on closure and improve tracing * refactor: break out the task future

updates bundler to streaming actor pattern

3117b85

refactors

96dce04

- improves poll interval handling - cleans up and updates comments - removes arc usage

fmt

5cfbdc9

fix: remove eq/partial eq

c4522ee

fix: various improvements to bundler tasks (#68)

01a11e6

chore: update to alloy@0.11

6374238

- adds init4 metrics - updates provider types to account for alloy changes

refactors to account for init4 bin base in builder craate

b1324b0

use signet-sdk

976dd03

- align to alloy @ 0.12.6 - transfer off of zenith-rs and use signet-sdk instead

fix: update bin-base import

b229996

nits: doc updates

bafe07f

lint: fmt

e0c79f7

feat: implements simulation for block building

785172b

dylanlott self-assigned this Apr 15, 2025

dylanlott added 5 commits April 15, 2025 13:40

lint: fmt

ff5cb31

cleanup

a142314

WIP: adding a block builder loop test

9d812ce

tests are passing now

bf75913

adds slot calculator to block builder

55b2193

dylanlott mentioned this pull request Apr 19, 2025

chore: refactor test utils #72

Closed

dylanlott added 2 commits April 18, 2025 20:37

refactors test utils across tasks

fd4bdcd

fmt

dd4b377

dylanlott force-pushed the dylan/sim-impl branch from ac4bbb1 to 47a2ed7 Compare April 19, 2025 03:09

fixup clippy and fmt

1ee991f

dylanlott force-pushed the dylan/sim-impl branch from 47a2ed7 to 1ee991f Compare April 19, 2025 03:13

dylanlott added 2 commits April 18, 2025 21:19

update cargo paths to sdk

50162b7

mark block builder test as integration test

14a0a62

creates mod consts

8980e23

Evalir reviewed Apr 29, 2025

View reviewed changes

src/consts.rs Outdated Show resolved Hide resolved

src/config.rs Outdated Show resolved Hide resolved

dylanlott added 2 commits April 29, 2025 11:05

pulls chain configs out into constants module

4e97d89

clippy + fmt

31d62d6

Evalir reviewed Apr 29, 2025

View reviewed changes

bin/builder.rs Show resolved Hide resolved

src/config.rs Outdated Show resolved Hide resolved

src/config.rs Show resolved Hide resolved

prestwich requested changes Apr 30, 2025

View reviewed changes

src/tasks/block.rs Outdated Show resolved Hide resolved

src/tasks/block.rs Outdated Show resolved Hide resolved

src/tasks/block.rs Outdated Show resolved Hide resolved