Skip to content

Update local-execution to newest task-spec#1625

Open
elliottslaughter wants to merge 68 commits intoflexflow:masterfrom
elliottslaughter:local-execution
Open

Update local-execution to newest task-spec#1625
elliottslaughter wants to merge 68 commits intoflexflow:masterfrom
elliottslaughter:local-execution

Conversation

@elliottslaughter
Copy link
Contributor

@elliottslaughter elliottslaughter commented Jan 17, 2026

Runs end-to-end tests, including loss function. Do not include cost estimator, that will be a separate PR.

Changes to local-execution:

  • ComputationGraphInstance now captures all the necessary state to run a computation
    • InitializedComputationGraphInstance has been removed
    • Creating the ComputationGraphInstance runs all passes, allocates and initializes the graph
  • local_task_registry.h is now static: no dynamic map is retained
    • This means task IDs are no longer used or required
  • Irrelevant sections of the old runtime have been removed

Changes to task-spec:

  • DynamicValueAttrs now stores a DynamicTensorAccessor (variant of GenericTensorAccessorR and GenericTensorAccessorW)
  • Exposed the mapping computed from labelled_open_kwarg_dataflow_graph_from_dynamic_open_dataflow_graph
  • Fixes for make_dynamic_open_dataflow_graph_from_cg
  • Fixes for perform_update_insertion
  • Fixes for linear op and optimizer wrappers

Follow-up PRs:


This change is Reviewable

@elliottslaughter elliottslaughter marked this pull request as ready for review January 29, 2026 01:00
Refactor computation graph instance as DTG.

Cut out more stuff that doesn't compile yet.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant