[ET Device Support] Annotate device attributes of CUDA backend IO tensors cuda device by Gasoonjia · Pull Request #18080 · pytorch/executorch

Gasoonjia · 2026-03-10T23:22:05Z

Stack from ghstack (oldest at bottom):

[ET Device Support] Device-aware memory planning: separate buffers per device type #18375
[ET Device Support] Add NonConstBufferDevice schema for per-buffer device mapping #18330
[ET Device Support] DeviceAllocator interface and DeviceAllocatorRegistry #17535
-> [ET Device Support] Annotate device attributes of CUDA backend IO tensors cuda device #18080
[ET Device Support] Parse device info from serialized tensor in tensor_parser #18328
[ET Device Support] Propagate device info from TensorSpec into serialized Tensor #18079
[executorch] Propagate device metadata from partitioner result onto TensorSpecs #18078
[ET Device Support] TensorImpl carries device info #17534
[ET Device Support] Schema changes: device info on Tensor and buffer-level device array #17533

Update cuda backend partitioner to annotate its IO tensors as cuda device

Differential Revision: D96010436

…sors cuda device Update cuda backend partitioner to annotate its IO tensors as cuda device Differential Revision: [D96010436](https://our.internmc.facebook.com/intern/diff/D96010436/) [ghstack-poisoned]

pytorch-bot · 2026-03-10T23:22:09Z

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/18080

📄 Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

❌ 86 New Failures

As of commit 61f249a with merge base 38b40bc ():

NEW FAILURES - The following jobs have failed:

Build documentation / build (buck2) / Build doc (gh)
RuntimeError: Command docker exec -t 405e5deb395d202411e6308ea9b61db171bbb930da54ee6b426e156cd2739959 /exec failed with exit code 2
periodic / test-models-linux (buck2, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
periodic / test-models-linux (buck2, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
periodic / test-models-linux (cmake, mv3, portable, linux.2xlarge, 90) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
periodic / test-models-linux (cmake, mv3, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
periodic / test-models-linux (cmake, vit, portable, linux.2xlarge, 90) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
periodic / test-models-linux (cmake, vit, xnnpack-quantization-delegation, linux.2xlarge, 90) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-build-wasm-linux / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-llama-runner-linux (bf16, custom, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-llama-runner-linux (fp32, xnnpack+custom+qe, linux.arm64.2xlarge, executorch-ubuntu-22.04-gc... / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04... / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-llama-runner-linux (fp32, xnnpack+custom+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu... / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-llama-runner-linux (fp32, xnnpack+quantize_kv, linux.arm64.2xlarge, executorch-ubuntu-22.04-... / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-lora-linux / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-lora-multimethod-linux / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-mcu-cortex-m-backend / linux-job (gh)
RuntimeError: Command docker exec -t 6bbf56822199cb6613af4f9f8a9ad0d2bd99fe1dfda298c74bc3b4e6815f710b /exec failed with exit code 1
pull / test-models-linux (emformer_join, portable, linux.4xlarge.memory) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (emformer_transcribe, portable, linux.2xlarge) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (emformer_transcribe, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (ic3, portable, linux.2xlarge) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (ic3, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (ic4, portable, linux.4xlarge.memory) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (ic4, xnnpack-quantization-delegation, linux.4xlarge.memory) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (llama3_2_vision_encoder, portable, linux.4xlarge.memory) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (mobilebert, portable, linux.2xlarge) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (mobilebert, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (mv2, portable, linux.2xlarge) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (mv2, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (phi_4_mini, portable, linux.4xlarge.memory) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (resnet18, portable, linux.2xlarge) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (resnet18, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (resnet50, portable, linux.2xlarge) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux (resnet50, xnnpack-quantization-delegation, linux.2xlarge) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux-basic (mv3, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux-basic (mv3, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux-basic (mv3, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux-basic (mv3, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux-basic (vit, portable, buck2, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux-basic (vit, portable, cmake, linux.2xlarge, executorch-ubuntu-22.04-clang12) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux-basic (vit, portable, cmake, linux.arm64.2xlarge, executorch-ubuntu-22.04-gcc11... / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, buck2, linux.2xlarge, executorch-u... / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.2xlarge, executorch-u... / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-models-linux-basic (vit, xnnpack-quantization-delegation, cmake, linux.arm64.2xlarge, execut... / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-moshi-linux / linux-job (gh)
test_exported_decoder_xnnpack
pull / test-multimodal-linux (gemma3-4b) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-parakeet-xnnpack-linux / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-phi-3-mini-runner-linux / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-quantized-aot-lib-linux / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-samsung-models-linux / linux-job (gh)
test_dl3_fp16
pull / test-selective-build-linux / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-voxtral-realtime-xnnpack-linux / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / test-vulkan-operators-linux / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / unittest / linux / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / unittest / macos / macos-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / unittest / windows / windows-job (gh)
Process completed with exit code 1.
pull / unittest-arm-backend-with-no-deps (test_pytest_models_tosa) / linux-job (gh)
RuntimeError: Command docker exec -t 491bee988d4afd2e6f3650d8c10562e54e00bb3fb8d1df8fe16bc232c087ccd3 /exec failed with exit code 1
pull / unittest-arm-backend-with-no-deps (test_pytest_ops_tosa) / linux-job (gh)
RuntimeError: Command docker exec -t a44dadebbcf83f9ad4339f9bac35896c119a6a3d19b63d0b06bddbc844e8be81 /exec failed with exit code 1
pull / unittest-editable / linux / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / unittest-editable / macos / macos-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
pull / unittest-editable / windows / windows-job (gh)
Process completed with exit code 1.
pull / unittest-nxp-neutron / linux-job (gh)
RuntimeError: Command docker exec -t 49c79f559a0d740fb27ef1fbf273e7311a5709f1380b5dba55e4883b31bd438f /exec failed with exit code 1
Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, non-quantized) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-tile-packed) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-weight-only) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / export-model-cuda-artifact (mistralai, Voxtral-Mini-4B-Realtime-2602, quantized-int4-tile-packed) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / export-model-cuda-artifact (nvidia, diar_streaming_sortformer_4spk-v2, non-quantized) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / export-model-cuda-artifact (nvidia, parakeet-tdt, non-quantized) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / export-model-cuda-artifact (nvidia, parakeet-tdt, quantized-int4-tile-packed) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / export-model-cuda-artifact (nvidia, parakeet-tdt, quantized-int4-weight-only) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-large-v3-turbo, non-quantized) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-large-v3-turbo, quantized-int4-tile-packed) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-large-v3-turbo, quantized-int4-weight-only) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, non-quantized) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, quantized-int4-tile-packed) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / export-model-cuda-artifact (openai, whisper-small, quantized-int4-weight-only) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Builds / unittest-cuda / linux-job (gh)
backends/cuda/tests/test_cuda_export.py::TestCudaExport::test_device_info_propagated_to_cuda_delegate_outputs
Test CUDA Windows Export and E2E / export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-3B-2507, non-quantized) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Windows Export and E2E / export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-3B-2507, quantized-int4-weight-only) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Windows Export and E2E / export-model-cuda-windows-artifact (mistralai, Voxtral-Mini-4B-Realtime-2602, quantized-int4-tile... / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Windows Export and E2E / export-model-cuda-windows-artifact (nvidia, diar_streaming_sortformer_4spk-v2, non-quantized) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Windows Export and E2E / export-model-cuda-windows-artifact (nvidia, parakeet-tdt, non-quantized) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'
Test CUDA Windows Export and E2E / export-model-cuda-windows-artifact (nvidia, parakeet-tdt, quantized-int4-weight-only) / linux-job (gh)
AttributeError: '_ViewSpec' object has no attribute 'device_index'

This comment was automatically generated by Dr. CI and updates every 15 minutes.

…sors cuda device Update cuda backend partitioner to annotate its IO tensors as cuda device Differential Revision: [D96010436](https://our.internmc.facebook.com/intern/diff/D96010436/) ghstack-source-id: 350230761 Pull Request resolved: #18080

github-actions · 2026-03-10T23:23:17Z

This PR needs a `release notes:` label

If your change should be included in the release notes (i.e. would users of this library care about this change?), please use a label starting with release notes:. This helps us keep track and include your important work in the next release notes.

To add a label, you can comment to pytorchbot, for example
@pytorchbot label "release notes: none"

For more information, see
https://github.com/pytorch/pytorch/wiki/PyTorch-AutoLabel-Bot#why-categorize-for-release-notes-and-how-does-it-work.

…kend IO tensors cuda device" Update cuda backend partitioner to annotate its IO tensors as cuda device Differential Revision: [D96010436](https://our.internmc.facebook.com/intern/diff/D96010436/) [ghstack-poisoned]

…sors cuda device Pull Request resolved: #18080 Update cuda backend partitioner to annotate its IO tensors as cuda device ghstack-source-id: 351558872 @exported-using-ghexport Differential Revision: [D96010436](https://our.internmc.facebook.com/intern/diff/D96010436/)

…kend IO tensors cuda device" Update cuda backend partitioner to annotate its IO tensors as cuda device Differential Revision: [D96010436](https://our.internmc.facebook.com/intern/diff/D96010436/) [ghstack-poisoned]

…sors cuda device Pull Request resolved: #18080 Update cuda backend partitioner to annotate its IO tensors as cuda device ghstack-source-id: 353202795 @exported-using-ghexport Differential Revision: [D96010436](https://our.internmc.facebook.com/intern/diff/D96010436/)

…kend IO tensors cuda device" Update cuda backend partitioner to annotate its IO tensors as cuda device Differential Revision: [D96010436](https://our.internmc.facebook.com/intern/diff/D96010436/) [ghstack-poisoned]

…sors cuda device Pull Request resolved: #18080 Update cuda backend partitioner to annotate its IO tensors as cuda device ghstack-source-id: 354478933 @exported-using-ghexport Differential Revision: [D96010436](https://our.internmc.facebook.com/intern/diff/D96010436/)

…kend IO tensors cuda device" Update cuda backend partitioner to annotate its IO tensors as cuda device Differential Revision: [D96010436](https://our.internmc.facebook.com/intern/diff/D96010436/) [ghstack-poisoned]

[ET Device Support] Annotate device attributes of CUDA backend IO ten…

50df074

…sors cuda device Update cuda backend partitioner to annotate its IO tensors as cuda device Differential Revision: [D96010436](https://our.internmc.facebook.com/intern/diff/D96010436/) [ghstack-poisoned]

Gasoonjia mentioned this pull request Mar 4, 2026

[ET Device Support] Schema changes: device info on Tensor and buffer-level device array #17533

Open

This was referenced Mar 4, 2026

[ET Device Support] TensorImpl carries device info #17534

Open

[executorch] Propagate device metadata from partitioner result onto TensorSpecs #18078

Open

[ET Device Support] Propagate device info from TensorSpec into serialized Tensor #18079

Open

meta-cla bot added the CLA Signed This label is managed by the Facebook bot. Authors need to sign the CLA before a PR can be reviewed. label Mar 10, 2026

meta-codesync bot added fb-exported meta-exported labels Mar 10, 2026

Gasoonjia mentioned this pull request Feb 18, 2026

[ET Device Support] DeviceAllocator interface and DeviceAllocatorRegistry #17535

Open

Gasoonjia mentioned this pull request Mar 19, 2026

[ET Device Support] Parse device info from serialized tensor in tensor_parser #18310

Open

This was referenced Mar 19, 2026

[ET Device Support] Parse device info from serialized tensor in tensor_parser #18328

Open

[ET Device Support] Add NonConstBufferDevice schema for per-buffer device mapping #18330

Open

Gasoonjia added 2 commits March 19, 2026 11:43

Gasoonjia mentioned this pull request Mar 20, 2026

[ET Device Support] Device-aware memory planning: separate buffers per device type #18375

Open

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[ET Device Support] Annotate device attributes of CUDA backend IO tensors cuda device#18080

[ET Device Support] Annotate device attributes of CUDA backend IO tensors cuda device#18080
Gasoonjia wants to merge 8 commits intogh/gasoonjia/137/basefrom
gh/gasoonjia/137/head

Gasoonjia commented Mar 10, 2026 •

edited

Loading

Uh oh!

pytorch-bot bot commented Mar 10, 2026 •

edited

Loading

Uh oh!

github-actions bot commented Mar 10, 2026

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

Gasoonjia commented Mar 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

pytorch-bot bot commented Mar 10, 2026 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

🔗 Helpful Links

🧪 See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/executorch/18080

❌ 86 New Failures

Uh oh!

github-actions bot commented Mar 10, 2026

This PR needs a release notes: label

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Gasoonjia commented Mar 10, 2026 •

edited

Loading

pytorch-bot bot commented Mar 10, 2026 •

edited

Loading

This PR needs a `release notes:` label