Skip to content

[AMD/ROCM] Qwen3.5 FP4 MI355x Perf - New SGLang Image #1041

Open
ajith-sirra-amd wants to merge 4 commits intoSemiAnalysisAI:mainfrom
ajith-sirra-amd:ajith/qwen3.5_fp4_mi355x_sglang
Open

[AMD/ROCM] Qwen3.5 FP4 MI355x Perf - New SGLang Image #1041
ajith-sirra-amd wants to merge 4 commits intoSemiAnalysisAI:mainfrom
ajith-sirra-amd:ajith/qwen3.5_fp4_mi355x_sglang

Conversation

@ajith-sirra-amd
Copy link
Copy Markdown

@ajith-sirra-amd ajith-sirra-amd commented Apr 16, 2026

Overview

Add benchmark configuration and testing support for AMD MI355X hardware.

Changes

  • Added benchmark script for Qwen3.5 FP4 model on MI355X to run with Updated SGLang Image.
  • Updated GitHub Actions configuration for AMD master branch

Testing

  • Verify benchmark execution on MI355X hardware
  • Validate configuration settings

e2e Test run: https://github.com/SemiAnalysisAI/InferenceX/actions/runs/24503738833

Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
Copy link
Copy Markdown
Contributor

@claude claude bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Claude Code Review

This pull request is from a fork — automated review is disabled. A repository maintainer can comment @claude review to run a one-time review.

Comment thread .github/configs/amd-master.yaml Outdated
Comment thread .github/configs/amd-master.yaml Outdated
Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
@seungrokj seungrokj changed the title Qwen3.5 FP4 MI355x Perf - New SGLang Image [AMD/ROCM] Qwen3.5 FP4 MI355x Perf - New SGLang Image Apr 16, 2026
@seungrokj seungrokj added the AMD label Apr 16, 2026
@seungrokj
Copy link
Copy Markdown
Collaborator

/sweep test-config --config-files .github/configs/amd-master.yaml --config-keys qwen3.5-fp4-mi355x-sglang

@github-actions
Copy link
Copy Markdown
Contributor

@seungrokj Kicking off a sweep.

Run: https://github.com/SemiAnalysisAI/InferenceX/actions/runs/24503738833
Command: test-config --config-files .github/configs/amd-master.yaml --config-keys qwen3.5-fp4-mi355x-sglang
Pinned ref: 7719878
Approval: not required (trusted collaborator).

@seungrokj
Copy link
Copy Markdown
Collaborator

Signed-off-by: ajith-sirra-amd <ajith.sirra@amd.com>
@ajith-sirra-amd
Copy link
Copy Markdown
Author

@seungrokj : Updated the perf-changelog.yaml. Please let me know.

@seungrokj
Copy link
Copy Markdown
Collaborator

hi @functionstackx @cquil11 can you help merging this ?

@seungrokj seungrokj self-requested a review April 16, 2026 11:29
Copy link
Copy Markdown
Collaborator

@seungrokj seungrokj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Copy link
Copy Markdown
Collaborator

@chunfangamd chunfangamd left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

Status: No status

Development

Successfully merging this pull request may close these issues.

3 participants