Skip to content

Benchmarks should disable package builds #37

@zanieb

Description

@zanieb

We got a report over in astral-sh/uv#17831 that the uv benchmark had significantly regressed so I briefly investigated and as noted in astral-sh/uv#17831 (comment) the issue is that we're resolving to a different version of a package (python-rapidjson) which takes >10s to build (on my machine) and creates a dramatic difference in the benchmark.

I think that --no-build or --only-binary :all: should be used so you're not including package build time in benchmarks.

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions