Search results

Endpoints Storage Requirements - Add Accuracy requirements

Status: Open.

#280 In mlcommons/endpoints;

· merlinf31 opened on Apr 13, 2026

PostGres branch synched to tip of main.

Status: Open.

#279 In mlcommons/endpoints;

· merlinf31 opened on Apr 13, 2026

Tokenizer boundary impact

Status: Open.

#278 In mlcommons/endpoints;

· arekay-nv opened on Apr 10, 2026

feat: Move to uv

dependencies

type: choreMaintenance, deps, CI, toolingMaintenance, deps, CI, tooling

type: enhancementImprovement to existing functionalityImprovement to existing functionality

Status: Open.

Feature

#274 In mlcommons/endpoints;

· arekay-nv opened on Apr 9, 2026

Low concurrency timeouts

area: clientEndpoint client, HTTP, transport, ZMQEndpoint client, HTTP, transport, ZMQ

priority: P1High — must address this cycleHigh — must address this cycle

type: bugSomething isn't workingSomething isn't working

Status: Open.

#269 In mlcommons/endpoints;

· arekay-nv opened on Apr 3, 2026

Phase 2 - Model selection

priority: P1High — must address this cycleHigh — must address this cycle

type: featureNew feature or capabilityNew feature or capability

Status: Open.

#268 In mlcommons/endpoints;

· arekay-nv opened on Apr 3, 2026

Handling failed requests

area: clientEndpoint client, HTTP, transport, ZMQEndpoint client, HTTP, transport, ZMQ

priority: P2Medium — address within quarterMedium — address within quarter

type: featureNew feature or capabilityNew feature or capability

Status: Open.

#254 In mlcommons/endpoints;

· arekay-nv opened on Apr 1, 2026

feat: multi-turn implementation

area: datasetDataset manager, formats, predefined datasetsDataset manager, formats, predefined datasets

priority: P0Critical — blocks release or usersCritical — blocks release or users

type: featureNew feature or capabilityNew feature or capability

Status: Open.

#232 In mlcommons/endpoints;

· tianmu-li opened on Mar 31, 2026

Endpoints test environment

priority: P2Medium — address within quarterMedium — address within quarter

type: choreMaintenance, deps, CI, toolingMaintenance, deps, CI, tooling

Status: Open.

#229 In mlcommons/endpoints;

· merlinf31 opened on Mar 30, 2026

Add additional DB and Object Store elements from Requirements Doc

priority: P2Medium — address within quarterMedium — address within quarter

type: featureNew feature or capabilityNew feature or capability

Status: Open.

#227 In mlcommons/endpoints;

· merlinf31 opened on Mar 30, 2026

feat: multiple performance configs in a submission config

area: config-cliConfig schema, CLI commands, YAMLConfig schema, CLI commands, YAML

priority: P2Medium — address within quarterMedium — address within quarter

type: featureNew feature or capabilityNew feature or capability

Status: Open.

#224 In mlcommons/endpoints;

· tianmu-li opened on Mar 27, 2026

[Roadmap] Inference Endpoints Phase 2 Roadmap

type: RFCRequest for comments / design proposalRequest for comments / design proposal

Status: Open.

#223 In mlcommons/endpoints;

· arekay-nv opened on Mar 27, 2026