[agentserver] azure-ai-agentserver-responses package

sdk/agentserver/azure-ai-agentserver-agentframework/pyproject.toml

@@ -9,6 +9,7 @@ authors = [
 ]
 license = "MIT"
 classifiers = [
+    "Development Status :: 7 - Inactive",
     "Programming Language :: Python",
     "Programming Language :: Python :: 3 :: Only",
     "Programming Language :: Python :: 3",

sdk/agentserver/azure-ai-agentserver-core/CHANGELOG.md

@@ -1,7 +1,21 @@
 # Release History
 
-## 1.0.0b1 (2025-11-07)
+## 2.0.0b1 (Unreleased)
 
 ### Features Added
 
-First version
+- `AgentHost` host framework with health probe (`/readiness`), graceful shutdown, and port binding.
+- `TracingHelper` for OpenTelemetry tracing with Azure Monitor and OTLP exporters.
+- Auto-enable tracing when Application Insights or OTLP endpoint is configured.
+- W3C Trace Context propagation and `leaf_customer_span_id` baggage re-parenting.
+- `create_error_response()` utility for standard error envelope responses.
+- `get_logger()` for library-scoped logging.
+- `register_routes()` for pluggable protocol composition.
+- Hypercorn-based ASGI server with HTTP/1.1 support.
+
+### Breaking Changes
+
+- Replaced `ErrorResponse.create()` static method with module-level `create_error_response()` function.
+- Replaced `AgentLogger.get()` static method with module-level `get_logger()` function.
+- Removed `AGENT_LOG_LEVEL` and `AGENT_GRACEFUL_SHUTDOWN_TIMEOUT` environment variable support from `Constants`.
+- Renamed health endpoint from `/healthy` to `/readiness`.

sdk/agentserver/azure-ai-agentserver-core/LICENSE

@@ -12,10 +12,10 @@ furnished to do so, subject to the following conditions:
 The above copyright notice and this permission notice shall be included in all
 copies or substantial portions of the Software.
 
-THE SOFTWARE IS PROVIDED *AS IS*, WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
+THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF ANY KIND, EXPRESS OR
 IMPLIED, INCLUDING BUT NOT LIMITED TO THE WARRANTIES OF MERCHANTABILITY,
 FITNESS FOR A PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT SHALL THE
 AUTHORS OR COPYRIGHT HOLDERS BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER
 LIABILITY, WHETHER IN AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM,
 OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE OR OTHER DEALINGS IN THE
-SOFTWARE.
+SOFTWARE.

sdk/agentserver/azure-ai-agentserver-core/MANIFEST.in

@@ -2,7 +2,6 @@ include *.md
 include LICENSE
 recursive-include tests *.py
 recursive-include samples *.py *.md
-recursive-include doc *.rst *.md
 include azure/__init__.py
 include azure/ai/__init__.py
 include azure/ai/agentserver/__init__.py

sdk/agentserver/azure-ai-agentserver-core/README.md

@@ -1,105 +1,137 @@
-# Azure AI Agent Server Adapter for Python
+# Azure AI AgentHost Core for Python
 
+The `azure-ai-agentserver-core` package provides the foundation host framework for building Azure AI Hosted Agent containers. It handles the protocol-agnostic infrastructure — health probes, graceful shutdown, OpenTelemetry tracing, and ASGI serving — so that protocol packages can focus on their endpoint logic.
 
 ## Getting started
 
+### Install the package
+
 ```bash
 pip install azure-ai-agentserver-core
 ```
 
+To enable OpenTelemetry tracing with Azure Monitor and OTLP exporters:
+
+```bash
+pip install azure-ai-agentserver-core[tracing]
+```
+
+### Prerequisites
+
+- Python 3.10 or later
+
 ## Key concepts
 
-This is the core package for Azure AI Agent server. It hosts your agent as a container on the cloud.
+### AgentHost
+
+`AgentHost` is the host process for Azure AI Hosted Agent containers. It provides:
+
+- **Health probe** — `GET /readiness` returns `200 OK` when the server is ready.
+- **Graceful shutdown** — On `SIGTERM` the server drains in-flight requests (default 30 s timeout) before exiting.
+- **OpenTelemetry tracing** — Automatic span creation with Azure Monitor and OTLP export when configured.
+- **Hypercorn ASGI server** — Serves on `0.0.0.0:${PORT:-8088}` with HTTP/1.1.
+
+Protocol packages (e.g. `azure-ai-agentserver-invocations`) plug into `AgentHost` by calling `register_routes()` to add their endpoints.
 
-You can talk to your agent using azure-ai-project sdk.
+### Environment variables
 
+| Variable | Description | Default |
+|---|---|---|
+| `PORT` | Listen port | `8088` |
+| `FOUNDRY_AGENT_NAME` | Agent name (used in tracing) | `""` |
+| `FOUNDRY_AGENT_VERSION` | Agent version (used in tracing) | `""` |
+| `FOUNDRY_PROJECT_ENDPOINT` | Azure AI Foundry project endpoint | `""` |
+| `FOUNDRY_PROJECT_ARM_ID` | Foundry project ARM resource ID (used in tracing) | `""` |
+| `FOUNDRY_AGENT_SESSION_ID` | Default session ID when not provided per-request | `""` |
+| `APPLICATIONINSIGHTS_CONNECTION_STRING` | Azure Monitor connection string | — |
+| `OTEL_EXPORTER_OTLP_ENDPOINT` | OTLP collector endpoint | — |
 
 ## Examples
 
-If your agent is not built using a supported framework such as LangGraph and Agent-framework, you can still make it compatible with Microsoft AI Foundry by manually implementing the predefined interface.
+`AgentHost` is typically used with a protocol package. The simplest setup with the invocations protocol:
 
 ```python
-import datetime
+from azure.ai.agentserver.core import AgentHost
+from azure.ai.agentserver.invocations import InvocationHandler
+from starlette.responses import JSONResponse
 
-from azure.ai.agentserver.core import FoundryCBAgent
-from azure.ai.agentserver.core.models import (
-    CreateResponse, 
-    Response as OpenAIResponse,
-)
-from azure.ai.agentserver.core.models.projects import (
-    ItemContentOutputText,
-    ResponsesAssistantMessageItemResource,
-    ResponseTextDeltaEvent,
-    ResponseTextDoneEvent,
-)
+server = AgentHost()
+invocations = InvocationHandler(server)
+
+@invocations.invoke_handler
+async def handle(request):
+    body = await request.json()
+    return JSONResponse({"greeting": f"Hello, {body['name']}!"})
+
+server.run()
+```
 
+### Using AgentHost standalone
 
-def stream_events(text: str):
-    assembled = ""
-    for i, token in enumerate(text.split(" ")):
-        piece = token if i == len(text.split(" ")) - 1 else token + " "
-        assembled += piece
-        yield ResponseTextDeltaEvent(delta=piece)
-    # Done with text
-    yield ResponseTextDoneEvent(text=assembled)
-
-
-async def agent_run(request_body: CreateResponse):
-    agent = request_body.agent
-    print(f"agent:{agent}")
-
-    if request_body.stream:
-        return stream_events("I am mock agent with no intelligence in stream mode.")
-
-    # Build assistant output content
-    output_content = [
-        ItemContentOutputText(
-            text="I am mock agent with no intelligence.",
-            annotations=[],
-        )
-    ]
-
-    response = OpenAIResponse(
-        metadata={},
-        temperature=0.0,
-        top_p=0.0,
-        user="me",
-        id="id",
-        created_at=datetime.datetime.now(),
-        output=[
-            ResponsesAssistantMessageItemResource(
-                status="completed",
-                content=output_content,
-            )
-        ],
-    )
-    return response
-
-
-my_agent = FoundryCBAgent()
-my_agent.agent_run = agent_run
-
-if __name__ == "__main__":
-    my_agent.run()
+For custom protocol implementations, use `AgentHost` directly and register your own routes:
 
+```python
+from azure.ai.agentserver.core import AgentHost
+from starlette.requests import Request
+from starlette.responses import JSONResponse
+from starlette.routing import Route
+
+async def my_endpoint(request: Request):
+    return JSONResponse({"status": "ok"})
+
+server = AgentHost()
+server.register_routes([Route("/my-endpoint", my_endpoint, methods=["POST"])])
+server.run()
+```
+
+### Shutdown handler
+
+Register a cleanup function that runs during graceful shutdown:
+
+```python
+server = AgentHost()
+
+@server.shutdown_handler
+async def on_shutdown():
+    # Close database connections, flush buffers, etc.
+    pass
+```
+
+### Configuring tracing
+
+Tracing is enabled automatically when an Application Insights connection string is available:
+
+```python
+server = AgentHost(
+    application_insights_connection_string="InstrumentationKey=...",
+)
+```
+
+Or via environment variable:
+
+```bash
+export APPLICATIONINSIGHTS_CONNECTION_STRING="InstrumentationKey=..."
+python my_agent.py
 ```
 
 ## Troubleshooting
 
-First run your agent with azure-ai-agentserver-core locally.
+### Logging
 
-If it works on local by failed on cloud. Check your logs in the application insight connected to your Azure AI Foundry Project.
+Set the log level to `DEBUG` for detailed diagnostics:
 
+```python
+server = AgentHost(log_level="DEBUG")
+```
 
 ### Reporting issues
 
-To report an issue with the client library, or request additional features, please open a GitHub issue [here](https://github.com/Azure/azure-sdk-for-python/issues). Mention the package name "azure-ai-agents" in the title or content.
-
+To report an issue with the client library, or request additional features, please open a GitHub issue [here](https://github.com/Azure/azure-sdk-for-python/issues).
 
 ## Next steps
 
-Please visit [Samples](https://github.com/Azure/azure-sdk-for-python/tree/main/sdk/agentserver/azure-ai-agentserver-core/samples) folder. There are several cases for you to build your agent with azure-ai-agentserver
-
+- Install [`azure-ai-agentserver-invocations`](https://pypi.org/project/azure-ai-agentserver-invocations/) to add the invocation protocol endpoints.
+- See the [container image spec](https://github.com/Azure/azure-sdk-for-python/tree/main/sdk/agentserver) for the full hosted agent contract.
 
 ## Contributing
 
@@ -117,3 +149,5 @@ This project has adopted the
 [Microsoft Open Source Code of Conduct][code_of_conduct]. For more information,
 see the Code of Conduct FAQ or contact opencode@microsoft.com with any
 additional questions or comments.
+
+[code_of_conduct]: https://opensource.microsoft.com/codeofconduct/

sdk/agentserver/azure-ai-agentserver-core/azure/__init__.py

@@ -1 +1 @@
-__path__ = __import__("pkgutil").extend_path(__path__, __name__)  # type: ignore
+__path__ = __import__("pkgutil").extend_path(__path__, __name__)

sdk/agentserver/azure-ai-agentserver-core/azure/ai/__init__.py

@@ -1 +1 @@
-__path__ = __import__("pkgutil").extend_path(__path__, __name__)  # type: ignore
+__path__ = __import__("pkgutil").extend_path(__path__, __name__)

sdk/agentserver/azure-ai-agentserver-core/azure/ai/agentserver/__init__.py

@@ -1 +1 @@
-__path__ = __import__("pkgutil").extend_path(__path__, __name__)  # type: ignore
+__path__ = __import__("pkgutil").extend_path(__path__, __name__)

sdk/agentserver/azure-ai-agentserver-core/azure/ai/agentserver/core/__init__.py

@@ -1,14 +1,35 @@
 # ---------------------------------------------------------
 # Copyright (c) Microsoft Corporation. All rights reserved.
 # ---------------------------------------------------------
+"""Azure AI AgentHost core framework.
+
+Provides the :class:`AgentHost` host and shared utilities for
+building Azure AI Hosted Agent containers.
+
+Public API::
+
+    from azure.ai.agentserver.core import (
+        get_logger,
+        AgentHost,
+        Constants,
+        create_error_response,
+        TracingHelper,
+    )
+"""
 __path__ = __import__("pkgutil").extend_path(__path__, __name__)
 
+from ._base import AgentHost
+from ._constants import Constants
+from ._errors import create_error_response
+from ._logger import get_logger
+from ._tracing import TracingHelper
 from ._version import VERSION
-from .logger import configure as config_logging
-from .server.base import FoundryCBAgent
-from .server.common.agent_run_context import AgentRunContext
-
-config_logging()
 
-__all__ = ["FoundryCBAgent", "AgentRunContext"]
+__all__ = [
+    "get_logger",
+    "AgentHost",
+    "Constants",
+    "create_error_response",
+    "TracingHelper",
+]
 __version__ = VERSION