Interface LlmTransport

All Known Implementing Classes:
NettyHttpClientLlmTransport

public interface LlmTransport
Transport seam for outbound runtime-LLM calls. Abstracts the HTTP send so LlmCompletionService can be unit-tested with a stub and wired to the running server's NettyHttpClient in production (see NettyHttpClientLlmTransport).
  • Method Summary

    Modifier and Type
    Method
    Description
    send(HttpRequest request, long timeoutMillis)
    Send the request and return the response, or throw on transport failure.
  • Method Details

    • send

      HttpResponse send(HttpRequest request, long timeoutMillis)
      Send the request and return the response, or throw on transport failure. Implementations must respect timeoutMillis (the LlmCompletionService treats a timeout or exception fail-closed).