Package dev.langchain4j.model.anthropic

Class AnthropicStreamingChatModel

java.lang.Object
dev.langchain4j.model.anthropic.AnthropicStreamingChatModel
All Implemented Interfaces:
dev.langchain4j.model.chat.StreamingChatLanguageModel
public class AnthropicStreamingChatModel extends Object implements dev.langchain4j.model.chat.StreamingChatLanguageModel
Represents an Anthropic language model with a Messages (chat) API. The model's response is streamed token by token and should be handled with StreamingResponseHandler.
More details are available here and here.

It supports Images as inputs. UserMessages can contain one or multiple ImageContents. Images must not be represented as URLs; they should be Base64-encoded strings and include a mimeType.

The content of SystemMessages is sent using the "system" parameter.

Sanitization is performed on the ChatMessages provided to ensure conformity with Anthropic API requirements. This includes ensuring the first message is a UserMessage and that there are no consecutive UserMessages. Any messages removed during sanitization are logged as warnings and not submitted to the API.

Supports caching SystemMessages and ToolSpecifications.

  • Nested Class Summary

    Nested Classes
    Modifier and Type
    Class
    Description
    static class 
    AnthropicStreamingChatModel.AnthropicStreamingChatModelBuilder
     

  • Method Summary

    Modifier and Type
    Method
    Description
    void
    chat(dev.langchain4j.model.chat.request.ChatRequest chatRequest, dev.langchain4j.model.chat.response.StreamingChatResponseHandler handler)
     
    List<dev.langchain4j.model.chat.listener.ChatModelListener>
    listeners()
     
    dev.langchain4j.model.ModelProvider
    provider()
     

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

    Methods inherited from interface dev.langchain4j.model.chat.StreamingChatLanguageModel

    chat, chat, defaultRequestParameters, doChat, supportedCapabilities

  • Method Details

    • chat

      public void chat(dev.langchain4j.model.chat.request.ChatRequest chatRequest, dev.langchain4j.model.chat.response.StreamingChatResponseHandler handler)
      Specified by:
      chat in interface dev.langchain4j.model.chat.StreamingChatLanguageModel

    • listeners

      public List<dev.langchain4j.model.chat.listener.ChatModelListener> listeners()
      Specified by:
      listeners in interface dev.langchain4j.model.chat.StreamingChatLanguageModel

    • provider

      public dev.langchain4j.model.ModelProvider provider()
      Specified by:
      provider in interface dev.langchain4j.model.chat.StreamingChatLanguageModel