generator: anthropic #263

Activity

1. leondz

   added

   generatorsInterfaces with LLMsInterfaces with LLMs

   new pluginDescribes an entirely new probe, detector, generator or harnessDescribes an entirely new probe, detector, generator or harness

   on Jul 26, 2023
2. ishaan-jaff commented on Sep 22, 2023

   

   ishaan-jaff

   on Sep 22, 2023

   More actions

   Hi @leondz I believe we can help with this issue. I’m the maintainer of LiteLLM https://github.com/BerriAI/litellm

   TLDR:
   We allow you to use any LLM as a drop in replacement for gpt-3.5-turbo.
   If you don't have access to the LLM you can use the LiteLLM proxy to make requests to the LLM

   You can use LiteLLM in the following ways:

   With your own API KEY:

   This calls the provider API directly

   from litellm import completion
   import os
   ## set ENV variables 
   os.environ["OPENAI_API_KEY"] = "your-key" # 
   os.environ["COHERE_API_KEY"] = "your-key" # 
   
   messages = [{ "content": "Hello, how are you?","role": "user"}]
   
   # openai call
   response = completion(model="gpt-3.5-turbo", messages=messages)
   
   # cohere call
   response = completion(model="command-nightly", messages=messages)

   Using the LiteLLM Proxy with a LiteLLM Key

   this is great if you don’t have access to claude but want to use the open source LiteLLM proxy to access claude

   from litellm import completion
   import os
   
   ## set ENV variables 
   os.environ["OPENAI_API_KEY"] = "sk-litellm-5b46387675a944d2" # [OPTIONAL] replace with your openai key
   os.environ["COHERE_API_KEY"] = "sk-litellm-5b46387675a944d2" # [OPTIONAL] replace with your cohere key
   
   messages = [{ "content": "Hello, how are you?","role": "user"}]
   
   # openai call
   response = completion(model="gpt-3.5-turbo", messages=messages)
   
   # cohere call
   response = completion(model="command-nightly", messages=messages)

   ❤️React with ❤️1Reacted by Leon Derczynski
3. leondz commented on Mar 24, 2024

   

   leondz

   on Mar 24, 2024

   CollaboratorAuthor

   More actions

   hey @ishaan-jaff! thanks for this request. a dedicate LiteLLM PR has been submitted (#572) - your feedback is welcome
4. fabriziorocco commented on May 14, 2024

   

   fabriziorocco

   on May 14, 2024

   Contributor

   More actions

   Hey, any plan to implement a generator for Claude3?
   Here's the API docs for Bedrock https://docs.anthropic.com/en/api/claude-on-amazon-bedrock
5. github-actions commented on Sep 23, 2025

   

   github-actionsBot

   on Sep 23, 2025 – with GitHub Actions

   Contributor

   More actions

   This issue has been automatically marked as stale because it has not had recent activity. If you are still interested in this issue, please respond to keep it open. Thank you!
6. github-actions

   added

   stalelow activity issue that may be auto-closed if there are no more updateslow activity issue that may be auto-closed if there are no more updates

   on Sep 23, 2025
7. leondz

   added

   good first issueGood for newcomersGood for newcomers

   dontautocloseThe `stale` workflow should not mark thisThe `stale` workflow should not mark this

   and removed

   stalelow activity issue that may be auto-closed if there are no more updateslow activity issue that may be auto-closed if there are no more updates

   on Sep 23, 2025
8. jmartin-tech

   added a commit that references this issue on Jun 10, 2026

   generator: add native Anthropic generator (#263)

   ...

   eec5c9e
9. jmartin-tech

   closed this as completedin #1809on Jun 10, 2026