Building a technical product that needs code-gen?

Hot-swap OpenAI's API with ours to get more reliable code-generation that pulls directly from sources you choose, like private Lunes or even coding style guides.

PYTHONCopied
from openai import OpenAI


client = OpenAI(api_key=$LUNE_API_KEY, base_url="https://api.trylune.ai")


completion = client.chat.completions.create(
  model="tycho", 
  messages=[
    {"role": "user", "content": "What is the format of OpenAI's chat completion response?"}
  ],
  stream=True
)


for chunk in completion:
  if chunk.choices[0].delta.content is not None:
      print(chunk.choices[0].delta.content, end='', flush=True)