xlr8harder

xlr8harder / sydney.py

Created August 2, 2024 18:49

Talk to Sydney with Llama 3.1 405B base model.

	import gradio as gr
	from openai import OpenAI
	import jinja2
	from transformers import AutoTokenizer

	# get an api key from hyperbolic.
	api_key = "..."

	# Initialize the OpenAI client
	client = OpenAI(