philschmid’s gists

philschmid / openai_meta.txt

Created October 2, 2024 06:38

Leaked meta prompt, seen at https://x.com/amebagpt/status/1841177927569838519

	Understand the Task: Grasp the main objective, goals, requirements, constraints, and expected output.
	- Minimal Changes: If an existing prompt is provided, improve it only if it's simple. For complex prompts, enhance clarity and add missing elements without altering the original structure.
	- Reasoning Before Conclusions: Encourage reasoning steps before any conclusions are reached. ATTENTION! If the user provides examples where the reasoning happens afterward, REVERSE the order! NEVER START EXAMPLES WITH CONCLUSIONS!
	- Reasoning Order: Call out reasoning portions of the prompt and conclusion parts (specific fields by name). For each, determine the ORDER in which this is done, and whether it needs to be reversed.
	- Conclusion, classifications, or results should ALWAYS appear last.
	- Examples: Include high-quality examples if helpful, using placeholders [in brackets] for complex elements.
	- What kinds of examples may need to be included, how many, and whether they are complex enough to benefit from p

philschmid / generate.py

Created June 30, 2024 20:57

	import os
	import asyncio
	import subprocess
	import time
	from typing import List, Dict
	import torch
	from openai import AsyncOpenAI
	from tqdm.asyncio import tqdm
	import logging

philschmid / armorm.py

Created June 12, 2024 11:15

	from typing import Dict, List
	import torch
	from transformers import AutoModelForSequenceClassification, AutoTokenizer


	class ArmoRMPipeline:
	def __init__(self, model_id, device_map="auto", torch_dtype=torch.bfloat16, truncation=True, trust_remote_code=False, max_length=4096):
	self.model = AutoModelForSequenceClassification.from_pretrained(
	model_id,
	device_map=device_map,

philschmid / top_100.py

Created March 20, 2024 08:04

	import requests as r
	from huggingface_hub import HfFolder
	from tqdm import tqdm
	from datasets import Dataset

	headers = {"Authorization": f"Bearer {HfFolder.get_token()}"}

	sess = r.Session()
	sess.headers.update(headers)

philschmid / run_nous

Created March 1, 2024 18:26

	#!/bin/bash
	start=$(date +%s)

	# Initialize RESULT_DIRECTORY with default value and HF_MODEL_ID with an empty string
	RESULT_DIRECTORY="nous"
	HF_MODEL_ID=""
	TRUST_REMOTE_CODE="False"
	CURRENT_DIR=$(pwd)

	# List of Benchmarking Tasks

philschmid / gemma.py

Created February 22, 2024 17:37

	from openai import OpenAI

	# initialize the client but point it to TGI
	client = OpenAI(
	base_url="https://api-inference.huggingface.co/v1",
	api_key="hf_xxx" # Replace with your token
	)

	chat_completion = client.chat.completions.create(
	model="google/gemma-7b-it",

philschmid / multi_node.sh

Created October 18, 2023 22:11

	torchrun --nnodes 2 --nproc_per_node 32 --master_addr algo-1 --master_port 7777 --node_rank 0 train_llama.py \
	--model_id "meta-llama/Llama-2-70b-hf" \
	--lr 5e-5 \
	--per_device_train_batch_size 16 \
	--bf16 True \
	--epochs 3

philschmid / test.py

Created September 28, 2023 14:37

	import re

	cli_output = '''
	Text Generation Launcher

	Usage: text-generation-launcher [OPTIONS]

	Options:
	--model-id <MODEL_ID>
	The name of the model to load. Can be a MODEL_ID as listed on <https://hf.co/models> like `gpt2` or `OpenAssistant/oasst-sft-1-pythia-12b`. Or it can be a local directory containing the necessary files as saved by `save_pretrained(...)` methods of transformers

philschmid / nuremberg.txt

Created August 7, 2023 19:08

Nuremberg (/ˈnjʊərəmbɜːrɡ/ NURE-əm-burg; German: Nürnberg [ˈnʏʁnbɛʁk] (listen); in the local East Franconian dialect: Nämberch [ˈnɛmbɛrç]) is the second-largest city of the German state of Bavaria after its capital Munich, and its 541.000 inhabitants[3] make it the 14th-largest city in Germany. On the Pegnitz River (from its confluence with the Rednitz in Fürth onwards: Regnitz, a tributary of the River Main) and the Rhine–Main–Danube Canal, it lies in the Bavarian administrative region of Middle Franconia, and is the largest city and the unofficial capital of Franconia. Nuremberg forms with the neighbouring cities of Fürth, Erlangen and Schwabach a continuous conurbation with a total population of 800,376 (2019), which is the heart of the urban area region with around 1.4 million inhabitants,[4] while the larger Nuremberg Metropolitan Region has approximately 3.6 million inhabitants. The city lies about 170 kilometres (110 mi) north of Munich. It is the largest city in the East Franconian dialect area (collo

philschmid / llama2_single_turn_prompt.py

Created July 19, 2023 07:57

	B_INST, E_INST = "[INST]", "[/INST]"
	B_SYS, E_SYS = "<<SYS>>\n", "\n<</SYS>>\n\n"

	SYSTEM= """\

	You are a helpful, respectful and honest assistant. Always answer as helpfully as possible, while being safe. Your answers should not include any harmful, unethical, racist, sexist, toxic, dangerous, or illegal content. Please ensure that your responses are socially unbiased and positive in nature.

	If a question does not make any sense, or is not factually coherent, explain why instead of answering something not correct. If you don't know the answer to a question, please don't share false information."""

	INSTRUCTION="What is the receipe of mayonnaise?"

Philipp Schmid philschmid