Promptsicle

A DX friendly library for standardizing and optimizing prompts for development projects.

Ideas

Create a function that takes a data loader, optimizer, scoring (metric) functions etc. and returns an optimized prompt or generated set of prompts.
Maybe have default / precanned data loaders and optimizers.
Maybe have a folder loader that loads examples from a folder. Maybe it should also have a file that represents the last score as the target to beat.`
Maybe have an default / precanned openai scoring function that returns a score based on the output of the model.
Maybe have a default / precanned human scoring function that shows a result and asks the user to score it.
Maybe it should generate a file with functions for each prompt (inspired by the supabase types generator).
Input parameters to the generated function should be fixed so that don't break contracts.
This could enable standardization of prompt generation, optimization, and usage for developers.

Name		Name	Last commit message	Last commit date
Latest commit History 34 Commits
.github		.github
.vscode		.vscode
bin		bin
examples/recipe		examples/recipe
.gitignore		.gitignore
.prettierrc.json		.prettierrc.json
README.md		README.md
config.ts		config.ts
deno.json		deno.json
deno.lock		deno.lock
edge.ts		edge.ts
evaluators.ts		evaluators.ts
llm.ts		llm.ts
loaders.ts		loaders.ts
main.ts		main.ts
mipro.ts		mipro.ts
optimizers.ts		optimizers.ts
output.ts		output.ts
package-lock.json		package-lock.json
package.json		package.json
runners.ts		runners.ts
types.ts		types.ts
utils.ts		utils.ts