Background
We (Hypermode) recently released Model Router, a tool that enables developers to connect to both open-source and commercial language models through a single, unified API.
Summary
- Created a new directory
packages/hypermode
- Today, we implement OpenAI's
/v1/chat/completions
and/v1/embeddings
API, so we simply extendOpenAICompatibleChatLanguageModel
andOpenAICompatibleEmbeddingModel
, but this might change as we evolve - We support OpenAI’s GPT, Anthropic’s Claude, Google’s Gemini, and several other open source models (see here for full list of models)
Verification
Create an .env
file with HYPERMODE_API_KEY=YOUR_HYPERMODE_API_KEY
, and then:
cd examples/ai-core
pnpm tsx src/embed-many/hypermode.ts
pnpm tsx src/embed/hypermode.ts
pnpm tsx src/generate-text/hypermode.ts
pnpm tsx src/stream-text/hypermode.ts
pnpm run test:file src/e2e/hypermode.test.ts
cd ../../packages/hypermode/
pnpm run test
Tasks
- Tests have been added / updated (for bug fixes / features)
- Documentation has been added / updated (for bug fixes / features)
- A patch changeset for relevant packages has been added (for bug fixes / features - run
pnpm changeset
in the project root) - Formatting issues have been fixed (run
pnpm prettier-fix
in the project root)
Next issue in about 1 hour