Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Add sst and tts capabilities to agent #2007

Open
wants to merge 6 commits into
base: main
Choose a base branch
from
Open

Conversation

YujohnNattrass
Copy link
Collaborator

@YujohnNattrass YujohnNattrass commented Feb 22, 2025

Agents now have a voice property with a composite voice type which allows the agent to have different providers for its voice capabilities.

Here is an example of what it would look like to initialize:

export const chefAgent = new Agent({
  name: 'Agent',
  instructions: `You are capable of speech to text and text to speech`
  model: openai('gpt-4o-mini'),
  voice: new CompositeVoice({
    speakProvider: new ElevenLabsVoice(),
    listenProvider: new OpenAIVoice(),
  }),
});

Copy link

changeset-bot bot commented Feb 22, 2025

🦋 Changeset detected

Latest commit: 92637d4

The changes in this PR will be included in the next version bump.

This PR includes changesets to release 44 packages
Name Type
@mastra/core Minor
mastra Patch
@mastra/deployer Patch
@mastra/evals Patch
@mastra/loggers Patch
@mastra/mcp Patch
@mastra/memory Patch
@mastra/rag Patch
@mastra/deployer-cloudflare Patch
@mastra/deployer-netlify Patch
@mastra/deployer-vercel Patch
@mastra/store-pg Patch
@mastra/store-upstash Patch
@mastra/vector-astra Patch
@mastra/vector-chroma Patch
@mastra/vector-pg Patch
@mastra/vector-pinecone Patch
@mastra/vector-qdrant Patch
@mastra/vector-upstash Patch
@mastra/vector-vectorize Patch
@mastra/astra Patch
@mastra/chroma Patch
@mastra/pg Patch
@mastra/pinecone Patch
@mastra/qdrant Patch
@mastra/upstash Patch
@mastra/vectorize Patch
@mastra/speech-azure Patch
@mastra/speech-deepgram Patch
@mastra/speech-elevenlabs Patch
@mastra/speech-google Patch
@mastra/speech-ibm Patch
@mastra/speech-murf Patch
@mastra/speech-openai Patch
@mastra/speech-playai Patch
@mastra/speech-replicate Patch
@mastra/speech-speechify Patch
@mastra/client-js Patch
@mastra/composio Patch
@mastra/firecrawl Patch
@mastra/github Patch
@mastra/ragie Patch
@mastra/stabilityai Patch
memory-todo-agent Patch

Not sure what this means? Click here to learn what changesets are.

Click here if you're a maintainer who wants to add another changeset to this PR

Copy link

vercel bot commented Feb 22, 2025

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name Status Preview Comments Updated (UTC)
assistant-ui ✅ Ready (Inspect) Visit Preview 💬 Add feedback Feb 22, 2025 5:36am
bird-checker ✅ Ready (Inspect) Visit Preview 💬 Add feedback Feb 22, 2025 5:36am
crypto-chatbot ❌ Failed (Inspect) Feb 22, 2025 5:36am
mastra ✅ Ready (Inspect) Visit Preview 💬 Add feedback Feb 22, 2025 5:36am
openapi-spec-writer ✅ Ready (Inspect) Visit Preview 💬 Add feedback Feb 22, 2025 5:36am
travel-ai ❌ Failed (Inspect) Feb 22, 2025 5:36am
1 Skipped Deployment
Name Status Preview Comments Updated (UTC)
mastra-docs ⬜️ Skipped (Inspect) Feb 22, 2025 5:36am

Copy link

promptless bot commented Feb 22, 2025

📝 Documentation updates detected! You can review documentation updates here

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant