Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Bug]: Google <> Anthropic Params Conflict with Mid-convo Switch #2778

Open
1 task done
TheValkyrja opened this issue May 18, 2024 · 1 comment
Open
1 task done
Labels
bug Something isn't working

Comments

@TheValkyrja
Copy link

TheValkyrja commented May 18, 2024

What happened?

when using switching Endpoints mid-conversation function after generating a response with a model, the parameter didn't dynamic change to new endpoint's default value.
for example, max context will remain 8192 when changing gemini-1.5-pro to claude-3-opus(so as other parameter, top P, top K etc.), and this will cause error.

Steps to Reproduce

1.use Gemini-1.5-flash-latest, with its default parameter value: (temperature 0.2, top P 0.8, top K 40 and max output tokens 8192) to generate a response.
2.change the conversation model to Anthropic Claude-3-Opus with out setting parameter value.
3.model returned with an error message says unsupported value.

What browsers are you seeing the problem on?

Chrome

Relevant log output

No response

Screenshots

image
image
as you can see, this is the default value for gemini, but wrongly applied to claude.

Code of Conduct

  • I agree to follow this project's Code of Conduct
@TheValkyrja TheValkyrja added the bug Something isn't working label May 18, 2024
@danny-avila danny-avila changed the title [Bug]: parameteters cannot automaticly change when switching Endpoints mid-conversation [Bug]: Google <> Anthropic Params Conflict with Mid-conversation Switch May 19, 2024
@danny-avila
Copy link
Owner

Thanks, when the params are "shared," the previous values are allowed mid-conversation but in this case, they are only shared in name, and some discrepancy needs to be made for a more seamless experience.

@danny-avila danny-avila changed the title [Bug]: Google <> Anthropic Params Conflict with Mid-conversation Switch [Bug]: Google <> Anthropic Params Conflict with Mid-convo Switch May 19, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants