Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Tokens repeating at the end with openai provider. #39

Closed
sameedzahoor opened this issue Mar 10, 2024 · 1 comment
Closed

Tokens repeating at the end with openai provider. #39

sameedzahoor opened this issue Mar 10, 2024 · 1 comment

Comments

@sameedzahoor
Copy link

sameedzahoor commented Mar 10, 2024

Tokens are repeating at the end for all queries with openai as the provider using api key.
Here is the error that is occuring.

Switched provider to openai.
>
Write an essay in 3000 words on the benefits of integration and education amongst tribals.
><
Introduction:
Tribal communities have long been marginalized and excluded from mainstream society, facing
discrimination and inequality in various aspects of life. However, integration and education can play
a vital role in bridging the gap between tribal and non-tribal communities, promoting social
cohesion, and empowering tribal individuals to reach their full potential. In this essay, we will
explore the benefits of integration and education amongst tribals, highlighting the positive impact
it can have on their socio-economic status, cultural preservation, and overall well-being.

Socio-Economic Benefits:
1. Improved Employment Opportunities: Education and integration can open up new avenues for
employment opportunities for tribal individuals. With access to quality education, they can acquire
skills and knowledge that are in demand in the job market, enabling them to secure better-paying jobs
and improve their socio-economic status.
2. Economic Empowerment: Tribal communities have traditionally been dependent on agriculture, forest
produce, and other natural resources for their livelihood. However, with education and integration,
they can explore new economic opportunities, such as entrepreneurship, vocational training, and
self-employment, which can help them achieve economic stability and independence.
3. Access to Healthcare and Social Services: Integration can provide tribal communities, and, and,
and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and, and,
and, and, and, and, and, and, and, and, and, and, and, and, and,

This needs to be fixed. This is happening everytime for every prompt.

@sameedzahoor sameedzahoor changed the title Tokens repeating in openai provider. Tokens repeating at the end with openai provider. Mar 10, 2024
@Simatwa
Copy link
Owner

Simatwa commented Mar 15, 2024

Try out this flag --top-k 0

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants