Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

110M TinyStories hits instruction limit for non-empty prompt #12

Open
icppWorld opened this issue Sep 28, 2023 · 0 comments
Open

110M TinyStories hits instruction limit for non-empty prompt #12

icppWorld opened this issue Sep 28, 2023 · 0 comments
Assignees
Labels
unknown Don't know yet if it is a bug, an enhancement or a limitation

Comments

@icppWorld
Copy link
Owner

For the 110M TinyStories canister, this works fine:

dfx canister call --network ic  "obk3p-xiaaa-aaaag-ab2oa-cai" new_chat '()'
dfx canister call --network ic  "obk3p-xiaaa-aaaag-ab2oa-cai" inference '(record {prompt = "" : text; steps = 10 : nat64; temperature = 0.0 : float32; topp = 0.9 : float32; rng_seed = 0 : nat64;})'

But this fails:

dfx canister call --network ic  "obk3p-xiaaa-aaaag-ab2oa-cai" new_chat '()'
dfx canister call --network ic  "obk3p-xiaaa-aaaag-ab2oa-cai" inference '(record {prompt = "Bobby" : text; steps = 10 : nat64; temperature = 0.0 : float32; topp = 0.9 : float32; rng_seed = 0 : nat64;})'

Error: Failed update call.
Caused by: Failed update call.
  The replica returned a replica error: Replica Error: reject code CanisterError, reject message Canister obk3p-xiaaa-aaaag-ab2oa-cai exceeded the instruction limit for single message execution., error code None
@icppWorld icppWorld self-assigned this Sep 28, 2023
@icppWorld icppWorld added the unknown Don't know yet if it is a bug, an enhancement or a limitation label Sep 28, 2023
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
unknown Don't know yet if it is a bug, an enhancement or a limitation
Projects
None yet
Development

No branches or pull requests

1 participant