with logits_all == true, use to the last logits vector #498

Piezoid · 2023-03-25T14:53:05Z

Affects llama_sample_top_p_top_k and params.ignore_eos mode in main.cpp.
Alternatively the sampler could take an additional argument indicating the position to sample in the batch.
As of now, I haven't come across any code path that hit this issue (beside my changes in #477).

Piezoid · 2023-03-25T19:03:36Z

Resolved in 03f7e33.

Added info to set ENV variables in PowerShell

* Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb * Update colab.ipynb

with logits_all == true, seek to the last logits vector

ea546b5

Piezoid closed this Mar 25, 2023

Piezoid deleted the seeklogits branch March 25, 2023 19:14

Deadsg pushed a commit to Deadsg/llama.cpp that referenced this pull request Dec 19, 2023

Merge pull request ggml-org#498 from ctejada85/windows-pip-install

a05cfaf

Added info to set ENV variables in PowerShell

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

with logits_all == true, use to the last logits vector #498

with logits_all == true, use to the last logits vector #498

Piezoid commented Mar 25, 2023

Piezoid commented Mar 25, 2023

with logits_all == true, use to the last logits vector #498

with logits_all == true, use to the last logits vector #498

Conversation

Piezoid commented Mar 25, 2023

Piezoid commented Mar 25, 2023