Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[LLM INFER] Fix some bugs and chatglm_v2 support block_attn #9271

Merged
merged 6 commits into from
Oct 25, 2024

update

d19ed92
Select commit
Loading
Failed to load commit list.
Merged

[LLM INFER] Fix some bugs and chatglm_v2 support block_attn #9271

update
d19ed92
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch failed Oct 25, 2024 in 1s

0.00% of diff hit (target 80.00%)

View this Pull Request on Codecov

0.00% of diff hit (target 80.00%)

Annotations

Check warning on line 34 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L34 

Added line #L34 was not covered by tests

Check warning on line 46 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L46 

Added line #L46 was not covered by tests

Check warning on line 181 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L181 

Added line #L181 was not covered by tests

Check warning on line 191 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L189-L191 

Added lines #L189 - L191 were not covered by tests

Check warning on line 193 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L193 

Added line #L193 was not covered by tests

Check warning on line 382 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L377-L382 

Added lines #L377 - L382 were not covered by tests

Check warning on line 386 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L384-L386 

Added lines #L384 - L386 were not covered by tests

Check warning on line 388 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L388 

Added line #L388 was not covered by tests

Check warning on line 393 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L390-L393 

Added lines #L390 - L393 were not covered by tests

Check warning on line 395 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L395 

Added line #L395 was not covered by tests

Check warning on line 398 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L398 

Added line #L398 was not covered by tests

Check warning on line 400 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L400 

Added line #L400 was not covered by tests

Check warning on line 414 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L412-L414 

Added lines #L412 - L414 were not covered by tests

Check warning on line 420 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L417-L420 

Added lines #L417 - L420 were not covered by tests

Check warning on line 422 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L422 

Added line #L422 was not covered by tests

Check warning on line 425 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L424-L425 

Added lines #L424 - L425 were not covered by tests

Check warning on line 435 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L435 

Added line #L435 was not covered by tests

Check warning on line 437 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L437 

Added line #L437 was not covered by tests

Check warning on line 448 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L446-L448 

Added lines #L446 - L448 were not covered by tests

Check warning on line 568 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L564-L568 

Added lines #L564 - L568 were not covered by tests

Check warning on line 572 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L570-L572 

Added lines #L570 - L572 were not covered by tests

Check warning on line 575 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L574-L575 

Added lines #L574 - L575 were not covered by tests

Check warning on line 587 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L585-L587 

Added lines #L585 - L587 were not covered by tests

Check warning on line 589 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L589 

Added line #L589 was not covered by tests

Check warning on line 593 in paddlenlp/experimental/transformers/chatglm_v2/modeling.py

See this annotation in the file changed.

@codecov codecov / codecov/patch

paddlenlp/experimental/transformers/chatglm_v2/modeling.py#L591-L593 

Added lines #L591 - L593 were not covered by tests
View more details on Codecov