Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Please share the name of "post_layernorm" OwlPredictor.encode_image_torch for output-blob-names for deepstream configuration #7

Open
pakyurekm opened this issue Nov 18, 2023 · 0 comments

Comments

@pakyurekm
Copy link

pakyurekm commented Nov 18, 2023

in OwlPredictor.encode_image_torch

def encode_image_torch(self, image: torch.Tensor)
        vision_outputs = self.model.owlvit.vision_model(image)
        last_hidden_state = vision_outputs[0]
        image_embeds = self.model.owlvit.vision_model.post_layernorm(last_hidden_state)
        class_token_out = image_embeds[:, :1, :]
        image_embeds = image_embeds[:, 1:, :] * class_token_out
        image_embeds = self.model.layer_norm(image_embeds) 

Please share the name of post_layernorm to address output-blob-names in deepstream configuration file
this is my config file

property]
gpu-id=0
model-engine-file=/nanoowl_utils/data/owl_image_encoder_patch32.engine
process-mode=2
network-mode=2
net-scale-factor=0.0146
offsets=122.77;116.75;104.094
secondary-reinfer-interval=0
gie-unique-id=2
output-blob-names=LayerNorm
output-tensor-meta=1
network-type=1
operate-on-gie-id=1
operate-on-class-ids=2
# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant