Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Getting started guide client samples broken ? #3348

Open
nikste opened this issue Oct 15, 2024 · 0 comments
Open

Getting started guide client samples broken ? #3348

nikste opened this issue Oct 15, 2024 · 0 comments

Comments

@nikste
Copy link

nikste commented Oct 15, 2024

🐛 Describe the bug

following the getting started guide:

https://github.com/pytorch/serve/blob/master/docs/getting_started.md

i get following error messages when trying to run the client examples.
Am I doing something wrong?

Error logs

serve$ python -m grpc_tools.protoc --proto_path=frontend/server/src/main/resources/proto/ --python_out=ts_scripts --grpc_python_out=ts_scripts frontend/server/src/main/resources/proto/inference.proto frontend/server/src/main/resources/proto/management.proto
google/rpc/status.proto: File not found.
inference.proto:6:1: Import "google/rpc/status.proto" was not found or had errors.
inference.proto:32:14: "google.rpc.Status" is not defined.

and

serve$ python ts_scripts/torchserve_grpc_client.py infer densenet161 examples/image_classifier/kitten.jpg
Traceback (most recent call last):
  File "[..]serve/ts_scripts/torchserve_grpc_client.py", line 7, in <module>
    import inference_pb2
ModuleNotFoundError: No module named 'inference_pb2'

Installation instructions

followed the getting started guide:
https://github.com/pytorch/serve/blob/master/docs/getting_started.md

Model Packaging

from getting started guide

config.properties

from getting started guide

Versions


Environment headers

Torchserve branch:

torchserve==0.12.0
torch-model-archiver==0.12.0

Python version: 3.10 (64-bit runtime)
Python executable: /home/nikste/workspace-abnoba/serving_test/venv/bin/python

Versions of relevant python libraries:
captum==0.6.0
numpy==1.24.3
nvgpu==0.10.0
pillow==10.3.0
psutil==5.9.8
requests==2.32.0
torch==2.4.0+cu121
torch-model-archiver==0.12.0
torch-workflow-archiver==0.2.15
torchaudio==2.4.0+cu121
torchserve==0.12.0
torchvision==0.19.0+cu121
wheel==0.42.0
torch==2.4.0+cu121
**Warning: torchtext not present ..
torchvision==0.19.0+cu121
torchaudio==2.4.0+cu121

Java Version:

OS: Ubuntu 22.04.5 LTS
GCC version: (Ubuntu 11.4.0-1ubuntu1~22.04) 11.4.0
Clang version: 14.0.0-1ubuntu1.1
CMake version: version 3.30.3

Environment:
library_path (LD_/DYLD_): /usr/local/cuda-11.8/lib64:

Repro instructions

getting started guide

Possible Solution

missing packages in the requirements?

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant