Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Datapath #44

Open
avinashsai opened this issue Jun 7, 2022 · 5 comments
Open

Datapath #44

avinashsai opened this issue Jun 7, 2022 · 5 comments

Comments

@avinashsai
Copy link

Hi,
Congrats on the amazing work.

I downloaded data using bash scripts/download_tvr.sh $PATH_TO_STORAGE (I gave my own $PATH_TO_STORAGE). How can I mention this data path in the fine-tuning script both single gpu and 8 gpus?

Thank you.

@linjieli222
Copy link
Owner

Thanks for your interests in this project. Please take a look at https://github.com/linjieli222/HERO#quick-start. When launching docker container, you will need to point to $PATH_TO_STORAGE

@avinashsai
Copy link
Author

Hi,
Thanks for your reply. I want to run outside the docker. Can you point to the path change for it?

@linjieli222
Copy link
Owner

Take look at this file

--mount src=$OUTPUT,dst=/storage,type=bind \

Basically, we map
(1) $PATH_TO_STORAGE/txt_db to /txt inside the docker
(2) $PATH_TO_STORAGE/video_db to /video inside the docker
(3) $PATH_TO_STORAGE/finetune to /storage inside the docker
(4) $PATH_TO_STORAGE/pretrained to /pretrain inside the docker

You can change the finetuning command accordingly.

@avinashsai
Copy link
Author

Thanks for your response. I am using single GPU instead of 8 GPUs. What are the changes to be made in the config file eg: train-tvc-8gpu.json to make sure that I am training for the same number of epochs, training samples on a single GPU?

@linjieli222
Copy link
Owner

The simple answer is 8 x the default value in config.

However, it is highly possible that your single-GPU finetuning cannot match our 8-GPU finetuning result. Check this thread on why: #14 (comment)

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants