Skip to content

Commit

Permalink
Merge branch 'main' of github:line/lighthouse into main
Browse files Browse the repository at this point in the history
  • Loading branch information
awkrail committed Sep 24, 2024
2 parents 40521f5 + 765f3cd commit 6394d56
Showing 1 changed file with 2 additions and 3 deletions.
5 changes: 2 additions & 3 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -8,7 +8,7 @@

Lighthouse is a user-friendly library for reproducible video moment retrieval and highlight detection (MR-HD).
It supports seven models, four features (video and audio features), and six datasets for reproducible MR-HD, MR, and HD. In addition, we prepare an inference API and Gradio demo for developers to use state-of-the-art MR-HD approaches easily.
Furthermore, Lighthouse supports [audio moment retrieval](https://h-munakata.github.io/Language-based-Audio-Moment-Retrieval/), a task a task that identifies relevant moments from an audio input based on a given text query.
Furthermore, Lighthouse supports [audio moment retrieval](https://h-munakata.github.io/Language-based-Audio-Moment-Retrieval/), a task to identify relevant moments from an audio input based on a given text query.

**News**: Our demo paper is available on arXiv. Any comments are welcome: [Lighthouse: A User-Friendly Library for Reproducible Video Moment Retrieval and Highlight Detection](https://www.arxiv.org/abs/2408.02901).

Expand Down Expand Up @@ -168,7 +168,6 @@ lighthouse/
│ │ ├── resnet
│ │ └── slowfast
│ ├── tvsum
│ │ ├── audio
│ │ ├── clip
│ │ ├── clip_text
│ │ ├── i3d
Expand Down Expand Up @@ -198,7 +197,7 @@ python training/train.py --model MODEL --dataset DATASET --feature FEATURE [--re
| | Options |
|---------|----------------------------------------------------------------------------------------------------------|
| Model | moment_detr, qd_detr, eatr, cg_detr, uvcom, tr_detr, taskweave_mr2hd, taskweave_hd2mr |
| Feature | resnet_glove, clip, clip_slowfast, clip_slowfast_pann, i3d_clip, clap (AMR) |
| Feature | resnet_glove, clip, clip_slowfast, clip_slowfast_pann, i3d_clip, clap |
| Dataset | qvhighlight, qvhighlight_pretrain, activitynet, charades, tacos, tvsum, youtube_highlight, clotho-moment |

(**Example 1**) Moment DETR w/ CLIP+Slowfast on QVHighlights:
Expand Down

0 comments on commit 6394d56

Please # to comment.