Skip to content

Live streaming facial landmarks example #2338

New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

#

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

Jump to bottom
Closed
nikolausWest opened this issue Jun 8, 2023 · 0 comments · Fixed by #2360
Closed

Live streaming facial landmarks example #2338

nikolausWest opened this issue Jun 8, 2023 · 0 comments · Fixed by #2360
Assignees
@abey79
Labels
enhancement New feature or request examples Issues relating to the Rerun examples

Comments

@nikolausWest
Copy link
Member

Add a python example that uses the mediapipe solution Facial landmark detection to visualize detected landmarks on a live webcam stream.
@nikolausWest nikolausWest added enhancement New feature or request examples Issues relating to the Rerun examples labels Jun 8, 2023
This was referenced Jun 12, 2023
Merged
Closed
abey79 added a commit that referenced this issue Jun 14, 2023
@abey79
New face detection example based on MediaPipe (#2360)
07c2a84 
### What

Closes #2338

New example based on
[MediaPipe](https://developers.google.com/mediapipe)'s Face Detector and
Landmarks solutions.

<img alt="image"
src="https://static.rerun.io/6efefd1de7c63166c4d99956711b6367206d9835_mp_face.png">

In the future, this example could benefit from a custom blueprint when
the API is stabilised enough:
- split face detect and face landmark into separate views (both with the
image in the background)
  - proper default orientation for the face 3D model
  - general layout order (cam views -> 3D view -> plots)

### Checklist
* [x] I have read and agree to [Contributor
Guide](https://github.com/rerun-io/rerun/blob/main/CONTRIBUTING.md) and
the [Code of
Conduct](https://github.com/rerun-io/rerun/blob/main/CODE_OF_CONDUCT.md)
* [x] I've included a screenshot or gif (if applicable)

<!-- This line will get updated when the PR build summary job finishes.
-->
PR Build Summary: https://build.rerun.io/pr/2360

<!-- pr-link-docs:start -->
Docs preview: https://rerun.io/preview/275e36b/docs
Examples preview: https://rerun.io/preview/275e36b/examples
<!-- pr-link-docs:end -->
emilk pushed a commit that referenced this issue Jun 15, 2023
@abey79 @emilk
New face detection example based on MediaPipe (#2360)
122832e 
### What

Closes #2338

New example based on
[MediaPipe](https://developers.google.com/mediapipe)'s Face Detector and
Landmarks solutions.

<img alt="image"
src="https://static.rerun.io/6efefd1de7c63166c4d99956711b6367206d9835_mp_face.png">

In the future, this example could benefit from a custom blueprint when
the API is stabilised enough:
- split face detect and face landmark into separate views (both with the
image in the background)
  - proper default orientation for the face 3D model
  - general layout order (cam views -> 3D view -> plots)

### Checklist
* [x] I have read and agree to [Contributor
Guide](https://github.com/rerun-io/rerun/blob/main/CONTRIBUTING.md) and
the [Code of
Conduct](https://github.com/rerun-io/rerun/blob/main/CODE_OF_CONDUCT.md)
* [x] I've included a screenshot or gif (if applicable)

<!-- This line will get updated when the PR build summary job finishes.
-->
PR Build Summary: https://build.rerun.io/pr/2360

<!-- pr-link-docs:start -->
Docs preview: https://rerun.io/preview/275e36b/docs
Examples preview: https://rerun.io/preview/275e36b/examples
<!-- pr-link-docs:end -->
# for free to join this conversation on GitHub. Already have an account? # to comment
Assignees

@abey79 abey79

Labels
enhancement New feature or request examples Issues relating to the Rerun examples
Projects
None yet
Milestone
No milestone
Development

Successfully merging a pull request may close this issue.

New face detection example based on MediaPipe rerun-io/rerun
2 participants
@nikolausWest @abey79