Skip to content
New issue

Have a question about this project? # for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “#”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? # to your account

[FEAT][MAINT][4019] Make multi-modal easier to configure in seedprompt files #696

Open
wants to merge 3 commits into
base: main
Choose a base branch
from

Conversation

shivenchawla
Copy link
Contributor

@shivenchawla shivenchawla commented Feb 7, 2025

Description

Issue: #695

Right now, images are configured like this in yaml (e.g., illegal-multimodal.prompt)

  • dataset_name: TestMultimodalTextImageAudioVideo
    harm_categories:
    • illegal
      source: AI Red Team
      value: ......\assets\pyrit_architecture.png
      data_type: image_path
      sequence: 1
  • dataset_name: TestMultimodalTextImageAudioVideo
    harm_categories:
    • illegal

These relative paths break when using in different contexts. For example, you can't use them in both jupyter notebooks and unit tests.
As part of this issue, we try to make it easier to use yaml across contexts.

Proposed solution:

  1. Path as:
    {pyrit_root}/assets/image.png or $pyrit_root/assets/image.png

  2. Using the other configured paths - e.g. see path.py

Tests and Documentation

Notebook sample and JupyText available at this path:

  1. Notebook: PyRIT\doc\code\memory\8_seed_prompt_database.ipynb
  2. JupyText: #PyRIT\doc\code\memory\8_seed_prompt_database.py

@shivenchawla shivenchawla force-pushed the maint/shivenchawla/4019 branch 2 times, most recently from 369d73f to b669b24 Compare February 7, 2025 23:48
@shivenchawla shivenchawla marked this pull request as ready for review February 8, 2025 00:00
@shivenchawla shivenchawla force-pushed the maint/shivenchawla/4019 branch 5 times, most recently from 63924c1 to 463a1e3 Compare February 12, 2025 00:52
@shivenchawla shivenchawla force-pushed the maint/shivenchawla/4019 branch from 6c85de8 to b8af35f Compare February 22, 2025 00:12
Copy link
Contributor

@jsong468 jsong468 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Great work, Shiven!

# for free to join this conversation on GitHub. Already have an account? # to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

4 participants