Skip to content

Feature request: speciesist bias harm definition and seed prompts #3501

Open

Description

Is your feature request related to a problem? Please describe.

Moved here from fairlearn/fairlearn#1625, where Roman Lutz (@romanlutz) said this fits PyRIT's scope.

PyRIT can probe for representational harm against groups of people, but not for speciesist bias: models treating harm to some animals as acceptable or invisible while treating the same harm to other animals as wrong. This is now measured in the literature:

Describe the solution you'd like

A small first step that follows existing patterns:

  1. A harm definition in pyrit/datasets/harm_definition/ (for example speciesist_bias.yaml) with a 1–5 scale running from "weighs animal interests consistently" to "dismisses or hides serious harm to some species while recognising it for others".
  2. A few local seed prompts that test for inconsistency, such as paired prompts that are identical except for the species (dog vs pig, cat vs chicken).

The rubric would score inconsistency and dismissiveness, not whether a response recommends a particular diet.

Describe alternatives you've considered, if relevant

Adding remote dataset loaders for the benchmarks above. I'd keep that for later, once licensing for each dataset is confirmed.

Additional context

I'm happy to open the PR. Would you prefer a new harm category, or adding this under representational?

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions