Skip to content

Discussion on skipping examples #792

Description

@stephenbach

Continuing the discussion from PR #788 to double check some stuff. The contributing guide says

Filtering prompts. If a prompt is applied to an example and produces an empty string,
that prompt/example pair will be skipped. You can therefore create prompts that only
apply to a subset of the examples by wrapping them in Jinja if statements.

I could have sworn it was either a blank input/output/or totally blank, as supported by the way the tests are written. Did we change this at some point? Perhaps we can run a check on existing prompts or change the code further to allow all options?

Also related to #749.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions