Skip to content

[FEA] Set up infra for scheduling e2e vector database benchmarks / integration tests #2105

@cjnolet

Description

@cjnolet

#2012 Introduces new scaffolding for running Python tests on OpenSearch backends, conditional on whether certain environment variables are defined. It's probably not likely that we'll be able to run these tests in CI, but we should establish some infrastructure so that we can still run these, maybe nightly or weekly, to make sure we're spotting and fixing issues as they arise.

It's immensely useful to be able to test these backends. We just need to make sure we're taking advantage of these tests by actually using them. Otherwise, these backends are going to get stale and start failing silently. We need to make sure our users aren't the first ones alerting us to regressions and failures.

@jrbourbeau @jameslamb @jnke2016 JFYI.

Metadata

Metadata

Assignees

No one assigned

    Labels

    Type

    No type
    No fields configured for issues without a type.

    Projects

    Status

    Todo

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions