Skip to content

Fix copypasta in test case descriptions #271

@gilles-peskine-arm

Description

@gilles-peskine-arm

Description

We evidently have a lot of copypasta in test case descriptions. Mbed-TLS/mbedtls#2843 uncovered 1420 instances of test cases that have the same description. Sometimes the reason is test descriptions that aren't fully precise and could use some additional indications such as “… using this/that algorithm” or “… with an input of this/that length”. Sometimes there are just test cases with different input data and #1, #2, … is adequate. Sometimes test cases were copied and pasted and the test data was changed but not the test description, and the description is incorrect.

#270 added a disambiguator [#1], [#2], … to non-unique test descriptions. Not all incorrect test descriptions are formerly non-unique, but having been non-unique has a strong correlation with being imprecise or incorrect. The comments in #270 contain some analysis of some of the suspicious test descriptions.

Definition of done for this issue: no test case description contains [# anymore. All the descriptions that currently contain [# have been edited to be corrected, or to have a plain # without brackets if they were correct and sufficiently precise.

I expect this to be done partly organically as we modify or expand tests, and partly by working on one module at a time.

Issue request type

[ ] Question
[ ] Enhancement
[x] Bug

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions