summaryrefslogtreecommitdiff
path: root/reference.md
AgeCommit message (Collapse)AuthorFilesLines
2021-10-08reference: Update to a version which will work with modern scenario count checksDaniel Silverstone1-3/+3
Signed-off-by: Daniel Silverstone <dsilvers@digital-scurf.org>
2021-09-18reference.md: Update SHAs for compatibilityDaniel Silverstone1-3/+3
Signed-off-by: Daniel Silverstone <dsilvers@digital-scurf.org>
2021-09-07chore: Re-enable reference.md suiteDaniel Silverstone1-3/+3
Signed-off-by: Daniel Silverstone <dsilvers@digital-scurf.org>
2021-06-16test: have ./check tail the test.py log file on failureLars Wirzenius1-1/+20
For each subplot, if running the test program fails, the last 100 lines of the log file is output. For the reference.md subplot, the last 100 lines of the log file for the test program from the referenced subplot is output. This makes it easier to debug failures in CI. Sponsored-by: author
2021-06-11reference.md: Use the sorted metadata commit for referenceDaniel Silverstone1-3/+3
Signed-off-by: Daniel Silverstone <dsilvers@digital-scurf.org>
2021-05-01reference: We made a backward non-compatible changeDaniel Silverstone1-3/+3
Signed-off-by: Daniel Silverstone <dsilvers@digital-scurf.org>
2021-05-01reference: Update reference SHA for new CIDaniel Silverstone1-4/+4
Signed-off-by: Daniel Silverstone <dsilvers@digital-scurf.org>
2021-05-01reference: Update reference git URLsDaniel Silverstone1-3/+3
Signed-off-by: Daniel Silverstone <dsilvers@digital-scurf.org>
2021-04-25fix: actually run the right subplot binaryLars Wirzenius1-1/+1
This bug is dedicated to the screenwriters of the movie Inception. We are verifying, in reference.md, that the version of Subplot in the current source tree can still run the subplot from an older version of Subplot. The goal is to make sure that what worked doesn't accidentally stop working. We want to break backwards compatibility only on purpose. This commit fixes a problem in reference.md: it wasn't running the Subplot binaries built from the current source tree, but ones installed system-wide into /usr/bin. This was due to a fairly intricate bug. reference.md generates an outer test program, which clones a specific older version of Subplot, and generates an inner test program, using subplot.md from that older version. By default, that inner test program uses the Subplot binaries built from the inner source tree, but for reference.md we don't that. To get the inner test program to use the right binaries, we need to add the directory where they are to $PATH, and also set SUBPLOT_DIR in the environment to any value. If SUBPLOT_DIR is set, the inner test program won't generate a wrapper around the Subplot binaries that forces use of the build location of the inner, older Subplot source tree.
2021-04-24test: add subplot for testing Subplot against a curated listLars Wirzenius1-0/+61