Bug 474

Summary: Augment test infrastructure to show priorities of passing/failing tests
Product: Libre-SOC's first SoC Reporter: Cole Poirier <colepoirier>
Component: Source CodeAssignee: Luke Kenneth Casson Leighton <lkcl>
Status: DEFERRED ---    
Severity: enhancement CC: libre-soc-bugs, programmerjake
Priority: Lowest    
Version: unspecified   
Hardware: PC   
OS: Linux   
See Also: https://bugs.libre-soc.org/show_bug.cgi?id=190
NLnet milestone: --- total budget (EUR) for completion of task and all subtasks: 0
budget (EUR) for this task, excluding subtasks' budget: 0 parent task for budget allocation:
child tasks for budget allocation: The table of payments (in EUR) for this task; TOML format:

Description Cole Poirier 2020-08-27 01:55:05 BST 
Jacob and I just had a call because I wanted to ask him some questions about Kazan, and we talked about Libre-SOC's testing infrastructure.

Jacob said a change he would like to make to our testing infrastructure is to annotate the importance or priorities of the passing/failing tests.

I brought up that I thought we could also benefit (if to a much lesser extent) with an easier to parse test failure reporting format taken from https://wardpy.com/ or https://github.com/CleanCut/green or Jacob mentioned either taking code from VSCode's python unittest plugin, or looking into nmigen's interface for their CI code coverage.

I know I wouldn't be the right person to attempt these modifications, and I know we have the very tight upcoming October tape-out deadline, so I'm raising this bug as unconfirmed for you, Luke, to decide what to do with it.