Confluence Competition

CoCo 2024 Results

Combined Yes and No Results

category 1st place 2nd place 3rd place
COM ACP FORT-h
CSR CONFident
CTRS CONFident CO3 ACP
GCR AGCP FORT-h
INF infChecker Moca NaTT
LCTRS crest CRaris
NFP CSI FORT-h
SRS CSI ACP Hakusan
TRS CSI ACP CONFident
UNC CSI ACP FORT-h
UNR CSI FORT-h

Yes Results

category 1st place 2nd place 3rd place
COM ACP, FORT-h
CSR CONFident
CTRS CONFident CO3 ACP
GCR AGCP FORT-h
INF infChecker Moca NaTT
LCTRS crest CRaris
NFP CSI FORT-h
SRS CSI ACP Hakusan
TRS CSI ACP Hakusan
UNC CSI ACP FORT-h
UNR CSI FORT-h

No Results

category 1st place 2nd place 3rd place
COM ACP FORT-h
CSR CONFident
CTRS CONFident CO3 ACP
GCR AGCP FORT-h
INF infChecker
LCTRS crest
NFP CSI FORT-h
SRS CSI CONFident ACP
TRS CSI ACP FORT-h
UNC ACP CSI FORT-h
UNR CSI FORT-h

Detailed results are available. The same holds for the LiveView of CoCo 2024 upon completion. Tools with incorrect results (observed during the live competition due to a YES/NO conflict, or communicated afterwards by the tool authors to the SC) are excluded from the results table. This concerns ACP in the UNR category.

Certification Results

category 1st place 2nd place 3rd place
CERTIFICATION CeTA FORTify
RELIABILITY FORT-h CSI ACP

In the CERTIFICATION category, certifiers are ranked based on the number of certificates that are validated. In the RELIABILITY category, tools are ranked based on the number of generated certified proofs.


Problem Selection

The problems were selected using the following ARI-COPS queries. Here s is the number 361 composed of the three random digits 3 (Koko Muroya), 6 (Nick Smallbone), 1 (Geoff Sutcliffe) provided by the panel members.


categories   queries
COM limit:100,s 1..1605 2trs well-formed
CSR limit:100,s 1..1605 {cstrs or csctrs} well-formed
CTRS limit:100,s 1..1605 ctrs type3 oriented well-formed
GCR limit:100,s 1..1605 !srs {trs or mstrs} well-formed
INF 1606 or 1607
limit:98,s 1..1605 infeasibility well-formed
LCTRS 1608 or 1609 or 1610 or 1611
limit:96,s 1..1605 lctrs well-formed
NFP limit:100,s 1..1605 trs !CR:YES
SRS limit:100,s 1..1605 srs well-formed
TRS limit:100,s 1..1605 trs !srs well-formed
UNC limit:100,s 1..1605 trs !CR:YES
UNR 1612 or 1613
limit:98,s 1..1605 trs !CR:YES