Top All Release Checkout Repeat Running

OpenBSD perform 6.6 release 2020-02-07 checkout test results

created at 2022-07-23T18:58:41Z
run at 2020-02-07T13:16:09Z
run log/duration 17:52:25
test host with cpu cores ot14/4
machine release setup 6.6/keep info
steps 13/commit
cvs checkout 2020-01-21 2020-01-21 2020-01-21 2020-01-21 2020-01-21 2020-01-21 2020-01-21 2020-01-21 2020-01-21 2020-01-21 2020-01-21 2020-01-21 2020-01-22
machine build info build info build info build info build info build info build info build info build info build info build info build info build info
kernel build version version version version version version version version version version version version version
kernel commits cvslog/1 cvslog/1 cvslog/1 cvslog/1 cvslog/1 cvslog/1 cvslog/1 cvslog/1 cvslog/1 cvslog/3 cvslog/2 cvslog/0
kernel name list +6 -6 +0 -0 +0 -0 +0 -0 +0 -0 +0 -0 +0 -0 +4 -4 +35 -35 +3575 -3574 +36720 -36720 +0 -0
repetitions kernel mode 5/align 5/align 5/align 5/align 5/align 5/align 5/align 5/align 5/align 5/align 5/align 5/align 5/align
zoom
openbsd-openbsd-stack-tcp-ip3fwd-old iperf3 -c10.3.2.35 -w1m -t10 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 3780000000 3770000000 3790000000 3780000000 3780000000 3780000000 3780000000 3780000000 3790000000 3790000000 3790000000 3490000000 3500000000 bits/sec 3738461538.46154 3490000000 3790000000 103985661.278271 0.0278150945806074
receiver 3700000000 3700000000 3710000000 3710000000 3710000000 3710000000 3710000000 3710000000 3720000000 3720000000 3720000000 3420000000 3430000000 bits/sec 3666923076.92308 3420000000 3720000000 103357826.199502 0.0281865269686075
openbsd-openbsd-stack-tcp-ip3rev-old iperf3 -c10.3.2.35 -w1m -t10 -R PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 3680000000 3700000000 3680000000 3690000000 3690000000 3700000000 3700000000 3690000000 3700000000 3710000000 3730000000 3430000000 3430000000 bits/sec 3656153846.15385 3430000000 3730000000 97233933.7362347 0.0265945958041458
receiver 3750000000 3770000000 3750000000 3770000000 3760000000 3760000000 3770000000 3760000000 3770000000 3780000000 3800000000 3490000000 3490000000 bits/sec 3724615384.61538 3490000000 3800000000 100813261.079421 0.0270667574149622
openbsd-openbsd-stack-tcpbench-single-old tcpbench -S1000000 -t10 10.3.2.35 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 3553792750 3555104125 3570530000 3568619125 3580628000 3555883875 3559585500 3544188625 3558893250 3546179625 3579628250 3295298125 3292858750 bits/sec 3520091538.46154 3292858750 3580628000 96971215.0101472 0.0275479242373704
openbsd-openbsd-stack-tcpbench-parallel-old tcpbench -S1000000 -t10 -n100 10.3.2.35 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 3717626000 3709517750 3723220625 3707243500 3720015750 3716121500 3713030875 3710257000 3720913750 3714982500 3723894750 3452112500 3457141125 bits/sec 3675852125 3452112500 3723894750 94465858.2181002 0.0256990365786546
openbsd-openbsd-stack-udp-ip3fwd-old-1 iperf3 -c10.3.2.35 -u -b10G -w1m -t10 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 953000000 950000000 940000000 945000000 952000000 955000000 942000000 947000000 945000000 952000000 949000000 936000000 937000000 bits/sec 946384615.384615 936000000 955000000 5955455.95410643 0.00629284950039695
receiver 935000000 931000000 923000000 927000000 934000000 937000000 924000000 929000000 927000000 933000000 931000000 919000000 919000000 bits/sec 928384615.384615 919000000 937000000 5636944.91094193 0.00607177759899288
openbsd-openbsd-stack-udp-ip3rev-old-1 iperf3 -c10.3.2.35 -u -b10G -w1m -t10 -R PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 1010000000 1000000000 1010000000 1020000000 1020000000 1010000000 1010000000 1010000000 1020000000 1010000000 994000000 1010000000 999000000 bits/sec 1009461538.46154 994000000 1020000000 7712281.75968879 0.00763999564702844
receiver 1010000000 1000000000 1010000000 1030000000 1020000000 1010000000 1010000000 1010000000 1020000000 1010000000 995000000 1010000000 1000000000 bits/sec 1010384615.38462 995000000 1030000000 8871201.99590061 0.00878002481512813
openbsd-openbsd-stack-udpbench-long-send-old udpbench -l1472 -t10 -r ot15 send 10.3.2.35 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
send 2228770000 2213350000 2222410000 2219470000 2226800000 2223630000 2219070000 2233000000 2227500000 2223720000 2184050000 2151910000 2147320000 bits/sec 2209307692.30769 2147320000 2233000000 27944170.7568849 0.0126483834072457
recv 2227330000 2213080000 2220730000 2217480000 2226100000 2221330000 2217760000 2231580000 2225680000 2222540000 2182750000 2150580000 2146430000 bits/sec 2207951538.46154 2146430000 2231580000 27814493.6889313 0.0125974203710612
openbsd-openbsd-stack-udpbench-long-recv-old udpbench -l1472 -t10 -r ot15 recv 10.3.2.34 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
recv 2221990000 2206130000 2201110000 2216100000 2218810000 2212070000 2214180000 2210560000 2201240000 2214510000 2189540000 2163220000 2161120000 bits/sec 2202352307.69231 2161120000 2221990000 19029621.910568 0.00864058935716233
send 2224280000 2208100000 2201910000 2216320000 2220720000 2213770000 2216270000 2211400000 2202470000 2215660000 2190470000 2164720000 2162590000 bits/sec 2203744615.38462 2162590000 2224280000 19100501.6508365 0.00866729362263375
openbsd-openbsd-stack-udpbench-short-send-old udpbench -l36 -t10 -r ot15 send 10.3.2.35 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
send 97003300 97213600 97407800 97734500 97415600 96950400 96314900 96643300 96709900 97595000 95921800 94492600 93789300 bits/sec 96553230.7692308 93789300 97734500 1147730.8438055 0.0118870268209736
recv 96951600 97123800 97327500 97686400 97355500 96857200 96265600 96590000 96673600 97555700 95892300 94417500 93766500 bits/sec 96497169.2307692 93766500 97686400 1141205.46008603 0.0118263102346234
openbsd-openbsd-stack-udpbench-short-recv-old udpbench -l36 -t10 -r ot15 recv 10.3.2.34 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
recv 96084400 96178100 96105900 96340300 95992400 96887800 96676000 96400400 97095300 96335400 95071500 94824100 95165500 bits/sec 96089007.6923077 94824100 97095300 663431.19689818 0.00690434018241287
send 96089000 96254800 96131800 96428800 95998400 96928900 96764300 96438400 97151100 96404200 95085800 94905900 95165500 bits/sec 96134376.9230769 94905900 97151100 673462.010982569 0.00700542337234315
openbsd-openbsd-stack-tcp6-ip3fwd-old iperf3 -6 -cfdd7:e83e:66bc:0302::35 -w1m -t10 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 3090000000 3080000000 3090000000 3080000000 3090000000 3090000000 3080000000 3080000000 3090000000 3080000000 3090000000 2970000000 2960000000 bits/sec 3066923076.92308 2960000000 3090000000 43744822.178809 0.0142634233339483
receiver 3030000000 3020000000 3030000000 3020000000 3030000000 3030000000 3030000000 3020000000 3030000000 3030000000 3030000000 2910000000 2910000000 bits/sec 3009230769.23077 2910000000 3030000000 42510005.7835326 0.0141265356642619
openbsd-openbsd-stack-tcp6-ip3rev-old iperf3 -6 -cfdd7:e83e:66bc:0302::35 -w1m -t10 -R PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 3010000000 3030000000 3030000000 3040000000 3030000000 3030000000 3030000000 3030000000 3020000000 3040000000 3010000000 2900000000 2900000000 bits/sec 3007692307.69231 2900000000 3040000000 46765182.0109867 0.0155485259883076
receiver 3060000000 3090000000 3090000000 3090000000 3090000000 3090000000 3090000000 3090000000 3080000000 3100000000 3070000000 2960000000 2960000000 bits/sec 3066153846.15385 2960000000 3100000000 46332985.6811557 0.015111109228676
openbsd-openbsd-stack-tcp6bench-single-old tcpbench -S1000000 -t10 fdd7:e83e:66bc:0302::35 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 2916330875 2912841750 2919097000 2927654250 2913212625 2920076625 2920812375 2920367250 2922538750 2922786000 2895649250 2802017375 2806079125 bits/sec 2899958711.53846 2802017375 2927654250 41560442.1795483 0.0143313910002188
openbsd-openbsd-stack-tcp6bench-parallel-old tcpbench -S1000000 -t10 -n100 fdd7:e83e:66bc:0302::35 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 3023648000 3019100750 3024215125 3018902750 3020750750 3023657250 3018892000 3019302250 3019314000 3017493125 3008475000 2926412500 2928167375 bits/sec 3005256221.15385 2926412500 3024215125 33459787.6175481 0.0111337553790011
openbsd-openbsd-stack-udp6-ip3fwd-old iperf3 -6 -cfdd7:e83e:66bc:0302::35 -u -b10G -w1m -t10 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 887000000 888000000 892000000 892000000 886000000 890000000 888000000 892000000 890000000 888000000 891000000 885000000 882000000 bits/sec 888538461.538462 882000000 892000000 2925100.51412793 0.00329203590023921
receiver 870000000 872000000 875000000 875000000 870000000 874000000 871000000 875000000 874000000 871000000 874000000 868000000 865000000 bits/sec 871846153.846154 865000000 875000000 2957289.65949863 0.00339198566909142
openbsd-openbsd-stack-udp6-ip3rev-old iperf3 -6 -cfdd7:e83e:66bc:0302::35 -u -b10G -w1m -t10 -R PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 945000000 950000000 947000000 945000000 957000000 948000000 951000000 952000000 950000000 950000000 950000000 945000000 946000000 bits/sec 948923076.923077 945000000 957000000 3315732.62496189 0.00349420591151951
receiver 947000000 951000000 949000000 946000000 959000000 949000000 953000000 954000000 951000000 950000000 951000000 946000000 947000000 bits/sec 950230769.230769 946000000 959000000 3511603.75708102 0.00369552730851237
openbsd-openbsd-stack-udp6bench-long-send-old udpbench -l1452 -t10 -r ot15 send fdd7:e83e:66bc:0302::35 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
send 2004000000 1987640000 1994520000 1997480000 1998660000 1998050000 1995710000 2003800000 2008010000 1999000000 1971550000 1959410000 1955070000 bits/sec 1990223076.92308 1955070000 2008010000 16505852.7543393 0.00829346867983142
recv 2003110000 1986390000 1992730000 1996120000 1998520000 1997830000 1994340000 2002290000 2006120000 1998350000 1969620000 1957980000 1953340000 bits/sec 1988980000 1953340000 2006120000 16719915.8076644 0.00840627648727708
openbsd-openbsd-stack-udp6bench-long-recv-old udpbench -l1452 -t10 -r ot15 recv fdd7:e83e:66bc:0302::34 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
recv 1998900000 2003800000 1992110000 1990540000 1988040000 1999470000 1999690000 2000410000 1993280000 1999360000 1979340000 1967110000 1964280000 bits/sec 1990486923.07692 1964280000 2003800000 12293125.8994081 0.00617593904129006
send 2000030000 2005200000 1992340000 1991730000 1988460000 2000050000 2001270000 2002200000 1994160000 2000590000 1981390000 1968710000 1965410000 bits/sec 1991656923.07692 1965410000 2005200000 12232253.3207 0.00614174719499495
openbsd-openbsd-stack-udp6bench-short-send-old udpbench -l16 -t10 -r ot15 send fdd7:e83e:66bc:0302::35 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
send 93879900 93206300 94263400 92885300 94189200 93800200 94340400 93842900 94559200 93915300 92809300 92316600 92473800 bits/sec 93575523.0769231 92316600 94559200 719562.220706073 0.00768964144731056
recv 93878500 93182700 94182200 92829800 94096400 93775400 94327100 93791900 94506800 93861600 92724200 92233200 92397900 bits/sec 93522130.7692308 92233200 94506800 729523.059565542 0.00780053933293786
openbsd-openbsd-stack-udp6bench-short-recv-old udpbench -l16 -t10 -r ot15 recv fdd7:e83e:66bc:0302::34 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
recv 93443500 93453500 94215400 93900500 94028200 93175100 93965900 94357500 92813600 94151600 93214400 92462600 92226600 bits/sec 93492953.8461538 92226600 94357500 661517.60208616 0.00707558778359609
send 93497800 93527000 94229000 93940500 94098900 93225800 94042200 94397100 92864200 94235300 93218300 92490500 92234200 bits/sec 93538523.0769231 92234200 94397100 672833.35135695 0.00719311497791806
openbsd-linux-stack-tcp-ip3fwd-4 iperf3 -c10.3.3.36 -w2m -t10 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 3570000000 3580000000 3590000000 3600000000 3570000000 3610000000 3580000000 3560000000 3610000000 3570000000 3590000000 3390000000 3370000000 bits/sec 3553076923.07692 3370000000 3610000000 75384615.3846154 0.0212167135743667
receiver 3510000000 3520000000 3520000000 3540000000 3510000000 3540000000 3510000000 3500000000 3550000000 3500000000 3530000000 3330000000 3310000000 bits/sec 3490000000 3310000000 3550000000 74110105.1969817 0.0212349871624589
openbsd-linux-stack-tcp-ip3rev-4 iperf3 -c10.3.3.36 -w2m -t10 -R PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 4070000000 4060000000 4090000000 4070000000 4080000000 4090000000 4080000000 4060000000 4080000000 4110000000 4100000000 3780000000 3780000000 bits/sec 4034615384.61538 3780000000 4110000000 109447239.45743 0.0271270564908788
receiver 4140000000 4130000000 4160000000 4140000000 4150000000 4160000000 4150000000 4130000000 4150000000 4180000000 4170000000 3840000000 3850000000 bits/sec 4103846153.84615 3840000000 4180000000 111254279.885762 0.0271097589224911
openbsd-linux-stack-tcp6-ip3fwd-4 iperf3 -6 -cfdd7:e83e:66bc:0303::36 -w2m -t10 PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 631000000 632000000 633000000 631000000 631000000 631000000 632000000 631000000 631000000 632000000 632000000 631000000 632000000 bits/sec 631538461.538462 631000000 633000000 634323.942402717 0.00100441062743427
receiver 619000000 619000000 619000000 618000000 618000000 618000000 618000000 618000000 618000000 619000000 619000000 618000000 619000000 bits/sec 618461538.461538 618000000 619000000 498518.515262143 0.000806062275921376
openbsd-linux-stack-tcp6-ip3rev-4 iperf3 -6 -cfdd7:e83e:66bc:0303::36 -w2m -t10 -R PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS PASS unit mean minimum maximum deviation relative
sender 3670000000 3670000000 3700000000 3690000000 3690000000 3690000000 3690000000 3670000000 3690000000 3670000000 3690000000 3460000000 3450000000 bits/sec 3648461538.46154 3450000000 3700000000 83098287.8511163 0.0227762543129773
receiver 3740000000 3740000000 3760000000 3760000000 3750000000 3760000000 3760000000 3730000000 3760000000 3740000000 3750000000 3520000000 3510000000 bits/sec 3713846153.84615 3510000000 3760000000 85353424.6564935 0.0229824879978131
TCP Performance
TCP6 Performance
UDP Performance
UDP6 Performance
LINUX Performance
LINUX6 Performance
2017-10-04T03:27:49Z A OpenBSD/amd64 6.2 release
2017-10-04T21:45:15Z B fix cvs vendor branch checkout
2017-10-04T21:45:16Z C clang update LLVM to 5.0.0
2017-11-13T11:30:11Z D pfctl pf packet rate matching
2017-11-16T18:12:27Z E move kernel source file dwiic.c
2017-11-28T16:05:47Z F pfctl pf divert type
2017-12-11T05:27:40Z G sysctl struct vfsconf
2017-12-25T12:09:20Z H clang update LLVM to 5.0.1
2018-02-06T23:44:48Z I pfctl pf syncookies
2018-03-24T20:27:40Z J OpenBSD/amd64 6.3 release
2018-04-05T03:32:39Z K pfctl remove PF_TRANS_ALTQ
2018-04-07T10:05:05Z L fix cvs vendor branch checkout
2018-04-07T10:05:06Z M clang update LLVM to 6.0.0
2018-04-27T15:19:32Z N retpoline for kernel
2018-05-02T13:20:12Z O revert remaining puc commit for com
2018-05-14T12:31:21Z P top systat report CPU spinning time
2018-05-16T14:53:43Z Q sysctl add kern.witnesswatch
2018-06-03T21:30:38Z R clang add ret protector options as no-ops
2018-06-06T00:14:29Z S clang add retguard
2018-07-10T09:28:27Z T pfctl pf generic packet delay
2018-07-12T22:09:04Z U patch some garbage in GENERIC.MP
2018-07-13T05:25:24Z V zap some garbage in GENERIC.MP
2018-07-26T13:20:53Z W binutils infrastructure to install lld
2018-08-12T17:07:00Z X clang refactor retguard
2018-10-11T19:37:31Z Y OpenBSD/amd64 6.4 release
2018-10-16T18:20:58Z Z prepare kernel for lld linker
2018-10-22T15:18:50Z a cvs vendor branch checkout
2018-10-22T19:31:30Z b use lld as default linker
2018-10-24T21:19:03Z c clang with final lld fixes
2018-12-30T23:08:05Z d clang turns on retpoline by default
2019-01-12T23:36:35Z e clang builds itself without retpoline
2019-01-27T17:29:36Z f clang update LLVM to 7.0.1
2019-01-30T03:08:12Z g clang implement save function arguments
2019-02-03T10:58:51Z h save function arguments for ddb traces
2019-02-18T13:11:44Z i pfctl pf len ioctl get states
2019-03-01T16:46:11Z j binutils for libLLVM
2019-03-05T14:01:08Z k clang with libLLVM
2019-04-02T03:02:47Z l clang no stack protector if retguard
2019-04-13T20:56:59Z m OpenBSD/amd64 6.5 release
2019-05-08T23:53:40Z n add ucrcom to files
2019-06-17T22:31:48Z o libcxx update libc++, libc++abi, libunwind to 8.0.0
2019-06-23T17:18:50Z p sysctl kinfo_proc add p_pledge
2019-06-23T22:21:06Z q clang update LLVM to 8.0.0
2019-06-25T14:08:57Z r sysctl kinfo_proc move p_pledge
2019-08-02T02:17:35Z s per-process itimers, missing part of commit
2019-08-28T22:39:09Z t uhci PCI ACPI attach fail
2019-09-01T16:40:03Z u clang update LLVM to 8.0.1
2019-10-12T17:05:22Z v OpenBSD/amd64 6.6 release
2019-11-03T20:16:01Z w sys_shmctl fix copyin
2019-11-27T01:13:04Z x kernel provides msyscall as a noop
2019-11-29T06:34:46Z y ld.so uses msyscall to permit syscalls
2020-05-07T17:20:22Z z OpenBSD/amd64 6.7 release
2020-06-08T04:48:12Z A' update drm moves kernel source files
2020-07-06T13:33:09Z B' kernel provides timecounting in userland
2020-07-08T09:17:48Z C' libc uses timecounting in userland
2020-07-17T06:33:07Z D' include toeplitz.h in ixgbe.h
2020-07-17T07:40:35Z E' include toeplitz.h in ixgbe.h and backout in if_ix.c
2020-07-17T07:49:49Z F' backout bad include of toeplitz.h in if_ix.c
2020-07-23T14:53:48Z G' binutils bfd fixes strip after clang 10
2020-08-03T15:29:25Z H' clang update LLVM to 10.0.0
2020-08-09T15:56:55Z I' clang update LLVM to 10.0.1
2020-09-12T07:47:27Z J' move asmc.c kernel source file
2020-10-01T14:02:08Z K' pfctl routing domain check
2020-10-05T00:22:38Z L' OpenBSD/amd64 6.8 release
2021-02-08T11:20:04Z M' softraid_raid1c.c was not added in commit
2021-02-08T11:21:53Z N' replace softraid_raid1c.c copy with commit
2021-04-19T16:48:56Z O' OpenBSD/amd64 6.9 release
2021-04-28T13:07:33Z P' clang, libc++, and libc++abi update LLVM to 11.1.0
2021-05-21T16:52:42Z Q' futex ABI change in libc and librthread
2021-06-13T21:11:54Z R' futex full syscall stub and save errno
2021-06-28T08:55:06Z S' btrace includes userland in kstack
2021-07-07T02:38:38Z T' update drm moves kernel source files
2021-09-01T13:37:14Z U' clang lfence after ret in retpoline
2021-09-30T20:34:00Z V' OpenBSD/amd64 7.0 release
2021-10-21T22:59:08Z W' remove dangling crypto noqueue, missing part of commit
2021-11-23T10:30:08Z X' install bsd.own.mk with ar variable
2021-12-17T14:55:47Z Y' clang, libc++, and libc++abi update LLVM to 13.0.0
2021-12-23T18:50:59Z Z' kernel removes padding from syscalls
2022-01-14T06:53:17Z a' update drm moves kernel source files
2022-02-22T17:26:04Z b' maxcomlen include
2022-02-22T17:42:52Z c' param include
2022-03-23T14:36:01Z d' revert scsi link commit, panic during boot
2022-04-12T00:10:09Z e' OpenBSD/amd64 7.1 release
PASS performance test passed
FAIL performance test failed to produce value
NOEXIT performance test did not exit with code 0, test failed
NOTERM test did not terminate, aborted after timeout
NORUN test did not run, execute failed
NOLOG create log file for test output failed