<div dir="ltr">Ok, so the questions I have are still unanswered I think, possibly because it's a lot of work. But I think they're important.<div><br></div><div>1. Was there any REAL difference between the competitors? Everyone is all "oooh, ahh" about mayhem. But are there bugs or bugclasses it can find that open source shellphish or the ToB work cannot? I.E. Is the final score essentially noise for the thing we actually care about? </div><div>2. Is adding the SMT solver to the fuzzer 10% better or ... 1%? Would we be better just special casing certain things into the fuzzer?</div><div>3. What bugs could nobody find? Why?</div><div><br></div><div>-dave</div><div><br></div></div><br><div class="gmail_quote"><div dir="ltr">On Tue, Apr 18, 2017 at 9:35 AM Chris Eagle <<a href="mailto:cse.lists@gmail.com">cse.lists@gmail.com</a>> wrote:<br></div><blockquote class="gmail_quote" style="margin:0 0 0 .8ex;border-left:1px #ccc solid;padding-left:1ex">If you want to be able to do all of the performance measurements then yes that code is missing. If you want to study the successful PoVs then that code is not required. Most of them can be replayed on the publicly available VMs. However some of them depend on the specific CPUID values returned by the CFE hardware which you might need to emulate somehow. Even if all the code used to run the final event was released, the CPUID issue would continue to be a problem unless you are able to return the same CPUID values that the competitors saw during CFE.<br>
<br>
On 4/11/2017 10:38 AM, Ryan Stortz wrote:<br>
> Notably missing are:<br>
> * The kernel they ran the final event on<br>
> * The code they used to measure scores<br>
><br>
> This prevents a lot of analysis.<br>
><br>
_______________________________________________<br>
Dailydave mailing list<br>
<a href="mailto:Dailydave@lists.immunityinc.com" target="_blank">Dailydave@lists.immunityinc.com</a><br>
<a href="https://lists.immunityinc.com/mailman/listinfo/dailydave" rel="noreferrer" target="_blank">https://lists.immunityinc.com/mailman/listinfo/dailydave</a><br>
</blockquote></div>