<html>
<head>
<meta http-equiv="Content-Type" content="text/html; charset=Windows-1252">
</head>
<body style="word-wrap: break-word; -webkit-nbsp-mode: space; -webkit-line-break: after-white-space; color: rgb(0, 0, 0); font-size: 16px; font-family: Calibri, sans-serif;">
<div>I've used dnsperf in the past. Liked the company's reputation, the design of the tool, and the ease of getting visual output. I haven't used the others, so none of this is to say these things aren't also true about them...just what I liked about dnsperf.</div>
<div><br>
</div>
<div>The queryfile format makes a lot of sense, and is great for testing real-world performance... It's easy to use the one they provide or build your own from tcpdump/query logs. I usually do several runs with both cold and warm caches and take averages
to find interesting edge cases. That said, you are ultimately "testing the Internet" with this approach...and as others have pointed out much of the "performance" is responsiveness of authoritative servers for zones in your queryfile. For me, this was an
interesting thing to test since it finds many of the same issues seen in running DNS servers day-to-day.</div>
<div><br>
</div>
<div>Having said all that, in terms of an approach to measurement...if I was more concerned about raw throughput of a specific name server software, I would be sure to setup a lab so that I could control "the Internet" and "remote server responsiveness" --
similar to what I'd imagine product stress testers do in their labs. Build a query file with N random internal domains delegated to a farm of internal NS over a fast LAN...then run batches of queries with drop rate capped at some reasonable percent (I usually
do 1% which is a lot better than what's generally observed in the real world due to upstream problems). This qps number will obviously be a lot larger since you are now closer to comparing internal vs end-to-end performance.</div>
<div><br>
</div>
<span id="OLK_SRC_BODY_SECTION">
<div style="font-family:Consolas; font-size:11pt; text-align:left; color:black; BORDER-BOTTOM: medium none; BORDER-LEFT: medium none; PADDING-BOTTOM: 0in; PADDING-LEFT: 0in; PADDING-RIGHT: 0in; BORDER-TOP: #b5c4df 1pt solid; BORDER-RIGHT: medium none; PADDING-TOP: 3pt">
<span style="font-weight:bold">From: </span>Kumar Ashutosh <<a href="mailto:askuma@microsoft.com">askuma@microsoft.com</a>><br>
<span style="font-weight:bold">Date: </span>Monday, December 8, 2014 at 10:34 AM<br>
<span style="font-weight:bold">To: </span>"<a href="mailto:dns-operations@dns-oarc.net">dns-operations@dns-oarc.net</a>" <<a href="mailto:dns-operations@dns-oarc.net">dns-operations@dns-oarc.net</a>><br>
<span style="font-weight:bold">Subject: </span>[dns-operations] DNS measurement standards<br>
</div>
<div><br>
</div>
<blockquote id="MAC_OUTLOOK_ATTRIBUTION_BLOCKQUOTE" style="BORDER-LEFT: #b5c4df 5 solid; PADDING:0 0 0 5; MARGIN:0 0 0 5;">
<div xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40">
<meta name="Generator" content="Microsoft Word 15 (filtered medium)">
<style><!--
/* Font Definitions */
@font-face
{font-family:"Cambria Math";
panose-1:2 4 5 3 5 4 6 3 2 4;}
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:"Segoe UI";
panose-1:2 11 5 2 4 2 4 2 2 3;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:11.0pt;
font-family:"Calibri","sans-serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:#0563C1;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:#954F72;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-compose;
font-family:"Segoe UI","sans-serif";
color:windowtext;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]-->
<div lang="EN-US" link="#0563C1" vlink="#954F72">
<div class="WordSection1">
<p class="MsoNormal"><span style="font-family: 'Segoe UI', sans-serif;">Hi<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family: 'Segoe UI', sans-serif;">This may be a repeated question, but hoping a quick reply on this. There are multiple tools to measure DNS server performance. And there are umpteen ways to measure as well.
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family: 'Segoe UI', sans-serif;">I have come across many tools like ISC queryperf, nominum’s DNSperf, Dnsbench etc…
<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family: 'Segoe UI', sans-serif;"><o:p> </o:p></span></p>
<p class="MsoNormal"><span style="font-family: 'Segoe UI', sans-serif;">I may start a debate, if I ask which one is the best. So let me ask which *<b>are</b>* the most popular and Is there a standard take on the way to measure.<o:p></o:p></span></p>
<p class="MsoNormal"><span style="font-family: 'Segoe UI', sans-serif;"><o:p> </o:p></span></p>
<p class="MsoNormal"><span lang="EN-IN" style="font-size:8.0pt;color:#8EAADB">Regards<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IN" style="font-size:9.0pt;color:#2F5496">Kumar Ashutosh<o:p></o:p></span></p>
<p class="MsoNormal"><span lang="EN-IN" style="font-size:9.0pt;color:#2F5496">Microsoft<o:p></o:p></span></p>
<p class="MsoNormal"><o:p> </o:p></p>
</div>
</div>
</div>
</blockquote>
</span>
</body>
</html>