<html xmlns:v="urn:schemas-microsoft-com:vml" xmlns:o="urn:schemas-microsoft-com:office:office" xmlns:w="urn:schemas-microsoft-com:office:word" xmlns:m="http://schemas.microsoft.com/office/2004/12/omml" xmlns="http://www.w3.org/TR/REC-html40"><head><meta http-equiv=Content-Type content="text/html; charset=us-ascii"><meta name=Generator content="Microsoft Word 14 (filtered medium)"><style><!--
/* Font Definitions */
@font-face
{font-family:Calibri;
panose-1:2 15 5 2 2 2 4 3 2 4;}
@font-face
{font-family:Tahoma;
panose-1:2 11 6 4 3 5 4 4 2 4;}
/* Style Definitions */
p.MsoNormal, li.MsoNormal, div.MsoNormal
{margin:0in;
margin-bottom:.0001pt;
font-size:12.0pt;
font-family:"Times New Roman","serif";}
a:link, span.MsoHyperlink
{mso-style-priority:99;
color:blue;
text-decoration:underline;}
a:visited, span.MsoHyperlinkFollowed
{mso-style-priority:99;
color:purple;
text-decoration:underline;}
span.EmailStyle17
{mso-style-type:personal-reply;
font-family:"Calibri","sans-serif";
color:#1F497D;}
.MsoChpDefault
{mso-style-type:export-only;
font-family:"Calibri","sans-serif";}
@page WordSection1
{size:8.5in 11.0in;
margin:1.0in 1.0in 1.0in 1.0in;}
div.WordSection1
{page:WordSection1;}
--></style><!--[if gte mso 9]><xml>
<o:shapedefaults v:ext="edit" spidmax="1026" />
</xml><![endif]--><!--[if gte mso 9]><xml>
<o:shapelayout v:ext="edit">
<o:idmap v:ext="edit" data="1" />
</o:shapelayout></xml><![endif]--></head><body lang=EN-US link=blue vlink=purple><div class=WordSection1><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'>From:</span></b><span style='font-size:10.0pt;font-family:"Tahoma","sans-serif"'> extropy-chat-bounces@lists.extropy.org [mailto:extropy-chat-bounces@lists.extropy.org] <b>On Behalf Of </b>Adrian Tymes<br><b>Sent:</b> Sunday, December 30, 2012 11:47 PM<br><b>To:</b> ExI chat list<br><b>Subject:</b> Re: [ExI] tests again<o:p></o:p></span></p><p class=MsoNormal><o:p> </o:p></p><div><p class=MsoNormal>On Sun, Dec 30, 2012 at 10:42 PM, spike <<a href="mailto:spike66@att.net" target="_blank">spike66@att.net</a>> wrote:<o:p></o:p></p><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='color:#1F497D'>>…</span> In the real world, we all have access to externalized knowledge. The test is designed to show how effectively the technician can access that external knowledge pool out there on the internet.<span style='color:#1F497D'> </span>All suggestions welcome.<span style='color:#1F497D'> </span>Spike<o:p></o:p></p></div></div><div><p class=MsoNormal><br><span style='color:#1F497D'>>…</span>Be careful: if your test becomes popular enough, then someone<br>is likely to eventually write up the questions and answers they<br>faced. In other words, their version of the test itself may become<br>part of this externalized knowledge<span style='color:#1F497D'>…<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>Ja, this is why I wanted to use branching. That technique protects to some extent the content of the test leaking into the public domain, since only a small percentage of the questions are ever seen by any one test taker.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto;margin-left:23.1pt'><span style='color:#1F497D'>>…</span>What if they just said "Adjusting lash", with all those other words,<br>rather than "Adjusting valve lash". <span style='color:#1F497D'>..<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>This consideration has caused me to abandon the notion of both machine scoring and objective score all together. The test response will be recorded and I will subjectively evaluate which areas the candidate is strong, which not, and a general category of score will be assigned subjectively, perhaps returning to the original idea of seven ranks for each subspecialty. The beauty of this system is that each hiring manager has complete access to the responses of all the candidates, since memory is cheap. This means of evaluation is far more informative than the traditional five bubble test.<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p><p class=MsoNormal><span style='color:#1F497D'>spike<o:p></o:p></span></p><p class=MsoNormal><span style='color:#1F497D'><o:p> </o:p></span></p></div><blockquote style='border:none;border-left:solid #CCCCCC 1.0pt;padding:0in 0in 0in 6.0pt;margin-left:4.8pt;margin-right:0in'><div><div><p class=MsoNormal style='mso-margin-top-alt:auto;mso-margin-bottom-alt:auto'><span style='font-size:11.0pt;font-family:"Calibri","sans-serif";color:#1F497D'><o:p> </o:p></span></p></div></div></blockquote></div></div></body></html>