{"id":40,"date":"2015-06-09T13:26:11","date_gmt":"2015-06-09T12:26:11","guid":{"rendered":"http:\/\/spreadsheets.ist.tugraz.at\/?page_id=40"},"modified":"2015-06-09T15:15:51","modified_gmt":"2015-06-09T14:15:51","slug":"format","status":"publish","type":"page","link":"https:\/\/spreadsheets.sai.tugraz.at\/index.php\/corpora-for-benchmarking\/format\/","title":{"rendered":"Format"},"content":{"rendered":"<p>All provided corpora consist of the faulty spreadsheets and <em>properties\u00a0<\/em>files documenting the faults and the user&#8217;s testing decisions. The testing decisions simulate the user interaction with the fault localization approach. They are required to allow researchers to evaluate their fault localization techniques in batch mode.<\/p>\n<p>The faulty spreadsheets and the <em>properties\u00a0<\/em>files follow\u00a0a naming convention: \u00a0The name consists of the spreadsheet&#8217;s original name, the number\u00a0of faults (<em>&lt;X&gt;FAULTS<\/em>) and the fault version (<em>FAULTVERSION&lt;Y&gt;<\/em>), separated by an underscore, since the same base spreadsheet may have several faulty versions.\u00a0For example, a faulty version\u00a0of the\u00a0<tt>bonus.xls<\/tt> file is renamed to <tt>bonus_2FAULTS_FAULTVERSION1.xls<\/tt>. This spreadsheet contains a two faulty cells. The appropriate <em>properties<\/em> file is called <tt>bonus_2FAULTS_FAULTVERSION1.properties<\/tt>.<\/p>\n<p>A <em>properties<\/em> file contains the following information:<\/p>\n<ul>\n<li><span style=\"color: #808080;\"><tt>EXCEL_SHEET<\/tt><\/span> specifies the path to the spreadsheet.<\/li>\n<li>\u000f <span style=\"color: #808080;\"><tt>INCORRECT_OUTPUT_i<\/tt><\/span> specifies a negative testing decision, where <em>i<\/em> is a sequence\u00a0number starting from 1, and the cell coordinates are provided in the format\u00a0<em>&lt;worksheet number&gt;!&lt;column&gt;!&lt;row&gt;<\/em>.<\/li>\n<li><span style=\"color: #808080;\"><tt>INCORRECT_OUTCELL_ORACLE_MISTAKE_i<\/tt><\/span> defines whether the testing decision with\u00a0the sequence number <em>i<\/em> is an oracle mistake. If the value of this property equals\u00a0<em>&#8220;T&#8221;<\/em>, the testing decision should be positive instead of negative.<\/li>\n<li><span style=\"color: #808080;\"><tt>INCORRECT_OUTCELL_EXPECTED_VALUE_i<\/tt><\/span> specifies the expected value for the incorrect\u00a0cell with the sequence number <em>i<\/em>. This property might be required for some of the\u00a0model-based\u00a0approaches, but it is not required for trace-based approaches such as SFL.<\/li>\n<li><span style=\"color: #808080;\"><tt>CORRECT_OUTPUT_i<\/tt><\/span> specifies a positive testing decision, with <em>i<\/em> being a sequence\u00a0number starting from 1. Cells are speci\fed in the same format used for incorrect\u00a0output cells.\u00a0In contrast to incorrect cells, no output value is expected,\u00a0as the cell produces the expected value.<\/li>\n<li><span style=\"color: #808080;\"><tt>CORRECT_OUTCELL_ORACLE_MISTAKE_i<\/tt><\/span> defines whether the testing decision with\u00a0the sequence number <em>i<\/em> is an oracle mistake. If the value of this property equals\u00a0<em>&#8220;T&#8221;<\/em>, the testing decision should be negative instead of positive.<\/li>\n<li><span style=\"color: #808080;\"><tt>\u000fFAULTY_CELLS_i<\/tt><\/span> specifies that the formula in the cell is not correct, where <em>i<\/em> is a\u00a0sequence number starting with 1 and the cell coordinates are provided in the same\u00a0format as for testing decisions.<\/li>\n<li><span style=\"color: #808080;\"><tt>FAULT_TYPE_i<\/tt><\/span> specifies the fault type for the faulty cell with the sequence number\u00a0<em>i<\/em>, based on the mutation operators for spreadsheets specified by <a href=\"http:\/\/www.computer.org\/csdl\/trans\/ts\/2009\/01\/tts2009010094-abs.html\">Abraham and Erwig<\/a>.\u00a0This property value is optional.<\/li>\n<\/ul>\n<p>Example of a <em>properties<\/em> file:<\/p>\n<div class=\"codebox\"><code>EXCEL_SHEET =..\\\\xls\\\\bonus_1FAULTS_FAULTVERSION1.xls<br \/>\nCORRECT_OUTPUT_1 =0!E!3<br \/>\nCORRECT_OUTCELL_ORACLE_MISTAKE_1 =F<br \/>\nCORRECT_OUTPUT_2 =0!C!5<br \/>\nCORRECT_OUTCELL_ORACLE_MISTAKE_2 =F<br \/>\nINCORRECT_OUTPUT_1 =0!E!5<br \/>\nINCORRECT_OUTCELL_ORACLE_MISTAKE_1 =F<br \/>\nINCORRECT_OUTCELL_EXPECTED_VALUE_1 =874.0<br \/>\nFAULTY_CELLS_1 =0!D!2<br \/>\nFAULT_TYPE_1 =CRS<br \/>\n<\/code><\/div>\n","protected":false},"excerpt":{"rendered":"<p>All provided corpora consist of the faulty spreadsheets and properties\u00a0files documenting the faults and the user&#8217;s testing decisions. The testing decisions simulate the user interaction with the fault localization approach. They are required to allow researchers to evaluate their fault localization techniques in batch mode. The faulty spreadsheets and the properties\u00a0files follow\u00a0a naming convention: \u00a0The &hellip; <a href=\"https:\/\/spreadsheets.sai.tugraz.at\/index.php\/corpora-for-benchmarking\/format\/\" class=\"more-link\">Continue reading <span class=\"screen-reader-text\">Format<\/span> <span class=\"meta-nav\">&rarr;<\/span><\/a><\/p>\n","protected":false},"author":2,"featured_media":0,"parent":5,"menu_order":0,"comment_status":"closed","ping_status":"closed","template":"","meta":{"footnotes":""},"class_list":["post-40","page","type-page","status-publish","hentry"],"_links":{"self":[{"href":"https:\/\/spreadsheets.sai.tugraz.at\/index.php\/wp-json\/wp\/v2\/pages\/40","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/spreadsheets.sai.tugraz.at\/index.php\/wp-json\/wp\/v2\/pages"}],"about":[{"href":"https:\/\/spreadsheets.sai.tugraz.at\/index.php\/wp-json\/wp\/v2\/types\/page"}],"author":[{"embeddable":true,"href":"https:\/\/spreadsheets.sai.tugraz.at\/index.php\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/spreadsheets.sai.tugraz.at\/index.php\/wp-json\/wp\/v2\/comments?post=40"}],"version-history":[{"count":14,"href":"https:\/\/spreadsheets.sai.tugraz.at\/index.php\/wp-json\/wp\/v2\/pages\/40\/revisions"}],"predecessor-version":[{"id":54,"href":"https:\/\/spreadsheets.sai.tugraz.at\/index.php\/wp-json\/wp\/v2\/pages\/40\/revisions\/54"}],"up":[{"embeddable":true,"href":"https:\/\/spreadsheets.sai.tugraz.at\/index.php\/wp-json\/wp\/v2\/pages\/5"}],"wp:attachment":[{"href":"https:\/\/spreadsheets.sai.tugraz.at\/index.php\/wp-json\/wp\/v2\/media?parent=40"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}