[an error occurred while processing this directive]

Comparison on Optimized Set on 2014, 2015, and 2016 (TBD)

I. New SD-Rules Evaluation Results:

Three releases applied this approach to retrieve the optimized SD-rule set.

II. Comparison of SD-Rule set:

Item201420152016
Baseline Set
Include parent-child rules
107 120 132
Total Unique Rules96101111
Total Good Rules737682
Total Valid SD-pairs (SD-Facts: Relevant)42,55246,95050,814
Opti. System Precision95.30%95.2295.00%
Opti. System Recall95.01%95.70%95.26%
Opti. System Performance1.90311.90931.9026
Cufoff Rulear$|adj|e$|noun ar$|adj|e$|noun $|noun|ist$|noun
Optimized Set 2014 Optimized Set 2015 Optimized Set 2016 Optimized Set
Optimized Diagram

For the Optimial set:

III. Transaction History:
Baseline
Collected Candidate SD-Rules
Unique Rules
Remove child-rules from Baseline
Good Rules
Used in Lexical Tools SD-Rule set
2014107 96
  • removed 11 child-rules from baseline
  • 96 = 107 - 11
73
New Rules15
  • ES (Expert-Suggest)NOM_DORG_DSub-Total
    Total Rules76215
    Duplicated2002
    Total non-dul-rules56213
    Bad Rules2002
    Good Rules36211
  • details
2015120
  • 2 new rules out of 15 are child-rules of existing rules, not added
  • 120 = 107 + 15 - 2
101 76
  • 4 of good new rules are parent-rules of 4 existing rules (+0)
  • 2 of good new rules are parent-rules of 4 existing rules (-2)
  • 5 of good new rules have no parent-rules relationship with existing rule (+5)
  • 76 = 73 + 0 - 2 + 5
New Rules12
  • ES (Expert-Suggest)NOM_DORG_DSub-Total
    Total Rules25512
    Duplicated0101
    Total non-dup-rules24511
    Bad Rules1113
    Good Rules1348
  • details
2016132
  • 1 existing rule add child-rule nce$|noun|nt$|adj in 2015s
  • 1 new rules of out 12 is duplicatedm not added
  • 132 = 120 + 1 + 12 -1
111 82

Details:

The conclusion is the optimized set of SD-Rules is very steady as we expected. [an error occurred while processing this directive]