Showing posts with label NaveenL. Show all posts
Showing posts with label NaveenL. Show all posts

Sunday, July 13, 2014

Results all models


Flight

 Techniques         -effort         -months        -defects          -risks    #
         1 T0 m              23              67               5               0    #
   2 Bef disc m               3              14               4               2    #
   3 Aft disc m               9              30               6               2    #
    4 T9:j/j_ m               0              33               0              22    #
-------------------------------------------------------------------------------------
         1 T0 q              21              16               8               1    #
   2 Bef disc q               3               0               5               3    #
   3 Aft disc q               9               6               8               6    #
    4 T9:j/j_ q               3              21               1              38    #
-------------------------------------------------------------------------------------
         1 T0 w              79             100              36              17    #
   2 Bef disc w              29              28              46               8    #
   3 Aft disc w             100              66             100              14    #
    4 T9:j/j_ w              24              98              19             100    #
-------------------------------------------------------------------------------------
            100         3500.22           42.38        50660.52             8.6    #
              0          117.21            2.51          381.83             0.0    # 
 
Ground

Techniques         -effort         -months        -defects          -risks    #
         1 T0 m               5              43               3              12    #
   2 Bef disc m               0              12               3               6    #
   3 Aft disc m               9              49               3               0    #
4 T9:j/jground m               0              32               0              10    #
-------------------------------------------------------------------------------------
         1 T0 q               4               8               5              17    #
   2 Bef disc q               0               0               5               7    #
   3 Aft disc q              10              12               5               9    #
4 T9:j/jground q               5              35               1              16    #
-------------------------------------------------------------------------------------
         1 T0 w              31              69              34              48    #
   2 Bef disc w              16              24              37              22    #
   3 Aft disc w             100             100             100              49    #
4 T9:j/jground w              40              78              34             100    #
-------------------------------------------------------------------------------------
            100         6628.14           55.18         76485.1             4.8    #
              0          254.49            2.97          806.33            0.05    #
 
Osp
 
 Techniques         -effort         -months        -defects          -risks    #
         1 T0 m               9              36               5              36    #
   2 Bef disc m               0               8               1              12    #
   3 Aft disc m               8              44               3               0    #
  4 T9:j/josp m               1              29               0              11    #
-------------------------------------------------------------------------------------
         1 T0 q               2               2               3              32    #
   2 Bef disc q               0               0               1               5    #
   3 Aft disc q               9              12               4               3    #
  4 T9:j/josp q               1              18               1              29    #
-------------------------------------------------------------------------------------
         1 T0 w              17              43              14              65    #
   2 Bef disc w               7              17              15              32    #
   3 Aft disc w             100             100             100              29    #
  4 T9:j/josp w              31              64               5             100    #
-------------------------------------------------------------------------------------
            100         9665.91           63.82       103492.82             7.5    #
              0          142.78            2.31          722.41            0.27    #
 
Osp2
 
Techniques         -effort         -months        -defects          -risks    #
         1 T0 m               9              65               1              10    #
   2 Bef disc m               9              61               1               0    #
   3 Aft disc m               7              42               3               3    #
 4 T9:j/josp2 m               0              39               0              13    #
-------------------------------------------------------------------------------------
         1 T0 q               1               0               0              12    #
   2 Bef disc q               2               4               0              20    #
   3 Aft disc q               8               8               5               5    #
 4 T9:j/josp2 q               3              17               2              31    #
-------------------------------------------------------------------------------------
         1 T0 w              17              79               5              20    #
   2 Bef disc w              21              85               8              20    #
   3 Aft disc w             100             100             100              26    #
 4 T9:j/josp2 w              18              93              12             100    #
-------------------------------------------------------------------------------------
            100         5937.27            35.8        59880.52             5.1    #
              0          130.08            2.84           637.4             0.0    #
  
  
All
 
Techniques         -effort         -months        -defects          -risks    #
         1 T0 m              13              47               4              20    #
   2 Bef disc m              11              32              10               7    #
   3 Aft disc m               6              24               3               0    #
  4 T9:j/jall m               0              34               0              12    #
-------------------------------------------------------------------------------------
         1 T0 q              14              12               7              37    #
   2 Bef disc q              11               3              13              10    #
   3 Aft disc q               7               0               4               5    #
  4 T9:j/jall q               5              18               2              36    #
-------------------------------------------------------------------------------------
         1 T0 w              80             100              52             100    #
   2 Bef disc w              88              64             100              25    #
   3 Aft disc w             100              55              69              20    #
  4 T9:j/jall w              22              79              10              84    #
-------------------------------------------------------------------------------------
            100         3597.84           49.22        55387.16            5.67    #
              0          262.02            5.17         1028.96            0.11    #
  
Flight tree
 58  flex <= 27.5 samples = 941
    59 |- docu <= 6.5 samples = 483
    60 |-|- ['__7']  # samples = 31 # branch_id = 0
    61 |-|- team <= 27.0 samples = 452
    62 |-|-|- ['__2']  # samples = 440 # branch_id = 1
    63 |-|-|- ['__6']  # samples = 12 # branch_id = 2
    64 |- ruse <= 35.5 samples = 458
    65 |-|- docu <= 38.5 samples = 50
    66 |-|-|- team <= 21.5 samples = 30
    67 |-|-|-|- ['__4']  # samples = 14 # branch_id = 3
    68 |-|-|-|- ['__1']  # samples = 16 # branch_id = 4
    69 |-|-|- ['__2']  # samples = 20 # branch_id = 5
    70 |-|- ['__1']  # samples = 408 # branch_id = 6
 
Ground tree
 pr <= 12.5 samples = 918
    63 |- resl <= 17.5 samples = 191
    64 |-|- ['__7']  # samples = 28 # branch_id = 0
    65 |-|- ['__2']  # samples = 163 # branch_id = 1
    66 |- rely <= 19.5 samples = 727
    67 |-|- pcon <= 24.5 samples = 44
    68 |-|-|- ['__5']  # samples = 28 # branch_id = 2
    69 |-|-|- ['__4']  # samples = 16 # branch_id = 3
    70 |-|- resl <= 30.0 samples = 683
    71 |-|-|- ['__1']  # samples = 651 # branch_id = 4
    72 |-|-|- ['__1']  # samples = 32 # branch_id = 5
 
Osp Tree
 etat <= 5.5 samples = 939
    49 |- ['__2']  # samples = 47 # branch_id = 0
    50 |- time <= 1.5 samples = 892
    51 |-|- ['__4']  # samples = 12 # branch_id = 1
    52 |-|- ['__1']  # samples = 880 # branch_id = 2
 
Osp2 Tree
 69  etat <= 22.5 samples = 932
    70 |- ltex <= 33.5 samples = 369
    71 |-|- ruse <= 11.0 samples = 52
    72 |-|-|- sced <= 20.5 samples = 28
    73 |-|-|-|- ['__4']  # samples = 11 # branch_id = 0
    74 |-|-|-|- ['__7']  # samples = 17 # branch_id = 1
    75 |-|-|- ['__5']  # samples = 24 # branch_id = 2
    76 |-|- ltex <= 40.5 samples = 317
    77 |-|-|- pr <= 12.5 samples = 47
    78 |-|-|-|- ['__2']  # samples = 35 # branch_id = 3
    79 |-|-|- ['__2']  # samples = 270 # branch_id = 4
    80 |- aa <= 6.5 samples = 563
    81 |-|- ['__1']  # samples = 146 # branch_id = 5
    82 |-|- prec <= 22.0 samples = 417
    83 |-|-|- ['__3']  # samples = 43 # branch_id = 6
    84 |-|-|- ['__3']  # samples = 374 # branch_id = 7
 
All Tree
75  pr <= 25.5 samples = 824
    76 |- site <= 20.5 samples = 283
    77 |-|- site <= 9.5 samples = 101
    78 |-|-|- site <= 7.5 samples = 69
    79 |-|-|-|- ['__3']  # samples = 14 # branch_id = 0
    80 |-|-|-|- ['__9']  # samples = 55 # branch_id = 1
    81 |-|-|- ruse <= 16.5 samples = 32
    82 |-|-|-|- ['__5']  # samples = 15 # branch_id = 2
    83 |-|-|-|- ['__7']  # samples = 17 # branch_id = 3
    84 |-|- flex <= 26.5 samples = 182
    85 |-|-|- ['__2']  # samples = 150 # branch_id = 4
    86 |-|-|- team <= 48.0 samples = 32
    87 |-|-|-|- ['__8']  # samples = 17 # branch_id = 5
    88 |-|-|-|- ['__2']  # samples = 15 # branch_id = 6
    89 |- prec <= 35.0 samples = 541
    90 |-|- flex <= 22.0 samples = 289
    91 |-|-|- docu <= 24.5 samples = 47
    92 |-|-|-|- ['__6']  # samples = 14 # branch_id = 7
    93 |-|-|-|- ['__5']  # samples = 33 # branch_id = 8
    94 |-|-|- team <= 37.5 samples = 242
    95 |-|-|-|- aexp <= 23.5 samples = 26
    96 |-|-|-|-|- ['__8']  # samples = 11 # branch_id = 9
    97 |-|-|-|-|- ['__1']  # samples = 15 # branch_id = 10
    98 |-|-|-|- ['__1']  # samples = 216 # branch_id = 11
    99 |-|- aexp <= 10.5 samples = 252
   100 |-|-|- ['__1']  # samples = 14 # branch_id = 12
   101 |-|-|- ['__3']  # samples = 238 # branch_id = 13
 

Wednesday, July 9, 2014

New results dtree learning



Results

The samples generated are equal to original samples we started with.
sample work flow:

1. 500 samples
2. cluster into C1.C2....Cn
3. build Dtrees. form branches B1,B2,...Bn. Find best and worst between clusters in B1..Bn.
4. CS1,CS2,...CSn between worse clusters to become better clusters.
5. Regenerate samples using CS1,CS2...CSn. =Total 500. Maintaining the ratio.
6. Generate result tables.

Techniques:


1. Distance pruning: Prune clusters that are less than 0.3 (normalized distance) each other into one big cluster.

2. Dtree pruning: Prune leaves of decision trees -remove leaves with multiple majority classes - remove subtrees with same majority class

3. Discretize: Discretize continous data into discrete values and generate trees. Reduces trees a lot! Affects performance.

4. Infogain: Prune columns with infogain.

Distance pruning works:

Techniques: Distance pruning and  DTree pruning

Techniques         -effort         -months        -defects          -risks    #
         1 T0 m              31              67               6               0    #
  2 Bef prune m              11              20               8               2    #
  3 Aft prune m               8              20              11               2    #
    4 T9:j/j_ m               0              31               0              22    #
-------------------------------------------------------------------------------------
         1 T0 q              26              13               9               2    #
  2 Bef prune q              10               0              10               3    #
  3 Aft prune q               8               0              14               4    #
    4 T9:j/j_ q               3              19               2              38    #
-------------------------------------------------------------------------------------
         1 T0 w             100             100              42              16    #
  2 Bef prune w              67              38              63               9    #
  3 Aft prune w              58              39             100               9    #
    4 T9:j/j_ w              31              98              25             100    #
-------------------------------------------------------------------------------------
            100         2761.71            42.2        39498.09             8.6    #
              0          117.21            3.48          381.83             0.0    #
 
 
but tree is big:

MAIN_TREE:

173     $rely <= 3.5 samples = 500
   174    |- $ltex <= 2.5 samples = 253
   175    |-|- $cplx <= 3.5 samples = 167
   176    |-|-|- $site <= 2.5 samples = 54
   177    |-|-|-|- $kloc <= 249.0 samples = 24
   178    |-|-|-|-|- ['__2']  # samples = 13 # branch_id = 0
   179    |-|-|-|-|- ['__4', '__9']  # samples = 11 # branch_id = 1
   180    |-|-|-|- $pr <= 2.5 samples = 30
   181    |-|-|-|-|- ['__7']  # samples = 11 # branch_id = 2
   182    |-|-|-|-|- ['__5']  # samples = 19 # branch_id = 3
   183    |-|-|- $ruse <= 3.5 samples = 113
   184    |-|-|-|- $pcon <= 2.5 samples = 52
   185    |-|-|-|-|- $pcap <= 3.5 samples = 25
   186    |-|-|-|-|-|- ['__6']  # samples = 13 # branch_id = 4
   187    |-|-|-|-|-|- ['__13']  # samples = 12 # branch_id = 5
   188    |-|-|-|-|- $flex <= 2.5 samples = 27
   189    |-|-|-|-|-|- ['__7']  # samples = 13 # branch_id = 6
   190    |-|-|-|-|-|- ['__8', '__13']  # samples = 14 # branch_id = 7
   191    |-|-|-|- $pcap <= 3.5 samples = 61
   192    |-|-|-|-|- $kloc <= 152.0 samples = 29
   193    |-|-|-|-|-|- ['__15']  # samples = 11 # branch_id = 8
   194    |-|-|-|-|-|- ['__13']  # samples = 18 # branch_id = 9
   195    |-|-|-|-|- $aexp <= 2.5 samples = 32
   196    |-|-|-|-|-|- ['__13', '__15']  # samples = 19 # branch_id = 10
   197    |-|-|-|-|-|- ['__12']  # samples = 13 # branch_id = 11
   198    |-|- $pvol <= 2.5 samples = 86
   199    |-|-|- $resl <= 2.5 samples = 28
   200    |-|-|-|- ['__4']  # samples = 15 # branch_id = 12
   201    |-|-|-|- ['__2', '__7']  # samples = 13 # branch_id = 13
   202    |-|-|- $acap <= 3.5 samples = 58
   203    |-|-|-|- $resl <= 2.5 samples = 23
   204    |-|-|-|-|- ['__2']  # samples = 12 # branch_id = 14
   205    |-|-|-|-|- ['__5']  # samples = 11 # branch_id = 15
   206    |-|-|-|- $team <= 2.5 samples = 35
   207    |-|-|-|-|- ['__1', '__11']  # samples = 15 # branch_id = 16
   208    |-|-|-|-|- ['__7']  # samples = 20 # branch_id = 17
   209    |- $pr <= 4.5 samples = 247
   210    |-|- $plex <= 2.5 samples = 193
   211    |-|-|- $flex <= 2.5 samples = 129
   212    |-|-|-|- $pvol <= 2.5 samples = 63
   213    |-|-|-|-|- $kloc <= 164.5 samples = 22
   214    |-|-|-|-|-|- ['__13']  # samples = 11 # branch_id = 18
   215    |-|-|-|-|-|- ['__7']  # samples = 11 # branch_id = 19
   216    |-|-|-|-|- $pr <= 3.5 samples = 41
   217    |-|-|-|-|-|- $pcap <= 3.5 samples = 29
   218    |-|-|-|-|-|-|- ['__11']  # samples = 13 # branch_id = 20
   219    |-|-|-|-|-|-|- ['__14']  # samples = 16 # branch_id = 21
   220    |-|-|-|-|-|- ['__10']  # samples = 12 # branch_id = 22
   221    |-|-|-|- $site <= 1.5 samples = 66
   222    |-|-|-|-|- ['__15']  # samples = 17 # branch_id = 23
   223    |-|-|-|-|- $ruse <= 3.5 samples = 49
   224    |-|-|-|-|-|- ['__15']  # samples = 20 # branch_id = 24
   225    |-|-|-|-|-|- $pvol <= 3.5 samples = 29
   226    |-|-|-|-|-|-|- ['__12']  # samples = 16 # branch_id = 25
   227    |-|-|-|-|-|-|- ['__6', '__16']  # samples = 13 # branch_id = 26
   228    |-|-|- $kloc <= 295.5 samples = 64
   229    |-|-|-|- $team <= 1.5 samples = 47
   230    |-|-|-|-|- ['__13', '__15']  # samples = 17 # branch_id = 27
   231    |-|-|-|-|- $etat <= 2.5 samples = 30
   232    |-|-|-|-|-|- ['__13']  # samples = 13 # branch_id = 28
   233    |-|-|-|-|-|- ['__7']  # samples = 17 # branch_id = 29
   234    |-|-|-|- ['__7']  # samples = 17 # branch_id = 30
   235    |-|- $cplx <= 3.5 samples = 54
   236    |-|-|- ['__9']  # samples = 21 # branch_id = 31
   237    |-|-|- $team <= 2.5 samples = 33
   238    |-|-|-|- ['__15']  # samples = 15 # branch_id = 32
   239    |-|-|-|- ['__12', '__13']  # samples = 18 # branch_id = 33



To dist prune tree:
  94     $pr <= 1.5 samples = 500
    95    |- $prec <= 1.5 samples = 98
    96    |-|- $pcon <= 3.5 samples = 22
    97    |-|-|- ['__2']  # samples = 11 # branch_id = 0
    98    |-|- $flex <= 1.5 samples = 76
    99    |-|-|- $kloc <= 256.0 samples = 24
   100    |-|-|-|- ['__9']  # samples = 11 # branch_id = 1
   101    |-|-|-|- ['__5']  # samples = 13 # branch_id = 2
   102    |-|-|- $team <= 1.5 samples = 52
   103    |-|-|-|- ['__11']  # samples = 13 # branch_id = 3
   104    |-|-|-|- $pcon <= 2.5 samples = 39
   105    |-|-|-|-|- ['__13']  # samples = 20 # branch_id = 4
   106    |-|-|-|-|- ['__9']  # samples = 19 # branch_id = 5
   107    |- $prec <= 1.5 samples = 402
   108    |-|- $etat <= 1.5 samples = 103
   109    |-|-|- ['__13']  # samples = 13 # branch_id = 6
   110    |-|-|- $resl <= 3.5 samples = 90
   111    |-|-|-|- $ltex <= 2.5 samples = 66
   112    |-|-|-|-|- $site <= 3.5 samples = 38
   113    |-|-|-|-|-|- $rely <= 3.5 samples = 25
   114    |-|-|-|-|-|-|- ['__6']  # samples = 12 # branch_id = 7
   115    |-|-|-|-|-|- ['__7']  # samples = 13 # branch_id = 8
   116    |-|-|-|-|- $acap <= 3.5 samples = 28
   117    |-|-|-|-|-|- ['__13']  # samples = 12 # branch_id = 9
   118    |-|-|-|-|-|- ['__4']  # samples = 16 # branch_id = 10
   119    |-|-|-|- $site <= 2.5 samples = 24
   120    |-|-|-|-|- ['__9']  # samples = 12 # branch_id = 11
   121    |-|- $acap <= 3.5 samples = 299
   122    |-|-|- $rely <= 3.5 samples = 157
   123    |-|-|-|- $ruse <= 3.5 samples = 82
   124    |-|-|-|-|- $prec <= 2.5 samples = 47
   125    |-|-|-|-|-|- $pcap <= 3.5 samples = 31
   126    |-|-|-|-|-|-|- ['__7']  # samples = 16 # branch_id = 12
   127    |-|-|-|-|-|-|- ['__1']  # samples = 15 # branch_id = 13
   128    |-|-|-|-|- $docu <= 2.5 samples = 35
   129    |-|-|-|-|-|- ['__13']  # samples = 21 # branch_id = 14
   130    |-|-|-|-|-|- ['__1']  # samples = 14 # branch_id = 15
   131    |-|-|-|- $team <= 2.5 samples = 75
   132    |-|-|-|-|- $docu <= 2.5 samples = 44
   133    |-|-|-|-|-|- ['__1']  # samples = 27 # branch_id = 16
   134    |-|-|-|-|-|- ['__1']  # samples = 17 # branch_id = 17
   135    |-|-|-|-|- ['__1']  # samples = 31 # branch_id = 18
   136    |-|-|- $flex <= 2.5 samples = 142
   137    |-|-|-|- $pcon <= 1.5 samples = 70
   138    |-|-|-|-|- $prec <= 2.5 samples = 53
   139    |-|-|-|-|-|- $kloc <= 204.0 samples = 35
   140    |-|-|-|-|-|-|- ['__7']  # samples = 15 # branch_id = 19
   141    |-|-|-|-|-|-|- ['__1']  # samples = 20 # branch_id = 20
   142    |-|-|-|- $site <= 2.5 samples = 72
   143    |-|-|-|-|- $pcon <= 2.5 samples = 33
   144    |-|-|-|-|-|- ['__6']  # samples = 15 # branch_id = 21
   145    |-|-|-|-|-|- ['__7']  # samples = 18 # branch_id = 22
   146    |-|-|-|-|- $pvol <= 3.5 samples = 39
   147    |-|-|-|-|-|- $pcap <= 3.5 samples = 25
   148    |-|-|-|-|-|-|- ['__1']  # samples = 14 # branch_id = 23
   149    |-|-|-|-|-|-|- ['__11']  # samples = 11 # branch_id = 24
   150    |-|-|-|-|-|- ['__3']  # samples = 14 # branch_id = 25


 

  Infogain Discretized Dtree and Dist pruned doesnt work.

Tree:

 flex <= 27.5 samples = 500
|- docu <= 6.5 samples = 261
|-|- ['__1']  # samples = 31 # branch_id = 0
|-|- resl <= 33.5 samples = 230
|-|-|- ['__2']  # samples = 200 # branch_id = 1
|-|-|- ['__2']  # samples = 30 # branch_id = 2
|- pr <= 18.0 samples = 239
|-|- ['__6']  # samples = 16 # branch_id = 3
|-|- ruse <= 32.0 samples = 223
|-|-|- ['__4']  # samples = 203 # branch_id = 4
 
 
Performance:
 
     Techniques         -effort         -months        -defects          -risks    #
         1 T0 m              31              68              16               0    #
   2 Bef disc m              18              43              17               2    #
   3 Aft disc m              29              61              39               8    #
    4 T9:j/j_ m               0              33               0              22    #
-------------------------------------------------------------------------------------
         1 T0 q              29              16              24               0    #
   2 Bef disc q              15               8              26               3    #
   3 Aft disc q               3               0              10               9    #
    4 T9:j/j_ q               3              22               4              38    #
-------------------------------------------------------------------------------------
         1 T0 w             100             100              97              16    #
   2 Bef disc w              63              65             100              15    #
   3 Aft disc w              74              77              62              13    #
    4 T9:j/j_ w              32              99              58             100    #
-------------------------------------------------------------------------------------
            100         2702.14           41.94        17094.69             8.6    #
              0          117.21            2.44          381.83             0.0    # 


Wednesday, June 11, 2014

PLAN C: Prune trees

1a) delete data from any leaf containing things from > 1 cluster.
Did this one . Check http://unbox.org/things/var/nave/lpj/out/10_June_2014/dats/pruned_tree.dat

for pruned tree and actual tree. 
To check if the code is working or not see: http://unbox.org/things/var/nave/lpj/out/10_June_2014/dats/short_example.dat

1b) descend the trees generated from CART looking for sub-trees that
whose items with cluster ID have HIGHER entropy than the parents, then
delete all items in those sub-trees-of-confusion

1c) for all sub-trees built by CART, compute the entropy of the leaf
items in that tree. sort those entropies to find "too much confusion"
e.g. half way down that list. delete all sub-trees with MORE than "too
much confusion"

then after step1, rebuild the trees using the reduced data sets.


Apparently scikit-learn dtrees do not maintain samples in their trees. meaning. at the leafs or at the nodes there is no sample data. It runs through the sample data and gathers values(results) but not store samples themselves. So at a leaf, I can only find stats of samples, like
[  7.   8.   3.   0.   0.   0.   0.   0.   3.   0.   5.   2.   0.   0.   0.   0.   0.   0.   0.   0.   0.   0.]

indicating there are 7 samples of first cluster, 8 of second and so on.

So I cannot actually go back to dataset remove those rows and rebuild the tree.
Instead I can calculate entropies using above array at each leaf/node and prune ones using 1b and 1c.

PS: One more problem, those arrays of values are not maintained at nodes! there are only available at leaves, so I have to traverse down entire branch beneath a node and add those arrays together to get that above array at that node.

Monday, June 2, 2014

results Contrast set learner

55555 rounding
Before rounding:

 Techniques         -effort         -months        -defects          -risks    #
           T0 m              29              67              14               2    #
  T3 C25 N100 m               2              10               3               0    #
      T9:j/j_ m               0              35               0              21    #
-------------------------------------------------------------------------------------
           T0 q              26              16              20               6    #
  T3 C25 N100 q               3               0               5               1    #
      T9:j/j_ q               3              23               4              38    #
-------------------------------------------------------------------------------------
           T0 w             100             100             100              19    #
  T3 C25 N100 w              32              21              49               4    #
      T9:j/j_ w              32             100              56             100    #
-------------------------------------------------------------------------------------
            100         2687.38            41.4        17612.38             8.6    #
              0          117.21            1.93          381.83            0.05    #

After rounding:
Dataset rounded to integers:
 Techniques         -effort         -months        -defects          -risks    #
           T0 m              29              67              14               0    #
  T3 C25 N100 m               3              10              10               1    #
      T9:j/j_ m               0              35               0              22    #
-------------------------------------------------------------------------------------
           T0 q              28              17              24               2    #
  T3 C25 N100 q               3               0              13               2    #
      T9:j/j_ q               3              23               4              38    #
-------------------------------------------------------------------------------------
           T0 w             100              99             100              15    #
  T3 C25 N100 w              26              19              78               4    #
      T9:j/j_ w              32             100              59             100    #
-------------------------------------------------------------------------------------
            100          2695.0            41.4        16771.11             8.6    #
              0          117.21            1.85          381.83             0.0    # 
 
7777 Trees of all
 
http://unbox.org/things/var/nave/lpj/out/02_June_2014/dats/tree*
 
88888 Results for all models after rounding (makes sense):
 
flight:

     Techniques         -effort         -months        -defects          -risks    #
           T0 m              27              67              12               4    #
  T3 C25 N100 m               0              10               0               0    #
    T9:j/jall m               4              46               1              16    #
-------------------------------------------------------------------------------------
           T0 q              24              16              18              10    #
  T3 C25 N100 q               0               0               2               1    #
    T9:j/jall q              10              29               6              43    #
-------------------------------------------------------------------------------------
           T0 w             100             100             100              35    #
  T3 C25 N100 w              31              21              47               7    #
    T9:j/jall w              32              97              35             100    #
-------------------------------------------------------------------------------------
            100         2687.38           41.35        17612.38             4.8    #
              0          172.58            1.92          892.87            0.04    #
 
ground:
 
Techniques         -effort         -months        -defects          -risks    #
           T0 m              15              55               8              10    #
  T3 C25 N100 m               2              12               6               0    #
 T9:j/jground m               4              42               0               9    #
-------------------------------------------------------------------------------------
           T0 q              12              13              13              24    #
  T3 C25 N100 q               0               0               6               0    #
 T9:j/jground q              15              47               2              15    #
-------------------------------------------------------------------------------------
           T0 w              68              84             100              54    #
  T3 C25 N100 w              26              21              44               4    #
 T9:j/jground w             100             100              98             100    #
-------------------------------------------------------------------------------------
            100          2819.5            43.9        27175.92             4.8    #
              0          155.25            1.55          806.33            0.12    # 
 
 
osp:
 
Techniques         -effort         -months        -defects          -risks    #
           T0 m              30              54              38              37    #
  T3 C25 N100 m               0               8               2               0    #
    T9:j/josp m               4              47               0              11    #
-------------------------------------------------------------------------------------
           T0 q               9               5              21              29    #
  T3 C25 N100 q               0               0               4               0    #
    T9:j/josp q               4              30              10              30    #
-------------------------------------------------------------------------------------
           T0 w              54              67             100              64    #
  T3 C25 N100 w              13              16              55              10    #
    T9:j/josp w             100             100              41             100    #
-------------------------------------------------------------------------------------
            100          3063.6            41.7        14504.17             7.5    #
              0           89.69            1.47          722.41            0.26    #
 
 
 
osp2:
 
      Techniques         -effort         -months        -defects          -risks    #
           T0 m              49              67              11               5    #
  T3 C25 N100 m               1              12               1               0    #
   T9:j/josp2 m               2              44               0               9    #
-------------------------------------------------------------------------------------
           T0 q               9               5               2               7    #
  T3 C25 N100 q               0               0               4               2    #
   T9:j/josp2 q              16              21              18              28    #
-------------------------------------------------------------------------------------
           T0 w              90              82              34              15    #
  T3 C25 N100 w              44              23              93              17    #
   T9:j/josp2 w             100             100             100             100    #
-------------------------------------------------------------------------------------
            100          1198.0            33.4          7610.0             5.1    #
              0          112.45            1.57           637.4            0.21    #
 
all:

Techniques         -effort         -months        -defects          -risks    #
           T0 m              20              54              11              21    #
  T3 C25 N100 m               0              12               5               0    #
    T9:j/jall m               2              42               0              14    #
-------------------------------------------------------------------------------------
           T0 q              20              18              19              35    #
  T3 C25 N100 q               0               0               7               2    #
    T9:j/jall q               8              26               4              40    #
-------------------------------------------------------------------------------------
           T0 w             100             100             100             100    #
  T3 C25 N100 w              42              24              64              10    #
    T9:j/jall w              31              89              27              94    #
-------------------------------------------------------------------------------------
            100          2645.2           44.82        22300.72            5.08    #
              0          225.33            2.24         1028.96            0.12    #
 
99999 Cohen <=> Bootstrap
 
Bootstrap:
 
 Techniques         -effort         -months        -defects          -risks    #
           T0 m              27              67              12               4    #
  T3 C25 N100 m               0              10               0               0    #
    T9:j/jall m               4              46               1              16    #
-------------------------------------------------------------------------------------
           T0 q              24              16              18              10    #
  T3 C25 N100 q               0               0               2               1    #
    T9:j/jall q              10              29               6              43    #
-------------------------------------------------------------------------------------
           T0 w             100             100             100              35    #
  T3 C25 N100 w              31              21              47               7    #
    T9:j/jall w              32              97              35             100    #
-------------------------------------------------------------------------------------
            100         2687.38           41.35        17612.38             4.8    #
              0          172.58            1.92          892.87            0.04    #
 
Cohen:
 
  Techniques         -effort         -months        -defects          -risks    #
           T0 m              27              67              11               4    #
  T3 C25 N100 m               0              10               0               0    #
    T9:j/jall m               3              46               0              16    #
-------------------------------------------------------------------------------------
           T0 q              24              16              18              10    #
  T3 C25 N100 q               1               0               2               1    #
    T9:j/jall q               9              28               5              43    #
-------------------------------------------------------------------------------------
           T0 w             100             100             100              35    #
  T3 C25 N100 w              27              21              51               8    #
    T9:j/jall w              32              97              34             100    #
-------------------------------------------------------------------------------------
            100         2687.38           41.35        17612.38             4.8    #
              0          185.14            2.08          989.83            0.04    #
 
 
Runtimes:
 
Bootstrap:
real 1m51.292s
user 1m44.647s
sys 0m6.395s 
 
Cohen:
real 0m56.032s
user 0m52.087s
sys 0m3.737s
 

Summary

-555--Rounding dataset into integers makes more sense as it would be similar to the daataset we receive. Results indicate minor changes.

-777--Trees as indicated are very big. Working on axe to get it down.

-888--Results for other models are similar to flight. a little better.

-999--Swapping cohens to bootstrap gave little change to output. but runtime is reduced by half.

Tuesday, May 27, 2014

Results technique tables j*

Just with last gen values:

Techniques         -effort         -months        -defects          -risks    #
           T0 m              29              67              14               2    #
  T3 C25 N100 m               2              10               3               0    #
     T9:jlast m               0              35               0              22    #
-------------------------------------------------------------------------------------
           T0 q              26              16              20               6    #
  T3 C25 N100 q               2               0               5               1    #
     T9:jlast q               3              23               4              38    #
-------------------------------------------------------------------------------------
           T0 w             100             100             100              20    #
  T3 C25 N100 w              31              21              47               4    #
     T9:jlast w              32             100              56             100    #
-------------------------------------------------------------------------------------
            100         2687.38            41.4        17612.38             8.6    #
              0          117.21            1.92          381.83            0.03    #

Different Techniques:

Techniques         -effort         -months        -defects          -risks    #
           T0 m              22              44              10               2    #
  T3 C25 N100 m               4               6               3               0    #
      T9:j/j_ m               2              23               1              16    #
   T9:j/j_l20 m               6              30               4               4    #
    T9:j/j_l6 m               3              33               2               9    #
 T9:j/j_m0.01 m               3              26               2               5    #
  T9:j/j_m0.5 m               7              26               5               8    #
  T9:j/j_m0.7 m               3              25               1               2    #
  T9:j/j_p300 m               5              45               2               7    #
  T9:j/j_p500 m               0              16               0               4    #
-------------------------------------------------------------------------------------
           T0 q              20              11              15               4    #
  T3 C25 N100 q               4               0               4               1    #
      T9:j/j_ q               5              15               3              28    #
   T9:j/j_l20 q              20              20               7              14    #
    T9:j/j_l6 q               6              22               6              16    #
 T9:j/j_m0.01 q               7               9               3              14    #
  T9:j/j_m0.5 q              11              13               6              11    #
  T9:j/j_m0.7 q               7              21               2               7    #
  T9:j/j_p300 q              10              30               4              30    #
  T9:j/j_p500 q               0               8               1               9    #
-------------------------------------------------------------------------------------
           T0 w              71              65              68              15    #
  T3 C25 N100 w              22              13              32               3    #
      T9:j/j_ w              24              65              38              74    #
   T9:j/j_l20 w              52              59              26              54    #
    T9:j/j_l6 w              31              74              29              66    #
 T9:j/j_m0.01 w              26              58              14              79    #
  T9:j/j_m0.5 w              67              66             100              55    #
  T9:j/j_m0.7 w             100              69              34              37    #
  T9:j/j_p300 w              43             100              23             100    #
  T9:j/j_p500 w               6              33               6              60    #
-------------------------------------------------------------------------------------
            100          3798.0           62.54         25832.5           11.55    #
              0           28.96            1.89          163.65            0.04    #

m = mutation rate
p = population size
l = lives of bstop/generations

Monday, May 5, 2014

Magic Learner-JPL and others

FOR JPL


Study 1:

  1. Predict LogicalDelivered, excluding EKLOC, inheritance.
  2. Predict LogicalEKLOC, excluding delivered, and including inheritance.
Study 2:
  1. Boring COCOMO using 1.1
  2. Boring COCOMO using 1.2

Boring COCOMO ready and set to go.

Effort Predictions(val2):


so, we need a LOO experiment where we:
    0) cluster the dense columns 
    1)  take the "left out" example,  described in terms of:
                a) the new columns ("new" means "not traditional cocomo")
                b) its "class" e.g. "flight systems"
                c) act effort 
    2)  find the "left out" example's cluster and extract the LOC in that cluster
               - note: until step 5 we will ignore the actual effort
    3)  go to darren's rig and generate effort predictions (constrained by (2) and (1b))
    4) show the 50 to 70th percentile range of (3)
    5) mark on that  range the actual effort
    6) dance and sing if the the actual effort (from 1c) is in the range of (5


http://unbox.org/things/var/nave/lpj/out/master/effort_check_with_cocomo_50_70.xlsx


Graphs learnt on whole *old+new* with specific conditions(val0):




OTHER THAN JPL

Results for tables showing different techniques:

http://unbox.org/things/var/nave/lpj/out/master/*preptab*.dat

Contrast sets sorted:

http://unbox.org/things/var/nave/lpj/out/master/*contrast_sets_sorted.dat

Trees for different models:

http://unbox.org/things/var/nave/lpj/out/master/*dtree*.dat

Other graphs:


MRE with and without learning 20 records around cluster centroid:




Monday, April 28, 2014

Results of contrast set learning techniques


Results of contrast set learning techniques 

What was done using different techniques:

1. Cluster jplflight(-->C1) with xy_proj.py -->C2
2. Build decision trees using xy_dt.py
3. Use diff.py to get decisions(contrast sets) to be made for worse cluster to be better cluster.
4. Using the contrast sets generate 500 samples with gen.py. (used xomo)-->C3
5. Compare initial clusters to newly generated data.
6. Represent results as in fig 9 of http://menzies.us/pdf/12gense.pdf .

Techniques:
T0: asIs
T2 =C1+C3 
T3 = C2+C3


Flight data

 Techniques         -effort         -months        -defects          -risks    #
           T0 m              43              74              14               9    #
           T2 m               0               3               0               1    #
           T3 m               0               4               0               0    #
           T0 q              32              17              21              26    #
           T2 q               0               0               1               2    #
           T3 q               0               0               1               2    #
           T0 w             100             100             100             100    #
           T2 w               2               7              25              15    #
           T3 w               2               7              21              13    #
            100         30166.1            88.6         27118.6             1.8    #
              0          9598.8            16.4          4340.4             0.2    #

Ground data

  Techniques         -effort         -months        -defects          -risks    #
           T0 m              43              74              15              10    #
           T2 m               0               3               0               1    #
           T3 m               0               3               0               0    #
           T0 q              32              17              21              27    #
           T2 q               0               0               1               3    #
           T3 q               0               0               1               3    #
           T0 w             100             100             100             100    #
           T2 w               1               7              18              17    #
           T3 w               1               6              16              15    #
            100         30166.1            88.6         27118.6             1.8    #
              0          9598.8            16.4          4340.4             0.2    #


Osp data

 Techniques         -effort         -months        -defects          -risks    #
           T0 m              43              74              12               0    #
           T2 m               0               4               0              12    #
           T3 m               0               4               0              12    #
           T0 q              32              18              19              19    #
           T2 q               0               0               1               9    #
           T3 q               0               0               0               8    #
           T0 w             100             100             100             100    #
           T2 w               1               6              24              33    #
           T3 w               1               6              20              33    #
            100         30166.1            88.6         27118.6             1.8    #
              0          9598.8            16.4          6021.0             0.2    #


Osp2 data

Techniques         -effort         -months        -defects          -risks    #
           T0 m              43              74              14               3    #
           T2 m               0               4               0               0    #
           T3 m               0               4               0               0    #
           T0 q              32              18              21              22    #
           T2 q               0               0               0               2    #
           T3 q               0               0               0               2    #
           T0 w             100             100             100             100    #
           T2 w               1               6              14              14    #
           T3 w               1               6              11              14    #
            100         30166.1            88.6         27118.6             1.8    #
              0          9598.8            16.4          6021.0             0.2    #

Monday, March 3, 2014

JPL results

Results are here

ex: decs +=1 when risk in before > risk in after

Without any tricks:


before: 
w: both len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          7539.9          1746.4            55.3    #
             50             0.3         12711.3          4332.0            65.2    #
             75             0.5         18808.1          8054.3            74.5    #
            100             2.4         39571.6         55458.4            98.6    #
after: 
wced: gened len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          7171.9          1552.7            54.3    #
             50             0.3         12265.8          3394.4            64.1    #
             75             0.5         18948.0          6361.0            73.5    #
            100             2.4         33062.2         32483.0            94.0    #
###########################################################################
decs:  11 incs:  1 sames:  4

With rounded off to 2 decimal places:


flight
before: 
w: both len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          7539.9          1746.4            55.3    #
             50             0.3         12711.3          4332.0            65.2    #
             75             0.5         18808.1          8054.3            74.5    #
            100             2.4         39571.6         55458.4            98.6    #
after: 
wced: gened len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          8077.6          2545.1            56.2    #
             50             0.3         13000.4          4821.2            66.0    #
             75             0.5         19027.8          8807.1            74.1    #
            100             2.1         37703.9         61617.7            97.4    #
###########################################################################
decs: 4 incs: 9 sames: 3

With pruned leaves more than 0.3*root variance:


flight
before: 
w: both len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          7539.9          1746.4            55.3    #
             50             0.3         12711.3          4332.0            65.2    #
             75             0.5         18808.1          8054.3            74.5    #
            100             2.4         39571.6         55458.4            98.6    #
after: 
wced: gened len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          7167.8          1905.1            54.5    #
             50             0.0         13112.5          3694.2            65.2    #
             75             0.5         19143.8          9044.5            74.8    #
            100             2.1         42055.8         47935.8           101.8    #
###########################################################################
decs: 6 incs: 7 sames: 3

With near=50:

flight
before: 
w: both len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          7539.9          1746.4            55.3    #
             50             0.3         12711.3          4332.0            65.2    #
             75             0.5         18808.1          8054.3            74.5    #
            100             2.4         39571.6         55458.4            98.6    #
after: 
wced: gened len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          6628.1          2226.9            53.7    #
             50             0.3         12449.1          4711.6            63.9    #
             75             0.5         18024.6          8876.6            72.7    #
            100             2.4         36447.5         43329.9           100.9    #
###########################################################################
decs: 8 incs: 4 sames: 4

With near=20:

flight
before: 
w: both len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          7539.9          1746.4            55.3    #
             50             0.3         12711.3          4332.0            65.2    #
             75             0.5         18808.1          8054.3            74.5    #
            100             2.4         39571.6         55458.4            98.6    #
after: 
wced: gened len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          6445.3          1803.4            52.7    #
             50             0.3         13185.8          4169.2            65.8    #
             75             0.5         18991.1          9522.6            75.0    #
            100             2.4         35222.3         43783.5           100.7    #
###########################################################################
decs: 5 incs: 7 sames: 4

With near=10:

Notice the decrease in defects to half and also no increases by only decreases. good sign.

flight
before: 
w: both len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          7539.9          1746.4            55.3    #
             50             0.3         12711.3          4332.0            65.2    #
             75             0.5         18808.1          8054.3            74.5    #
            100             2.4         39571.6         55458.4            98.6    #
after: 
wced: gened len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          6576.3          1141.0            53.1    #
             50             0.0         12201.7          2659.5            63.1    #
             75             0.5         17473.0          4836.8            71.1    #
            100             2.1         37588.2         24027.8            95.9    #
###########################################################################
decs: 14 incs: 0 sames: 2

With near=5:

flight
before: 
w: both len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          7539.9          1746.4            55.3    #
             50             0.3         12711.3          4332.0            65.2    #
             75             0.5         18808.1          8054.3            74.5    #
            100             2.4         39571.6         55458.4            98.6    #
after: 
wced: gened len: 500
     percentile          -risks         -effort        -defects         -months    #
             25             0.0          7270.6          1776.4            54.9    #
             50             0.0         13055.3          4027.3            65.3    #
             75             0.5         18314.6          7566.9            74.1    #
            100             2.4         42903.9         48402.4           103.2    #
###########################################################################
decs: 8 incs: 5 sames: 3


Summing up:

?Without --Without seems to decs are 11 and incs are 1, different than what I saw in the mail. Perhaps my edits after generating flight.csv might have caused that.
-Roundoff ---for generating ptiles: few clusters are not having any rows left after pruning rows off that dont obey the conditions. Every row violates atleast one condition in few clusters.
-Prune --Pruned leaves with variances over 0.3 that of root. ~3-4 leaves get eliminated.
+near when n = 10 --Works for a range of n when n is neither too high for excessive learning nor too low for insufficient learning.

Monday, February 24, 2014

Scoring JPL

Ideas implemented:

  1. Changed criterion to gini and checked results. Result: Minor changes to CART tree.
  2. Train on N nearest to centroid. What should N be? I am planning to try out range of values and check the result.
  3. Prune leaves with sd greater than 0.3 of root. -->Very different clusters. Result: 3 clusterers eliminated.

Ideas to be implemented:
  1. Join two clusters that are statistically insignificantly different. Problem: Needs major changes to structure, Trying to figure a smart way out.

Scoring:

For every cluster:
  • Compare with all other clusters.
  • It is said to be "better" over other when:
    • Both clusters are statistically significantly different by both tests.
    • Centroid is better(more or less based on dependent variables) than other.
  • It is said to be similar when:
    • first if a12 returns as similar.
    • if a12 returns as different--bootstrap test is done to check that.
    • Similar if Both tests returns similar.
  • It is said to be worse when:
    • if it is different as stated by both tests.
    • Centroid is not better than other.
  • If cluster is better on one and is worse on none, then score of that cluster is incremented.
Scores of each cluster based on training in nearest n = 20 to centroid:

when nearest n is not used:

To do:
As structures for each branch are already done, categorize clusters based on scores into "good" and "bad". Pick each cluster from "bad", find the nearest branch in CART that has good and difference the conditions.

Run these conditions through xomo to generate new dataset and compare result.

Ideas for "good" and "bad":
Sort clusters based on scores and pick top n^0.5 and say they are "good". Others are "bad".

Monday, February 3, 2014

POM4

List of changes in POM4 compared to POM3:

* Replaced Requirements with User Stories
* Added Sprints
* Changed Execution
* Models time of completion (Velocity)
* No product Backlog as mentioned earlier--Not relevant


Sample output:

[Cost, Score, completion, idle, velocity]

[2409.671458440433, 0.8841628909936482, 0.29411764705882354, 0.7058823529411764, 28.1]
[2308.2960550738408, 0.7867703286312365, 0.3660130718954248, 0.6339869281045751, 28.791666666666668]
[2570.022284498054, 0.8192890455541242, 0.3492063492063492, 0.6507936507936508, 28.15]
[1776.6221769857425, 0.8934120231082071, 0.06578947368421052, 0.9305555555555556, 18.25]
[2663.5466581317396, 0.8377502677420756, 0.20610687022900764, 0.7923076923076923, 24.583333333333332]
[2873.7679677836973, 0.8005907722786698, 0.30708661417322836, 0.6929133858267716, 28.0625]
[2974.0503086683807, 0.9211912145791122, 0.13821138211382114, 0.8571428571428572, 21.375]
[2254.083309388589, 0.8483742963781609, 0.22875816993464052, 0.7712418300653595, 27.125]
[2252.9218006369865, 0.8187803230043464, 0.10588235294117647, 0.8881987577639752, 24.125]
[1970.4420192421026, 0.8980781700913005, 0.10382513661202186, 0.8716216216216216, 28.083333333333332]
[2239.8372694910295, 0.7732764195049752, 0.4065040650406504, 0.5934959349593496, 28.041666666666668]
[2490.8178434146753, 0.8548533334449776, 0.30158730158730157, 0.6984126984126984, 27.6875]
[2090.459851323212, 0.906146585636779, 0.09595959595959595, 0.8983957219251337, 28.875]
[2487.32661497613, 0.8025235096809521, 0.310126582278481, 0.689873417721519, 28.541666666666668]
[1999.257417423182, 0.7881805570666411, 0.15263157894736842, 0.8473684210526315, 28.166666666666668]
[2659.3639169614175, 0.8136230090693194, 0.44715447154471544, 0.5528455284552846, 31.416666666666668]
[2518.5831627767234, 0.7714916788706024, 0.3984375, 0.6015625, 28.458333333333332]
[2653.9829039013243, 0.7942550808491925, 0.3898305084745763, 0.6101694915254237, 27.916666666666668]
[2520.328542653908, 0.8374772551439275, 0.29545454545454547, 0.7045454545454546, 28.4375]
[2544.763860934486, 0.8723176429348501, 0.11711711711711711, 0.8828828828828829, 26.0]
[2628.456723197506, 0.8203655792518135, 0.39316239316239315, 0.6068376068376069, 28.8]
[2573.503127321302, 0.7884237959629854, 0.3142857142857143, 0.6857142857142857, 26.55]
[1961.7933461746904, 0.8152854455707702, 0.27350427350427353, 0.7264957264957265, 27.875]
[2316.8948214132224, 0.8217888256150522, 0.21951219512195122, 0.7804878048780488, 28.583333333333332]
[2480.6806520346904, 0.8747529690927919, 0.16923076923076924, 0.8211382113821138, 26.583333333333332]
[2659.449863697794, 0.9241150906277656, 0.10285714285714286, 0.8971428571428571, 21.75]
[2670.630413055988, 0.8185772070791713, 0.44660194174757284, 0.5533980582524272, 26.833333333333332]
[2261.9032345883297, 0.880074563709406, 0.3673469387755102, 0.6326530612244898, 26.5]
[2803.9527726963315, 0.8112949960654825, 0.4020618556701031, 0.5760869565217391, 24.4]
[1789.2637140962051, 0.9134638787851941, 0.1320754716981132, 0.8571428571428572, 26.25]
[2551.9635529278703, 0.8700612111658858, 0.2184873949579832, 0.7777777777777778, 27.583333333333332]
[2715.4994139204637, 0.8218098445599464, 0.19718309859154928, 0.8028169014084507, 25.8125]
[2792.223819921654, 0.8980444641536334, 0.25510204081632654, 0.7448979591836735, 28.583333333333332]
[2484.5482551716327, 0.8902994085435698, 0.2127659574468085, 0.7872340425531915, 25.333333333333332]
[2723.6434810973956, 0.7986069896029132, 0.3389830508474576, 0.6610169491525424, 29.125]
[2927.417113886656, 0.8386515663739715, 0.3037037037037037, 0.6962962962962963, 28.9375]
[2295.532964721932, 0.8358459503202905, 0.20437956204379562, 0.7956204379562044, 28.25]
[2312.3109954731426, 0.7936932169797876, 0.3, 0.7, 27.625]
[2043.7151661914083, 0.8710077212863819, 0.1721311475409836, 0.7835051546391752, 23.25]
[2331.391170948724, 0.7928084070500105, 0.296875, 0.703125, 31.25]
[3078.8501033528346, 0.8888925374805372, 0.2549019607843137, 0.7450980392156863, 24.166666666666668]
[3100.958248463834, 0.7515307494535662, 0.23893805309734514, 0.7610619469026548, 26.9375]
[2199.850852366886, 0.8303671112167473, 0.21022727272727273, 0.7897727272727273, 26.875]
[2232.2895282162535, 0.904199293106172, 0.10559006211180125, 0.8944099378881988, 27.25]
[2795.6273106821627, 0.8801933995960874, 0.18115942028985507, 0.8188405797101449, 23.0]
[3066.9233408587424, 0.8898168997188672, 0.16822429906542055, 0.8317757009345794, 23.75]
[2887.73100680117, 0.9125038606759316, 0.12149532710280374, 0.8785046728971962, 22.25]
[2848.9219718849586, 0.9314492852738758, 0.11564625850340136, 0.8721804511278195, 25.75]
[2423.8773329190794, 0.8759079531570052, 0.20353982300884957, 0.7964601769911505, 23.083333333333332]
[2125.342000582769, 0.8306157810083096, 0.23270440251572327, 0.7672955974842768, 26.6875]



---------------------------------------------------------------------------------
> SPRINT LENGTH is considered as 30 days as given in the "ScrumBut" paper

> Time estimates are randomly assigned in the range(0,30) and are changed randomly based on team dynamism and culture.

> Velocity represents average time of completion for each sprint.

______________________________________________________________

Currently analyzing JMOO_V0 and hooking POM4 to JMOO. ETA: 2-3 days

Monday, January 20, 2014

POM4

Scrum'med POM3? Or Generic POM based model with more agile support?

Requirements

*1. Input and output remains same as POM3. More outputs--velocity/burndown charts?Or Need any changes?
*2. Instead of pom3_requirements--Add user stories. Each user story has..
   -Number of teams.
   -Estimate size.(s)
   -Priority.
   -Cost.
   -Value.
   =Generate them at random and (min<Sum(s)<max)--min,max predefined
   ?Heap or not?
   ?Implementing changes on the go?
3. Teams in pom3 remains the same. If any, Make Changes in pom3_teams according to (2)
*4. Maintain product backlog at all times.
    -Divide user stories into sprints and assign sprint to each team.
    -If team completes one sprint, assign one more. loop it.
    -Manage release backlog? Set of sprints at random as "release backlog".
    -End of each sprint update release backlog and calculate velocity.
5. Have to figure a way to score? Use pareto frontier as base as in POM3? Any other idea?