- For our current rig, we have a new optimizer that does interesting things for 2-d goals.
- If we added more dimensions to the goals, then we'd may some really interesting results.
- We need those distributions for size, effort, defects, have we done this before. That would blow us out to 6-d.
- We need to baseline this against something else. GAs? DEs?
Rapid recursive spectral learning (RRSL):
- A spectral learner learns important parameters by reflecting over training data’s eigenvectors.
- If applied recursively, this approach generates a tree of clusters where each split is defined in terms of the principle component of the data at that level of the tree .
- Traditional recursive spectral learners are slow since the matrix calculations of PCA take polynomial time. Our rapid RRSL algorithm splits data on parameters found by a very fast Nyström approximation .
- Any any level in the recursion, RRSL finds two distant points then divides the data on the median position between them. RRSL checks if one these two points dominates the other. If so, then it prunes the dominated half of the data.
- For each leaf cluster generated after domination pruning, RRSL sorts attribute ranges according to how much more frequently they occur in the leaf cluster (compared to the rest of the data). RRSL then generates contrast rules from the first i-th items in that sort. The rules are then applied to data not used in training.
Recursive spectral learningHere's RRSL working of a 2-d objective space from feature maps (the goal is most features with fewest violations). In the following:
- the thickest black line is the first found dimension
- each thinner line represents a binary split of some thicker line.
Domination pruningAfter applying domination pruning, we only get the following eight classes:
Range sortingWhen RRSL took one of the above clusters and sorted attribute ranges (bu how more often it appears in that cluster vs anything else), we get the following (this list is sorted most important at the top to least important at the bottom).
(Aside: Curiously most of the advise is about what not to do.)(_ID_192 0)
Contrast set rule testingIf we build rules using the first "x" items in the above list, then generate 10,000 more projects (rejecting any that contradict the rules), we get the following effects.
- After the first 16 items shown above, further changes become mostly noise.
- In terms of max features with least violations, 6 changes look most interesting.
 John C. Platt, FastMap, MetricMap, and Landmark MDS are all Nyström Algorithms, Proceedings 10th In. Workshop on Artificial Intelligence and Statistics, 2005..