Tuesday, March 15, 2011
Tuesday, March 8, 2011
Some terminology
Something that caused me a lot of time to correct..
When speaking of ABE, instance selection and instance retrieval correspond to entirely different things. Instance selection = filtering, whereas retrieval = analogy selection. Corrected ESEM paper is here.
When speaking of ABE, instance selection and instance retrieval correspond to entirely different things. Instance selection = filtering, whereas retrieval = analogy selection. Corrected ESEM paper is here.
If only I had perfect experts!
Here is a short report about the results of active learning experiments in effort estimation.
For full plots, refer here.
The moral of the story is:
1) When using 1NN as estimation method, (more or less) half of the instances are not closest neighbor to any other instances.
2) When project instances are labeled by an expert based on their popularity, MdMRE values very easily drop below regular 1NN (with LOO).
3) ASSUMPTION/CHEAT is that the expert perfectly predicts the project effort, which is (probably) never the case.
For full plots, refer here.
The moral of the story is:
1) When using 1NN as estimation method, (more or less) half of the instances are not closest neighbor to any other instances.
2) When project instances are labeled by an expert based on their popularity, MdMRE values very easily drop below regular 1NN (with LOO).
3) ASSUMPTION/CHEAT is that the expert perfectly predicts the project effort, which is (probably) never the case.
Monday, March 7, 2011
Even More on Business Intelligence
New runtime chart can be found at this location:
---
Empirical (not fitted) Weibull CDF of the effort distribution w/ you are here in red:
-----
Takes on the 3 shot cycle:
Subscribe to:
Posts (Atom)