samoa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Gianmarco De Francisci Morales (JIRA)" <j...@apache.org>
Subject [jira] [Created] (SAMOA-48) Multiple copies of evaluation statistics printed in ensemble methods
Date Mon, 26 Oct 2015 09:05:27 GMT
Gianmarco De Francisci Morales created SAMOA-48:
---------------------------------------------------

             Summary: Multiple copies of evaluation statistics printed in ensemble methods
                 Key: SAMOA-48
                 URL: https://issues.apache.org/jira/browse/SAMOA-48
             Project: SAMOA
          Issue Type: Bug
          Components: SAMOA-API
            Reporter: Gianmarco De Francisci Morales


When running an ensemble method the evaluation statistics are reported multiple times. Probably,
once per classifier in the ensemble.
We should de-duplicate the output and print the statistics only once.

To reproduce:
{code}
./bin/samoa local target/SAMOA-Local-0.4.0-incubating-SNAPSHOT.jar "PrequentialEvaluation
-l (classifiers.ensemble.Bagging) -s (ArffFileStream -f ../covtypeNorm.arff)"
{code}

{code}
...
2015-10-26 10:50:45,719 [main] INFO  org.apache.samoa.evaluation.EvaluatorProcessor (EvaluatorProcessor.java:191)
- total evaluation time: 12 seconds for 580000 instances
2015-10-26 10:50:45,719 [main] INFO  org.apache.samoa.evaluation.EvaluatorProcessor (EvaluatorProcessor.java:183)
- last event is received!
2015-10-26 10:50:45,719 [main] INFO  org.apache.samoa.evaluation.EvaluatorProcessor (EvaluatorProcessor.java:184)
- total count: 580000
2015-10-26 10:50:45,719 [main] INFO  org.apache.samoa.evaluation.EvaluatorProcessor (EvaluatorProcessor.java:187)
- org.apache.samoa.evaluation.EvaluatorProcessorid = 0
evaluation instances,classified instances,classifications correct (percent),Kappa Statistic
(percent),Kappa Temporal Statistic (percent)
100000.0,122089.0,68.69005397701676,22.105931593255672,-207.85213819763229
200000.0,244303.0,70.60330818696455,28.288283767693795,-301.3692505449057
300000.0,366827.0,69.57802997053106,43.57425440093415,-345.368559683921
400000.0,488954.0,65.99680133509491,39.744010597463216,-423.47218286577856
500000.0,611016.0,65.4212000995064,40.65657964083249,-463.8095746384162

2015-10-26 10:50:45,719 [main] INFO  org.apache.samoa.evaluation.EvaluatorProcessor (EvaluatorProcessor.java:191)
- total evaluation time: 12 seconds for 580000 instances
2015-10-26 10:50:45,719 [main] INFO  org.apache.samoa.evaluation.EvaluatorProcessor (EvaluatorProcessor.java:183)
- last event is received!
2015-10-26 10:50:45,720 [main] INFO  org.apache.samoa.evaluation.EvaluatorProcessor (EvaluatorProcessor.java:184)
- total count: 580000
2015-10-26 10:50:45,720 [main] INFO  org.apache.samoa.evaluation.EvaluatorProcessor (EvaluatorProcessor.java:187)
- org.apache.samoa.evaluation.EvaluatorProcessorid = 0
evaluation instances,classified instances,classifications correct (percent),Kappa Statistic
(percent),Kappa Temporal Statistic (percent)
100000.0,122089.0,68.69005397701676,22.105931593255672,-207.85213819763229
200000.0,244303.0,70.60330818696455,28.288283767693795,-301.3692505449057
300000.0,366827.0,69.57802997053106,43.57425440093415,-345.368559683921
400000.0,488954.0,65.99680133509491,39.744010597463216,-423.47218286577856
500000.0,611016.0,65.4212000995064,40.65657964083249,-463.8095746384162

2015-10-26 10:50:45,720 [main] INFO  org.apache.samoa.evaluation.EvaluatorProcessor (EvaluatorProcessor.java:191)
- total evaluation time: 12 seconds for 580000 instances
2015-10-26 10:50:45,720 [main] INFO  org.apache.samoa.evaluation.EvaluatorProcessor (EvaluatorProcessor.java:183)
- last event is received!
2015-10-26 10:50:45,720 [main] INFO  org.apache.samoa.evaluation.EvaluatorProcessor (EvaluatorProcessor.java:184)
- total count: 580000
2015-10-26 10:50:45,720 [main] INFO  org.apache.samoa.evaluation.EvaluatorProcessor (EvaluatorProcessor.java:187)
- org.apache.samoa.evaluation.EvaluatorProcessorid = 0
evaluation instances,classified instances,classifications correct (percent),Kappa Statistic
(percent),Kappa Temporal Statistic (percent)
100000.0,122089.0,68.69005397701676,22.105931593255672,-207.85213819763229
200000.0,244303.0,70.60330818696455,28.288283767693795,-301.3692505449057
300000.0,366827.0,69.57802997053106,43.57425440093415,-345.368559683921
400000.0,488954.0,65.99680133509491,39.744010597463216,-423.47218286577856
500000.0,611016.0,65.4212000995064,40.65657964083249,-463.8095746384162
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message