samoa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (SAMOA-68) Saving true and predicted labels to file
Date Wed, 07 Jun 2017 13:36:18 GMT

    [ https://issues.apache.org/jira/browse/SAMOA-68?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16040888#comment-16040888
] 

ASF GitHub Bot commented on SAMOA-68:
-------------------------------------

Github user mgrzenda commented on the issue:

    https://github.com/apache/incubator-samoa/pull/61
  
    The code is extended now to handle new switch "-h". This makes it possible to declare
how frequently lines in labels file should be created. If set to e.g. 10 this option will
make the label file contain true and predicted labels (+ votes for classification tasks) for
every 10th instance in the stream. Please let us know if there is anything else to add.


> Saving true and predicted labels to file
> ----------------------------------------
>
>                 Key: SAMOA-68
>                 URL: https://issues.apache.org/jira/browse/SAMOA-68
>             Project: SAMOA
>          Issue Type: New Feature
>          Components: SAMOA-API
>            Reporter: Maciej Grzenda
>              Labels: features
>
> Currently PrequentialEvaluation task supports dumpFile option.  With this option model
performance can be saved to a file. However, in some cases it would be good to save also individual
predictions made by a model.  This is useful for model debugging and method development.
> This could be also used to visualize model output, calculate custom performance indicators
(e.g. model accuracy for instances of a certain class or sharing the same feature value).
 Such saving of model output (if done) should be made for every instance. Hence, a new option
making it possible to dump predictions to a separate file seems justified.  For classification,
it should include votes made for individual classes, if available.



--
This message was sent by Atlassian JIRA
(v6.3.15#6346)

Mime
View raw message