samoa-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <>
Subject [jira] [Commented] (SAMOA-68) Saving true and predicted labels to file
Date Mon, 22 May 2017 15:17:04 GMT


ASF GitHub Bot commented on SAMOA-68:

GitHub user mgrzenda opened a pull request:

    SAMOA-68:  Saving true and predicted labels to file

    This pull request refers to new code saving predicted and true values for classification
and regression tasks. In addition, votes are saved for classification tasks. This can be easily
extended at the level of individual evaluators.

You can merge this pull request into a Git repository by running:

    $ git pull predictions-file

Alternatively you can review and apply these changes as the patch at:

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

    This closes #61
commit 830ec5f282c7bdde03c902e9a9a68679266bec83
Author: Maciej Grzenda <>
Date:   2017-05-17T11:51:56Z

    Draft label dump code

commit b936c2b0b673903409a6a05cec07263eefeb2b5e
Author: Jerzy Jegier <>
Date:   2017-05-17T13:52:47Z

    Label dump with tests

commit 95adef29fbbd0afa2fe6ff8c452a7cee7fddbf47
Author: Jerzy Jegier <>
Date:   2017-05-22T13:20:13Z

    Migrating code to evaluators

commit d51b5abed8c620b351f00f216e3ac19688b2b57c
Author: Jerzy Jegier <>
Date:   2017-05-22T15:00:26Z

    Comments added


> Saving true and predicted labels to file
> ----------------------------------------
>                 Key: SAMOA-68
>                 URL:
>             Project: SAMOA
>          Issue Type: New Feature
>          Components: SAMOA-API
>            Reporter: Maciej Grzenda
>              Labels: features
> Currently PrequentialEvaluation task supports dumpFile option.  With this option model
performance can be saved to a file. However, in some cases it would be good to save also individual
predictions made by a model.  This is useful for model debugging and method development.
> This could be also used to visualize model output, calculate custom performance indicators
(e.g. model accuracy for instances of a certain class or sharing the same feature value).
 Such saving of model output (if done) should be made for every instance. Hence, a new option
making it possible to dump predictions to a separate file seems justified.  For classification,
it should include votes made for individual classes, if available.

This message was sent by Atlassian JIRA

View raw message