beam-commits mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "ASF GitHub Bot (JIRA)" <j...@apache.org>
Subject [jira] [Work logged] (BEAM-3217) Add a performance test for HadoopInputFormatIO
Date Sat, 10 Mar 2018 12:10:00 GMT

     [ https://issues.apache.org/jira/browse/BEAM-3217?focusedWorklogId=79207&page=com.atlassian.jira.plugin.system.issuetabpanels:worklog-tabpanel#worklog-79207
]

ASF GitHub Bot logged work on BEAM-3217:
----------------------------------------

                Author: ASF GitHub Bot
            Created on: 10/Mar/18 12:09
            Start Date: 10/Mar/18 12:09
    Worklog Time Spent: 10m 
      Work Description: lgajowy commented on issue #4758: [BEAM-3217] Jenkins job for HadoopInputFormatIOIT
URL: https://github.com/apache/beam/pull/4758#issuecomment-372025071
 
 
   Retest this please

----------------------------------------------------------------
This is an automated message from the Apache Git Service.
To respond to the message, please log on GitHub and use the
URL above to go to the specific comment.
 
For queries about this service, please contact Infrastructure at:
users@infra.apache.org


Issue Time Tracking
-------------------

    Worklog Id:     (was: 79207)
    Time Spent: 5h 50m  (was: 5h 40m)

> Add a performance test for HadoopInputFormatIO
> ----------------------------------------------
>
>                 Key: BEAM-3217
>                 URL: https://issues.apache.org/jira/browse/BEAM-3217
>             Project: Beam
>          Issue Type: Test
>          Components: io-java-hadoop
>            Reporter: Chamikara Jayalath
>            Assignee: Ɓukasz Gajowy
>            Priority: Major
>          Time Spent: 5h 50m
>  Remaining Estimate: 0h
>
> We should add a large scale performance test for HadoopInputFormatIO. We should use PerfKitBenchmarker
based performance testing framework [1] to manage Kubernetes based muti-node data store and
to publish benchmark results.
> Example input format implementation to use: DBInputFormat to connect to a Postgres instance.
> https://github.com/hanborq/hadoop/blob/master/src/mapred/org/apache/hadoop/mapreduce/lib/db/DBInputFormat.java
>  
> Example docker image to use: https://hub.docker.com/_/postgres/
> [1] https://beam.apache.org/documentation/io/testing/



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message