nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Sebastian Nagel (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (NUTCH-2676) Update to the latest selenium and add code to use chrome and firefox headless mode with the remote web driver
Date Mon, 19 Nov 2018 15:18:01 GMT

    [ https://issues.apache.org/jira/browse/NUTCH-2676?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16691835#comment-16691835
] 

Sebastian Nagel commented on NUTCH-2676:
----------------------------------------

Hi [~virt], thanks for the detailed description how the Docker image is built. Now I understand
why our nightly builds still fail sometimes with the "javax.ws.rs-api.packaging.type" error,
see NUTCH-2669. The work-around works only when the local ivy cache already contains the javax.ws-rs
jars. When building the Docker image or working in a container the cache is not persisted
and can not contain the dependencies. As a "work-around to the work-around" you could call
the build twice if it fails the first time:
{noformat}
RUN ant runtime || ant runtime
{noformat}


> Update to the latest selenium and add code to use chrome and firefox headless mode with
the remote web driver
> -------------------------------------------------------------------------------------------------------------
>
>                 Key: NUTCH-2676
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2676
>             Project: Nutch
>          Issue Type: New Feature
>          Components: protocol
>    Affects Versions: 1.15
>            Reporter: Stas Batururimi
>            Priority: Major
>             Fix For: 1.16
>
>         Attachments: Screenshot 2018-11-16 at 18.15.52.png
>
>
> * Selenium needs to be updated
>  * missing remote web driver for chrome 
>  * necessity to add headless mode for both remote WebDriverBase Firefox & Chrome
>  * use case with Selenium grid using docker (1 hub docker container, several nodes in
different docker containers, Nutch in another docker container, streaming to Apache Solr in
docker container, that is at least 4 different docker containers)



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message