nutch-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Jorge Luis Betancourt Gonzalez (JIRA)" <j...@apache.org>
Subject [jira] [Updated] (NUTCH-2353) Create seed file with metadata using the REST API
Date Wed, 18 Jan 2017 21:20:26 GMT

     [ https://issues.apache.org/jira/browse/NUTCH-2353?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Jorge Luis Betancourt Gonzalez updated NUTCH-2353:
--------------------------------------------------
    Description: 
At the moment its not possible to create a seed file and specify any metadata when using the
REST API. The file gets created but there is no option to add any metadata to the seed URLs.

If we use a payload like this:

{code}
{
    "name":"name-of-seedlist", 
    "seedUrls":[
        {
            "url" : "http://example.com",
            "metadata" : {
                "key1" : "value1",
                "key2" : "value2",
                "key3" : "value3"
            }
        }
    ]
}
{code}

It should be easy to specify the desired metadata. Also this should keep BC with the previous
array syntax if we only want to specify the list of URLs without any metadata at all.

  was:
At the moment its not possible to create a seed file and specify any metadata when using the
REST API. The file gets created but there is no option to add any metadata to the seed URLs.

If we use a payload like this:

{code}
{
    "name":"name-of-seedlist", 
    "seedUrls":[
        {
            "url" : "http://example.com",
            "metadata" : {
                "key1" : "value1",
                "key2" : "value2",
                "key3" : "value3"
            }
        }
    ]
}
{code}

It should be easy to specify the desired metadata.


> Create seed file with metadata using the REST API
> -------------------------------------------------
>
>                 Key: NUTCH-2353
>                 URL: https://issues.apache.org/jira/browse/NUTCH-2353
>             Project: Nutch
>          Issue Type: Improvement
>          Components: injector, REST_api
>    Affects Versions: 1.12
>            Reporter: Jorge Luis Betancourt Gonzalez
>            Assignee: Jorge Luis Betancourt Gonzalez
>            Priority: Minor
>              Labels: rest_api
>             Fix For: 1.13
>
>
> At the moment its not possible to create a seed file and specify any metadata when using
the REST API. The file gets created but there is no option to add any metadata to the seed
URLs.
> If we use a payload like this:
> {code}
> {
>     "name":"name-of-seedlist", 
>     "seedUrls":[
>         {
>             "url" : "http://example.com",
>             "metadata" : {
>                 "key1" : "value1",
>                 "key2" : "value2",
>                 "key3" : "value3"
>             }
>         }
>     ]
> }
> {code}
> It should be easy to specify the desired metadata. Also this should keep BC with the
previous array syntax if we only want to specify the list of URLs without any metadata at
all.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Mime
View raw message