tika-dev mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Chris A. Mattmann (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (TIKA-1577) NetCDF Data Extraction
Date Sat, 28 Mar 2015 16:51:53 GMT

    [ https://issues.apache.org/jira/browse/TIKA-1577?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=14385408#comment-14385408

Chris A. Mattmann commented on TIKA-1577:

Agreed, if we can reuse this, then great. The one catch is that I'm not sure that dump capability
generates a table or something in an XHTML representation which is our basis representation
in Tika. I would like us to consider the output of this issue to be:

- TikaParser generates XHTML tabular and other elements that represent the data in the NetCDF
- we create like a ScientificContentHandler that can then take that output from the parser
(in the data section) and then format it e.g., like NCDump. 

Sound good?

> NetCDF Data Extraction
> ----------------------
>                 Key: TIKA-1577
>                 URL: https://issues.apache.org/jira/browse/TIKA-1577
>             Project: Tika
>          Issue Type: Improvement
>          Components: handler, parser
>    Affects Versions: 1.7
>            Reporter: Ann Burgess
>            Assignee: Ann Burgess
>              Labels: features, handler
>             Fix For: 1.8
>   Original Estimate: 504h
>  Remaining Estimate: 504h
> A netCDF classic or 64-bit offset dataset is stored as a single file comprising two parts:
>  - a header, containing all the information about dimensions, attributes, and variables
except for the variable data;
>  - a data part, comprising fixed-size data, containing the data for variables that don't
have an unlimited dimension; and variable-size data, containing the data for variables that
have an unlimited dimension.
> The NetCDFparser currently extracts the "header part".  
>  -- text extracts file Dimensions and Variables
>  -- metadata extracts Global Attributes
> We want the option to extract the "data part" of NetCDF files.  
> Lets use the NetCDF test file for our dev testing:  tika/tika-parsers/src/test/resources/test-documents/sresa1b_ncar_ccsm3_0_run1_200001.nc

This message was sent by Atlassian JIRA

View raw message