hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-12369) Native Vector GroupBy (Part 1)
Date Sun, 22 Apr 2018 19:54:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-12369?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16447345#comment-16447345
] 

Hive QA commented on HIVE-12369:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12920198/HIVE-12369.099.patch

{color:red}ERROR:{color} -1 due to build exiting with an error

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/10414/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/10414/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-10414/

Messages:
{noformat}
**** This message was trimmed, see log for full details ****
error: src/test/results/clientpositive/llap/vector_binary_join_groupby.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vector_cast_constant.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vector_char_2.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_coalesce_2.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_complex_all.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_count_distinct.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vector_data_types.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_decimal_aggregate.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vector_decimal_precision.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vector_decimal_udf.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_distinct_2.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_groupby_3.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_groupby_cube1.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vector_groupby_grouping_id1.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vector_groupby_grouping_id2.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vector_groupby_grouping_id3.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vector_groupby_grouping_sets1.q.out: does not
exist in index
error: src/test/results/clientpositive/llap/vector_groupby_grouping_sets2.q.out: does not
exist in index
error: src/test/results/clientpositive/llap/vector_groupby_grouping_sets3_dec.q.out: does
not exist in index
error: src/test/results/clientpositive/llap/vector_groupby_grouping_sets4.q.out: does not
exist in index
error: src/test/results/clientpositive/llap/vector_groupby_grouping_sets5.q.out: does not
exist in index
error: src/test/results/clientpositive/llap/vector_groupby_grouping_sets6.q.out: does not
exist in index
error: src/test/results/clientpositive/llap/vector_groupby_grouping_sets_grouping.q.out: does
not exist in index
error: src/test/results/clientpositive/llap/vector_groupby_grouping_sets_limit.q.out: does
not exist in index
error: src/test/results/clientpositive/llap/vector_groupby_grouping_window.q.out: does not
exist in index
error: src/test/results/clientpositive/llap/vector_groupby_mapjoin.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vector_groupby_reduce.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vector_groupby_rollup1.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vector_groupby_sort_11.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vector_groupby_sort_8.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vector_grouping_sets.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vector_inner_join.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_join30.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_left_outer_join.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vector_leftsemi_mapjoin.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vector_mapjoin_reduce.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vector_number_compare_projection.q.out: does not
exist in index
error: src/test/results/clientpositive/llap/vector_orc_nested_column_pruning.q.out: does not
exist in index
error: src/test/results/clientpositive/llap/vector_orderby_5.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_outer_join1.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_outer_join2.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_outer_reference_windowed.q.out: does not
exist in index
error: src/test/results/clientpositive/llap/vector_partition_diff_num_cols.q.out: does not
exist in index
error: src/test/results/clientpositive/llap/vector_partitioned_date_time.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vector_ptf_1.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_reduce_groupby_decimal.q.out: does not
exist in index
error: src/test/results/clientpositive/llap/vector_reduce_groupby_duplicate_cols.q.out: does
not exist in index
error: src/test/results/clientpositive/llap/vector_reuse_scratchcols.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vector_string_concat.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vector_udf1.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_when_case_null.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vector_windowing.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vector_windowing_gby2.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vectorization_0.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorization_1.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorization_12.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorization_13.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorization_14.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorization_15.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorization_16.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorization_2.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorization_3.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorization_4.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorization_5.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorization_9.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorization_limit.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorization_nested_udf.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vectorization_part_project.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vectorization_short_regress.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vectorized_case.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorized_date_funcs.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vectorized_distinct_gby.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vectorized_dynamic_partition_pruning.q.out: does
not exist in index
error: src/test/results/clientpositive/llap/vectorized_dynamic_semijoin_reduction.q.out: does
not exist in index
error: src/test/results/clientpositive/llap/vectorized_mapjoin.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorized_mapjoin3.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorized_parquet_types.q.out: does not exist
in index
error: src/test/results/clientpositive/llap/vectorized_ptf.q.out: does not exist in index
error: src/test/results/clientpositive/llap/vectorized_timestamp.q.out: does not exist in
index
error: src/test/results/clientpositive/llap/vectorized_timestamp_funcs.q.out: does not exist
in index
error: src/test/results/clientpositive/orc_struct_type_vectorization.q.out: does not exist
in index
error: src/test/results/clientpositive/parquet_complex_types_vectorization.q.out: does not
exist in index
error: src/test/results/clientpositive/parquet_map_type_vectorization.q.out: does not exist
in index
error: src/test/results/clientpositive/parquet_struct_type_vectorization.q.out: does not exist
in index
error: src/test/results/clientpositive/parquet_vectorization_0.q.out: does not exist in index
error: src/test/results/clientpositive/parquet_vectorization_1.q.out: does not exist in index
error: src/test/results/clientpositive/parquet_vectorization_12.q.out: does not exist in index
error: src/test/results/clientpositive/parquet_vectorization_13.q.out: does not exist in index
error: src/test/results/clientpositive/parquet_vectorization_14.q.out: does not exist in index
error: src/test/results/clientpositive/parquet_vectorization_15.q.out: does not exist in index
error: src/test/results/clientpositive/parquet_vectorization_16.q.out: does not exist in index
error: src/test/results/clientpositive/parquet_vectorization_2.q.out: does not exist in index
error: src/test/results/clientpositive/parquet_vectorization_3.q.out: does not exist in index
error: src/test/results/clientpositive/parquet_vectorization_4.q.out: does not exist in index
error: src/test/results/clientpositive/parquet_vectorization_5.q.out: does not exist in index
error: src/test/results/clientpositive/parquet_vectorization_9.q.out: does not exist in index
error: src/test/results/clientpositive/parquet_vectorization_limit.q.out: does not exist in
index
error: src/test/results/clientpositive/spark/parquet_vectorization_0.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/parquet_vectorization_1.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/parquet_vectorization_12.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/parquet_vectorization_13.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/parquet_vectorization_14.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/parquet_vectorization_15.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/parquet_vectorization_16.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/parquet_vectorization_2.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/parquet_vectorization_3.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/parquet_vectorization_4.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/parquet_vectorization_5.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/parquet_vectorization_9.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/parquet_vectorization_limit.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/spark_vectorized_dynamic_partition_pruning.q.out:
does not exist in index
error: src/test/results/clientpositive/spark/vector_between_in.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_cast_constant.q.out: does not exist in
index
error: src/test/results/clientpositive/spark/vector_count_distinct.q.out: does not exist in
index
error: src/test/results/clientpositive/spark/vector_data_types.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_decimal_aggregate.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/vector_distinct_2.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_groupby_3.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_inner_join.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_left_outer_join.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/vector_mapjoin_reduce.q.out: does not exist in
index
error: src/test/results/clientpositive/spark/vector_orderby_5.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_outer_join0.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_outer_join1.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_outer_join2.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_outer_join3.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_outer_join4.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_outer_join5.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vector_string_concat.q.out: does not exist in
index
error: src/test/results/clientpositive/spark/vectorization_0.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorization_1.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorization_12.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorization_13.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorization_14.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorization_15.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorization_16.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorization_2.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorization_3.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorization_4.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorization_5.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorization_9.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorization_nested_udf.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/vectorization_parquet_projection.q.out: does
not exist in index
error: src/test/results/clientpositive/spark/vectorization_short_regress.q.out: does not exist
in index
error: src/test/results/clientpositive/spark/vectorized_case.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorized_mapjoin.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorized_ptf.q.out: does not exist in index
error: src/test/results/clientpositive/spark/vectorized_timestamp_funcs.q.out: does not exist
in index
error: src/test/results/clientpositive/vector_aggregate_9.q.out: does not exist in index
error: src/test/results/clientpositive/vector_aggregate_without_gby.q.out: does not exist
in index
error: src/test/results/clientpositive/vector_binary_join_groupby.q.out: does not exist in
index
error: src/test/results/clientpositive/vector_cast_constant.q.out: does not exist in index
error: src/test/results/clientpositive/vector_char_2.q.out: does not exist in index
error: src/test/results/clientpositive/vector_coalesce_2.q.out: does not exist in index
error: src/test/results/clientpositive/vector_data_types.q.out: does not exist in index
error: src/test/results/clientpositive/vector_decimal_aggregate.q.out: does not exist in index
error: src/test/results/clientpositive/vector_decimal_precision.q.out: does not exist in index
error: src/test/results/clientpositive/vector_distinct_2.q.out: does not exist in index
error: src/test/results/clientpositive/vector_empty_where.q.out: does not exist in index
error: src/test/results/clientpositive/vector_groupby_3.q.out: does not exist in index
error: src/test/results/clientpositive/vector_groupby_mapjoin.q.out: does not exist in index
error: src/test/results/clientpositive/vector_groupby_reduce.q.out: does not exist in index
error: src/test/results/clientpositive/vector_grouping_sets.q.out: does not exist in index
error: src/test/results/clientpositive/vector_include_no_sel.q.out: does not exist in index
error: src/test/results/clientpositive/vector_orderby_5.q.out: does not exist in index
error: src/test/results/clientpositive/vector_outer_join1.q.out: does not exist in index
error: src/test/results/clientpositive/vector_outer_join2.q.out: does not exist in index
error: src/test/results/clientpositive/vector_outer_join3.q.out: does not exist in index
error: src/test/results/clientpositive/vector_outer_join4.q.out: does not exist in index
error: src/test/results/clientpositive/vector_outer_join_no_keys.q.out: does not exist in
index
error: src/test/results/clientpositive/vector_reduce_groupby_decimal.q.out: does not exist
in index
error: src/test/results/clientpositive/vector_reduce_groupby_duplicate_cols.q.out: does not
exist in index
error: src/test/results/clientpositive/vector_string_concat.q.out: does not exist in index
error: src/test/results/clientpositive/vector_when_case_null.q.out: does not exist in index
error: src/test/results/clientpositive/vectorization_1.q.out: does not exist in index
error: src/test/results/clientpositive/vectorization_12.q.out: does not exist in index
error: src/test/results/clientpositive/vectorization_13.q.out: does not exist in index
error: src/test/results/clientpositive/vectorization_14.q.out: does not exist in index
error: src/test/results/clientpositive/vectorization_15.q.out: does not exist in index
error: src/test/results/clientpositive/vectorization_16.q.out: does not exist in index
error: src/test/results/clientpositive/vectorization_2.q.out: does not exist in index
error: src/test/results/clientpositive/vectorization_3.q.out: does not exist in index
error: src/test/results/clientpositive/vectorization_4.q.out: does not exist in index
error: src/test/results/clientpositive/vectorization_5.q.out: does not exist in index
error: src/test/results/clientpositive/vectorization_9.q.out: does not exist in index
error: src/test/results/clientpositive/vectorization_limit.q.out: does not exist in index
error: src/test/results/clientpositive/vectorization_nested_udf.q.out: does not exist in index
error: src/test/results/clientpositive/vectorized_case.q.out: does not exist in index
error: src/test/results/clientpositive/vectorized_date_funcs.q.out: does not exist in index
error: src/test/results/clientpositive/vectorized_mapjoin.q.out: does not exist in index
error: src/test/results/clientpositive/vectorized_mapjoin2.q.out: does not exist in index
error: src/test/results/clientpositive/vectorized_mapjoin3.q.out: does not exist in index
error: src/test/results/clientpositive/vectorized_parquet_types.q.out: does not exist in index
error: src/test/results/clientpositive/vectorized_timestamp.q.out: does not exist in index
error: src/test/results/clientpositive/vectorized_timestamp_funcs.q.out: does not exist in
index
error: src/org/apache/hadoop/hive/tools/GenVectorCode.java: does not exist in index
fatal: git diff header lacks filename information when removing 2 leading pathname components
(line 641)
The patch does not appear to apply with p0, p1, or p2
+ exit 1
'
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12920198 - PreCommit-HIVE-Build

> Native Vector GroupBy (Part 1)
> ------------------------------
>
>                 Key: HIVE-12369
>                 URL: https://issues.apache.org/jira/browse/HIVE-12369
>             Project: Hive
>          Issue Type: Bug
>          Components: Hive
>            Reporter: Matt McCline
>            Assignee: Matt McCline
>            Priority: Critical
>         Attachments: HIVE-12369.01.patch, HIVE-12369.02.patch, HIVE-12369.05.patch, HIVE-12369.06.patch,
HIVE-12369.091.patch, HIVE-12369.094.patch, HIVE-12369.095.patch, HIVE-12369.096.patch, HIVE-12369.097.patch,
HIVE-12369.098.patch, HIVE-12369.099.patch
>
>
> Implement Native Vector GroupBy using fast hash table technology developed for Native
Vector MapJoin, etc.
> Patch is currently limited to a single COUNT aggregation.  Or, no aggregation also known
as duplicate reduction.
> Here are examples of new kinds of classes introduces that stored the count in the slot
table and don't allocate hash elements:
> {noformat}
>   COUNT(column)  VectorGroupByHashLongKeySingleCountColumnOperator      
>   COUNT(key)     VectorGroupByHashLongKeySingleCountKeyOperator            
>   COUNT(*)       VectorGroupByHashLongKeySingleCountStarOperator           
> {noformat}
> And the duplicate reduction operator a single key.  Example:
> {noformat}
>   VectorGroupByHashLongKeyDuplicateReductionOperator
> {noformat}



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

Mime
View raw message