hive-issues mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "Hive QA (JIRA)" <j...@apache.org>
Subject [jira] [Commented] (HIVE-18269) LLAP: Fast llap io with slow processing pipeline can lead to OOM
Date Thu, 14 Dec 2017 02:45:00 GMT

    [ https://issues.apache.org/jira/browse/HIVE-18269?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16290247#comment-16290247
] 

Hive QA commented on HIVE-18269:
--------------------------------



Here are the results of testing the latest attachment:
https://issues.apache.org/jira/secure/attachment/12901931/HIVE-18269.1.patch

{color:red}ERROR:{color} -1 due to no test(s) being added or modified.

{color:red}ERROR:{color} -1 due to 39 failed/errored test(s), 10764 tests executed
*Failed tests:*
{noformat}
TestCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=39)
	[unionall_join_nullconstant.q,tez_join.q,cbo_rp_windowing.q,orc_merge11.q,udf_float.q,udf_sentences.q,bucketmapjoin13.q,udf_split.q,load_dyn_part9.q,auto_join16.q,vector_reduce2.q,tez_joins_explain.q,udf_replace.q,create_or_replace_view.q,alter_partition_clusterby_sortby.q,exchange_partition2.q,vector_aggregate_9.q,udf_greaterthan.q,exim_15_external_part.q,delete_orig_table.q,index_auto_unused.q,groupby_position.q,llap_acid_fast.q,acid_subquery.q,nullformatCTAS.q,decimal_join2.q,join21.q,cbo_rp_groupby3_noskew_multi_distinct.q,transform1.q,delete_where_partitioned.q]
TestCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=58)
	[load_dyn_part2.q,llap_uncompressed.q,smb_mapjoin_7.q,mapjoin46.q,temp_table_external.q,ctas_colname.q,index_auto_empty.q,index_in_db.q,subquery_in_having.q,vectorized_string_funcs.q,vectorization_1.q,stats_ppr_all.q,join0.q,timestamptz_1.q,decimal_6.q,udf_sign.q,alter_file_format.q,vector_udf1.q,select_unquote_not.q,join14_hadoop20.q,constprog_when_case.q,druid_timeseries.q,avro_change_schema.q,create_udaf.q,array_size_estimation.q,merge3.q,lateral_view_onview.q,groupby4_map_skew.q,ppd_constant_expr.q,drop_table_with_stats.q]
TestCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=74)
	[auto_join24.q,parquet_schema_evolution.q,udf_to_string.q,vectorized_distinct_gby.q,mapreduce8.q,constantfolding.q,groupby8.q,serde_opencsv.q,druidmini_test1.q,tez_vector_dynpart_hashjoin_1.q,groupby_multi_insert_common_distinct.q,join6.q,expr_cached.q,script_pipe.q,udf_bitwise_or.q,multiMapJoin2.q,filter_join_breaktask.q,udf_regexp.q,udf_xpath_long.q,ppd_multi_insert.q,alter_merge_2_orc.q,join_thrift.q,pointlookup4.q,union4.q,load_fs2.q,llap_text.q,input42.q,udf_mask.q,dynamic_semijoin_reduction_3.q,stats_aggregator_error_1.q]
TestCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=8)
	[dp_counter_mm.q,llap_reader.q,columnstats_tbllvl.q,insert_into_with_schema.q,groupby_map_ppr.q,input_part1.q,convert_enum_to_string.q,union14.q,subquery_unqual_corr_expr.q,annotate_stats_filter.q,sort_merge_join_desc_8.q,udf_format_number.q,dynamic_semijoin_reduction_sw.q,alter_change_db_location.q,udf_minute.q,groupby_sort_test_1.q,authorization_update.q,authorization_cli_createtab_noauthzapi.q,tez_insert_overwrite_local_directory_1.q,testSetQueryString.q,parquet_ppd_partition.q,nested_complex.q,alter_table_serde.q,drop_view.q,exim_09_part_spec_nonoverlap.q,delimiter.q,udaf_collect_set.q,authorization_view_4.q,groupby_sort_skew_1_23.q,skewjoinopt12.q]
TestCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=80)
	[groupby6_map.q,tez_union_group_by.q,llap_acid.q,groupby_nullvalues.q,join15.q,msck_repair_0.q,msck_repair_1.q,udf_round_2.q,setop_no_distinct.q,authorization_reset.q,vectorization_decimal_date.q,windowing_columnPruning.q,create_nested_type.q,stats13.q,stats_publisher_error_1.q,groupby_sort_3.q,partInit.q,auto_join13.q,partition_decode_name.q,date_1.q,join_acid_non_acid.q,udf9.q,vector_groupby_grouping_window.q,auto_join21.q,join_view.q,input_lazyserde2.q,encryption_insert_partition_dynamic.q,crtseltbl_serdeprops.q,fold_eq_with_case_when.q,dynamic_partition_skip_default.q]
TestMiniLlapCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=147)
	[mapreduce2.q,orc_llap_counters1.q,bucket6.q,insert_into1.q,empty_dir_in_table.q,orc_merge1.q,parquet_types_vectorization.q,orc_merge_diff_fs.q,llap_stats.q,llapdecider.q,load_hdfs_file_with_space_in_the_name.q,llap_nullscan.q,orc_ppd_basic.q,rcfile_merge4.q,orc_merge3.q]
TestMiniLlapCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=148)
	[acid_bucket_pruning.q]
TestMiniLlapCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=149)
	[intersect_all.q,unionDistinct_1.q,orc_ppd_schema_evol_3a.q,table_nonprintable.q,tez_union_dynamic_partition.q,tez_union_dynamic_partition_2.q,temp_table_external.q,global_limit.q,llap_udf.q,schemeAuthority.q,cte_2.q,rcfile_createas1.q,dynamic_partition_pruning_2.q,intersect_merge.q,parallel_colstats.q]
TestMiniLlapCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=150)
	[parquet_complex_types_vectorization.q,import_exported_table.q,except_distinct.q,orc_merge10.q,mapreduce1.q,explainuser_2.q,mm_all.q,orc_merge4.q,rcfile_merge2.q,dynamic_semijoin_user_level.q,bucket5.q,external_table_with_space_in_location_path.q,load_fs2.q,intersect_distinct.q,remote_script.q]
TestMiniLlapCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=151)
	[orc_merge2.q,insert_into2.q,reduce_deduplicate.q,orc_llap_counters.q,cte_4.q,schemeAuthority2.q,llap_smb.q,reduce_deduplicate_distinct.q,file_with_header_footer.q,rcfile_merge3.q,multi_count_distinct_null.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=152)
	[vectorized_dynamic_semijoin_reduction.q,vector_udf_octet_length.q,schema_evol_orc_acidvec_table_update.q,vector_decimal_5.q,insert_values_tmp_table.q,escape1.q,tez_union2.q,cte_mat_5.q,smb_mapjoin_19.q,join_max_hashtable.q,cross_prod_3.q,join46.q,dynpart_sort_optimization2.q,tez_bmj_schema_evolution.q,bucketmapjoin4.q,vector_include_no_sel.q,semijoin7.q,uber_reduce.q,schema_evol_orc_nonvec_part_all_complex.q,vector_interval_arithmetic.q,bucketsortoptimize_insert_2.q,is_distinct_from.q,smb_mapjoin_17.q,auto_sortmerge_join_3.q,vectorization_9.q,materialized_view_create_rewrite.q,merge2.q,join_nulls.q,cbo_udf_udaf.q,bucketmapjoin2.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=153)
	[vector_coalesce.q,dp_counter_mm.q,orc_ppd_decimal.q,cbo_rp_lineage2.q,insert_into_with_schema.q,join_emit_interval.q,join1.q,join32_lessSize.q,vector_null_projection.q,vector_groupby_grouping_sets_grouping.q,vector_cast_constant.q,mapjoin2.q,orc_predicate_pushdown.q,cte_mat_4.q,correlationoptimizer4.q,groupby3.q,vector_windowing_navfn.q,vectorization_12.q,vector_number_compare_projection.q,orc_merge_incompat3.q,dynamic_semijoin_reduction_sw.q,update_all_non_partitioned.q,tez_insert_overwrite_local_directory_1.q,column_table_stats_orc.q,schema_evol_text_vecrow_table.q,vector_if_expr.q,delete_whole_partition.q,materialized_view_drop.q,bucketsortoptimize_insert_6.q,ctas.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=154)
	[skewjoinopt15.q,filter_union.q,load_dyn_part3.q,auto_sortmerge_join_14.q,schema_evol_text_nonvec_table.q,mrr.q,orc_ppd_schema_evol_2b.q,bucket_map_join_tez2.q,orc_analyze.q,schema_evol_orc_acidvec_part_update.q,subquery_views.q,vector_interval_1.q,tez_join_result_complex.q,vector_leftsemi_mapjoin.q,ptf_matchpath.q,multi_column_in_single.q,schema_evol_orc_nonvec_table.q,constprog_dpp.q,cbo_rp_semijoin.q,unionDistinct_2.q,vectorization_14.q,cbo_stats.q,vector_count.q,auto_sortmerge_join_6.q,auto_sortmerge_join_15.q,vector_groupby4.q,insert_dir_distcp.q,vector_decimal_6.q,vector_windowing_range_multiorder.q,sample1.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=155)
	[insert_values_non_partitioned.q,bucket3.q,vectorized_math_funcs.q,vectorization_4.q,vectorization_2.q,subquery_multi.q,cbo_simple_select.q,cbo_rp_udf_udaf_stats_opt.q,tez_union_decimal.q,multi_column_in.q,groupby1.q,partition_shared_scan.q,order_null.q,cbo_rp_udf_udaf.q,cbo_rp_views.q,vector_decimal_aggregate.q,vector_groupby_grouping_sets3.q,leftsemijoin_mr.q,vector_date_1.q,lvj_mapjoin.q,update_all_types.q,kill_query.q,vector_decimal_3.q,update_two_cols.q,ptf.q,update_where_non_partitioned.q,update_where_no_match.q,vectorized_nested_mapjoin.q,authorization_2.q,schema_evol_text_nonvec_part.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=156)
	[acid_vectorization_missing_cols.q,union5.q,vector_join_nulls.q,vector_decimal_math_funcs.q,vector_left_outer_join.q,vectorization_part_project.q,count.q,parallel.q,llap_partitioned.q,vectorization_10.q,smb_mapjoin_4.q,insert1.q,custom_input_output_format.q,vectorized_bucketmapjoin1.q,partition_multilevels.q,varchar_udf1.q,select_dummy_source.q,limit_join_transpose.q,tez_multi_union.q,skewjoin.q,cte_mat_3.q,autoColumnStats_1.q,vector_count_distinct.q,vector_decimal_round_2.q,semijoin.q,column_names_with_leading_and_trailing_spaces.q,vector_varchar_mapjoin1.q,dp_counter_non_mm.q,vectorized_insert_into_bucketed_table.q,union_stats.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=157)
	[list_bucket_dml_10.q,orc_merge9.q,acid_globallimit.q,vector_acid3.q,delete_where_no_match.q,vector_reduce1.q,stats_only_null.q,vectorization_6.q,semijoin_hint.q,vector_groupby_grouping_sets4.q,tez_vector_dynpart_hashjoin_2.q,delete_all_non_partitioned.q,delete_all_partitioned.q,cbo_rp_windowing_2.q,cbo_rp_unionDistinct_2.q,vector_reduce3.q,vector_varchar_4.q,smb_cache.q,hybridgrace_hashjoin_1.q,ppd_union_view.q,vector_decimal_4.q,schema_evol_orc_acid_part.q,hybridgrace_hashjoin_2.q,cross_join.q,parquet_predicate_pushdown.q,llap_vector_nohybridgrace.q,tez_smb_main.q,quotedid_smb.q,vector_groupby_grouping_id1.q,vector_bucket.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=158)
	[mapjoin_emit_interval.q,vector_auto_smb_mapjoin_14.q,deleteAnalyze.q,database.q,vector_bround.q,smb_mapjoin_6.q,vector_reduce_groupby_decimal.q,vectorized_dynamic_partition_pruning.q,cbo_views.q,vectorization_part.q,auto_join30.q,dynamic_partition_pruning.q,cte_mat_1.q,cluster.q,vector_char_mapjoin1.q,cte_5.q,subquery_shared_alias.q,vector_decimal_2.q,bucketmapjoin7.q,vector_string_concat.q,subquery_nested_subquery.q,limit_pushdown3.q,vector_outer_join2.q,smb_mapjoin_18.q,vectorized_context.q,metadata_only_queries.q,auto_sortmerge_join_12.q,union6.q,cbo_subq_in.q,vectorized_timestamp_funcs.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=159)
	[vector_groupby_grouping_id3.q,vector_elt.q,explainuser_1.q,partialdhj.q,multi_insert.q,tez_dml.q,cross_prod_4.q,vector_when_case_null.q,orc_ppd_schema_evol_1b.q,vector_join30.q,vector_groupby_grouping_sets2.q,cte_3.q,update_tmp_table.q,vector_ptf_part_simple.q,vector_decimal_cast.q,groupby_grouping_id2.q,vector_decimal_round.q,vector_windowing_order_null.q,tez_smb_empty.q,orc_merge6.q,vector_decimal_trailing.q,tez_union.q,columnStatsUpdateForStatsOptimizer_1.q,vector_outer_join3.q,vector_windowing_windowspec.q,schema_evol_text_vec_part_all_complex.q,materialized_view_rewrite_ssb.q,tez_dynpart_hashjoin_2.q,tez_union_multiinsert.q,mapjoin_hint.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=160)
	[vector_windowing_windowspec4.q,sysdb.q,tez_dynpart_hashjoin_3.q,tez_join.q,vectorized_rcfile_columnar.q,groupby_resolution.q,delete_where_non_partitioned.q,orc_merge11.q,schema_evol_orc_acid_table.q,cbo_semijoin.q,mergejoin_3way.q,orc_merge_incompat_schema.q,subquery_scalar.q,vectorization_11.q,ppr_pushdown.q,orc_llap_nonvector.q,vector_reduce2.q,vector_interval_mapjoin.q,tez_joins_explain.q,explainuser_4.q,vector_aggregate_9.q,vector_groupby_grouping_sets_limit.q,alter_merge_stats_orc.q,windowing_gby.q,vectorization_part_varchar.q,offset_limit.q,llap_acid_fast.q,subquery_select.q,delete_where_partitioned.q,union9.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=161)
	[authorization_view_8.q,load_dyn_part5.q,enforce_order.q,vector_groupby_grouping_sets5.q,vector_complex_join.q,vectorization_7.q,orc_ppd_schema_evol_1a.q,cbo_gby.q,vectorized_dynamic_semijoin_reduction2.q,subquery_exists.q,schema_evol_orc_vec_table.q,auto_sortmerge_join_1.q,lineage3.q,vector_struct_in.q,bucketmapjoin3.q,vectorization_16.q,orc_ppd_schema_evol_2a.q,vector_windowing_multipartitioning.q,vectorized_join46.q,orc_ppd_date.q,create_merge_compressed.q,vector_outer_join1.q,dynpart_sort_optimization_acid.q,vectorization_not.q,having.q,vectorization_input_format_excludes.q,vector_orderby_5.q,vector_outer_join6.q,leftsemijoin.q,special_character_in_tabnames_1.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=162)
	[dynamic_semijoin_reduction.q,materialized_view_create_rewrite_3.q,vectorization_pushdown.q,correlationoptimizer2.q,cbo_gby_empty.q,vectorization_short_regress.q,identity_project_remove_skip.q,mapjoin3.q,cross_product_check_1.q,unionDistinct_3.q,cbo_join.q,correlationoptimizer6.q,union_remove_26.q,cbo_rp_limit.q,vector_groupby_cube1.q,vectorization_13.q,current_date_timestamp.q,union2.q,groupby2.q,schema_evol_text_vec_table.q,dynpart_sort_opt_vectorization.q,exchgpartition2lel.q,multiMapJoin1.q,sample10.q,vectorized_timestamp_ints_casts.q,vector_char_simple.q,auto_sortmerge_join_2.q,bucketizedhiveinputformat.q,cte_mat_2.q,vectorization_8.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=163)
	[bucketsortoptimize_insert_7.q,cbo_windowing.q,vectorized_parquet.q,subquery_corr.q,vector_decimal_expressions.q,union_fast_stats.q,cbo_subq_not_in.q,resourceplan.q,materialized_view_rewrite_ssb_2.q,windowing.q,delete_tmp_table.q,bucket2.q,vector_aggregate_without_gby.q,schema_evol_text_nonvec_part_all_primitive.q,vector_windowing_streaming.q,orc_create.q,vector_distinct_2.q,vector_groupby_rollup1.q,mapjoin_mapjoin.q,bucketmapjoin6.q,update_all_partitioned.q,vector_decimal_precision.q,auto_sortmerge_join_16.q,auto_join29.q,dynpart_sort_optimization.q,tez_join_hash.q,multi_insert_lateral_view.q,ptf_streaming.q,non_native_window_udf.q,schema_evol_orc_vec_part_all_complex.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=164)
	[groupby_rollup_empty.q,load_dyn_part2.q,parquet_types.q,vectorization_5.q,schema_evol_stats.q,mapjoin46.q,jdbc_handler.q,column_access_stats.q,vector_between_in.q,merge1.q,cbo_rp_join.q,subquery_in_having.q,vectorized_string_funcs.q,vectorization_1.q,join0.q,vector_coalesce_3.q,stats_noscan_1.q,vector_partition_diff_num_cols.q,vector_decimal_10_0.q,orc_merge5.q,vector_udf1.q,schema_evol_text_vec_part.q,vector_groupby_reduce.q,union8.q,lineage2.q,insert_values_orig_table.q,correlationoptimizer1.q,vector_decimal_mapjoin.q,vectorized_case.q,vector_windowing_rank.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=165)
	[auto_sortmerge_join_13.q,union_top_level.q,vector_left_outer_join2.q,schema_evol_text_vecrow_part_all_primitive.q,constprog_semijoin.q,update_where_partitioned.q,vectorized_multi_output_select.q,drop_partition_with_stats.q,smb_mapjoin_14.q,skiphf_aggr.q,vectorized_ptf.q,auto_join_filters.q,join_reordering_no_stats.q,insert_orig_table.q,mergejoin.q,orc_split_elimination.q,subquery_in.q,vector_outer_join0.q,schema_evol_text_vec_part_all_primitive.q,vector_complex_all.q,auto_sortmerge_join_4.q,bucket_many.q,vectorization_15.q,union3.q,windowing_windowspec2.q,insert_values_orig_table_use_metadata.q,auto_smb_mapjoin_14.q,vector_mr_diff_schema_alias.q,vector_join_filters.q,reduce_deduplicate_extended.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=166)
	[vector_interval_2.q,schema_evol_orc_acid_table_update.q,metadataonly1.q,limit_pushdown.q,auto_join_nulls.q,metadata_only_queries_with_filters.q,schema_evol_text_nonvec_part_all_complex.q,alter_merge_orc.q,vector_between_columns.q,vector_char_cast.q,vector_groupby_grouping_sets6.q,join_filters.q,udaf_collect_set_2.q,update_after_multiple_inserts.q,offset_limit_ppd_optimizer.q,materialized_view_describe.q,orc_merge_incompat1.q,vectorized_parquet_types.q,vector_windowing_gby2.q,explainanalyze_2.q,union7.q,vectorization_nested_udf.q,vector_char_2.q,schema_evol_orc_acidvec_part.q,vector_groupby_3.q,materialized_view_create_rewrite_multi_db.q,acid_no_buckets.q,cbo_rp_gby.q,auto_sortmerge_join_9.q,vector_groupby_grouping_id2.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=167)
	[materialized_view_create.q,schema_evol_orc_acid_part_update.q,orc_ppd_varchar.q,optimize_join_ptp.q,count_dist_rewrite.q,vector_nvl.q,join_nullsafe.q,vectorized_mapjoin.q,cross_prod_1.q,vectorized_shufflejoin.q,autoColumnStats_10.q,tez_smb_1.q,tez_vector_dynpart_hashjoin_1.q,vector_inner_join.q,subquery_notin.q,vector_coalesce_2.q,table_access_keys_stats.q,subquery_null_agg.q,multiMapJoin2.q,filter_join_breaktask.q,mapjoin_decimal.q,column_table_stats.q,alter_merge_2_orc.q,columnstats_part_coltype.q,union4.q,stats_based_fetch_decision.q,auto_sortmerge_join_10.q,extrapolate_part_stats_partial_ndv.q,dynamic_semijoin_reduction_3.q,vector_decimal_udf2.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=168)
	[smb_mapjoin_15.q,vector_windowing_expressions.q,auto_join1.q,insert_values_partitioned.q,selectDistinctStar.q,vector_windowing_gby.q,vectorized_timestamp.q,bucket4.q,vector_groupby_mapjoin.q,cbo_subq_exists.q,insert_values_dynamic_partitioned.q,schema_evol_orc_vec_part_all_primitive.q,infer_bucket_sort_bucketed_table.q,cbo_union.q,filter_join_breaktask2.q,udaf_all_keyword.q,schema_evol_orc_vec_part.q,tez_self_join.q,vector_data_types.q,mm_conversions.q,vector_partitioned_date_time.q,schema_evol_orc_nonvec_part.q,dynamic_semijoin_reduction_2.q,vector_mapjoin_reduce.q,vectorization_3.q,auto_sortmerge_join_8.q,disable_merge_for_bucketing.q,vectorized_date_funcs.q,vector_varchar_simple.q,vector_adaptor_usage_mode.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=169)
	[tez_union_group_by.q,escape2.q,llap_acid.q,sqlmerge.q,vector_udf_character_length.q,tez_dynpart_hashjoin_1.q,correlationoptimizer3.q,vector_groupby_grouping_sets1.q,autoColumnStats_2.q,vector_binary_join_groupby.q,lateral_view.q,semijoin6.q,vectorization_0.q,orc_merge_incompat2.q,optimize_nullscan.q,nonmr_fetch_threshold.q,vectorization_decimal_date.q,vectorized_casts.q,schema_evol_text_vecrow_part_all_complex.q,acid_vectorization_original.q,tez_fsstat.q,stats11.q,tez_join_tests.q,join_acid_non_acid.q,empty_join.q,vector_groupby_grouping_window.q,auto_join21.q,schema_evol_text_vecrow_part.q,orc_ppd_timestamp.q,vector_decimal_1.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=170)
	[join_is_not_distinct_from.q,tez_nway_join.q,tez_schema_evolution.q,bucket_map_join_tez1.q,vector_multi_insert.q,insert_update_delete.q,temp_table.q,cross_product_check_2.q,cte_1.q,partition_pruning.q,vectorization_17.q,orc_merge8.q,bucket_groupby.q,vector_outer_join4.q,vector_nullsafe_join.q,orc_merge7.q,bucketpruning1.q,schema_evol_orc_acidvec_table.q,vector_grouping_sets.q,vector_outer_join5.q,vector_groupby6.q,bucketmapjoin1.q,smb_mapjoin_5.q,auto_sortmerge_join_5.q,auto_join0.q,load_dyn_part1.q,vector_windowing.q,schema_evol_orc_nonvec_part_all_primitive.q,auto_sortmerge_join_11.q,orc_merge_incompat_writer_version.q]
TestMiniLlapLocalCliDriver - did not produce a TEST-*.xml file (likely timed out) (batchId=171)
	[auto_sortmerge_join_7.q,cbo_limit.q,materialized_view_create_rewrite_2.q,input16_cc.q,vector_decimal_udf.q,vector_char_4.q]
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[auto_sortmerge_join_2] (batchId=48)
org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver[ppd_join5] (batchId=35)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[authorization_part] (batchId=93)
org.apache.hadoop.hive.cli.TestNegativeCliDriver.testCliDriver[stats_aggregator_error_1] (batchId=93)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[auto_sortmerge_join_10] (batchId=138)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[bucketsortoptimize_insert_7] (batchId=128)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[ppd_join5] (batchId=120)
org.apache.hadoop.hive.cli.TestSparkCliDriver.testCliDriver[subquery_multi] (batchId=113)
org.apache.hadoop.hive.ql.parse.TestReplicationScenarios.testConstraints (batchId=226)
{noformat}

Test results: https://builds.apache.org/job/PreCommit-HIVE-Build/8229/testReport
Console output: https://builds.apache.org/job/PreCommit-HIVE-Build/8229/console
Test logs: http://104.198.109.242/logs/PreCommit-HIVE-Build-8229/

Messages:
{noformat}
Executing org.apache.hive.ptest.execution.TestCheckPhase
Executing org.apache.hive.ptest.execution.PrepPhase
Executing org.apache.hive.ptest.execution.YetusPhase
Executing org.apache.hive.ptest.execution.ExecutionPhase
Executing org.apache.hive.ptest.execution.ReportingPhase
Tests exited with: TestsFailedException: 39 tests failed
{noformat}

This message is automatically generated.

ATTACHMENT ID: 12901931 - PreCommit-HIVE-Build

> LLAP: Fast llap io with slow processing pipeline can lead to OOM
> ----------------------------------------------------------------
>
>                 Key: HIVE-18269
>                 URL: https://issues.apache.org/jira/browse/HIVE-18269
>             Project: Hive
>          Issue Type: Bug
>    Affects Versions: 3.0.0
>            Reporter: Prasanth Jayachandran
>            Assignee: Prasanth Jayachandran
>         Attachments: HIVE-18269.1.patch, Screen Shot 2017-12-13 at 1.15.16 AM.png
>
>
> pendingData linked list in Llap IO elevator (LlapRecordReader.java) may grow indefinitely
when Llap IO is faster than processing pipeline. Since we don't have backpressure to slow
down the IO, this can lead to indefinite growth of pending data leading to severe GC pressure
and eventually lead to OOM.
> This specific instance of LLAP was running on HDFS on top of EBS volume backed by SSD.
The query that triggered this is issue was ANALYZE STATISTICS .. FOR COLUMNS which also gather
bitvectors. Fast IO and Slow processing case.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

Mime
View raw message