From user-return-10113-apmail-drill-user-archive=drill.apache.org@drill.apache.org Thu Feb 7 14:54:16 2019 Return-Path: X-Original-To: apmail-drill-user-archive@www.apache.org Delivered-To: apmail-drill-user-archive@www.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id 3453318035 for ; Thu, 7 Feb 2019 14:54:16 +0000 (UTC) Received: (qmail 45220 invoked by uid 500); 7 Feb 2019 14:54:15 -0000 Delivered-To: apmail-drill-user-archive@drill.apache.org Received: (qmail 45135 invoked by uid 500); 7 Feb 2019 14:54:15 -0000 Mailing-List: contact user-help@drill.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: user@drill.apache.org Delivered-To: mailing list user@drill.apache.org Received: (qmail 45106 invoked by uid 99); 7 Feb 2019 14:54:15 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 07 Feb 2019 14:54:15 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id B0DB5CD76A for ; Thu, 7 Feb 2019 14:54:13 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 0.799 X-Spam-Level: X-Spam-Status: No, score=0.799 tagged_above=-999 required=6.31 tests=[DKIMWL_WL_MED=-0.001, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_REPLY=1, MIME_QP_LONG_LINE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_PASS=-0.001] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id S4rgeHn_8vEJ for ; Thu, 7 Feb 2019 14:54:12 +0000 (UTC) Received: from mail-ed1-f42.google.com (mail-ed1-f42.google.com [209.85.208.42]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 0A5CD5F17E for ; Thu, 7 Feb 2019 14:54:12 +0000 (UTC) Received: by mail-ed1-f42.google.com with SMTP id b17so112780eds.2 for ; Thu, 07 Feb 2019 06:54:12 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=from:content-transfer-encoding:mime-version:date:subject:message-id :references:in-reply-to:to; bh=XbcYY5rz1l9U86wzYz9gXhy1DTiogwcDIg23/mXfGxw=; b=PulQm0Uzp1f8TRE3Xz5VHpAf1gYzmvK4lxN64AdvTRERY13LUpYTWDb7PLxgcuei+u RJVlYw//vV6pK7+Kw29rqeJJuuVBxYZCFF7KhU2KT5WWAVa8yc0xnnL/SRJSbmhXAAVU ZDsYiFPCFBZyq0BhvPZtheAt+fCQiK/VMwImTV3VWNERtrAXZu7rqdI0drAEfR8m84Pl tTcp8rRD9Svmw4sPed9C8xcAbfxYinfQPyeD1yqJ4FS9jK7H6FdqE12OPXKzdzvNE6Pw gcmTrvKJ1ckWCiWYguqGIk1PHUNMaTTnYL8FSi430ESkakhQ5Yy5wnqj0Rzj1Ew/IA8H Oi5A== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:from:content-transfer-encoding:mime-version:date :subject:message-id:references:in-reply-to:to; bh=XbcYY5rz1l9U86wzYz9gXhy1DTiogwcDIg23/mXfGxw=; b=Xg13v9+O7i5lLUVS/FPlNeJ5PwgEnE4ziP+kR2yfPFo0Ru/52r7pH7bPf/GAiugJ7A i5zJXegyzQTzgF+1fu5JV7+ZMY1I57g0vfLQBvH0MVSs3/Odgry15ry+xc41FlZNeZJD ZUvX9tEVGhoIfJtzt+1UKwVP2d1NiI+vvIoSCENKblLWIvUDJbmLH/TTWZQayETw9XyF jy2wpjhykEgU0Dzxl81AE3fxcEAu3pjQYoX5FqjLXfhe/WMAaFAU4WLqTJearwOQq8md Gc3K6aYYAHeeCSG2NYGut9M1O6qMRWLkZ3at5ywk2cgJeY5JmnVh0v8Uzr3pW5enrsQ+ bkkQ== X-Gm-Message-State: AHQUAuaxM2IsOg47ZoqxeLkODo41HqXlW8hxGTBQLk7owN3tJQMBGpZ2 /xg+yucYXZRbFx0FAP3ymrizsf6BVXY= X-Google-Smtp-Source: AHgI3IaOsPqyUmHYJALsgueUVb5X8ELKjJg3NpqZRI3uckX0cFvU8mReuiiWNv2X1/34X8O887m1Ug== X-Received: by 2002:a17:906:d288:: with SMTP id ay8mr12218729ejb.59.1549551251259; Thu, 07 Feb 2019 06:54:11 -0800 (PST) Received: from ?IPv6:2001:420:44f0:1252:25d0:69:b2a2:49e3? ([2001:420:44f0:1252:25d0:69:b2a2:49e3]) by smtp.gmail.com with ESMTPSA id f38sm2089922edd.97.2019.02.07.06.54.10 for (version=TLS1_2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Thu, 07 Feb 2019 06:54:10 -0800 (PST) From: GiovanniC Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable Mime-Version: 1.0 (1.0) Date: Thu, 7 Feb 2019 15:54:09 +0100 Subject: Re: Drill fails to query pcap files Message-Id: <977B672B-F3F6-464C-B231-59F7C777CB21@gmail.com> References: <1002D02D-FC78-456F-9F91-E1FA763AD2D6@gmail.com> <58C84879-B414-4FFC-91BA-0A43224C9FD8@gmail.com> <0DEBCA2A-EB3E-48B2-BF6D-1EB821880FBC@gmail.com> In-Reply-To: <0DEBCA2A-EB3E-48B2-BF6D-1EB821880FBC@gmail.com> To: user@drill.apache.org X-Mailer: iPhone Mail (16C50) Unfortunately I don=E2=80=99t have more of them at the moment. > Il giorno 7 feb 2019, alle ore 14:33, Charles Givre ha s= critto: >=20 > Hi Giovanni,=20 > Can you post additional PCAP files that don=E2=80=99t work? Basically, I=E2= =80=99m going to add some code that will let you set a tolerance level of ho= w many errors Drill will tolerate before throwing an exception.=20 > =E2=80=94 C >=20 >> On Feb 7, 2019, at 07:33, GiovanniC wrote: >>=20 >> I can help you by doing some test. >>=20 >>> Il giorno 6 feb 2019, alle ore 18:46, Charles Givre h= a scritto: >>>=20 >>> Just create a ticket and I will work on it.=20 >>>=20 >>> Sent from my iPhone >>>=20 >>>> On Feb 6, 2019, at 12:35, Giovanni Conte wrote: >>>>=20 >>>> I would like to, but I am not a java dev :( >>>>=20 >>>> Il giorno mer 6 feb 2019 alle ore 18:31 Arina Yelchiyeva < >>>> arina.yelchiyeva@gmail.com> ha scritto: >>>>=20 >>>>> Contributions are always welcome :) >>>>>=20 >>>>> Kind regards, >>>>> Arina >>>>>=20 >>>>>> On Wed, Feb 6, 2019 at 7:19 PM Charles Givre wrote= : >>>>>>=20 >>>>>> Hi Giovanni >>>>>> I think it would be useful for Drill to have some ability to ignore >>>>>> corrupt rows in a PCAP file. Can you open a JIRA ticket for this? >>>>>>=20 >>>>>> Sent from my iPhone >>>>>>=20 >>>>>>> On Feb 6, 2019, at 12:15, Arina Yelchiyeva >>>>>=20 >>>>>> wrote: >>>>>>>=20 >>>>>>> Hi Giovanni, >>>>>>>=20 >>>>>>> I don't think Drill pcap format reader has such functionality. >>>>>>>=20 >>>>>>> Kind regards, >>>>>>> Arina >>>>>>>=20 >>>>>>>> On Wed, Feb 6, 2019 at 6:39 PM Giovanni Conte >>>>>> wrote: >>>>>>>>=20 >>>>>>>> Hi, >>>>>>>> I'm trying to query a pcap file and I know that there are corrupted= >>>>> rows >>>>>>>> (precisely line 6407), >>>>>>>> I need a command to skip this rows to avoid the following error: >>>>>>>>=20 >>>>>>>> Error: INTERNAL_ERROR ERROR: null >>>>>>>> Fragment 0:0 >>>>>>>> Please, refer to logs for more information. >>>>>>>> [Error Id: fe17f64d-4ac8-453f-b442-9bcf68c69c61 on ubuntu:31010] >>>>>>>> (state=3D,code=3D0) >>>>>>>>=20 >>>>>>>> [...] >>>>>>>>=20 >>>>>>>> the complete error is attached in the txt file ()for java exception= s, >>>>>>>> along with the pcap file used for testing this issue. I would like t= o >>>>>> avoid >>>>>>>> a pre-parsing of the pcap when a corrupted row is found. >>>>>>>> Is there a way to avoid this problem? >>>>>>>> Thanks, >>>>>>>>=20 >>>>>>>> Giovanni >>>>>>>>=20 >>>>>>>> OS: Ubuntu 18.4 >>>>>>>> Drill version: 1.15.0 >>>>>>>> Java(TM) SE Runtime Environment (build 1.8.0_191-b12) >>>>>>>>=20 >>>>>>=20 >>>>>=20 >=20