From user-return-66571-apmail-spark-user-archive=spark.apache.org@spark.apache.org Fri Dec 30 20:10:32 2016 Return-Path: X-Original-To: apmail-spark-user-archive@minotaur.apache.org Delivered-To: apmail-spark-user-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id A5BE719DE8 for ; Fri, 30 Dec 2016 20:10:32 +0000 (UTC) Received: (qmail 39450 invoked by uid 500); 30 Dec 2016 20:10:23 -0000 Delivered-To: apmail-spark-user-archive@spark.apache.org Received: (qmail 39309 invoked by uid 500); 30 Dec 2016 20:10:23 -0000 Mailing-List: contact user-help@spark.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Delivered-To: mailing list user@spark.apache.org Received: (qmail 39299 invoked by uid 99); 30 Dec 2016 20:10:23 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Fri, 30 Dec 2016 20:10:23 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 088F9C0A52 for ; Fri, 30 Dec 2016 20:10:23 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: 3.206 X-Spam-Level: *** X-Spam-Status: No, score=3.206 tagged_above=-999 required=6.31 tests=[DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, FREEMAIL_ENVFROM_END_DIGIT=0.25, HTML_IMAGE_ONLY_16=1.048, HTML_MESSAGE=2, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H2=-0.001, SPF_PASS=-0.001, T_REMOTE_IMAGE=0.01] autolearn=disabled Authentication-Results: spamd1-us-west.apache.org (amavisd-new); dkim=pass (2048-bit key) header.d=gmail.com Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id IzTKeQIufR43 for ; Fri, 30 Dec 2016 20:10:22 +0000 (UTC) Received: from mail-ua0-f175.google.com (mail-ua0-f175.google.com [209.85.217.175]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTPS id 7D31D5F230 for ; Fri, 30 Dec 2016 20:10:21 +0000 (UTC) Received: by mail-ua0-f175.google.com with SMTP id v2so85215542uac.2 for ; Fri, 30 Dec 2016 12:10:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=H6ZLg08/h6gIZHSYwyJwKyw2/dTZrc7UDFOc0uip8fM=; b=HvjOWC8Z/jtantkAmaF/Qcbyr7A/ZWwqALGVCUao8BEsZU3UgzqZaBWqrCkwa5Flhn k9dHGaeKtU+z7pZ6PC9qa1Q1e9aWWQumw1rqytshY/Ikoa5PEprsLbn9tRCMYpFMWgsP i3VFv0KTUQJP1m20118cSLce0IYvqGnVYAjFdNVhgUgNMUJH8OB/4ezSKbrvsxQQMNJj WeoHNjiwtTYQN+L+C/FfgAEwILVU7qE2JOjrnSpO5e07wNAnGYp9rMiECvsoCd1TqZ6G 0bk/BX0AQDJlQRi6Z4rzQtlOJkmWyFvHXAk8BhgU3P+xRQ1QQaMrFgOmax8o9vh186SY A1CQ== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=H6ZLg08/h6gIZHSYwyJwKyw2/dTZrc7UDFOc0uip8fM=; b=tbq5GLV2cSGf+N7C27E1ugPx0nUt5Bn3BcVPX4mB1zvUpbxEXaUMADN3Phb95kORSc xgPvYD2iVz57k6yKAGloXdwLI26sFNZZt8h/06kiaQxJm815AwAjvd+crIisY+t0p0OX 7hJT/vxRKIFQ8lo+WLUr2iVcsJ1KcLHUemka4TvlrjWahE4Ja/ymLxKKi0mPOmcsfjFy E2n5fI5U5A3jm8yMZfg1D9A7dY7UpbLdk/tzKErnuZ5froPX/i85m7KM2BOiI+zmfsiI 79gosE9m3Am7ftms2TkrHvGqKb+NDWTk1hCq/d0CeBFLGaV2QVitq06Lj87LPUt99hHg 5nIA== X-Gm-Message-State: AIkVDXInqHxZmMLlJqFi/h3dLoGvEKKz9hVZBvYXkHVVBWrdBZLl1vuan0MF8dRG73SHBwA11k0/Tt7vfn5Lfw== X-Received: by 10.176.71.87 with SMTP id i23mr30470639uac.123.1483128619607; Fri, 30 Dec 2016 12:10:19 -0800 (PST) MIME-Version: 1.0 Received: by 10.103.149.72 with HTTP; Fri, 30 Dec 2016 12:09:59 -0800 (PST) From: Raymond Xie Date: Fri, 30 Dec 2016 15:09:59 -0500 Message-ID: Subject: What's the best practice to load data from RDMS to Spark To: user@spark.apache.org Content-Type: multipart/alternative; boundary=f403045f8b1c877bf40544e5ca58 --f403045f8b1c877bf40544e5ca58 Content-Type: text/plain; charset=UTF-8 Hello, I am new to Spark, as a SQL developer, I only took some courses online and spent some time myself, never had a chance working on a real project. I wonder what would be the best practice (tool, procedure...) to load data (csv, excel) into Spark platform? Thank you. *Raymond* --f403045f8b1c877bf40544e5ca58 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hello,

I am new to Spark, as a S= QL developer, I only took some courses online and spent some time myself, n= ever had a chance working on a real project.

I wonder what would be the= best practice (tool, procedure...) to load data (csv, excel) into Spark pl= atform?

Thank you.


<= br>
Raymond
--f403045f8b1c877bf40544e5ca58--