From issues-return-176955-apmail-flink-issues-archive=flink.apache.org@flink.apache.org Thu Jul 12 10:56:03 2018 Return-Path: X-Original-To: apmail-flink-issues-archive@minotaur.apache.org Delivered-To: apmail-flink-issues-archive@minotaur.apache.org Received: from mail.apache.org (hermes.apache.org [140.211.11.3]) by minotaur.apache.org (Postfix) with SMTP id B377C18408 for ; Thu, 12 Jul 2018 10:56:03 +0000 (UTC) Received: (qmail 81532 invoked by uid 500); 12 Jul 2018 10:56:03 -0000 Delivered-To: apmail-flink-issues-archive@flink.apache.org Received: (qmail 81242 invoked by uid 500); 12 Jul 2018 10:56:03 -0000 Mailing-List: contact issues-help@flink.apache.org; run by ezmlm Precedence: bulk List-Help: List-Unsubscribe: List-Post: List-Id: Reply-To: dev@flink.apache.org Delivered-To: mailing list issues@flink.apache.org Received: (qmail 80933 invoked by uid 99); 12 Jul 2018 10:56:03 -0000 Received: from pnap-us-west-generic-nat.apache.org (HELO spamd1-us-west.apache.org) (209.188.14.142) by apache.org (qpsmtpd/0.29) with ESMTP; Thu, 12 Jul 2018 10:56:03 +0000 Received: from localhost (localhost [127.0.0.1]) by spamd1-us-west.apache.org (ASF Mail Server at spamd1-us-west.apache.org) with ESMTP id 9323DCD7A2 for ; Thu, 12 Jul 2018 10:56:02 +0000 (UTC) X-Virus-Scanned: Debian amavisd-new at spamd1-us-west.apache.org X-Spam-Flag: NO X-Spam-Score: -110.301 X-Spam-Level: X-Spam-Status: No, score=-110.301 tagged_above=-999 required=6.31 tests=[ENV_AND_HDR_SPF_MATCH=-0.5, RCVD_IN_DNSWL_MED=-2.3, SPF_PASS=-0.001, USER_IN_DEF_SPF_WL=-7.5, USER_IN_WHITELIST=-100] autolearn=disabled Received: from mx1-lw-eu.apache.org ([10.40.0.8]) by localhost (spamd1-us-west.apache.org [10.40.0.7]) (amavisd-new, port 10024) with ESMTP id 1QFcT62E8o0y for ; Thu, 12 Jul 2018 10:56:02 +0000 (UTC) Received: from mailrelay1-us-west.apache.org (mailrelay1-us-west.apache.org [209.188.14.139]) by mx1-lw-eu.apache.org (ASF Mail Server at mx1-lw-eu.apache.org) with ESMTP id 65CFA5F430 for ; Thu, 12 Jul 2018 10:56:01 +0000 (UTC) Received: from jira-lw-us.apache.org (unknown [207.244.88.139]) by mailrelay1-us-west.apache.org (ASF Mail Server at mailrelay1-us-west.apache.org) with ESMTP id 67405E0D09 for ; Thu, 12 Jul 2018 10:56:00 +0000 (UTC) Received: from jira-lw-us.apache.org (localhost [127.0.0.1]) by jira-lw-us.apache.org (ASF Mail Server at jira-lw-us.apache.org) with ESMTP id 13F2723F97 for ; Thu, 12 Jul 2018 10:56:00 +0000 (UTC) Date: Thu, 12 Jul 2018 10:56:00 +0000 (UTC) From: "buptljy (JIRA)" To: issues@flink.apache.org Message-ID: In-Reply-To: References: Subject: [jira] [Created] (FLINK-9834) Unable to support scala BasicArrayTypeInfo MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: 7bit X-JIRA-FingerPrint: 30527f35849b9dde25b450d4833f0394 buptljy created FLINK-9834: ------------------------------ Summary: Unable to support scala BasicArrayTypeInfo Key: FLINK-9834 URL: https://issues.apache.org/jira/browse/FLINK-9834 Project: Flink Issue Type: Bug Components: Type Serialization System Reporter: buptljy BasicArrayTypeInfo does not supported scala type in some circumstances. For example, {code:scala} // we set a descriptor here and get value from it. val datas: mutable.Map[String, Array[Byte]] = mutable.Map() val descriptor = new MapStateDescriptor("realtime-state", BasicTypeInfo.STRING_TYPE_INFO, BasicArrayTypeInfo.BYTE_ARRAY_TYPE_INFO) val state = context.getKeyedStateStore.getMapState(descriptor) val iter = state.entries().iterator() while (iter.hasNext) { val entry = iter.next() datas.put(entry.getKey, entry.getValue) } {code} The codes above cannot be compiled successfully because the "state" is using java.lang.Byte but the "datas" is using scala.Byte, and we have to iterate all values of the Array like "datas.put(entry.getKey, entry.getValue.map(byte => byte.asInstanceOf[Byte]))", which is definitely not what we want. I suggest that we create a ScalaBasicArrayTypeInfo like the "BasicArrayTypeInfo" for scala. -- This message was sent by Atlassian JIRA (v7.6.3#76005)