spark-user mailing list archives

Site index · List index
Message view « Date » · « Thread »
Top « Date » · « Thread »
From "母延年(YDB技术支持)" <1820150...@qq.com>
Subject why visitCreateFileFormat doesn`t support hive STORED BY ,just support store as
Date Sat, 05 Nov 2016 12:27:55 GMT
why visitCreateFileFormat doesn`t support  hive STORED BY ,just support story as 
when i update spark1.6.2 to spark2.0.1  
so what i want to ask is .does it on plan to support hive stored by ?  or never support that
?
configureOutputJobProperties is quit important ,is there any other method to instand?

 override def visitCreateFileFormat(
      ctx: CreateFileFormatContext): CatalogStorageFormat = withOrigin(ctx) {
    (ctx.fileFormat, ctx.storageHandler) match {
      // Expected format: INPUTFORMAT input_format OUTPUTFORMAT output_format
      case (c: TableFileFormatContext, null) =>
        visitTableFileFormat(c)
      // Expected format: SEQUENCEFILE | TEXTFILE | RCFILE | ORC | PARQUET | AVRO
      case (c: GenericFileFormatContext, null) =>
        visitGenericFileFormat(c)
      case (null, storageHandler) =>
        operationNotAllowed("STORED BY", ctx)
      case _ =>
        throw new ParseException("Expected either STORED AS or STORED BY, not both", ctx)
    }
  }
Mime
View raw message