atom feed1 message in org.apache.spark.issues[jira] [Resolved] (SPARK-20783) Enhan...
FromSent OnAttachments
Wenchen Fan (JIRA)Oct 4, 2017 12:08 am 
Subject:[jira] [Resolved] (SPARK-20783) Enhance ColumnVector to support compressed representation
From:Wenchen Fan (JIRA) (ji@apache.org)
Date:Oct 4, 2017 12:08:00 am
List:org.apache.spark.issues

[
https://issues.apache.org/jira/browse/SPARK-20783?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel
]

Wenchen Fan resolved SPARK-20783.

--------------------------------- Resolution: Fixed Fix Version/s: 2.3.0

Issue resolved by pull request 18704 [https://github.com/apache/spark/pull/18704]

Enhance ColumnVector to support compressed representation

---------------------------------------------------------

Key: SPARK-20783 URL: https://issues.apache.org/jira/browse/SPARK-20783 Project: Spark Issue Type: Sub-task Components: SQL Affects Versions: 2.3.0 Reporter: Kazuaki Ishizaki Fix For: 2.3.0

Current {{ColumnVector}} handles uncompressed data for parquet. For handling table cache, this JIRA entry adds {{OnHeapCachedBatch}} class to
have compressed data. As first step of this implementation, this JIRA supports primitive data and
string types.