44 messages in org.apache.hadoop.generalRe: [PROPOSAL] new subproject: Avro| From | Sent On | Attachments |
|---|---|---|
| Doug Cutting | Apr 2, 2009 3:04 pm | |
| Owen O'Malley | Apr 2, 2009 3:19 pm | |
| Abhishek Verma | Apr 2, 2009 5:11 pm | |
| Owen O'Malley | Apr 2, 2009 9:28 pm | |
| Doug Cutting | Apr 3, 2009 9:06 am | |
| Bryan Duxbury | Apr 3, 2009 9:24 am | |
| Doug Cutting | Apr 3, 2009 10:27 am | |
| Doug Cutting | Apr 3, 2009 10:39 am | |
| Alan Gates | Apr 3, 2009 10:42 am | |
| Bryan Duxbury | Apr 3, 2009 10:49 am | |
| Doug Cutting | Apr 3, 2009 11:37 am | |
| George Porter | Apr 3, 2009 12:03 pm | |
| Scott Carey | Apr 3, 2009 12:49 pm | |
| Bryan Duxbury | Apr 3, 2009 12:58 pm | |
| Doug Cutting | Apr 3, 2009 1:01 pm | |
| George Porter | Apr 3, 2009 1:23 pm | |
| Sameer Paranjpye | Apr 3, 2009 1:26 pm | |
| Nigel Daley | Apr 3, 2009 1:46 pm | |
| Jerome Boulon | Apr 3, 2009 1:59 pm | |
| Jim Kellerman (POWERSET) | Apr 3, 2009 3:09 pm | |
| Doug Cutting | Apr 3, 2009 3:44 pm | |
| Sanjay Radia | Apr 5, 2009 10:33 pm | |
| Dhruba Borthakur | Apr 5, 2009 10:42 pm | |
| Chad Walters | Apr 5, 2009 11:51 pm | |
| Chad Walters | Apr 6, 2009 12:22 am | |
| Doug Cutting | Apr 6, 2009 12:12 pm | |
| Doug Cutting | Apr 6, 2009 1:08 pm | |
| George Porter | Apr 6, 2009 1:25 pm | |
| Brian Forney | Apr 6, 2009 1:38 pm | |
| Doug Cutting | Apr 6, 2009 1:48 pm | |
| George Porter | Apr 6, 2009 2:02 pm | |
| Chad Walters | Apr 6, 2009 2:05 pm | |
| Doug Cutting | Apr 6, 2009 3:17 pm | |
| Kevin Clark | Apr 6, 2009 5:17 pm | |
| Doug Cutting | Apr 6, 2009 9:14 pm | |
| Chad Walters | Apr 7, 2009 1:56 am | |
| Doug Cutting | Apr 7, 2009 9:16 am | |
| Tom White | Apr 7, 2009 10:26 am | |
| Doug Cutting | Apr 7, 2009 8:33 pm | |
| Chad Walters | Apr 8, 2009 12:03 am | |
| Doug Cutting | Apr 8, 2009 11:03 am | |
| Doug Cutting | Apr 9, 2009 3:32 pm | |
| Ankur Goel | Apr 13, 2009 4:27 am | |
| Doug Cutting | Apr 13, 2009 10:53 am |
| Subject: | Re: [PROPOSAL] new subproject: Avro | |
|---|---|---|
| From: | Sameer Paranjpye (spar...@yahoo.com) | |
| Date: | Apr 3, 2009 1:26:47 pm | |
| List: | org.apache.hadoop.general | |
+1
While protocol buffers and thrift have similar goals. Avro takes a different
approach to schema evolution and reconciliation. I feel that Avros tighter
layout of data and schema management is better suited for many of Hadoop and
Pigs use cases for large data sets/tables on HDFS. Field ids start to matter
when milions of objects have hundreds of fields each. There is, of course, the
storage overhead. Schema management becomes hard especially if there are cases
where field ids need to be assigned manually.
----- Original Message ---- From: Doug Cutting <cutt...@apache.org> To: gene...@hadoop.apache.org Sent: Thursday, April 2, 2009 3:05:08 PM Subject: [PROPOSAL] new subproject: Avro
I propose we add a new Hadoop subproject for Avro, a serialization system. My
ambition is for Avro to replace both Hadoop's RPC and to be used for most Hadoop
data files, e.g., by Pig, Hive, etc.
Initial committers would be Sharad Agarwal and me, both existing Hadoop
committers. We are the sole authors of this software to date.
The code is currently at:
http://people.apache.org/~cutting/avro.git/
To learn more:
git clone http://people.apache.org/~cutting/avro.git/ avro cat avro/README.txt
Comments? Questions?
Doug