HIVE-2906 [jira] Support providing some table properties by user via SQL
Needs ReviewPublic

Press ? to show keyboard shortcuts.
Author
navis
Reviewers
JIRA
Lint
Lint OK
Unit
No Unit Test Coverage
Branch
HIVE-2906
Apply Patch
arc patch D2499
Arcanist Project
Restricted Arcanist Project
Subscribers
njain
Projects
None
Summary

DPAL-1010 Support providing some table properties by user via SQL

Some properties are needed to be provided to StorageHandler by user in runtime.
It might be an address for remote resource or retry count for access or maximum
version count(for hbase), etc.

For example,

select emp.empno, emp.ename from hbase_emp ('max.version'='3') emp;

Test Plan

EMPTY

njain added a comment.Via LegacyMar 28 2012, 5:21 AM

Can you add a test where the value is actually being used ?

navis added a comment.Via LegacyMar 29 2012, 1:04 AM

It was intended for specifying 'max version' for hbase handler and it seemed require some modifications. So I was thinking it could be done in a separated issue after this. But if it's OK, I'll work on that in this issue, too.

navis updated this revision.Via LegacyMar 29 2012, 8:55 AM
  1. Added 'hbase.max.versions' as a example of using table properties
  2. Added test case 'hbase_max_versions.q'
navis updated this revision.Via LegacyMar 29 2012, 9:14 AM
  1. Fixed test case to have deterministic result
navis updated this revision.Via LegacyMar 30 2012, 1:53 AM
  1. Fixed not applying table properties to fetch operator
  2. Added 'hbase.versions.order' option for ordering of multi-versioned result
  3. Removed debug message, added test case
navis updated this revision.Via LegacyMar 30 2012, 11:59 PM
  1. Fixed NPE
  2. Passed all tests
navis updated this revision.Via LegacyJul 19 2013, 2:08 AM

Rebase to trunk
Removed HBase version property from patch (will make an another issue)

navis updated this revision.Via LegacyJul 23 2013, 1:32 AM

Fixed test cases

Revision Update History

DiffIDBaseDescriptionCreatedLintUnit
BaseBase
Diff 178811304068Mar 26 2012, 7:34 AM
Diff 2809713040681. Added 'hbase.max.versions' as a example of using table properties 2. Added teMar 29 2012, 8:53 AM
Diff 3810313040681. Fixed test case to have deterministic resultMar 29 2012, 9:13 AM
Diff 4812713040681. Fixed not applying table properties to fetch operator 2. Added 'hbase.versionMar 30 2012, 1:51 AM
Diff 5819313040681. Fixed NPE 2. Passed all testsMar 30 2012, 11:59 PM
Diff 6359011504395Rebase to trunkJul 19 2013, 2:06 AM
Diff 7359851505418Fixed test casesJul 23 2013, 1:32 AM

Local Commits

CommitTreeParentsAuthorSummaryDate
8de4700adfc77983c97b437e10da3330bf65navis
HIVE-2906 [jira] Support providing some table properties by user via SQL (Show More…)
Mar 26 2012, 7:33 AM

Diff 35985

ql/src/java/org/apache/hadoop/hive/ql/optimizer/GenMapRedUtils.java

Loading...

ql/src/java/org/apache/hadoop/hive/ql/parse/FromClauseParser.g

Loading...

ql/src/java/org/apache/hadoop/hive/ql/parse/MapReduceCompiler.java

Loading...

ql/src/java/org/apache/hadoop/hive/ql/parse/ParseContext.java

Loading...

ql/src/java/org/apache/hadoop/hive/ql/parse/QB.java

Loading...

ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java

Loading...

ql/src/test/queries/clientpositive/serde_user_properties.q

Loading...

ql/src/test/results/clientnegative/ptf_negative_DistributeByOrderBy.q.out

Loading...

ql/src/test/results/clientnegative/ptf_negative_PartitionBySortBy.q.out

Loading...

ql/src/test/results/clientpositive/serde_user_properties.q.out

Loading...

ql/src/test/results/compiler/errors/missing_overwrite.q.out

Loading...

Add Comment