public class JDBCStatsPublisher extends java.lang.Object implements StatsPublisher
Constructor and Description |
---|
JDBCStatsPublisher() |
Modifier and Type | Method and Description |
---|---|
boolean |
closeConnection()
This method closes the connection to the temporary storage.
|
boolean |
connect(Configuration hiveconf)
This method connects to the intermediate statistics database.
|
boolean |
init(Configuration hconf)
Initialize the intermediate stats DB for the first time it is running (e.g.,
creating tables.).
|
boolean |
publishStat(java.lang.String fileID,
java.util.Map<java.lang.String,java.lang.String> stats)
This method publishes a given statistic into a disk storage, possibly HBase or MySQL.
|
public boolean connect(Configuration hiveconf)
StatsPublisher
connect
in interface StatsPublisher
hiveconf
- HiveConf that contains the connection parameters.public boolean publishStat(java.lang.String fileID, java.util.Map<java.lang.String,java.lang.String> stats)
StatsPublisher
publishStat
in interface StatsPublisher
fileID
- : a string identification the statistics to be published by all mappers/reducers
and then gathered. The statID is unique per output partition per task, e.g.,:
the output directory name (uniq per FileSinkOperator) +
the partition specs (only for dynamic partitions) +
taskID (last component of task file)stats
- : a map containing key-value pairs, where key is a string representing the statistic
to be published,
and value is a string representing the value for the given statisticpublic boolean closeConnection()
StatsPublisher
closeConnection
in interface StatsPublisher
public boolean init(Configuration hconf)
init
in interface StatsPublisher
hconf
- HiveConf that contains the configurations parameters used to connect to
intermediate stats database.Copyright © 2012 The Apache Software Foundation