TY - GEN
T1 - The sufficiency principle for decentralized data reduction
AU - Xu, Ge
AU - Chen, Biao
PY - 2012
Y1 - 2012
N2 - This paper develops the sufficiency principle suitable for data reduction in decentralized inference systems. Both parallel and tandem networks are studied and we focus on the cases where observations at decentralized nodes are conditionally dependent. For a parallel network, through the introduction of a hidden variable that induces conditional independence among the observations, the locally sufficient statistics, defined with respect to the hidden variable, are shown to be globally sufficient for the parameter of inference interest. For a tandem network, the notion of conditional sufficiency is introduced and the related theories and tools are developed. Finally, connections between the sufficiency principle and some distributed source coding problems are explored.
AB - This paper develops the sufficiency principle suitable for data reduction in decentralized inference systems. Both parallel and tandem networks are studied and we focus on the cases where observations at decentralized nodes are conditionally dependent. For a parallel network, through the introduction of a hidden variable that induces conditional independence among the observations, the locally sufficient statistics, defined with respect to the hidden variable, are shown to be globally sufficient for the parameter of inference interest. For a tandem network, the notion of conditional sufficiency is introduced and the related theories and tools are developed. Finally, connections between the sufficiency principle and some distributed source coding problems are explored.
UR - http://www.scopus.com/inward/record.url?scp=84867565951&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84867565951&partnerID=8YFLogxK
U2 - 10.1109/ISIT.2012.6284199
DO - 10.1109/ISIT.2012.6284199
M3 - Conference contribution
AN - SCOPUS:84867565951
SN - 9781467325790
T3 - IEEE International Symposium on Information Theory - Proceedings
SP - 319
EP - 323
BT - 2012 IEEE International Symposium on Information Theory Proceedings, ISIT 2012
T2 - 2012 IEEE International Symposium on Information Theory, ISIT 2012
Y2 - 1 July 2012 through 6 July 2012
ER -