Dynamical complexity of short and noisy time series: Compression-Complexity vs. Shannon entropy

Publication Type:

Journal Article

Source:

The European Physical Journal Special Topics (2017)

URL:

http://link.springer.com/article/10.1140%2Fepjst%2Fe2016-60397-x

Abstract:

Shannon entropy has been extensively used for characteriz- ing complexity of time series arising from chaotic dynamical systems and stochastic processes such as Markov chains. However, for short and noisy time series, Shannon entropy performs poorly. Complexity measures which are based on lossless compression algorithms are a good substitute in such scenarios. We evaluate the performance of two such Compression-Complexity Measures namely Lempel-Ziv complexity(LZ) and Effort-To-Compress ( ETC)on short time series from chaoticdynamical systems in the presence of noise. Both LZ and ETC outperform Shannon entropy (H) in accurately characterizing the dynamical complexity of such systems. For very short binary sequences (which arise in neuroscience applications), ETC has higher number of distinct complexity values than LZ and H, thus enabling a finer resolution. For two-state ergodic Markov chains, we empirically show that ETC converges to a steady state value faster than LZ. Compression-Complexity measures are promising for applications which involve short and noisy time series