Quantcast

Posts tagged with autocorrelation

When we do something in a default style acquired unconsciously, it is like typing on the only typewriter we have ever known: we do not notice the style of our activity any more than we notice the typeface on the machine. In such cases, we have an abstract concept of action that leaves style out of account.

We can have a concept of lying without being aware…that, in practice, we must have a style of lying. We can have a concept of quarreling without being aware…that in practice, we must have a style of quarreling.
from Clear and Simple as the Truth by Francis-Noël Thomas & Mark Turner (via untilasinglesolitonsurvives)

(Source: cmnotes)




3 × 3 × 3 × 3 × 3 × 3 × 3 × 3 × 3 × 3 × 3 × 3 × 3 … modulo 89

  • An application of group theory to Navy sonar — can you generate a sequence whose 1-differences are random? (whose 1-autocorrelations are nil)


  • Also the patterns look a bit like low-discrepancy sequences:
     

     




Autocorrelation

A “truly” random, uniform random, completely random sequence might look like

◯◯⨯◯⨯⨯⨯⨯◯◯⨯◯◯⨯⨯◯⨯◯◯⨯⨯◯⨯⨯◯⨯◯◯⨯◯
R code: > xooooo = sample( c("◯", "⨯") , 30, rep = T) 

like the flips of a fair coin. But there are other “random”s as well.

Biased

For example, biased random, like an unfair coin with 4/5 bias, might generate a sequence that looks like this:

◯◯◯◯⨯◯◯⨯◯◯⨯◯◯◯◯◯◯◯◯◯◯◯◯◯◯◯◯◯◯◯

R code: > xooooo = sample( c("◯","◯","◯","◯", "⨯") , 30, rep = T)

 

Self-Correlated

But there’s also autocorrelated, or serially correlated, randomness.

◯◯◯◯◯◯◯◯◯◯◯◯◯◯◯◯◯◯◯◯⨯⨯⨯◯◯◯◯◯◯◯

For example you feel fine ◯ 80% of the time and 20% you’re sick ⨯ — and of course the sick days are more likely to come one after another. Or 80% of the time you don’t smoke ◯ but then you buy a pack and all of a sudden you smoke ⨯⨯⨯ three days in a row. Once you’ve broken your resolve, you’re more likely to smoke again the next day.

 

Equation-wise, autocorrelation amounts to adding a self-lag term to the other explanatory variables (plus unexplained residual). Besides habit and viral invasion, autocorrelation brings many things under the penumbra of randomness:

  • income. The strong gets more, while the weak ones fade. If you made a lot of money at your previous job, your next employer will pay you more either to steal you away or simply because salary history determines compensation in HR’s formula.
  • unemployment. Jobless today, jobless tomorrow. Those who are unemployed for more than six months are even more likely to be unemployed for the long term. Also people who take care of their own kids as their job are likely to still be doing so next week and next year rather than working for a company.
  • likelihood of cancer. Back to the subject of smoking, your likelihood of getting cancer accumulates faster and faster the more you smoke. I’ve seen claims that there is a kink in the cumulative propensity to cancer rate above one pack / day.
  • stock prices. Stocks don’t just jump around in a Cauchy distribution, although maybe the daily change in stock price does. Daily change is a lag term  so that’s serial correlation.

Serial correlation or autocorrelation refers to things that bunch together. When it rains, it pours.




The VIX has a daily autocorrelation of −.04, a weekly autocorrelation of −.21, and a monthly autocorrelation of −.12.
Euan Sinclair, Volatility Trading