Correlation with P-Value & Confidence Interval [pig]

1919 görüntülenme
Pearson correlation coefficient measures the linear correlation between two variables. It has a value between +1 and −1, where 1 is total positive linear correlation, 0 is no linear correlation and −1 is total negative linear correlation. It’s often denoted by r for sample correlation and ρ for population correlation.

Note: Pearson Correlation only measures the linear relationship between two variables, such as y = a*x + b. There are other measurements for nonlinear correlations.

When option “R” for "Correlation variants" is chosen, the value would be the same as TradingView's built in correlation() function. For "Adjusted R ", the calculation is based on the traditional Pearson. The sample r is a biased estimate of population ρ. The adjusted r gets rid of some of the bias but not all. As the sample size or lookback period increases, adjusted r will be closer to r.

The confidence interval is computed for population ρ estimation based on sample r. Correlation coefficient itself doesn’t follow a normal distribution. Fisher transformation is applied to transform the data into an approximately normal distribution. We compute the standard error based on the transformed data, then use an inverse fisher transform to transform back the standard error in terms of r.

Note: the confidence interval band is an approximation of population, it proposes a range of plausible r values (instead of a point). The confidence level represents the frequency (i.e. the proportion) of possible confidence intervals that contain the true value of the unknown population parameter. The proportion of those intervals that contain the true value of the parameter will be equal to the confidence level. For example, if the confidence level is 95% then in hypothetical indefinite data collection, in 95% of the samples the interval estimate will contain the population parameter. The default setting is 1.96* standard error which is 95% confidence interval.

The most important and distinguishable feature of this indicator is the p-value provided along with the correlation.

The value of Correlation Coefficient alone doesn’t provide any information regarding its statistical significance. For example, two sets of independent samples have 0 correlation in theory. However, your correlation coefficient on these samples will never actually show 0 correlation (small correlation value but not 0). Therefore without a significance test, one would be fooled by the value of r when there’s no linear relationship at all.

In statistical hypothesis testing, the p-value or probability value is the probability of obtaining test results at least as extreme as the results actually observed during the test, assuming that the null hypothesis is correct. The smaller the p-value, the stronger the evidence that the null hypothesis should be rejected and that the alternate hypothesis might be more credible. Since one could be deceived by r showing values while correlation is actually 0. The null hypothesis here is the “r is 0”. The alternative hypothesis is “ r is not 0”. The default setting for p critical value is 0.05. It means that when p is lower than 0.05, there’s less than 5% chance that correlation is 0, and we consider that to be "significant correlation". To get the p-value, We use a t distribution with n – 2 degrees of freedom to find the probability. P-value will adjust automatically when the sample size or lookback changes.

Displays :
When p is lower than 0.05 and r > 0, correlation coefficient shows red, p-value shows yellow, panel shows “Significant Positive Correlation”.
When p is lower than 0.05 and r < 0, correlation coefficient shows green, p-value shows yellow, panel shows “Significant Negative Correlation”.
When p is higher than 0.05, correlation, correlation coefficient shows white, p-value shows grey, panel shows “Insignificant Correlation”.

r² (r squared) also known as the coefficient of determination, is the square of correlation r. r² measures how well the data fit the linear regression model used in correlation. When two assets show significant correlation, r squared can be used to compare which one fits the data better. r² is displayed on the panel and has a different lookback by default than the correlation coefficient .

Contributors : Pig (ideas, code, math and design), Balipour (ideas), midtownsk8rguy(applying/employing Pine etiquette).
Sürüm Notları: minor fix to adjust panel's positioning.
Sürüm Notları: added feature to assist the visually impaired.
Sürüm Notları: Modified the security() function to avoid lookahead bias.
Sürüm Notları: removed the mtf function.
Sürüm Notları: update to modify default position of the panel.

Yorumlar

Awesome script. Thanks Bali+Pig :)

Congrats on being featured in the best scripts of the month!
Cevap Gönder
This publication will be featured in our "Best Scripts of The Month" selection. Thank you for your valuable contribution to the TradingView community, and congrats!
Cevap Gönder
Amazing! It would be great if you make something like this with financial multipliers. Or maybe you would make optimal hedge portfolio with covariation matrix.
Cevap Gönder
I'm sure this is an amazing indicator and I've heard great things about the developers and love pig's ISI EMA. BUT the technicals on this one is so far above my layman thinking that I have no idea how to use it.
@balipour, is there any sort of tutorial of video on YouTube that shows how to use this indicator?? Appreciate it.
Cevap Gönder
Long live the PIG. This is by far the most efficient tool out there. Utilizing a 95% confidence level to test the trend is amazingly practical. Correlation and R^2 are also vital measurements that this indicator includes. Well done. Looking forward to seeing more features.
Cevap Gönder
What the bleep; only 360 odd subscribers! How'zit my brother...my comment will bring you great prosperity and happiness *laughs* I love you...grab Steph and show her why she's with you...see ya in the chats. Oh; indicator looks boss as per usual in the bali style.

Rap
Cevap Gönder
🐷
Cevap Gönder
Thanks for this
Cevap Gönder
pretty much thanks for that one mate
Cevap Gönder
As a fellow mathematician, I can say this is well made. Whether it translates into making better trades, i'm not so sure.
Cevap Gönder