New York – We have been writing on aspects of informational alpha, or synthetic returns of research providers for about 5 years now. One might think that we have exhausted our ability to analyze research provider returns in new and exciting ways, but this underestimates our geekiness.
In the table, there are six columns of numbers. The first three columns are directly from the Investars system and relate to the absolute returns produced by the recommendations of the top research providers. The second three columns attempt to analyze the same numbers, but only for those recommendations that were directionally correct. This is done by dividing the returns by the number of recommendations that actually moved in the right direction (utilizing the batting averages).
But research provider recommendations always have some right and some wrong calls. Why on earth should we give them credit only for the recommendations they get right? The answer is related to the conviction of the recommendations. By necessity, recommendations are translated into a three category rating system by Investars, so that the firms can be compared to one another on an equivalent basis. However, many firms have differing recommendation structures. For example, one firm many have strong buy, buy, neutral, sell and strong sell. As well, quantitative firms tend to rank stocks in deciles. Obviously, the tails of the distribution, say the top and bottom deciles are more likely to move in the expected direction than are say the top and bottom 3 deciles.
While we cannot recreate a more granular rating system, we can make an assumption, that a larger proportion of the returns from correct calls are generated by those calls in which the research provider has stronger conviction.
Research Provider |
Returns in Basis points per day |
Returns per Correct Call |
||||
B-S |
Buy |
Sell |
Buy |
Sell |
B-S |
|
B Riley & Co |
65.17 |
1.66 |
-63.51 |
3.36 |
-70.57 |
73.93 |
Ativo Research |
17.93 |
9.62 |
-8.31 |
19.65 |
-16.61 |
36.26 |
Sandler O`Neill |
21.27 |
-3.01 |
-24.28 |
-6.51 |
-27.45 |
20.94 |
Market Profile Theorems |
9.48 |
7.11 |
-2.37 |
15.90 |
-3.84 |
19.74 |
Rochdale |
8.91 |
-0.95 |
-9.86 |
-1.89 |
-14.83 |
12.94 |
DA Davidson & Co |
12.15 |
-5.56 |
-17.71 |
-14.77 |
-25.71 |
10.94 |
Northland Securities |
6.02 |
1.07 |
-4.95 |
2.33 |
-8.07 |
10.40 |
Keefe Bruyette & Woods |
10.11 |
-5.46 |
-15.57 |
-12.61 |
-21.73 |
9.13 |
Janney Montgomery Scott |
8.78 |
-4.16 |
-12.94 |
-10.21 |
-18.98 |
8.77 |
Caris & Company |
14.26 |
-4.79 |
-19.05 |
-13.52 |
-21.54 |
8.02 |
Stifel Nicolaus |
9.80 |
-4.73 |
-14.53 |
-13.50 |
-20.59 |
7.08 |
Hilliard Lyons |
12.42 |
-4.55 |
-16.97 |
-14.01 |
-19.80 |
5.79 |
Wedbush Morgan |
3.00 |
4.38 |
1.38 |
8.31 |
2.96 |
5.36 |
Ford Equity Research |
0.87 |
-1.56 |
-2.43 |
-3.15 |
-4.23 |
1.08 |
Dougherty & Co |
1.29 |
-2.69 |
-3.98 |
-6.94 |
-7.96 |
1.02 |
Audit Integrity, Inc |
1.45 |
-2.61 |
-4.06 |
-6.31 |
-7.08 |
0.77 |
Pacific Crest |
1.57 |
-2.52 |
-4.09 |
-6.70 |
-6.54 |
-0.16 |
WR Hambrecht |
9.22 |
-4.67 |
-13.89 |
-14.75 |
-13.89 |
-0.86 |
Standpoint Research |
0.41 |
-3.77 |
-4.18 |
-9.23 |
-8.36 |
-0.87 |
Analysis of the Returns per Correct Recommendation
By this admittedly clunky logic, the B-S column on the far right of the table represents the overall returns of the research providers’ from the calls that were in the correct direction. B. Riley & Co. was the winner by a long shot, racking up nearly 74 basis points per day in the year ended July 2009, and more than doubling the next closest provider. Ativo Research was second in line with 36 basis points return and Sandler O’Neil came in third, with a return of about 21 basis points per day. Market Profile Theorems, Rochdale, DA Davidson and Northland Securities all produced double digit returns.
Another interesting insight from the data is the contribution of buy and sell recommendations to the overall return. For example, B. Riley & Co. had a very strong overall return, mostly based on the sell portfolio. Ativo Research had roughly equal contributions from the buy and sell portfolios and racked up the strongest return on its buys of any firm. Market Profile Theorems’ 19 basis point per day return was dominated by the buy recommendation portfolio of the firm. Market Profile Theorems’ buy portfolio provided over 80% of the total return produced.
Despite the obvious assumptions applied to this analysis, the results remain interesting and helpful to the analysis of overall performance and informational alpha provided by the research providers presented.
Note: The performance data is from Investars. The analysis and conclusions are Integrity’s.
1 Comment
“While we cannot recreate a more granular rating system, we can make an assumption, that a larger proportion of the returns from correct calls are generated by those calls in which the research provider has stronger conviction.”
I think that is an assumption too far. The behavioral finance literature shows that overconfidence often leads to errors; is there a reason why “conviction” recommendations from research providers should be exempt from that? I don’t think so, because my observation of asset managers and research providers over the years has provided too many concrete examples of stronger conviction recommendations or positions being detrimental to performance. Too often “experts” are even more susceptible to the pitfalls of overconfidence, because they believe they are immune due to their expertise.
I agree that this all is worth further study, and I believe that you will find that one dividing line in the analysis that will be of interest is “quantitative” versus “fundamental.” The patterns that emerge regarding those more confident recommendations (or, in the case of an asset manager, larger weights) vary considerably by the nature of the methodology employed.