I laugh a lot when I see mixed prior results as a motivation for a study UNLESS is accompanied by an analysis of the likely “root causes” of those mixed results. Yet study after study is allowed to be published based on the dubious premise that yet another study, in a void by itself, will tell us something about prior research’s mixed results.
So I propose a simple criteria for my fellow editors – make every author who claims mixed results as a motivator for their work to provide a detailed root cause analysis and show how the current study will address those root causes! If the study does not, then do not let the mixed results argument as a motivation for the paper, only as factoid. For without an attempt at a “root cause” analysis, all the authors of the current paper have done is add another confusing data point to what is an already confused picture.
In the world of allowing “mixed results” to stand as a motivation for just another data point, no wonder some (most or indeed near all) social constructivists (also known as interpretivists) researchers in accounting suggest that positivist research has “failed” in its mission to produce a large number of empirically supported theoretically based regularities.
My belief is that with a wee bit more work, we could list many more empirically supported theoretically based conclusions in our research in financial accounting and auditing (and likely other areas of accounting research as well). Why do I highlight financial accounting and auditing? Because they are the closest to areas where we as accounting academics have the potential to inform society about the evidence basis for rules and standards and allowing such mixed results to stand and be added to without any attention to root causes of differences detracts from what the evidence could really show.
Robert Frank wrote a book many years ago (1987 or so) entitled “Choosing the right pond: Human behavior and the quest for status.” He argues that people control their happiness by selecting the “pond” that is right for them and working at the level that gets them to a an appropriate fish size for the pond. Unhappiness comes from choosing (or desiring) to be in one “pond” but wanting to live like one is in another.
We encounter this issue in academia, especially with younger academics. I did a session with doctoral students a few weeks ago and I posed the question – define your ideal mentor. many of them had mentors that they believed exhibited “work-life balance.” These mentors, many of whom I knew, were current high performers being well compensated for doing what they enjoyed at top research universities while also taking the time to live life! They were big fish in big ponds for the most part!
But what these young doctoral students did not think about is that their mentors had gained the privilege by working their way up from being a small but growing fat to bring a big fish in this big pond, they did not just get that status by turning up. These folks has got to a point where they were big fish having passed the tests, met numerous challenges, contributing greatly and showing strong evidence of a future of continuing to be a big fish. In other words, they had grown up to be big fish to be in the big pond.
The key to note is they did not arrive at the big pond as a big fish. They spent years of totally out of balance life growing into being a big fish that permitted them flexibility and exhibit work life balance today! Why could they not have had balance from the start? Because no one who wants to be considered among the best can fast track or take short cuts through the 10000 to 15000 hours it takes to have a chance of becoming a big fish (and note this is a ” chance” not a guarantee).
The moral of the story, if young researchers want the types of rewards given at top research schools recognize that lack of balance goes with the territory, especially in the first decade! Just as sports greats stay on the field longer, chess grandmasters play more games and study them carefully, and as great ballet dancers practice long hours, if you want to be a big fish in a big pond, there is a price to pay. Second, even if you want to be in that big pond and are willing to live that unbalanced life when you are a little fish, just as every athlete, chess master and performer knows, you still might not make it due to talent and/ or luck.
Or maybe I am just all wet!!!!
One of my teachers at the undergrad level and now a member of the International Accounting Standards Board (wow that is a long way from Mount Allison University) is noted for saying that as accounting researchers “we are not looking for the cure to cancer!”
What he was NOT doing was saying our research was unimportant! What he was saying is that as social science researchers we need to 1. Get it right and 2. Write it clearly and persuasively.
My added observation is that for most of us getting papers in top journals is hard to do. The number of ideas we have that put us into a position to get into those journals is likely limited ( I can say this readily with one JAR for seven submissions, four TARs for eleven submissions, five for eight at CAR, eight for eleven at AOS etc).
So, for good ideas we need to think long term and not rush them into journal submission especially when the feedback from peers at conferences and workshops is “great idea package it better”. Years ago Larry Brown did a study that showed papers exposed at workshops and conferences did better at senior journals! BUT this result is NOT by magic! It means take the authors needed to revise, revise, revise if they were to get published in senior journals!
So, I do not know about you, but I can tell you from this side of the desk, I have too few good ideas to waste them by submitting papers early only to get them rejected!