When more with less might just be possible

Stephen Moss has just written an excellent post on the impossibility of fulfilling the government’s platitude that we should ‘do more with less’ – good science requires a certain level of resources, in terms of equipment, consumables and personnel, and if you reduce them, your will inevitably get less. It’s impossible to argue with this logic, and I don’t intend to; generally, we’re all working just about as efficiently as we can. But that doesn’t mean that there aren’t other cogs in the great machine of science administration that are not as effective as they might be. This suggests that there are ways in which we might be able to make more from less. In particular, I’m thinking of the whole unwieldy process of applying for funding through the UK research councils. My main experience is with the NERC, but I gather things are similar with the other main councils. Now, any post moaning about science funding has to tread a fine line between legitimate gripes and sour grapes, so let me state at the outset that of course I understand that more grant proposals are submitted than will ever get funded, that success rates typically hover between 5 and 20%, that many of those which are unsuccessful fall well within the ‘fundable’ bracket in terms of quality, and that one should expect disappointment when submitting an application. This is not a whinge about not getting funded. What comes below is rather a distillation of conversations I’ve had with numerous colleagues at differing career stages, and with varying levels of success in winning funding.

The gripe is more to do with the time involved in chasing these unlikely pots of money. As Bob highlighted recently, we tend to be obsessed with the question, ‘Am I wasting my time?’ In terms of writing grant applications, when you add up the amount of time potentially involved, this becomes a really serious question. At a rough estimate, writing a full standard grant proposal probably takes a month of more-or-less full time work (that’s in addition to having the idea, and following initial discussions with potential collaborators, any preliminary work, etc.). This will involve not only preparing a detailed science plan (generally 8 pages for NERC), but also calculating an exact budget, securing letters of support, writing an impact plan, and so on and on. Given that your typical academic will be expected by his or her employer to hit most deadlines, this adds up to perhaps 3 months in the year being dedicated to writing applications, at least 4 in 5 of which will not be funded, and perhaps 2-3 in 5 will not even reach external peer review.

This seems to me to be a colossal waste of time, both for those writing the applications, and for those who have to read and review the damn things. Given last year’s success in persuading the UK government that science is vital, the economics are also ludicrous: up to a quarter of the working life of UK scientists is spent on a fruitless activity. (As a cynical aside, the commonly-voiced belief that you generally only get a proposal funded if you’ve already done most of the work suggests that there’s a certain amount of wasted time involved even with a successful application.)

Two obvious routes seem open to reduce this wastage. First, reduce the amount of work involved with preparing an application. Does the council really need to know the minutiae of my proposed budget, experimental methods, and so on, in order to make an initial assessment of whether or not the core idea is a good one? I don’t think so, which is why I favour the idea of pre-proposals: a couple of pages with an outline of the question to be tackled, very brief methodology and a rough outline budget. You could get rid of 50-60% of proposals at this stage – which still wouldn’t be fair, but would massively reduce the amount of time required to produce a proposal whose fate is to be unfairly binned. Some organisations (e.g. the Leverhulme Trust) already use this system.

Second, reduce the number of submissions. Various means have been proposed to this end, perhaps most notoriously the EPSRC so-called blacklist, whereby researchers with a certain number of unsuccessful applications would be barred from applying for a set amount of time. I actually favour the opposite approach, whereby we have a full accounting of the time committed by academics to research projects, with a limit at perhaps 30% (which would equate to, say, being PI on one project, at 20% of your time, and Co-I on a couple more). There would be some flexibility, in case you were unexpectedly successful in concurrent schemes; but once you hit or exceed that limit, the (reasonable) assumption would be that you had insufficient time left to devote to any further projects, at least in a costed capacity. Such a scheme is quite common in organisations like government research institutes, but I’m not aware of it being prevalent in Universities at all.

Together, these measures would, I believe, allow academics to focus more intensively on a smaller number of projects, and would result in the quality (if not the quantity) of scientific output increasing. So with fewer resources, less would certainly get done; but with a few changes in how we chase the diminishing resources, it just might get done better.

Christmas Post

It was a toss-up whether to post a comprehensive and insightful review of 2010’s scientific highs and lows, or a couple of funny YouTube clips. YouTube won… First, here’s one from Armstrong & Miller, for everyone shivering in Britain’s frigid December (or anywhere else), who has had cause while de-icing a car or thawing out a boiler to question the fact that 2010 is set to be the hottest year on record:

And this is an oldie from Big Train, showing that non-scientists are very much aware of what we get up to:

And finally…

When my son was born last month, he had to spend a couple of nights in the special care unit. Fortunately for us, this was largely a precautionary measure, but some of the little mites in there were really, really poorly – many of them born 8 or more weeks premature. But for the SCU, keeping these tiny people alive and eventually discharging them to live normal lives is pretty routine. I couldn’t help but be staggered by the sheer amount of knowledge embedded in the paraphernalia of neonatal intensive care, from the basic science of baby biology, to the technological know-how required to design and build the necessary hardware and software. It was a humbling dose of humanity at its very best, with science and technology wedded to the wonderfully caring, supporting and capable staff; for me a vision of what we can achieve if everyone pulls in the same direction. I can’t think of a better note on which to wish you all a very Happy Christmas.

Information vs. understanding: Wikileakising the news

So I fire up the computer again after my statutory two weeks, only to catch the tail end of a diplomatic crisis. Apparently Wikileaks have released a load of stolen cables too, and it’s this latter (clearly less significant) scandal that I’d like to comment on. I know it may border on heresy to express this opinion online, but personally I am deeply concerned about the wikileakisation of the news (to coin an appropriately ugly term). It’s been going on a lot recently, and the fact that the latest leak happens to embarrass people whom I rather dislike= should not disguise the similarities with so-called climategate last year. I wrote then about the right of scientists to be indiscreet in their private communications, which in fact boils down to the simpler statement that I believe that lines of private, written communications should exist. Diplomats perhaps shouldn’t have the same license for indiscretion (the clue’s in the name), but quoting selected morsels of communications which are removed from all context is no way to understand the world.

Let me expand. I rely for my research on data collected by other people – often very large cooperatives of other scientists. And the first tenet of data-driven science is that data without metadata is useless. ‘Metadata’ is simply data about data: so for instance, it might be a document describing the column headings in a spreadsheet, or the field protocols used to collect the data (with information on known biases and so on). Presented only with the raw data, I can run fancy statistical models to my heart’s content, but the results will be completely devoid of meaning. I would never get such analyses published unless I could demonstrate a clear understanding of the scope and limitations of the data. To the extent that I could ever be considered an ‘expert’, this is my job: not simply to provide titbits (or even torrents) of information out of context, but to perform sensible analyses on the data and to interpret these in the context of what is known about the system. Of course, I am in favour of supporting any conclusion I might make with full access to the data and methods I used to arrive there, but that is somewhat different. Wikileakisation places the cart of data in front of the horses of professionsal competence. Were I a political journalist I would be ashamed of having my expertise undermined, but most seem content to report gossip as fact or insight.

As far as the clamour for complete disclosure, for absolute freedom of information goes, I would argue that simply spewing out data in an uncontrolled torrent is not complete disclosure. Quoting what diplomat x said about minor royal y to ambassador z does not fully inform us about the reality of the situation, not unless we understand the personal relationships involved, and the political context behind the communication.

In much the same way, in order to interpret a (hypothetical) email I sent along the lines of ‘this work is awful, we should try to make sure it is never published’ it would be essential to know whether I was addressing a good friend – and so to take it as a throwaway comment – or a senior academic editor with whom I had never shared a pint, wherein the implications would be somewhat different.

I think we could all agree that actively concealing information is rarely defensible (although more often so in diplomatic than in scientific circles). But at the same time, information is not understanding, and we should not confuse the two.

And I say this as a parent, so it must be true ;-)