Listing entries tagged with peer_review

the future of academic publishing, peer review, and tenure requirements   01.06.2006, 12:54 PM

There's a brilliant guest post today on the Valve by Kathleen Fitzpatrick, english and media studies professor/blogger, presenting "a sketch of the electronic publishing scheme of the future." Fitzpatrick, who recently launched ElectraPress, "a collaborative, open-access scholarly project intended to facilitate the reimagining of academic discourse in digital environments," argues convincingly why the embrace of digital forms and web-based methods of discourse is necessary to save scholarly publishing and bring the academy into the contemporary world.

In part, this would involve re-assessing our fetishization of the scholarly monograph as "the gold standard for scholarly production" and the principal ticket of entry for tenure. There is also the matter of re-thinking how scholarly texts are assessed and discussed, both prior to and following publication. Blogs, wikis and other emerging social software point to a potential future where scholarship evolves in a matrix of vigorous collaboration -- where peer review is not just a gate-keeping mechanism, but a transparent, unfolding process toward excellence.

There is also the question of academic culture, print snobbism and other entrenched attitudes. The post ends with an impassioned plea to the older generations of scholars, who, since tenured, can advocate change without the risk of being dashed on the rocks, as many younger professors fear.

...until the biases held by many senior faculty about the relative value of electronic and print publication are changed—but moreover, until our institutions come to understand peer-review as part of an ongoing conversation among scholars rather than a convenient means of determining “value” without all that inconvenient reading and discussion—the processes of evaluation for tenure and promotion are doomed to become a monster that eats its young, trapped in an early twentieth century model of scholarly production that simply no longer works.

I'll stop my summary there since this is something that absolutely merits a careful read. Take a look and join in the discussion.

Posted by ben vershbow at 12:54 PM | Comments (0)
tags: Education , Publishing, Broadcast, and the Press , academia , e-publishing , monograph , peer_review , publishing , scholarship , university

ElectraPress   12.12.2005, 2:36 AM

Kathleen Fitzpatrick has put forth a very exciting proposal calling for the formation of an electronic academic press. Recognizing the crisis in academic publishing, particularly with the humanities, Fitzpatrick argues that:

The choice that we in the humanities are left with is to remain tethered to a dying system or to move forward into a mode of publishing and distribution that will remain economically and intellectually supportable into the future.

i've got my fingers crossed that Kathleen and her future colleagues have the courage to go way beyond PDF and print-on-demand; the more Electrapress embraces new forms of born-digital documents especially in an open-access pubishing environment, the more interesting the new enterprise will be.

Posted by bob stein at 02:36 AM | Comments (1)
tags: Publishing, Broadcast, and the Press , academia , e-publishing , ebooks , peer_review , publishing , university

tipping point?   12.08.2005, 7:36 AM

An article by Eileen Gifford Fenton and Roger C. Schonfeld in this morning's Inside Higher Ed claims that over the past year, libraries have accelerated the transition towards purchasing only electronic journals, leaving many publishers of print journals scrambling to make the transition to an online format:

Faced with resource constraints, librarians have been required to make hard choices, electing not to purchase the print version but only to license electronic access to many journals — a step more easily made in light of growing faculty acceptance of the electronic format. Consequently, especially in the sciences, but increasingly even in the humanities, library demand for print has begun to fall. As demand for print journals continues to decline and economies of scale of print collections are lost, there is likely to be a tipping point at which continued collecting of print no longer makes sense and libraries begin to rely only upon journals that are available electronically.

According to Fenton and Schonfeld, this imminent "tipping point" will be a good thing for larger publishing houses which have already begun to embrace an electronic-only format, but smaller nonprofit publishers might "suffer dramatically" if they don't have the means to convert to an electronic format in time. If they fail, and no one is positioned to help them, "the alternative may be the replacement of many of these journals with blogs, repositories, or other less formal distribution models."

Fenton and Schonfeld's point that electronic distribution might substantially change the format of some smaller journals echoes other expressions of concern about the rise of "informal" academic journals and repositories, mainly voiced by scientists who worry about the decline of peer review. Most notably, the Royal Society of London issued a statement on Nov. 24 warning that peer-reviewed scientific journals were threatened by the rise of "open access journals, archives and repositories."

According to the Royal Society, the main problem in the sciences is that government and nonprofit funding organizations are pressing researchers to publish in open-access journals, in order to "stop commercial publishers from making profits from the publication of research that has been funded from the public purse." While this is a noble principle, the Society argued, it undermines the foundations of peer review and compels scientists to publish in formats that might be unsustainable:

The worst-case scenario is that funders could force a rapid change in practice, which encourages the introduction of new journals, archives and repositories that cannot be sustained in the long term, but which simultaneously forces the closure of existing peer-reviewed journals that have a long-track record for gradually evolving in response to the needs of the research community over the past 340 years. That would be disastrous for the research community.

There's more than a whiff of resistance to change in the Royal Society's citing of 340 years of precedent; more to the point however, their position statement downplays the depth of the fundamental opposition between the open access movement in science and traditional journals. As Roger Chartier notes in a recent issue of Critical Inquiry, "Two different logics are at issue here: the logic of free communication, which is associated with the ideal of the Enlightenment that upheld at the sharing of knowledge, and the logic of publishing based on the notion of author's rights and commercial gain."

As we've discussed previously on if:book. the fate of peer review in electronic age is an open question: as long as peer review is tied to the logic of publishing, its fate will be determined at least as much by the still evolving market for electronic distribution as by the needs of the various research communities which have traditionally valued it as a method of assessment.

Posted by lisa lynch at 07:36 AM | Comments (0)
tags: Education , Libraries, Search and the Web , library , peer_review , publishing , royal_society_of_london

blogging and the true spirit of peer review   11.17.2005, 3:27 PM

Slate goes to college this week with a series of articles on higher education in America, among them a good piece by Robert S. Boynton that makes the case for academic blogging:

"...academic blogging represents the fruition, not a betrayal, of the university's ideals. One might argue that blogging is in fact the very embodiment of what the political philosopher Michael Oakshott once called "The Conversation of Mankind"—an endless, thoroughly democratic dialogue about the best ideas and artifacts of our culture.

...might blogging be subversive precisely because it makes real the very vision of intellectual life that the university has never managed to achieve?"

The idea of blogging as a kind of service or outreach is just beginning (maybe) to gain traction. But what about blogging as scholarship? Most professor-bloggers I've spoken with consider blogging an invaluable tool for working through ideas, for facilitating exchange within and across disciplines. But it's all decidedly casual. And that's part of what makes it such fun. But to gain acceptance in the academy, there have to be standards. There have to be barriers to entry. Traditionally, that's what peer review has been for. Can there be some sort of peer review system for blogs?

Boynton has a few ideas about how something like this could work (we're also wrestling with these questions on our back porch blog, Sidebar, with the eventual aim of making some sort of formal proposal). Whatever the technicalities, the approach should be to establish a middle path, something like peer review, but not a literal transposition. Some way to gauge and recognize the intellectual rigor of academic blogs without compromising their refreshing immediacy and individuality -- without crashing the party as it were.

There's already a sort of peer review going on among blog carnivals, the periodicals of the blogosphere. Carnivals are rotating showcases of exemplary blog writing in specific disciplines -- history, philosophy, science, education, and many, many more, some quite eccentric. Like blogs, carnivals suffer from an unfortunate coinage. But even with a snootier name -- blog symposiums maybe -- you would never in a million years confuse them with an official-looking peer review journal. Yet the carnivals practice peer review in its most essential form: the gathering of one's fellows (in this case academics and non-scholar enthusiasts alike) to collectively evaluate (ok, perhaps "savor" is more appropriate) a range of intellectual labors in a given area. Boynton:

In the end, peer review is just that: review by one's peers. Any particular system should be judged by its efficiency and efficacy, and not by the perceived prestige of the publication in which the work appears.

If anything, blog-influenced practices like these might reclaim for intellectuals the true spirit of peer review, which, as Harvard University Press editor Lindsay Waters has argued, has been all but outsourced to prestigious university presses and journals. Experimenting with open-source methods of judgment—whether of straight scholarship or academic blogs—might actually revitalize academic writing.

It's unfortunate that the accepted avenues of academic publishing -- peer-reviewed journals and monographs -- purchase prestige and job security usually at the expense of readership. It suggests an institutional bias in the academy against public intellectualism and in favor of kind of monastic seclusion (no doubt part of the legacy of this last great medieval institution). Nowhere is this more apparent than in the language of academic writing: opaque, convoluted, studded with jargon, its remoteness from ordinary human speech the surest sign of the author's membership in the academic elite.

This crisis of clarity is paired with a crisis of opportunity, as severe financial pressures on university presses are reducing the number of options for professors to get published in the approved ways. What's needed is an alternative outlet alongside traditional scholarly publishing, something between a casual, off-the-cuff web diary and a polished academic journal. Carnivals probably aren't the solution, but something descended from them might well be.

It will be to the benefit of society if blogging can be claimed, sharpened and leveraged as a recognized scholarly practice, a way to merge the academy with the traffic of the real world. The university shouldn't keep its talents locked up within a faltering publishing system that narrows rather than expands their scope. That's not to say professors shouldn't keep writing papers, books and monographs, shouldn't continue to deepen the well of knowledge. On the contrary, blogging should be viewed only as a complement to research and teaching, not a replacement. But as such, it has the potential to breathe new life into the scholarly enterprise as a whole, just as Boynton describes.

Things move quickly -- too quickly -- in the media-saturated society. To remain vital, the academy needs to stick its neck out into the current, with the confidence that it won't be swept away. What's theory, after all, without practice? It's always been publish or perish inside the academy, but these days on the outside, it's more about self-publish. A small but growing group of academics have grasped this and are now in the process of inventing the future of their profession.

Posted by ben vershbow at 03:27 PM | Comments (3)
tags: Education , academic , academy , authority , blogging , blogs , higher_ed , higher_education , peer_review , publishing , scholar , teaching , tenure , university

the blog carnival   10.11.2005, 7:18 AM

The Chronicle of Higher Education ran a good piece last week by Henry Farrell -- "The Blogosphere As A Carnival of Ideas" -- looking at the small but growing minority of scholars who have become bloggers. Farrell is a poli sci professor at George Washington, and a contributor to the popular group blog Crooked Timber. He argues from experience how blogs have invigorated scholarly exchange within and across fields, allowing for a more relaxed discourse, free of the jargon and stuffy manner of journals. In some cases, blogs have enabled previously obscure academics to break beyond the ivory tower to connect with a large general readership hungry for their insight and expertise.

What Farrell neglects to mention -- which is surprising given the title of the piece -- is the phenomenon of the "blog carnival," an interesting subculture of the web that has been adopted in certain academic, or semi-academic, circles. A blog carnival is like a roving journal, a rotating showcase of interesting writing from around the blogosphere within a particular discipline. Individual bloggers volunteer to host a carnival on their personal blog, acting as chief editor for that edition. It falls to them to collect noteworthy items, and to sort through suggestions from the community, many of which are direct submissions from authors. On the appointed date (carnivals generally keep to a regular schedule) the carnival gets published and the community is treated to a richly annotated feast of new writing in the field.

Granted, not all participating bloggers are academics. Some are students, some simply enthusiasts. Anyone with a serious interest in the given area is usually welcome. Among the more active blog carnivals are Tangled Bank, a science carnival currently in its 38th edition, the Philosophers' Carnival, whose 20th edition was just posted this past Sunday, and the History Carnival, currently in its 17th edition.

Here's a small taste from the most recent offering at History Carnival, hosted by The Apocalyptic Historian:

New Deal liberalism has been on the minds of politicians lately. Hiram Hover posts about the recent talk of New Deal analogies from politicians in deciding how to help the victims of Katrina in “Responding to Katrina: Is History Any Guide?” Caleb McDaniel at Mode for Caleb draws a startling historical parallel between the 1793 yellow fever epidemic in Phildelphia and New Orleans after Katrina in 2005.

In a comparison of another of Bush’s crises in the making, Jim MacDonald revisits the history of the Sepoy Rebellion with comments on the current situation in Iraq. Meanwhile Sepoy contributes to a recent attempt to compile the views Westerners have about Islam at Chapati Mystery.

How many times have humans believed the world was coming to an end? Natalie Bennett reviews a recent work on the Anabaptist takeover of Münster in 1534, when the belief in the impending apocalypse sent that city into chaos.

Most carnivals have a central site that indexes links to past editions and provides a schedule of upcoming ones, but the posts themselves exist on the various blogs that comprise the community. Hence the "carnival" -- a traveling festival of ideas, a party that moves from house to house. Participating blogs generally display a badge on their sidebar signaling their affiliation with a particular collective.

Though carnivals keep to a strict schedule, but there is no mandated format or style. Host bloggers can organize the material however they choose, putting their own personal spin or filter on the current round -- just as long as they stick to the overall topic. The latest issue of Carnivalesque, a monthly circuit on medieval and early modern history, shows how far some hosts will go -- styled as a full magazine, the October issue is complete with a mock cover, a letter from the editor, and links organized by section.

The concept of the carnival seems to have originated in 2002 with "The Carnival of the Vanities," which for a while served as a venue for bloggers to promote their best writing -- a way of fighting the swift sinking of words in a sea of rapidly updating blogs. It's not surprising that the idea was then taken up by academic types, since the carnival model, in its essence, rather jives with the main warranting mechanism of all scholarly publication: peer review. It's a looser, less formal peer review to be sure, but still operates according to the ethos of the self-evaluating collective.

It's worth paying attention to how these carnivals work because they provide at least part of the answer to a larger concern about the web: how to maintain quality and authority in a flood of amateur self-publishing. In the cycle of the carnival, blogging becomes a kind of open application process where your best work is dangled in the path of roving editors. You might say all bloggers are roving editors, but these ones represent an authoritative collective, one with a self-sustaining focus.

So the idea of the carnival, refined and sharpened by academics and lifelong learners, might in fact have broader application for electronic publishing. It happily incorporates the de-centralized nature of the web, thriving through collaborative labor, and yet it retains the primacy of individual voices and editorial sensibilities. Again, you might point out that its formula is far from unique, that this is in fact the procedure of just about any blog: find interesting stuff on the web and link to it with a few original comments. But the carnival focuses this practice into a regular, more durable form, providing an authoritative context that can be counted on week after week, even year after year. Sounds sort of like a magazine doesn't it? But its offices are constantly in flux, its editorial chair a rotating one. I'm interested to see how it evolves. If blogs in cyberspace are like the single-cell organism in the primordial porridge, might the carnival be a form of multi-cell life?

Posted by ben vershbow at 07:18 AM | Comments (7)
tags: Education , academia , academic , academy , aggregation , blog , blog_carnival , blogging , blogs , carnival , early_modern , history , journal , medieval , peer_review , philosophy , publishing , reading , science , university , writing