Tag Archives: open science

Let’s improve the ASA/Sage journal author agreement

open

I have spoken well of the policy that permits authors to post preprint versions of their papers before submitting them to journals of the American Sociological Association. That means you can get your work out more broadly while it’s going through the review process. The rule says:

ASA authors may post working versions of their papers on their personal web sites and non-peer-reviewed repositories. Such postings are not considered by ASA as previous publication.

The policy goes on to ask that authors modify their posted papers to acknowledge publication if they are subsequently published. That’s all reasonable. This is why SocArXiv and other services offer authors the opportunity to link their papers to the DOI (record locator) for the published version, should it become available. This allows citation aggregators such as Google Scholar link the records.

Unfortunately, the good part of this policy is undermined by the ASA / Sage author agreement that authors sign when their paper is accepted. It transfers the copyright of the paper to ASA, and sets conditions under which authors can distribute the paper in the future. The key passage here is this:

1. Subject to the conditions in this paragraph, without further permission each Contributor may …

  • At any time, circulate or post on any repository or website, the version of the Contribution that Contributors submitted to the Journal (i.e. the version before peer-review) or an abstract of the Contribution.
  • No sooner than 12 months after initial publication, post on any non-commercial repository or website the version of the Contribution that was accepted for publication.

This is not good. It means that if you post a paper publicly, e.g., on SocArXiv, and then submit it to ASA, you can’t update it to the revised version as your paper moves through the process. Only 12 months after ASA publishes it can you update the preprint version to match the version that the journal approved.

This policy, if followed, would produce multiple bad outcomes.

One scenario is that people post papers publicly, and submit them to ASA journals for review. Over the course of the next year or so, the paper is substantially revised and eventually published, but the preprint version is not updated until a full year after that, often two years after the initial submission. That means readers don’t get to see the improved version, and authors have to live with people reading and sharing their unimproved work. This discourages people from sharing their papers in the first place.

In the other scenario, people update their preprints as the paper goes through the revision process, so they and their readers get the benefit of access to the latest work. However, when the paper is accepted authors are expected to remove from public view that revised paper, and only share the pre-review version. If this were feasible, it would be terrible for science and the public interest, as well as the author’s career interests. Of course, this isn’t really feasible — you can’t unring the bell of internet distribution (SocArXiv and other preprint services do not allow removing papers, which would corrupt the scholarly record.) This would also discourage people from sharing their papers in the first place.

So, what possible reason can there be for this policy? It is clearly intended to punish the public in order to buttress the revenue stream of Sage, which returns some of its profits to ASA, at the expense of our libraries, which pay for subscriptions to ASA journals.

I assume this policy is never enforced, as I’ve never heard of it, but I don’t know that for a fact. It’s also possible that whoever wrote the Publications policy I linked above didn’t realize that it contradicted the Sage author agreement, which basically no one reads. I also assume that such a policy does not in fact have any effect on Sage’s profits, or the profits that it kick backs to ASA. So it’s probably useless, but if it has any effects at all they’re bad, by discouraging people from distributing their work. ASA should change this author agreement.

I will be on the ballot for the ASA Publications Committee this spring. If elected, I will add making this change to my platform, which I outlined here. If I’m not elected, I’ll try to do this anyway.

Leave a comment

Filed under Me @ work

Philip Cohen’s ASA Publications Committee platform

open

The American Sociological Association’s Committee on Nominations invited me to stand for election to the ASA’s Committee on Publications. I accepted the invitation reluctantly, because I am pessimistic about the opportunities to make progress on the most pressing issues before ASA, which I discuss below. I think it’s likely we’ll be in better shape for making big decisions in a few years, after the economics of publishing have gotten worse and (hopefully) alternatives such as SocArXiv and Sociological Science have gotten stronger.

But I appreciate the invitation, and I think there is something to be gained even if all I can do is raise the issues, and help disseminate important information (and my opinions) to the membership. And of course I can’t predict the future, and what the other present and future committee members will do, so who knows. Plus, it’s as a chance to spend time with the interesting and dedicated members of the committee and ASA staff.

Note on conflict of interest

I am the director of SocArXiv, a non-profit, open source, open access paper server for the social sciences, which I founded with a group of sociologists and library community leaders. I don’t draw a salary as director of SocArXiv, but if I can get grants for the project I might use them to buy off some of my time (meaning my salary doesn’t go up, but I work on SocArXiv instead of teaching), so you could say I stand to gain from promoting SocArXiv. And one of my ambitions in that role is to have ASA work with SocArXiv, for example in the dissemination of preprints and postprints from ASA journals, conference papers, and possibly innovative new projects like open peer review. I hope serving on this committee will help me advance SocArXiv’s agenda as well as ASA’s. So if that makes you uncomfortable you might not want to vote for me. In that case you might also consider the similar conflicts of interest held by the committee members who are, were, or hope to be editors of journals Sage publishes for ASA, or who otherwise benefit in their careers from the paywalled publishing status quo in academia. We’re all trying to do what we think is right and get paid and at the same time.

Basic perspective

In 2016 I wrote a short essay about ASA and publishing, and my basic perspective hasn’t much changed. Here is the gist from that essay.

The scholarly communication system is broken, and ASA lives off the money that brokenness creates. According to the 2016 budget report (I don’t see an update to this), 35% of total revenue comes from journal operations. That is $2.2 million that came from institutional subscriptions (mostly paid by the libraries of colleges and universities where ASA members work), under the contract with Sage. Increasingly, these subscriptions are part of big “bundles” of journals, in which individual libraries have little say over what they’re actually buying. Publishing the journals, in turn, costs 11% of total expenses, or about $717,000. So journal publishing produces money for other things the association does.

At the same time, ASA — like other paywall publishers — is in an increasingly defensive position, as open access alternatives spread and the cost of technologically and legally defending the paywall increases under pressure from Sci-Hub (which I wrote about here) and various other breaches. In a quasi-official statement from the ASA, publications director Karen Edwards wrote that Sci-Hub, “threatens the well-being of ASA and our sister associations as well as the peer assessment of scholarship in sociology and other academic disciplines.” Without the paywall, she implied, peer review itself cannot survive. I disagree.

More generally, ASA staff has raised alarms about the sustainability of the current model. From the Publications Committee minutes in spring 2016:  “The possibility exists that the journal world may not be as profitable in the future as it is now. The journal marketplace is shifting, and will continue to do so, so Council and EOB should keep an eye on this revenue source.”

We know that free journals could be published for a fraction of what ASA and Sage now spend and reap (one of the major expenses of any paywall publisher is developing and maintaining the technology to keep publications out of the hands of non-paying customers). That would mean giving up a substantial share of the association’s current income. And of course, it’s not a simple task. The basic goal is a future in which scholarly societies, academic libraries, and granting agencies together pay for scholarly publication, and cut out the for-profit publishers. That is instead of universities and federal agencies paying for research twice — once for the researchers, and once again for their published output — and all of it gets to be open access. This requires some institutional mechanism for collecting and distributing the funds used to produce open-access research output. Such solutions will require creativity, collaboration, and hard work. Designing a new system is relatively easy, but moving today’s institutional actors in that direction is not.

Platform

Here’s what I’d like to do, more and less implausible. These are overlapping and not mutually exclusive.

1. Adopt TOP guidelines for ASA journals

The Center for Open Science has published Transparency and Openness Promotion (TOP) Guidelines. The guidelines are incremental.  With almost 5,000 signatories — journals and associations — they include eight standards, each with three levels of stringency. Journals select which standards they will adopt and a level of implementation for each, ranging from disclosure requirements to verified replications. For example, we could say ASA journals will encourage data and code for analyses be posted publicly and require a statement about whether they are or not. We could encourage publication of replication studies. And so on. Even at low levels of implementation, they set an important tone and direction. This could be done for all of ASA, or individual journal editorial boards could implement them. In addition, by assigning openness badges to journals, authors, or papers, we can symbolically reward open scholarship practices.

2. Adopt preprints and data sharing

When people submit papers for ASA journals, they should be encouraged or required to post them on a public server (such as SocArXiv), along with data and code. When papers are published they can be linked to the preprints, ensuring readers are let to the final versions, while disseminating the research earlier, and free. As a model, consider the American Psychological Association, which has designated a preferred preprint server (PsyArXiv) and data archive (the Center for Open Science, which hosts SocArXiv and PsyArXiv).

3. Open conference papers

ASA requires complete papers be submitted for presentation at the annual meetings. We should make these papers available in a public archive, properly identified and preserved as part of the scholarly record. This is a key step in developing the working paper culture in sociology.

4. No new paywall journals

I will oppose the creation of any new paywalled journals, by ASA or its sections.

5. Flip ASA journals

The Holy Grail. Flipping journals refers to transitioning them from paywalled to open access. We can disseminate more sociology, better and faster, for less money. University libraries and university presses, and some foundations, can be mobilized to raise the money needed to launch sustainable models. For example, if a few hundred libraries would agree to give ASA what they spend on subscriptions to our journals, we could produce the same journals and open them to the public, cutting out Sage’s profits. My goal is for the ASA membership to task our association’s staff with figuring out how to pay for the journals without paywalls, which might require research and grants, and then bring proposals to the membership for approval.

6. Reduce revenue

ASA should make less money. Instead of making money from publications, we should just raise the money we need to publish journals, with the appropriate academic partners (universities and funding agencies). The many laudable things ASA does should be paid for voluntarily, by institutions or people who want to support them, rather than being paid for by publication profits from consumers (our employers) who have no choice but to subsidize ASA operations (and Sage profits).

7. Disseminate information

Too many sociologists don’t know how ASA works, how academic publishing works, and how we all fit into the overall system of research production and dissemination, the “scholarly communications ecosystem.” I would like to see us (starting with students) learning more about the politics and economics of this system, to have a better grasp of the big issues we face. On the publications committee I would hope to learn a lot, and help communicate this to our members and the public.

Conclusion

Here are some relevant experiences I’ve had. As editor, with Syed Ali (who is also running for publications committee!) of Contexts for three years (just completed), I was a non-voting member of the publications committee and got to see how it works. This included participating on a task force on the future of Contexts, which resulted in Sage agreeing to allow free downloads of the journal for the first 30 days of each issue, and in perpetuity after the first year. I’m the current chair of the Family section, and secretary treasurer of the Population section. I also successfully agitated for a new rule requiring ASA-award-winning dissertations to be publicly available. (For previous posts and activity related to ASA, visit the tag on this blog.) All that gives me some useful experience and knowledge.

I’d love for this election to help spur a more widespread discussion and debate over these questions. Without a majority on the publications committee or the ASA Council (and even with such a majority) this is a pretty daunting set of goals. I couldn’t pretend to promise results on any of these, but I pledge to at least promote these ideas, in the service of more research transparency and openness at lower cost.

The ASA election ballots will go out in April. To see what the Committee on Publications does, check out the committee records here.

14 Comments

Filed under Me @ work

Let’s use award incentives to promote open scholarship (at ASA this year!)

At the American Sociological Association of America meetings in Montreal next month, I will begin a one-year term as chair of the Family Section. I’m honored to have been elected to this position, and will do my best to make a positive contribution in that role. Besides doing the job in the normal ways — organizing our sessions at the conference next year, coordinating committees, and so on — I will bring a proposal to the section’s council to open our graduate student paper award. Here’s what I mean.

Steps toward solutions

Sociology has an inertia problem with regard to open scholarship. Lots of us understand that it would be better if our work was shared faster and more freely. That would be better for the generation and dissemination of new knowledge, it would promote collaboration, reduce costs to the public, and increase our capacity for engagement with each other and the public. Unfortunately, the individual steps toward that goal are unclear or daunting. Many of us need promotion and tenure, which requires prestige, which is still driven by publication in the paywalled journals that work against our open goals: they slow down dissemination, restrict access to our work, and bilk our institutions with exorbitant subscription fees.

To help overcome this inertia, a group of us have created SocArXiv, a non-profit, open access, open source archive of social science research that allows free, immediate publication of papers at any stage of the publication process. When and if the papers are published in a peer-reviewed journal, the preprint version can link to the journal version, providing a free copy of the paywalled paper. (Here’s an example of a new paper published in American Sociological Review, with a free copy on SocArXiv, which includes a link to the ASR version). In the meantime, the paper is available to our peers and the public. It provides a time-stamped record of the development of our original ideas, and is discoverable through Google Scholar and other search tools. People can still get their jobs and promotions, but the quality, efficiency, and reach of our research is improved. And part of what we are rewarding is open scholarship itself.

flipaward

Using awards

SocArXiv, of which I’m director, is trying to get the word out and encourage the use of our system, and open scholarship in general. One of our new ideas is opening paper awards. This may help people get in the habit of openness — and start to see its benefits — and also work against the negative impression that many people have of open access as a cesspool of low quality work. We hope this intervention will be especially effective coming early in the career of up-and-coming scholars.

Using its grant money and support from academic libraries, SocArXiv is offering sections of the ASA — like the Family Section — $400 to transport their paper award winner to the conference next year, if they using the archive as the submission platform for their awards. I’m bringing this proposal to the Family Section (and one just like it to the Population Section, of which I’m Secretary Treasurer).

We hope the open paper award will become a common best practice in our association — still providing the prestige and reward functions of the award, but also promoting best practices with regard to open scholarship, increasing our visibility, building the scholarly communication infrastructure of the future, and generating buzz for our conference and our research.

There are possible objections to this idea. Here are a few, with my responses:

  • Sharing unpublished work will lead to someone stealing their ideas. You protect yourself by posting it publicly.
  • We shouldn’t promote the dissemination of research that hasn’t been peer reviewed yet. We do this all the time at conferences, and SocArXiv allows posting updated versions that replace the original when it is revised.
  • This would impose a burden on people submitting papers. Being considered for an award is a privilege, not a right; it’s OK to require a short, free submission process.
  • Sharing a paper publicly will compromise its publishability later. All ASA journals, and all journals worthy of our support, allow posting preprints prior to publication. Here’s a list of 25 top journals and their policies.

Details

In the case of the Family Section, it looks like no change in the bylaws is needed, because they don’t specify the submission process for the graduate student paper award. They state:

Best Graduate Student Paper Award. The committee will be chaired by the Section Chair. Two additional members of the Section will be appointed by the Section Chair. The committee will select a best paper from among nominations submitted. Papers, dealing with a family-related topic, may be either published or unpublished and must have been writted by a graduate student (or group of graudate students) while still enrolled in a graduate program. The award, in the form of a Plaque and citation, shall be presented at a Section Reception (or, in the event no reception is held, at a Business Meeting of the Section).

Instead, I think we can just revise the call for award nominations, like this:

The Family Section Outstanding Graduate Student Paper Award

​Deadline: 3/13/2018

Graduate students are invited to submit an article-length paper on the family. The paper should represent a finished product rather than a proposal for future work. The submission can be based on a course paper, a recently published journal article, a manuscript under review at a journal, or a conference presentation. Co-authored papers are acceptable if all authors are students, although the prize will be shared. The paper must have been written when the author was enrolled in a graduate program. The paper may not exceed 30 pages or 11,000 words. Submissions are made by posting the paper on SocArXiv and sending a link to the paper to the committee chair, Philip N. Cohen, at pnc@umd.edu. To submit your paper, go to SocArXiv.org, and click “Add a preprint.” If you don’t yet have an account, you will fill out a short form — it’s free, non-profit, and won’t spam you! For assistance, contact socarxiv@gmail.com or consult the FAQ page. Please indicate whether you would like your paper to be included in a public list of submissions (this will not affect your chances of winning). The winner will receive a plaque and travel reimbursement up to $400 to attend the 2018 Family Section reception at the ASA meetings.

The Family Section Council will consider this proposal next month in Montreal. Please let us know what you think!

1 Comment

Filed under Me @ work

Update on SocArXiv and social science without walls

social science without walls

Meanwhile, over at SocArXiv, we’re working on revolutionizing the research process and how we communicate about it in the social sciences. You can follow the exploits of the SocArXiv project on our blog SocOpen. There you can read, most recently:

That’s the update!

Leave a comment

Filed under Me @ work

Do we get tenure for this?

My photo. For the occasion I titled it, Openness. https://flic.kr/p/FShb6d

For the occasion I titled this photo of Utah “Openness.”

Colleen Flaherty at Inside Higher Ed has written up the American Sociological Association’s committee report, “What Counts? Evaluating Public Communication in Tenure and Promotion.”

I was once a member of the ASA Subcommittee on the Evaluation Of Social Media and Public Communication In Sociology, which was chaired by Leslie McCall when they produced the report. (It is a subcommittee of the task force on engaging sociology, convened by then-President Annette Lareau.)

It’s worth reading the whole article, which also includes comments from Sara Ovink, McCall and me, in addition to the report. Having thought about this issue a little, I was happy to respond to Flaherty’s request for comment. These are the full comments I sent her, from which she quoted in the article:

1. We don’t need credit toward promotion for every thing we do. Scholars who take a public-facing stance in their work often find that it enhances the quality and quantity of their work in the traditional fields of assessment (research, teaching, service), so that separately rewarding the public work is not always necessary. I don’t need credit for having a popular blog – that work has led to new research ideas, better feedback on my research, better grad students, teaching ideas, invitations to contribute to policy, and book contracts.

2. We’d all love to be promoted for authoring a great tweet but no one wants to be fired for a bad one. Assessment of public engagement needs to be holistic and qualitative, taking into the account quality, quantity, and impact of the work. Simplistic quantitative metrics will not be useful.

3. It is also important to value and reward openness in our routine work, such as posting working papers, publishing in open access journals, sharing replication files, and disseminating open teaching materials. Public engagement does not need to mean separate activities and products, but can mean taking a public-facing stance in our existing work.

The SocArxiv project is one outcome of these conversations (links to latest infosubmit a paper), especially relating to point #3 above. Academics who open up their work should be recognized for that contribution to the public good and for promoting the future of academia. In that spirit also I proposed a rule change for the ASA Dissertation Award, which now includes this:

To be eligible for the ASA Dissertation Award, candidates’ dissertations must be publicly available in Dissertation Abstracts International or a comparable outlet. Dissertations that are not available in this fashion will not be considered for the award.

It’s hard to change everything, but it’s not that hard to make some important changes in the right direction. Rewarding engagement and openness is an important step in the right direction.

1 Comment

Filed under Uncategorized

SocArXiv in development

Print

Readers of the blog have become familiar with my complaints about our publishing system (scan the academia tag for examples): it’s needlessly slow, inefficient, hierarchical, profit-driven, exploitative, and also doesn’t work well.

Simple example: a junior scholar sends a perfectly reasonable sociology paper to a high-status journal. The editor commissions three anonymous reviews, and four months later the paper is rejected on the basis of a few hours of their volunteer labor. This increases the value — and subscription price — of the for-profit journal, because its high rejection rate is a key selling point. The author will now revise the paper (some of the advice was good, but nothing to suggest the analysis or conclusions were actually wrong) and send it to another journal, where three more anonymous reviewers — having no access to the previous round of review and exchange — will donate a few hours labor to a different for-profit publisher. In a few months we’ll find out what happens. Repeat. The outcome will be a good paper, improved by the process, published 1-3 years after it was written — during which time the paper, the code, and the data, were not available to anyone else. It will be available for $39.95 to non-academics, but most of the people who are aware of it will be able to read it because their institutions buy it as part of a giant bundle of journals from the publisher. The writer may get a job and, later, tenure. Thus, the process produces a good paper, inaccessible to most of the world, as well as a person dependent on the process, one with the institutional position and incentive to perpetuate it for another generation. There’s more wrong than this, but that’s the basic idea. The system is not completely non-functional, it’s just very bad.

With current technology, replacing our outdated journal system is not difficult. We could save vast amounts of money while providing free, faster access to research for everyone. Like our healthcare system, academic publishing is laboring under the weight of supporting its usurious middlemen. Getting them out of the way is a problem of politics and organization, not technology or cost. We academics do all the work already – research, writing, reviewing, editing – contributing our labor without compensation to giant companies that claim to be helping us get and keep our incredibly privileged jobs. But most of us are supported directly or indirectly by the state and our students (or their banks), not the journal publishers. We don’t need most of what the journal publishers do any more, and working for them is degrading our research, making it less innovative and transformative, less engaging and engaged, less open and accountable.

SocArXiv

The people in math and physics developed a workaround for this system in arXiv.org, where people share papers before they are peer-reviewed. Other paper servers have arisen as well, including some run by universities and some run privately for profit, some in specific disciplines. But there is a need for a new general, open-access, open-source, paper server for the social sciences, one that encourages linking and sharing data and code, that serves its research to an open metadata system, and that provides the foundation for a post-publication review system. I hope that SocArXiv will enable us to save research from the journal system. Once its built, anyone will be able to use it to organize their own peer-review community, to select and publish papers (though not exclusively), to review and comment on each other’s work — and to discover, cite, value, and share research unimpeded. We will be able to do this because of the brilliant efforts of the Center for Open Science (which is already developing a new preprint server) and SHARE (“a free, open, data set about research and scholarly activities across their life cycle”).

And we hope you’ll get involved: sharing research, reviewing, moderating, editing, mobilizing. Lots to do, but the good news is we’re doing most of this work already.

SocArXiv won’t take over this blog, though. You can read more about the project, and see the steering committee, in the announcement of our partnership. For updates, you can follow us on Twitter or Facebook, or email to add your name to the mailing list. In fact, you can also make a tax-deductible contribution to SocArXiv through the University of Maryland here.

When your paper is ready, check SocArXiv.org.

5 Comments

Filed under Me @ work

Life table says divorce rate is 52.7%

After the eternal bliss, there are two ways out of marriage: divorce or death.

I have posted my code and calculations for divorce rates using the 2010-2012 American Community Survey as an Open Science Framework project. The files there should be enough to get you started if you want to make multiple-decrement life tables for divorce or other things.

Because the American Community survey records year of marriage, and divorce and widowhood, it’s perfectly set up for a multiple-decrement life table approach. A multiple-decrement life table uses the rate of each of two exits for each year of the original state (in this case marriage), to project the probability of either exit happening at or after a given year of marriage. It’s a projection of current rates, not a prediction of what will happen. So, if you write a headline that says, “your chance of divorce if you marry today is 52.7%,” that would be too strong, because it doesn’t take into account that the world might change. Also, people are different.

The divorce rate of 52.7% can accurately be described like this: “If current divorce and widowhood rates remain unchanged, 52.7% of today’s marriages would end in divorce before widowhood.” Here is a figure showing the probability of divorce at or after each year of the model:

div-mdlt

So there’s 52.7% up at year 0. Marriages that make it to year 15 have a 30% chance of eventually divorcing, and so on.

Because the ACS doesn’t record anything about the spouses of divorce or widowed people, I don’t know who was married to whom, such as age, education, race-ethnicity, or even the sex of the spouse. So the estimates differ by sex as well as other characteristics. I estimated a bunch of them in the spreadsheet file on the OSF site, but here are the bottom lines, showing, for example, that second or higher-order marriages have a 58.5% projected divorce rate and Blacks have a 64.2% divorce rate, compared with 52.9% for Whites.

div-mdlt-tab

(The education ones should be taken with a grain of salt because education levels can change but this assumes they’re static.)

Check the divorce tag for other posts and papers on divorce.

The ASA-style citation to the OSF project would be like this:  Cohen, Philip N. 2016. “Multiple-Decrement Life Table Estimates of Divorce Rates.” Retrieved (osf.io/zber3).

18 Comments

Filed under Me @ work