DORA

@dorassessment.bsky.social

204

Posts

San Francisco Declaration on Research Assessment. Putting science into the assessment of research. Sign the Declaration at https://sfdora.org/sign
.

Posts Replies Media Lists

Examples of actions for institutions just starting to think about #ResearchAssessment reform 🎈: ⭐️ Articulate a case for new assessment practices ⭐️ Align on values to support new practices ⭐️ Identify the nature of biases in current assessment systems Workshop kit: sfdora.org/resource/wor...

SPACE rubric workbook and workshop kit | DORAsfdora.org This is part of DORA’s toolkit of resources to support academic institutions that are improving their policies and practices. Find the other resources in the toolkit here. With thanks to volunteers in...

Here is a first draft at a Research Assessment starter pack! Sure to be updated as more researchers join this platform. We welcome any suggestions! go.bsky.app/6Qn4uG1

One 1️⃣ myth about evaluation is that hiring and promotion decisions are made purely on "merit." This might be addressed by implementing standards, like narrative CVs and assessment matrices, into #ResearchAssessment processes. Read 📖 the one-pager: sfdora.org/resource/ret...

Rethinking Research Assessment: Ideas for Action | DORAsfdora.org Ideas for Action outlines five common myths about research evaluation to help universities better understand barriers to change and provides analogous examples to illustrate how these myths exist insi...

Registration ☑ is still open for #REvaluation24, a conference dedicated to exploring the "rapidly changing landscape of research and innovation policy and its implications for assessment and evaluation.” 🔎 Find more information: www.revaluation2024.eu

REvaluation Conference 2024www.revaluation2024.eu Navigating Times of Change

Reforming research assessment policies and procedures is likely to fail 👎 unless they occur in a supportive culture. To put it another way, "Culture eats policy, procedure, and practice for lunch." - Elyse Aurbach youtu.be/P8E2AP6n3Mc?...

Takeaway Short: Organizational culture eats policy, procedure, and practice for lunch.youtu.be YouTube video by HIBAR Research Alliance

“Something has to be done to replace the 50- or 100-page CV and what that says about the culture of our workplaces.” Joanna Harrington argues that it is time for Canada 🇨🇦 to replace traditional lists with shorter, more relevant narratives: universityaffairs.ca/opinion/in-m...

Changing academic culture with a narrative CV — University Affairsuniversityaffairs.ca Replacing the traditional ‘listing everything’ approach is long overdue.

Flashback: How can early career researchers support responsible research assessment reform at their institution? "Recommendations for empowering early career researchers to improve research culture and practice" outlines general strategies for change. 👇 doi.org/10.1371/jour...

Recommendations for empowering early career researchers to improve research culture and practicedoi.org Around the world, early-career researchers are working to improve research culture and practice by addressing systemic challenges. This consensus statement provides expert guidance for individuals inv...

"A framework for values-based assessment in promotion, tenure, and other academic evaluations." Preprint released last week by Erin McKiernan, Caitlin Carter, Michael Dougherty, and Greg Tananbaum: 👇 osf.io/preprints/os...

OSFosf.io

ICYMI! The Dimensions of Responsible Research Assessment (RRA) is a framework for research funders to implement and frame discussions on RRA. The report and one-pager were created by the Global Research RRA Working Group. They include guiding principles and more: doi.org/10.6084/m9.f...

Dimensions of Responsible Research Assessment (full report and summary)doi.org In support of a better, healthier research culture that promotes rigorous research undertaken to the highest standards, the Global Research Council's Responsible Research Assessment (RRA) working grou...

🆕 Adrian Barnett on "Why I’ve removed journal titles from the papers on my CV" Science is rarely simple. "Simplistic promotion and hiring criteria ignore this wonderful complexity. Changing typical academic CV formats could bring some of it back.” doi.org/10.1038/d415...

Why I’ve removed journal titles from the papers on my CVdoi.org Changing how published papers are displayed could shift the focus from simple metrics to research quality. Changing how published papers are displayed could shift the focus from simple metrics to rese...

🆕 Stuart King reimagines peer review: "Reshaping research culture hinges on transforming peer review through collaboration between academic research institutions and publishers, and the researchers of all career stages who engage with them." exchanges.warwick.ac.uk/index.php/ex...

Reimagining Peer Review Needs Publishers and Institutions to Collaborate More | Exchanges: The Interdisciplinary Research Journal exchanges.warwick.ac.uk

The QuOCCA, by Neuroscience Research Australia, has an 11-item checklist ☑ to help evaluate published research work and guide discussions based on transparency, quality, and openness. In DORA’s Resource Library: sfdora.org/resource/qua...

Quality Output Checklist and Content Assessment (QuOCCA): a new tool for assessing research quality and reproducibility | DORAsfdora.org The Research Quality Committee at Neuroscience Research Australia (NeuRA) has developed a new tool to assess and improve scientific research quality and reproducibility: Quality Output Checklist and C...

University of Bath formalized existing good practices by developing a set of principles that specified the need for context-specific indicators for career assessment. Just one of DORA's 17 in-depth case studies of research assessment reform: sfdora.org/case-study/u...

University of Bath | DORAsfdora.org The University of Bath (United Kingdom) released “Principles of research assessment and management” in 2017. The Principles were designed to “encapsulate current good practice and to act as a guide fo...

ICYMI: As we expand the type of work that we recognize to include preprints, we can foster trust by: ☝ Recognizing and rewarding transparency and rigor. ✌ Developing resources to foster and support responsible preprint review. sfdora.org/2024/08/01/e...

Encouraging innovation in open scholarship while fostering trust: A responsible research assessment perspective | DORAsfdora.org The Declaration on Research Assessment (DORA) recognizes the need to improve the ways in which the outputs of scholarly research are evaluated.

#Reformscape includes 65 concrete 🧱 examples of how academic institutions are reforming their research assessment policies. Browse 🔍 these policies at sfdora.org/reformscape/...

Reformscape Source Materials | DORAsfdora.org The Declaration on Research Assessment (DORA) recognizes the need to improve the ways in which the outputs of scholarly research are evaluated.

🆕 DORA Resource Library entry: "Towards responsible research assessment: How to reward research quality" is a 2024 article that advocates for a holistic assessment approach that prioritizes quality, transparency, reproducibility, and innovation. sfdora.org/resource/tow...

Towards responsible research assessment: How to reward research quality | DORAsfdora.org This paper examines how to appropriately recognize and reward quality research. It critiques the overreliance on traditional quantitative indicators like journal impact factor and citation counts in e...

Want to reach out to DORA? You can find our contact form here: sfdora.org/contact/

Contact | DORAsfdora.org The Declaration on Research Assessment (DORA) recognizes the need to improve the ways in which the outputs of scholarly research are evaluated.

🆕 Blog post explores how emerging policies are reshaping research evaluation, the challenges of moving away from traditional metrics, and the vital role of fostering trust in the open scholarship ecosystem. www.templetonworldcharity.org/blog/encoura...

Encouraging Innovation in Open Scholarship While Fostering Trustwww.templetonworldcharity.org The Future of Flourishing blog features podcasts, videos, articles, and news from thought leaders, researchers, and practitioners at the cutting edge of…

Steffi Genderjahn's recent blog post "Research assessment between competence assessment, recognition and justice" argues for the importance of institutional 🏫 support of grassroots efforts to reform research assessment in Germany. Read the piece: 👇 www.laborjournal.de/rubric/essay...

Kulturwandel im Wissenschaftsbetriebwww.laborjournal.de Trotz umfangreicher Kritik an bibliometrischen Indikatoren und trotz jahrzehntelanger Reforminitiativen stockt der Kulturwandel im Wissenschaftsbetrieb. Was genau erschwert informierte Entscheidungen ...

📚 #Reformscape is a tool to explore & share examples of responsible assessment for hiring, promotion, and tenure. Explore Reformscape: sfdora.org/reformscape/ Data 📊 in Reformscape are categorized by institution, population, stage of reform, and more!

Reformscape | DORAsfdora.org The Declaration on Research Assessment (DORA) recognizes the need to improve the ways in which the outputs of scholarly research are evaluated.

Using top-down action from leadership and bottom-up feedback from faculty, Tampere University 🇫🇮 is creating faculty recruitment policies and review guidelines that emphasize equitable evaluation practices with flexible assessment methods. Read more: sfdora.org/case-study/t...

Tampere University | DORAsfdora.org Tampere University is a new Finnish institution, formed in 2019 from the merger of the University of Tampere and the Tampere University of Technology. As a result of the merger, Tampere recognized it ...

⚖️ Ensuring the internalization and active use of new assessment practices requires addressing issues of capacity. Read 📑 the SPACE rubric to learn more strategies for research assessment reform at academic institutions: sfdora.org/resource/spa...

One ☝️ way to implement a more holistic evaluation system: Consider 💭 capturing the full breadth of a researcher's contributions by recognizing a broader range of scholarly work, beyond publications. Read more 📖 in from DORA and Luxembourg National Research Fund (FNR): sfdora.org/resource/bal...

Balanced, broad, responsible: A practical guide for research evaluators | DORAsfdora.org This is part of DORA’s toolkit of resources to support academic institutions that are improving their policies and practices. Find the other resources in the toolkit here. Balanced, broad, responsib...

DORA Idea 💡 for Action: Refine #ResearchAssessment through iterative feedback. This might look like crafting both short and long-term goals for new policies and practices to measure success. More ideas: 👇 sfdora.org/resource/ret...

⚡ #FlashbackFriday: In 2023, research examined the association between Journal Impact Factor and the thoroughness and helpfulness of #PeerReview. 👇 (Spoiler alert: There's not much of a connection.) doi.org/10.1371/jour...

Relationship between journal impact factor and the thoroughness and helpfulness of peer reviewsdoi.org An analysis of the content of 10,000 peer review reports reveals that reports submitted to journals with higher impact factors pay more attention to the materials and methods of a study but less atten...

📚 CLACSO-FOLEC is working to reform #ResearchAssessment in Latin America & the Caribbean by fostering dialogue with experts across the region and developing guidance to support collective action. 📖 Read about their process for international reform: sfdora.org/case-study/t...

The Latin American Forum for Research Assessment | DORAsfdora.org The Latin American Forum for Research Assessment (FOLEC) is an initiative of the international Latin American Council of Social Sciences (CLACSO). CLACSO created FOLEC to support knowledge sharing on ...

🆕 “Scientists who spend time peer-reviewing manuscripts don’t get rewarded for their efforts. It’s time to change that.” Opinion piece from C. Brandon Ogbunu on the importance of recognizing and rewarding peer review: undark.org/2024/07/04/o...

The Misplaced Incentives in Academic Publishingundark.org Opinion | Scientists who spend time peer-reviewing manuscripts don’t get rewarded for their efforts. It’s time to change that.

All of DORA’s tools, reports, and position papers are in one easy-to-find location! Click the "Reports" tab at the top 🔝 of the DORA homepage (sfdora.org) to find them. sfdora.org/reports/

💡 In 2020, DORA, the European University Association, and SPARC Europe created a case study repository showing key elements of responsible research assessment reform. To this day, the case study repository continues to be updated and to grow. Explore the case studies ⬇️ sfdora.org/dora-case-st...

Reimagining academic assessment: stories of innovation and change | DORAsfdora.org The Declaration on Research Assessment (DORA) recognizes the need to improve the ways in which the outputs of scholarly research are evaluated.

🆕 Dimensions of Responsible Research Assessment (RRA) is a framework for research funders to implement and frame discussions on RRA. The report and one-pager were created by the Global Research Council RRA Working Group. They include guiding principles and more. 👇 figshare.com/articles/onl...

Dimensions of Responsible Research Assessment (full report and summary)figshare.com In support of a better, healthier research culture that promotes rigorous research undertaken to the highest standards, the Global Research Council's Responsible Research Assessment (RRA) working grou...