Russia: Who Assesses the Quality of Education?

May 01 | 2020

The Center for Institutional Analysis of Science and Education at the European University at St. Petersburg analyzed the work of the experts from the Supervisory Authority for Science and Education SASE (Rosobrnadzor).

Katerina Guba


Photos: Who are the SASE’s experts, who are assessing the quality of education in Russian universities? (Free photobank, CC BY-NC-SA 2.0,


The idea of university autonomy is based on the open opinions of scientists on a number of issues. One of these issues is how to assess the quality of education at universities.


How Are Universities Assessed?

There is a variety of formats how to assess the university’s work, but the format which is used more is when a university is assessed by experts from the university community. When it comes to the quality of studies, the experts are not needed because in this case various metrics on publications and citations can be used. When it comes to accreditation or audit procedures, experts must personally visit universities to see processes at a place. It is necessary because the audit procedure is complicated.

What is the university performance and how it can be measured? There is no single opinion on these questions. Experts become aware of multiple university processes and the information they gain must be countable. But the final opinion is left up to the people.


Who Carries out an Audit?

Often, an audit significantly affects university activities. Therefore, it is important to understand how experts are selected because their opinions influence the audit’s results and the further development of a university.

This was especially important for the Russian context in 2013-2016 when universities experienced close attention from the side of the regulatory authorities. These years were full of a great number of experts’ visits to universities with different kinds of inspections.

The Center for Institutional Analysis of Science and Education at the European University at St. Petersburg analyzed the work of Rosobrnadzor, whose experts were involved in audit and assessment activities. We started with the information taken from the official records of accredited experts and supplemented it with the data about universities’ Ph.D. defenses and publications.


Experts from Rosobrnadzor

The regulatory requirements say that almost any employee of a university can become an expert. Applicants must have a university degree and the experience of working at a university at least for 2 years (5 years if it comes to the experts for accreditation).

However, a deeper consideration of this issue shows that these two entry criteria alone are not enough to call a person “an expert”. In our opinion to be an expert, an applicant must:

  • (1) do teaching and conduct own research – this provides him/her with the necessary experience to assess the quality of educational programs;
  • (2) be a representative of a leading university;
  • (3) demonstrate ethically impeccable behavior – they must not be seen in violations of academic ethics.

How are things in practice? Who were those people who received the right to be experts?



Our research shows that the expert positions are more often related to administrative and educational work, rather than teaching or research, for example:

  • 75% of experts take leadership positions;
  • among the university departments, the educational part is represented noticeably, thus, 35% of the experts are engaged in educational activities in their universities.

With this, the experts whose activities are related only to teaching and research, and not administration work, are much less common. In fact, representatives of educational departments come to check how well the paper processes are organized in other universities.


Private Universities

Teachers from private universities tend to become Rosobrnadzor’s experts more often. According to the latest data, 132 experts (19%) work in private universities, whereas in 2014 only 6.7% of all teachers worked in private universities.

If we say about experts from private universities, most of them (six at once) have come from the Eurasian Open Institute. At the same time, according to the data of our Center, it is private universities that Rosobrnadzor considers as suspicious institutions which require additional quality control.

Interestingly, the indicators showing the efficacy level of a university do not significantly reduce the possibility for private universities to be audited.


Leading Universities

We have found that experts from leading universities are less common, for example:

  • only 11% of the experts work in leading universities;
  • only 21 universities (out of 45 leading ones) are represented with at least one expert;
  • 15% of the experts work at “inefficient” (non-high ranked) universities.

A more detailed analysis of the materials presented in Monitoring of HE Institutions Efficacy has shown that if the efficacy indicators are taken as criteria to select experts, a number of experts from the leading universities will be a rare case.

A weak point for experts is their low rates for publications in Scopus – the database that tracks the citation of articles published by scholars in scientific journals. The accredited experts have come mainly from those universities that either do not know what international science is or how to publish a paper in high-index journals. The reasonable doubts arise how experts who do not work at the leading universities can qualitatively do the expertise.


Expert Citation Index

Experts may not represent the leading universities, but they must demonstrate consistency in their work. There are no data on the quality of teaching, but we can analyze their publication indicators.

Data analysis of RSCI (Russian Science Citation Index) has shown that on average all experts have a great number of publications, but not many of them are from the high rating journals. At the same time, among non-experts, there are more people with fewer publications, but in higher quality journals.

This model of fabricated publication rating (great number but low quality) is typical to managers of Russian universities, who, while dealing with the administrative affairs of the university, make it seem that they do scientific work.


Violation of Academic Ethics

Database Dissernet has shown that a harsh violation of academic ethics is more common among Rosobrnadzor’s experts than on average among Russian scientists.

Such being the case, the entire list of experts has not been checked. At the same time, Dissernet has found in its database 224 cases when the dissertations of the experts turned out to be under additional review. The main claim concerns incorrect references (plagiarism) – 10%. Additionally, the audit has revealed 22 “leaders” of the “dissertation industry” – here we mean people who took part in organizing more than 5 fake dissertation defenses.

The audit for scientific articles has shown that 25% of the experts used plagiarism in their publications. In total, according to the Dissernet report, 183 experts (81% of those in the sample) have any of the three forms of a violation of academic ethics. However, people, who were noticed in violation of academic ethics, not only continue to work as experts in university audits, but also are the labour strikers involved in dozens of audits per year.

The results of the study, conducted by the Center for Institutional Analysis of Science and Education, call into question the data about the quality of universities that were obtained during the campaign aimed at “cleansing universities”.

The very idea of audits is based on the peer-professionals assessment. If we cannot call an expert assessing the universities a high-level professional, then the audit itself cannot be recognized as valid, even if it has been carried out correctly.

The absence of serious selection requirements increases the risk that “pocket” experts of Rosobrnadzor will become more and more and this will mean that the verdict they have made will not describe a true picture and cannot be an independent opinion. Several cases of the audits for the leading Russian universities (the European University at St. Petersburg and Shaninka – the best in their fields) have shown that the doubts in the independent assessment are reasoned.


How to Improve Assessment of the Quality of Education?

In response to criticism from the university community (including an audit procedure), Rozobrnadzor has agreed that significant changes are needed. Recently Rozobrnadzor has proposed the tightened requirements to the experts engaged in university audits. According to the draft, the experts must have publications in leading national and/or foreign peer-reviewed scientific journals over the past 5 years (to date, such information has not been collected).

But will those who really meet the new requirements agree to become an expert and submit their applications for this to Rosobrnadzor? Russian scientists know how to fabricate indicators – they really know how to do it. Even the requirement “have publications in journals from Scopus database” is not an unachievable criterion due to the opportunity to be published in vulnerable journals and conference proceedings that are included in Scopus.

However, we think that the measure which is needed in this situation is not increasing the level of publication, not only this at least but reforming the entire system used in university audits and first, the bureaucracy must be reduced.

Now a typical procedure of any audit is a documentation check that requires many people, not to even mention time and space (rooms). It is hard to imagine that a good scientist would voluntarily agree to spend his/her time checking whether records, curricula, plans, and transcripts have been filled out correctly.

If they agree to do this, then on duty – to understand how audits are carried out and what to expect when the next time Rosobrnadzor commission arrives at their university. For a reason, 35% of the experts work in the educational departments of universities.

A real assessment system should be based on the unique knowledge of experts. Now it is pure paper work that requires the experts’ knowledge of regulations and norms, not their expertise in education and scientific fields. Only in this case, teachers will see the reason in the expertise and will perceive it as work for the benefit of the academic community.

Now “within a “regulatory guillotine” there are extensive discussions of new approaches to assessing the quality of education. A window of opportunity has been opened to ensure that the new assessment system does not repeat the mistakes critical to the effectiveness and legitimacy of the academic education system.

Katerina Guba is the Director of the Center of Institutional Analysis of Science and Education at the European University at St. Petersburg.

The post is published on


School of Entrepreneurship and Innovation, Almaty Management University

Almaty, 31 October 2 November 2024


Academic freedom is a cornerstone of scholarly and research activities worldwide. The globalization of higher education and science necessitates a shared understanding of academic freedom principles globally, particularly in Eurasian countries. Despite the universality of academic freedom, the commitment to its protection and promotion varies and is shaped by the intricate interplay of legal, socio-political, and cultural contexts. A country’s legal regulations and policy frameworks significantly impact how the protection and promotion of academic freedom are understood and implemented.

The quality of democracy and freedom protection in a country also affects the level of academic freedom there. This effect is evident in the rapid challenges all political systems face, such as managerialism and consumerism in higher education. It is even more pronounced in undemocratic regimes with breaches of institutional autonomy and ideologization of higher education.

Equally striking is how the global academy interprets academic freedom when it encounters local traditions that are not universally democratic. In this regard, the operation of campuses of leading universities in authoritarian countries and the debates about the principles and conditions of their operation deserve additional interest.

These observable diversities raise the question of whether global academic freedom can be discussed as a universal concept and how to distinguish the diversity of academic freedom manifestations from aberrations. It also raises the question of how to protect and promote academic freedom as a principle while considering the legal, socio-economic, and cultural contexts in which it is practiced.

For a conference exploring the complexities of academic freedom in a global context, with a particular focus on Eurasian countries, here are some potential topics that could be addressed:

  • The cultural and social context of academic freedom in practice, the contextualization of academic freedom, its cultural and political interpretations, and the universality of academic freedom.
  • Academic freedom in democratic vs. authoritarian regimes, the balance between the social-economic dimension of academic freedom and political rights’ dimension,
  • Legal framework of academic freedom, comparative analyses of legislation, the impact of legal tradition on the application of academic freedom in different countries,
  • Globalization and academic freedom, including academic freedom on international campuses, academic exchange, and academic freedom strategies for maintaining academic standards and freedom in diverse political landscapes.
  • Managerialism and academic freedom, balance between financial sustainability and scholarly independence. Academic integrity and academic freedom
  • Effect of the social and political crises for the academic freedom, academic freedom for persecuted scholars: issues and supports of the scholars in exile
  • Ethnic and moral considerations in upholding academic freedom, including ethical dilemmas scholars faced due to the conflict between national and international academic standards.

The conference is organized by CISRus (Center for Independent Social Research) with generous support of Almaty Management University (AlmaU) and in information partnership with Ghent University.

The conference will be conducted in English. We welcome applications for individual contributions, which should include the title, a brief description (up to 200 words), and a short academic biography of the presenter (approximately 100 words). Presentations will be organized in either thematic panels or roundtable discussions. The organizing committee reserves the right to determine the presentation format (panel or round table) for each selected participant.

Please send your applications to the email:


Application Deadline: July 25, 2024

The Conference Committee is ready to provide accommodation for all participants for the days of the conference and has some capacity to contribute to the ticket costs as well. Please indicate your need for accommodation and travel expenses with your application.


The conference committee:

Dmitry Dubrovsky (Research Scholar, Department of Social Science, Charles University; Professor, Free University)

 Aleksandr Vileikis (Professor, School of entrepreneurship and innovation, AlmaU)

Elizaveta Potapova (Senior Researcher, Public Policy and Management Institute, Lithuania)

Irina Olimpieva (Director CISRus, Research Professor at the Institute for European, Russian and Eurasian Studies, George Washington University)


About AlmaU:

Almaty Management University – is a world-class, entrepreneurial, socially responsible university. More than 35 years in the education market, the oldest private university in the country, the 1st business school of the Republic of Kazakhstan, a pioneer of business education in the CIS.

The School of Entrepreneurship and Innovation (SEI) is a leading and internationally accredited (BGA&AMBA) entrepreneurship school with a commitment to excellence, innovation, and global perspective. SEI AlmaU offers a range of cutting-edge entrepreneurship programs designed to prepare students for successful careers in diverse fields.


Information for traveling:

Kazakhstan has adopted a policy allowing dozens of countries to enter without a visa. Please contact your local Kazakhstani embassy for further details. For guests who may require a visa, AlmaU will issue a letter of invitation confirming their participation in the conference. Participants will also receive information about housing and traveling to Almaty.


Біз сіздермен Алматыда кездесуді асыға күтеміз !

We are looking forward to meeting you in Almaty!

You May Also Interested


Submit a Comment

Your email address will not be published. Required fields are marked *

+ 53 = 59