<?xml version="1.0" encoding="UTF-8"?>
<!DOCTYPE article PUBLIC "-//NLM//DTD JATS (Z39.96) Journal Publishing DTD v1.3 20210610//EN" "JATS-journalpublishing1-3.dtd">
<article article-type="research-article" dtd-version="1.3" xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xml:lang="ru"><front><journal-meta><journal-id journal-id-type="publisher-id">intechngu</journal-id><journal-title-group><journal-title xml:lang="ru">Вестник НГУ. Серия: Информационные технологии</journal-title><trans-title-group xml:lang="en"><trans-title>Vestnik NSU. Series: Information Technologies</trans-title></trans-title-group></journal-title-group><issn pub-type="ppub">1818-7900</issn><issn pub-type="epub">2410-0420</issn><publisher><publisher-name>НГУ</publisher-name></publisher></journal-meta><article-meta><article-id pub-id-type="doi">10.25205/1818-7900-2019-17-2-61-73</article-id><article-id custom-type="elpub" pub-id-type="custom">intechngu-88</article-id><article-categories><subj-group subj-group-type="heading"><subject>Research Article</subject></subj-group><subj-group subj-group-type="section-heading" xml:lang="ru"><subject>Статьи</subject></subj-group></article-categories><title-group><article-title>Системы автоматизированной оценки заданий по программированию: разработка, использование и перспективы</article-title><trans-title-group xml:lang="en"><trans-title>Systems for Automated Evaluation of Programming Tasks: Development, Use and Perspectives</trans-title></trans-title-group></title-group><contrib-group><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Иртегов</surname><given-names>Д. В.</given-names></name><name name-style="western" xml:lang="en"><surname>Irtegov</surname><given-names>D. V.</given-names></name></name-alternatives><email xlink:type="simple">fat@nsu.ru</email><xref ref-type="aff" rid="aff-1"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Нестеренко</surname><given-names>Т. В.</given-names></name><name name-style="western" xml:lang="en"><surname>Nesterenko</surname><given-names>T. V.</given-names></name></name-alternatives><email xlink:type="simple">nest@iis.nsk.su</email><xref ref-type="aff" rid="aff-2"/></contrib><contrib contrib-type="author" corresp="yes"><name-alternatives><name name-style="eastern" xml:lang="ru"><surname>Чурина</surname><given-names>Т. Г.</given-names></name><name name-style="western" xml:lang="en"><surname>Churina</surname><given-names>T. G.</given-names></name></name-alternatives><email xlink:type="simple">tanch@iis.nsk.su</email><xref ref-type="aff" rid="aff-2"/></contrib></contrib-group><aff-alternatives id="aff-1"><aff xml:lang="ru"><institution>Новосибирский государственный университет</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Novosibirsk State University</institution><country>Russian Federation</country></aff></aff-alternatives><aff-alternatives id="aff-2"><aff xml:lang="ru"><institution>Новосибирский государственный университет; Институт систем информатики им. А.П. Ершова СО РАН</institution><country>Россия</country></aff><aff xml:lang="en"><institution>Novosibirsk State University; A. P. Ershov Institute of Informatics Systems SB RAS</institution><country>Russian Federation</country></aff></aff-alternatives><pub-date pub-type="collection"><year>2019</year></pub-date><pub-date pub-type="epub"><day>11</day><month>11</month><year>2020</year></pub-date><volume>17</volume><issue>2</issue><fpage>61</fpage><lpage>73</lpage><permissions><copyright-statement>Copyright &amp;#x00A9; Иртегов Д.В., Нестеренко Т.В., Чурина Т.Г., 2020</copyright-statement><copyright-year>2020</copyright-year><copyright-holder xml:lang="ru">Иртегов Д.В., Нестеренко Т.В., Чурина Т.Г.</copyright-holder><copyright-holder xml:lang="en">Irtegov D.V., Nesterenko T.V., Churina T.G.</copyright-holder><license xml:lang="ru" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>Данная работа распространяется под лицензией Creative Commons Attribution 4.0.</license-p></license><license xml:lang="en" license-type="creative-commons-attribution" xlink:href="https://creativecommons.org/licenses/by/4.0/" xlink:type="simple"><license-p>This work is licensed under a Creative Commons Attribution 4.0 License.</license-p></license></permissions><self-uri xlink:href="https://intechngu.elpub.ru/jour/article/view/88">https://intechngu.elpub.ru/jour/article/view/88</self-uri><abstract><p>Приводится обзор существующих систем проверки заданий по программированию, кратко описано современное состояние архитектуры системы NSUts, созданной в Новосибирском государственном университете, и практика ее использования в учебном процессе и в олимпиадах по программированию различных уровней. Приведен анализ опыта использования таких систем и обозначены перспективы их развития.</p></abstract><trans-abstract xml:lang="en"><p>The paper is devoted to the issues related to the development and use of automated assessment systems for programming tasks. The work on automated testing of programming tasks had been held in Novosibirsk State University since 1998. It was created several generations of systems of this type. The first program of about 1,000 lines was written in Perl. Currently, the automated system, named NSUts, is used in the programming contests and in the educational process. As a result of work in it, as well as acquaintance with other similar systems, both Russian and foreign, it was possible to formulate requirements for software development of this kind, to analyze the difference between the systems for testing competitions and training support systems. The article also provides an overview of the existing systems for checking tasks on programming, an analysis of the advantages and disadvantages of each of these systems, and a detailed comparison of the NSUts system with the Yandex Contest system. The current state of the NSUts system architecture is described. Much attention is paid to the practice of using the system in the educational process, statistics and graphs of students' progress of students studying with the help of this system are given. The article describes the analysis of the experience of using the NSUts system and outlines the prospects for its development.</p></trans-abstract><kwd-group xml:lang="ru"><kwd>knowledge testing</kwd><kwd>programming training</kwd><kwd>programming contests</kwd><kwd>testing systems</kwd></kwd-group></article-meta></front><back><ref-list><title>References</title></ref-list><fn-group><fn fn-type="conflict"><p>The authors declare that there are no conflicts of interest present.</p></fn></fn-group></back></article>
