You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: doc/config_rsmcompare.rst
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -3,7 +3,7 @@
3
3
Experiment configuration file
4
4
"""""""""""""""""""""""""""""
5
5
6
-
This is a file in ``.json`` format that provides overall configuration options for an ``rsmcompare`` experiment. Here's an `example configuration file <https://github.com/EducationalTestingService/rsmtool/blob/master/examples/rsmcompare/config_rsmcompare.json>`_ for ``rsmcompare``.
6
+
This is a file in ``.json`` format that provides overall configuration options for an ``rsmcompare`` experiment. Here's an `example configuration file <https://github.com/EducationalTestingService/rsmtool/blob/main/examples/rsmcompare/config_rsmcompare.json>`_ for ``rsmcompare``.
7
7
8
8
.. note:: To make it easy to get started with ``rsmcompare``, we provide a way to **automatically generate** configurations file both interactively as well as non-interactively. Novice users will find interactive generation more helpful while more advanced users will prefer non-interactive generation. See :ref:`this page <autogen_configuration>` for more details.
Copy file name to clipboardExpand all lines: doc/config_rsmeval.rst
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -3,7 +3,7 @@
3
3
Experiment configuration file
4
4
"""""""""""""""""""""""""""""
5
5
6
-
This is a file in ``.json`` format that provides overall configuration options for an ``rsmeval`` experiment. Here's an `example configuration file <https://github.com/EducationalTestingService/rsmtool/blob/master/examples/rsmeval/config_rsmeval.json>`_ for ``rsmeval``.
6
+
This is a file in ``.json`` format that provides overall configuration options for an ``rsmeval`` experiment. Here's an `example configuration file <https://github.com/EducationalTestingService/rsmtool/blob/main/examples/rsmeval/config_rsmeval.json>`_ for ``rsmeval``.
7
7
8
8
.. note:: To make it easy to get started with ``rsmeval``, we provide a way to **automatically generate** configurations file both interactively as well as non-interactively. Novice users will find interactive generation more helpful while more advanced users will prefer non-interactive generation. See :ref:`this page <autogen_configuration>` for more details.
Copy file name to clipboardExpand all lines: doc/config_rsmpredict.rst
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -2,7 +2,7 @@
2
2
3
3
Experiment configuration file
4
4
"""""""""""""""""""""""""""""
5
-
This is a file in ``.json`` format that provides overall configuration options for an ``rsmpredict`` experiment. Here's an `example configuration file <https://github.com/EducationalTestingService/rsmtool/blob/master/examples/rsmpredict/config_rsmpredict.json>`_ for ``rsmpredict``.
5
+
This is a file in ``.json`` format that provides overall configuration options for an ``rsmpredict`` experiment. Here's an `example configuration file <https://github.com/EducationalTestingService/rsmtool/blob/main/examples/rsmpredict/config_rsmpredict.json>`_ for ``rsmpredict``.
6
6
7
7
.. note:: To make it easy to get started with ``rsmpredict``, we provide a way to **automatically generate** configurations file both interactively as well as non-interactively. Novice users will find interactive generation more helpful while more advanced users will prefer non-interactive generation. See :ref:`this page <autogen_configuration>` for more details.
Copy file name to clipboardExpand all lines: doc/config_rsmsummarize.rst
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -3,7 +3,7 @@
3
3
Experiment configuration file
4
4
"""""""""""""""""""""""""""""
5
5
6
-
This is a file in ``.json`` format that provides overall configuration options for an ``rsmsummarize`` experiment. Here's an `example configuration file <https://github.com/EducationalTestingService/rsmtool/blob/master/examples/rsmsummarize/config_rsmsummarize.json>`_ for ``rsmsummarize``.
6
+
This is a file in ``.json`` format that provides overall configuration options for an ``rsmsummarize`` experiment. Here's an `example configuration file <https://github.com/EducationalTestingService/rsmtool/blob/main/examples/rsmsummarize/config_rsmsummarize.json>`_ for ``rsmsummarize``.
7
7
8
8
.. note:: To make it easy to get started with ``rsmsummarize``, we provide a way to **automatically generate** configurations file both interactively as well as non-interactively. Novice users will find interactive generation more helpful while more advanced users will prefer non-interactive generation. See :ref:`this page <autogen_configuration>` for more details.
Copy file name to clipboardExpand all lines: doc/config_rsmtool.rst
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -3,7 +3,7 @@
3
3
Experiment configuration file
4
4
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
5
5
6
-
This is a file in ``.json`` format that provides overall configuration options for an ``rsmtool`` experiment. Here's an `example configuration file <https://github.com/EducationalTestingService/rsmtool/blob/master/examples/rsmtool/config_rsmtool.json>`_ for ``rsmtool``.
6
+
This is a file in ``.json`` format that provides overall configuration options for an ``rsmtool`` experiment. Here's an `example configuration file <https://github.com/EducationalTestingService/rsmtool/blob/main/examples/rsmtool/config_rsmtool.json>`_ for ``rsmtool``.
7
7
8
8
.. note:: To make it easy to get started with ``rsmtool``, we provide a way to **automatically generate** configurations file both interactively as well as non-interactively. Novice users will find interactive generation more helpful while more advanced users will prefer non-interactive generation. See :ref:`this page <autogen_configuration>` for more details.
Copy file name to clipboardExpand all lines: doc/contributing.rst
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -8,7 +8,7 @@ Setting up
8
8
9
9
To set up a local development environment, follow the steps below:
10
10
11
-
1. Pull the latest version of RSMTool from GitHub and switch to the ``master`` branch.
11
+
1. Pull the latest version of RSMTool from GitHub and switch to the ``main`` branch.
12
12
13
13
2. If you already have the ``conda`` package manager installed, skip to the next step. If you do not, follow the instructions on `this page <https://conda.io/projects/conda/en/latest/user-guide/install/index.html>`_ to install conda.
Copy file name to clipboardExpand all lines: doc/internal/release_process.rst
+6-6Lines changed: 6 additions & 6 deletions
Original file line number
Diff line number
Diff line change
@@ -3,7 +3,7 @@ RSMTool Release Process
3
3
4
4
This process is only meant for the project administrators, not users and developers.
5
5
6
-
1. Make sure any and all tests are passing in ``master``. Make sure you have also run tests locally in strict mode (``STRICT=1 nosetests --nologcapture tests``) to catch any deprecation warnings in the HTML report that can be fixed before the release.
6
+
1. Make sure any and all tests are passing in ``main``. Make sure you have also run tests locally in strict mode (``STRICT=1 nosetests --nologcapture tests``) to catch any deprecation warnings in the HTML report that can be fixed before the release.
7
7
8
8
2. Run the ``tests/update_files.py`` script with the appropriate arguments to make sure that all test data in the new release have correct experiment ids and filenames. If any (non-model) files need to be changed this should be investigated before the branch is released.
9
9
@@ -41,17 +41,17 @@ This process is only meant for the project administrators, not users and develop
41
41
42
42
12. Draft a release on GitHub while the Linux and Windows package tester builds are running.
43
43
44
-
13. Once both builds have passed, make a pull request with the release branch to be merged into ``master`` and request code review.
44
+
13. Once both builds have passed, make a pull request with the release branch to be merged into ``main`` and request code review.
45
45
46
-
14. Once the build for the PR passes and the reviewers approve, merge the release branch into ``master``.
46
+
14. Once the build for the PR passes and the reviewers approve, merge the release branch into ``main``.
47
47
48
48
15. Upload source and wheel packages to PyPI using ``python setup.py sdist upload`` and ``python setup.py bdist_wheel upload``
49
49
50
-
16. Make sure that the ReadTheDocs build for ``master`` passes by examining the badge at this `URL <https://img.shields.io/readthedocs/rsmtool/latest>`_ - this should say "passing" in green.
50
+
16. Make sure that the ReadTheDocs build for ``main`` passes by examining the badge at this `URL <https://img.shields.io/readthedocs/rsmtool/latest>`_ - this should say "passing" in green.
51
51
52
-
17. Tag the latest commit in ``master`` with the appropriate release tag and publish the release on GitHub.
52
+
17. Tag the latest commit in ``main`` with the appropriate release tag and publish the release on GitHub.
53
53
54
-
18. Make another PR to merge ``master`` branch into ``stable`` so that the the default ReadTheDocs build (which is ``stable``) always points to the latest release.
54
+
18. Make another PR to merge ``main`` branch into ``stable`` so that the the default ReadTheDocs build (which is ``stable``) always points to the latest release.
55
55
56
56
19. Update the CI plan for RSMExtra (only needed for ETS users) to use this newly built RSMTool conda package. Do any other requisite changes for RSMExtra. Once everything is done, do a release of RSMExtra.
Copy file name to clipboardExpand all lines: doc/pipeline.rst
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -12,7 +12,7 @@ As its primary input, RSMTool takes a :ref:`data file <input_file_format>` conta
12
12
13
13
This trained model can then be used to generate scores for a held-out evaluation data whose feature values are pre-processed using the same :ref:`Pre-processing Parameters <preprocessing_parameters>`. In addition to the raw scores predicted by the model, the **Prediction Analysis** component of the pipline generates several additional :ref:`post-processed scores <score_postprocessing>` that are commonly used in automated scoring.
14
14
15
-
The primary output of RSMTool is a comprehensive, customizable HTML statistical report that contains the multiple analyses required for a comprehensive evaluation of an automated scoring model including descriptive analyses for all features, model analyses, subgroup comparisons, as well as several different :ref:`evaluation measures <evaluation>` illustrating model efficacy. More Details about these analyses can be found in this documentaion and in a separate `technical paper <https://raw.githubusercontent.com/EducationalTestingService/rsmtool/master/doc/assets/rsmtool.pdf>`_.
15
+
The primary output of RSMTool is a comprehensive, customizable HTML statistical report that contains the multiple analyses required for a comprehensive evaluation of an automated scoring model including descriptive analyses for all features, model analyses, subgroup comparisons, as well as several different :ref:`evaluation measures <evaluation>` illustrating model efficacy. More Details about these analyses can be found in this documentaion and in a separate `technical paper <https://raw.githubusercontent.com/EducationalTestingService/rsmtool/main/doc/assets/rsmtool.pdf>`_.
16
16
17
17
In addition to the HTML report, RSMTool also saves the intermediate outputs of all of the performed analyses as :ref:`CSV files <intermediate_files_rsmtool>`.
Copy file name to clipboardExpand all lines: doc/tutorial.rst
+1-1Lines changed: 1 addition & 1 deletion
Original file line number
Diff line number
Diff line change
@@ -26,7 +26,7 @@ ASAP Example
26
26
27
27
Let's see how we can apply this basic RSMTool workflow to a simple example based on a 2012 Kaggle competition on automated essay scoring called the `Automated Student Assessment Prize (ASAP) contest <https://www.kaggle.com/c/asap-aes>`_. As part of that contest, responses to 8 different essay questions written by students in grades 6-10 were provided. The responses were scored by humans and given a holistic score indicating the English proficiency of the student. The goal of the contest was to build an automated scoring model with the highest accuracy on held-out evaluation data.
28
28
29
-
For our tutorial, we will use one of the questions from this data to illustrate how to use RSMTool to train a scoring model and evaluate its performance. All of the data we refer to below can be found in the ``examples/rsmtool`` folder in the `github repository <https://github.com/EducationalTestingService/rsmtool/tree/master/examples/rsmtool>`_.
29
+
For our tutorial, we will use one of the questions from this data to illustrate how to use RSMTool to train a scoring model and evaluate its performance. All of the data we refer to below can be found in the ``examples/rsmtool`` folder in the `github repository <https://github.com/EducationalTestingService/rsmtool/tree/main/examples/rsmtool>`_.
0 commit comments