diff --git a/docs/source/build.linux.rst b/docs/source/build.linux.rst
index 5aa10dd7a4..864078257d 100644
--- a/docs/source/build.linux.rst
+++ b/docs/source/build.linux.rst
@@ -15,7 +15,7 @@ Here, we install nightly build.
 
 .. code-block::
 
-   conda install pytorch -c pytorch-nightly
+   pip install --pre --index-url https://download.pytorch.org/whl/nightly/cpu
 
 3. Install build tools
 ----------------------
diff --git a/docs/source/build.rst b/docs/source/build.rst
index 32f283ba0b..f1f80ece28 100644
--- a/docs/source/build.rst
+++ b/docs/source/build.rst
@@ -12,8 +12,6 @@ TorchAudio integrates PyTorch for numerical computation and third party librarie
    - `MSVC <https://visualstudio.microsoft.com>`_  2019 or newer (Windows)
 - `CUDA toolkit <https://developer.nvidia.com/cudnn>`_ and `cuDNN <https://developer.nvidia.com/cudnn>`_ (if building CUDA extension)
 
-Most of the tools are available in `Conda <https://conda.io/>`_, so we recommend using conda.
-
 .. toctree::
    :maxdepth: 1
 
diff --git a/docs/source/build.windows.rst b/docs/source/build.windows.rst
index ef040bb322..732f246865 100644
--- a/docs/source/build.windows.rst
+++ b/docs/source/build.windows.rst
@@ -86,21 +86,8 @@ The following combination is known to work.
 
 3. Install PyTorch
 ------------------
-
 Please refer to https://pytorch.org/get-started/locally/ for the up-to-date way to install PyTorch.
 
-The following command installs the nightly build version of PyTorch.
-
-.. code-block::
-
-   # CPU-only
-   conda install pytorch cpuonly -c pytorch-nightly
-
-   # With CUDA support
-   conda install pytorch pytorch-cuda=11.7 -c pytorch-nightly -c nvidia
-
-When installing CUDA-enabled version, it also install CUDA toolkit.
-
 4. [Optional] cuDNN
 -------------------
 
@@ -159,7 +146,7 @@ To build single version FFmpeg extension, FFmpeg binaries must be provided by us
    conda install -c conda-forge ffmpeg
    FFMPEG_ROOT=${CONDA_PREFIX}/Library python setup.py develop
 
-   
+
 [Optional] Building FFmpeg from source
 --------------------------------------