Merge branch 'pandas-dev:main' into raise-on-parse-int-overflow

Author: SandroCasagrande

.github/workflows/32-bit-linux.yml

@@ -4,10 +4,12 @@ on:
   push:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
   pull_request:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
     paths-ignore:
       - "doc/**"

.github/workflows/code-checks.yml

@@ -4,10 +4,12 @@ on:
   push:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
   pull_request:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
 
 env:

.github/workflows/docbuild-and-upload.yml

@@ -4,10 +4,14 @@ on:
   push:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
+    tags:
+      - '*'
   pull_request:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
 
 env:
@@ -49,6 +53,9 @@ jobs:
     - name: Build documentation
       run: doc/make.py --warnings-are-errors
 
+    - name: Build documentation zip
+      run: doc/make.py zip_html
+
     - name: Build the interactive terminal
       run: |
         cd web/interactive_terminal
@@ -73,6 +80,10 @@ jobs:
       run: rsync -az --delete doc/build/html/ docs@${{ secrets.server_ip }}:/usr/share/nginx/pandas/pandas-docs/dev
       if: github.event_name == 'push' && github.ref == 'refs/heads/main'
 
+    - name: Upload prod docs
+      run: rsync -az --delete doc/build/html/ docs@${{ secrets.server_ip }}:/usr/share/nginx/pandas/pandas-docs/version/${GITHUB_REF_NAME}
+      if: github.event_name == 'push' && startsWith(github.ref, 'refs/tags/')
+
     - name: Move docs into site directory
       run: mv doc/build/html web/build/docs
 

.github/workflows/macos-windows.yml

@@ -4,10 +4,12 @@ on:
   push:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
   pull_request:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
     paths-ignore:
       - "doc/**"

.github/workflows/python-dev.yml

@@ -24,10 +24,12 @@ on:
   push:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
   pull_request:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
     paths-ignore:
       - "doc/**"

.github/workflows/sdist.yml

@@ -4,10 +4,12 @@ on:
   push:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
   pull_request:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
     types: [labeled, opened, synchronize, reopened]
     paths-ignore:

.github/workflows/ubuntu.yml

@@ -4,10 +4,12 @@ on:
   push:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
   pull_request:
     branches:
       - main
+      - 1.5.x
       - 1.4.x
     paths-ignore:
       - "doc/**"

doc/source/whatsnew/index.rst

@@ -10,6 +10,14 @@ This is the list of changes to pandas between each release. For full details,
 see the `commit logs <https://github.com/pandas-dev/pandas/commits/>`_. For install and
 upgrade instructions, see :ref:`install`.
 
+Version 1.6
+-----------
+
+.. toctree::
+   :maxdepth: 2
+
+   v1.6.0
+
 Version 1.5
 -----------
 

doc/source/whatsnew/v1.4.4.rst

@@ -14,16 +14,19 @@ including other versions of pandas.
 
 Fixed regressions
 ~~~~~~~~~~~~~~~~~
+- Fixed regression in :meth:`DataFrame.fillna` not working :class:`DataFrame` with :class:`MultiIndex` (:issue:`47649`)
 - Fixed regression in taking NULL :class:`objects` from a :class:`DataFrame` causing a segmentation violation. These NULL values are created by :meth:`numpy.empty_like` (:issue:`46848`)
 - Fixed regression in :func:`concat` materializing :class:`Index` during sorting even if :class:`Index` was already sorted (:issue:`47501`)
 - Fixed regression in calling bitwise numpy ufuncs (for example, ``np.bitwise_and``) on Index objects (:issue:`46769`)
 - Fixed regression in :func:`cut` using a ``datetime64`` IntervalIndex as bins (:issue:`46218`)
 - Fixed regression in :meth:`DataFrame.select_dtypes` where ``include="number"`` included :class:`BooleanDtype` (:issue:`46870`)
+- Fixed regression in :meth:`DataFrame.loc` raising error when indexing with a ``NamedTuple`` (:issue:`48124`)
 - Fixed regression in :meth:`DataFrame.loc` not updating the cache correctly after values were set (:issue:`47867`)
 - Fixed regression in :meth:`DataFrame.loc` not aligning index in some cases when setting a :class:`DataFrame` (:issue:`47578`)
 - Fixed regression in :meth:`DataFrame.loc` setting a length-1 array like value to a single value in the DataFrame (:issue:`46268`)
 - Fixed regression when slicing with :meth:`DataFrame.loc` with :class:`DateOffset`-index (:issue:`46671`)
 - Fixed regression in setting ``None`` or non-string value into a ``string``-dtype Series using a mask (:issue:`47628`)
+- Fixed regression in :meth:`DataFrame.select_dtypes` returning a view on the original DataFrame (:issue:`48090`)
 - Fixed regression using custom Index subclasses (for example, used in xarray) with :meth:`~DataFrame.reset_index` or :meth:`Index.insert` (:issue:`47071`)
 - Fixed regression in :meth:`DatetimeIndex.intersection` when the :class:`DatetimeIndex` has dates crossing daylight savings time (:issue:`46702`)
 - Fixed regression in :func:`merge` throwing an error when passing a :class:`Series` with a multi-level name (:issue:`47946`)

doc/source/whatsnew/v1.5.0.rst

@@ -154,8 +154,6 @@ from_dummies
 
 Added new function :func:`~pandas.from_dummies` to convert a dummy coded :class:`DataFrame` into a categorical :class:`DataFrame`.
 
-Example::
-
 .. ipython:: python
 
     import pandas as pd
@@ -308,7 +306,7 @@ Other enhancements
 - :meth:`DataFrame.rolling` and :meth:`Series.rolling` now support a ``step`` parameter with fixed-length windows (:issue:`15354`)
 - Implemented a ``bool``-dtype :class:`Index`, passing a bool-dtype array-like to ``pd.Index`` will now retain ``bool`` dtype instead of casting to ``object`` (:issue:`45061`)
 - Implemented a complex-dtype :class:`Index`, passing a complex-dtype array-like to ``pd.Index`` will now retain complex dtype instead of casting to ``object`` (:issue:`45845`)
-- :class:`Series` and :class:`DataFrame` with ``IntegerDtype`` now supports bitwise operations (:issue:`34463`)
+- :class:`Series` and :class:`DataFrame` with :class:`IntegerDtype` now supports bitwise operations (:issue:`34463`)
 - Add ``milliseconds`` field support for :class:`.DateOffset` (:issue:`43371`)
 - :meth:`DataFrame.reset_index` now accepts a ``names`` argument which renames the index names (:issue:`6878`)
 - :func:`concat` now raises when ``levels`` is given but ``keys`` is None (:issue:`46653`)
@@ -319,7 +317,7 @@ Other enhancements
 - A :class:`errors.PerformanceWarning` is now thrown when using ``string[pyarrow]`` dtype with methods that don't dispatch to ``pyarrow.compute`` methods (:issue:`42613`)
 - Added ``numeric_only`` argument to :meth:`Resampler.sum`, :meth:`Resampler.prod`, :meth:`Resampler.min`, :meth:`Resampler.max`, :meth:`Resampler.first`, and :meth:`Resampler.last` (:issue:`46442`)
 - ``times`` argument in :class:`.ExponentialMovingWindow` now accepts ``np.timedelta64`` (:issue:`47003`)
-- :class:`.DataError`, :class:`.SpecificationError`, :class:`.SettingWithCopyError`, :class:`.SettingWithCopyWarning`, :class:`.NumExprClobberingError`, :class:`.UndefinedVariableError`, :class:`.IndexingError`, :class:`.PyperclipException`, :class:`.PyperclipWindowsException`, :class:`.CSSWarning`, :class:`.PossibleDataLossError`, :class:`.ClosedFileError`, :class:`.IncompatibilityWarning`, :class:`.AttributeConflictWarning`, :class:`.DatabaseError, :class:`.PossiblePrecisionLoss, :class:`.ValueLabelTypeMismatch, :class:`.InvalidColumnName, and :class:`.CategoricalConversionWarning` are now exposed in ``pandas.errors`` (:issue:`27656`)
+- :class:`.DataError`, :class:`.SpecificationError`, :class:`.SettingWithCopyError`, :class:`.SettingWithCopyWarning`, :class:`.NumExprClobberingError`, :class:`.UndefinedVariableError`, :class:`.IndexingError`, :class:`.PyperclipException`, :class:`.PyperclipWindowsException`, :class:`.CSSWarning`, :class:`.PossibleDataLossError`, :class:`.ClosedFileError`, :class:`.IncompatibilityWarning`, :class:`.AttributeConflictWarning`, :class:`.DatabaseError`, :class:`.PossiblePrecisionLoss`, :class:`.ValueLabelTypeMismatch`, :class:`.InvalidColumnName`, and :class:`.CategoricalConversionWarning` are now exposed in ``pandas.errors`` (:issue:`27656`)
 - Added ``check_like`` argument to :func:`testing.assert_series_equal` (:issue:`47247`)
 - Add support for :meth:`.GroupBy.ohlc` for extension array dtypes (:issue:`37493`)
 - Allow reading compressed SAS files with :func:`read_sas` (e.g., ``.sas7bdat.gz`` files)
@@ -491,16 +489,6 @@ Calling :meth:`.DataFrameGroupBy.value_counts` with ``observed=True`` would inco
 Backwards incompatible API changes
 ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
 
-.. _whatsnew_150.api_breaking.api_breaking1:
-
-api_breaking_change1
-^^^^^^^^^^^^^^^^^^^^
-
-.. _whatsnew_150.api_breaking.api_breaking2:
-
-api_breaking_change2
-^^^^^^^^^^^^^^^^^^^^
-
 .. _whatsnew_150.api_breaking.deps:
 
 Increased minimum versions for dependencies
@@ -567,7 +555,73 @@ Optional libraries below the lowest tested version may still work, but are not c
 +-----------------+-----------------+---------+
 | Package         | Minimum Version | Changed |
 +=================+=================+=========+
-|                 |                 |    X    |
+| beautifulsoup4  |4.9.3            |    X    |
++-----------------+-----------------+---------+
+| blosc           |1.21.0           |    X    |
++-----------------+-----------------+---------+
+| bottleneck      |1.3.2            |    X    |
++-----------------+-----------------+---------+
+| brotlipy        |0.7.0            |         |
++-----------------+-----------------+---------+
+| fastparquet     |0.4.0            |         |
++-----------------+-----------------+---------+
+| fsspec          |2021.05.0        |    X    |
++-----------------+-----------------+---------+
+| html5lib        |1.1              |         |
++-----------------+-----------------+---------+
+| hypothesis      |6.13.0           |    X    |
++-----------------+-----------------+---------+
+| gcsfs           |2021.05.0        |    X    |
++-----------------+-----------------+---------+
+| jinja2          |3.0.0            |    X    |
++-----------------+-----------------+---------+
+| lxml            |4.6.3            |    X    |
++-----------------+-----------------+---------+
+| matplotlib      |3.3.2            |         |
++-----------------+-----------------+---------+
+| numba           |0.53.1           |    X    |
++-----------------+-----------------+---------+
+| numexpr         |2.7.3            |    X    |
++-----------------+-----------------+---------+
+| odfpy           |1.4.1            |         |
++-----------------+-----------------+---------+
+| openpyxl        |3.0.7            |    X    |
++-----------------+-----------------+---------+
+| pandas-gbq      |0.15.0           |    X    |
++-----------------+-----------------+---------+
+| psycopg2        |2.8.6            |    X    |
++-----------------+-----------------+---------+
+| pyarrow         |1.0.1            |         |
++-----------------+-----------------+---------+
+| pymysql         |1.0.2            |    X    |
++-----------------+-----------------+---------+
+| pyreadstat      |1.1.2            |    X    |
++-----------------+-----------------+---------+
+| pytables        |3.6.1            |         |
++-----------------+-----------------+---------+
+| python-snappy   |0.6.0            |         |
++-----------------+-----------------+---------+
+| pyxlsb          |1.0.8            |    X    |
++-----------------+-----------------+---------+
+| s3fs            |2021.05.0        |    X    |
++-----------------+-----------------+---------+
+| scipy           |1.7.1            |    X    |
++-----------------+-----------------+---------+
+| sqlalchemy      |1.4.16           |    X    |
++-----------------+-----------------+---------+
+| tabulate        |0.8.9            |    X    |
++-----------------+-----------------+---------+
+| tzdata          |2022a            |         |
++-----------------+-----------------+---------+
+| xarray          |0.19.0           |    X    |
++-----------------+-----------------+---------+
+| xlrd            |2.0.1            |         |
++-----------------+-----------------+---------+
+| xlsxwriter      |1.4.3            |    X    |
++-----------------+-----------------+---------+
+| xlwt            |1.3.0            |         |
++-----------------+-----------------+---------+
+| zstandard       |0.15.2           |         |
 +-----------------+-----------------+---------+
 
 See :ref:`install.dependencies` and :ref:`install.optional_dependencies` for more.
@@ -703,7 +757,7 @@ retained by specifying ``group_keys=False``.
 
 Inplace operation when setting values with ``loc`` and ``iloc``
 ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
-Most of the time setting values with ``frame.iloc`` attempts to set values
+Most of the time setting values with :meth:`DataFrame.iloc` attempts to set values
 inplace, only falling back to inserting a new array if necessary. There are
 some cases where this rule is not followed, for example when setting an entire
 column from an array with different dtype:
@@ -924,7 +978,7 @@ Categorical
 ^^^^^^^^^^^
 - Bug in :meth:`.Categorical.view` not accepting integer dtypes (:issue:`25464`)
 - Bug in :meth:`.CategoricalIndex.union` when the index's categories are integer-dtype and the index contains ``NaN`` values incorrectly raising instead of casting to ``float64`` (:issue:`45362`)
-- Bug in :meth:`DataFrame.concat` when concatenating two (or more) unordered ``CategoricalIndex`` variables, whose categories are permutations, yields incorrect index values (:issue:`24845`)
+- Bug in :meth:`concat` when concatenating two (or more) unordered :class:`CategoricalIndex` variables, whose categories are permutations, yields incorrect index values (:issue:`24845`)
 
 Datetimelike
 ^^^^^^^^^^^^