Merge branch 'master' into nui-regression

Author: jreback

.github/workflows/database.yml

@@ -86,6 +86,9 @@ jobs:
       run: ci/run_tests.sh
       if: always()
 
+    - name: Build Version
+      run: pushd /tmp && python -c "import pandas; pandas.show_versions();" && popd
+
     - name: Publish test results
       uses: actions/upload-artifact@master
       with:
@@ -169,6 +172,9 @@ jobs:
       run: ci/run_tests.sh
       if: always()
 
+    - name: Build Version
+      run: pushd /tmp && python -c "import pandas; pandas.show_versions();" && popd
+
     - name: Publish test results
       uses: actions/upload-artifact@master
       with:

.gitignore

@@ -110,7 +110,7 @@ asv_bench/pandas/
 doc/source/generated
 doc/source/user_guide/styled.xlsx
 doc/source/reference/api
-doc/source/_static
+doc/source/_static/*.html
 doc/source/vbench
 doc/source/vbench.rst
 doc/source/index.rst

.pre-commit-config.yaml

@@ -1,4 +1,4 @@
-minimum_pre_commit_version: '2.9.2'
+minimum_pre_commit_version: 2.9.2
 repos:
 -   repo: https://github.com/python/black
     rev: 20.8b1
@@ -162,9 +162,15 @@ repos:
     hooks:
     -   id: yesqa
 -   repo: https://github.com/pre-commit/pre-commit-hooks
-    rev: v3.3.0
+    rev: v3.4.0
     hooks:
     -   id: end-of-file-fixer
         exclude: ^LICENSES/|\.(html|csv|txt|svg|py)$
     -   id: trailing-whitespace
         exclude: \.(html|svg)$
+-   repo: https://github.com/codespell-project/codespell
+    rev: v2.0.0
+    hooks:
+    -   id: codespell
+        types_or: [python, rst, markdown]
+        files: ^pandas/core/

asv_bench/benchmarks/frame_methods.py

@@ -597,6 +597,19 @@ def time_frame_quantile(self, axis):
         self.df.quantile([0.1, 0.5], axis=axis)
 
 
+class Rank:
+    param_names = ["dtype"]
+    params = [
+        ["int", "uint", "float", "object"],
+    ]
+
+    def setup(self, dtype):
+        self.df = DataFrame(np.random.randn(10000, 10), columns=range(10), dtype=dtype)
+
+    def time_rank(self, dtype):
+        self.df.rank()
+
+
 class GetDtypeCounts:
     # 2807
     def setup(self):

asv_bench/benchmarks/groupby.py

@@ -29,7 +29,6 @@
         "skew",
         "cumprod",
         "cummax",
-        "rank",
         "pct_change",
         "min",
         "var",

asv_bench/benchmarks/series_methods.py

@@ -349,4 +349,18 @@ def time_func(self, func, N, dtype):
         self.func()
 
 
+class Rank:
+
+    param_names = ["dtype"]
+    params = [
+        ["int", "uint", "float", "object"],
+    ]
+
+    def setup(self, dtype):
+        self.s = Series(np.random.randint(0, 1000, size=100000), dtype=dtype)
+
+    def time_rank(self, dtype):
+        self.s.rank()
+
+
 from .pandas_vb_common import setup  # noqa: F401 isort:skip

doc/source/_static/banklist.html

@@ -68,7 +68,12 @@
     "contributors",  # custom pandas extension
 ]
 
-exclude_patterns = ["**.ipynb_checkpoints"]
+exclude_patterns = [
+    "**.ipynb_checkpoints",
+    # to ensure that include files (partial pages) aren't built, exclude them
+    # https://github.com/sphinx-doc/sphinx/issues/1965#issuecomment-124732907
+    "**/includes/**",
+]
 try:
     import nbconvert
 except ImportError:

doc/source/_static/excel_pivot.png

@@ -1610,6 +1610,17 @@ request by pushing to the branch on GitHub::
 
     git push origin shiny-new-feature
 
+Autofixing formatting errors
+----------------------------
+
+We use several styling checks (e.g. ``black``, ``flake8``, ``isort``) which are run after
+you make a pull request. If there is a scenario where any of these checks fail then you
+can comment::
+
+    @github-actions pre-commit
+
+on that pull request. This will trigger a workflow which will autofix formatting errors.
+
 Delete your merged branch (optional)
 ------------------------------------
 

doc/source/_static/logo_excel.svg

@@ -151,6 +151,17 @@ Here are some things to check when reviewing a pull request.
   for regression fixes and small bug fixes, the next minor milestone otherwise)
 * Changes should comply with our :ref:`policies.version`.
 
+Backporting
+-----------
+
+In the case you want to apply changes to a stable branch from a newer branch then you
+can comment::
+
+    @meeseeksdev backport version-branch
+
+This will trigger a workflow which will backport a given change to a branch
+(e.g. @meeseeksdev backport 1.2.x)
+
 Cleaning up old issues
 ----------------------
 

doc/source/conf.py

@@ -149,13 +149,6 @@ be located.
             ``frame_or_series`` fixture, by convention it goes in the
             ``tests.frame`` file.
 
-      - tests.generic.methods.test_mymethod
-
-        .. note::
-
-           The generic/methods/ directory is only for methods with tests
-           that are fully parametrized over Series/DataFrame
-
 7. Is your test for an Index method, not depending on Series/DataFrame?
    This test likely belongs in one of:
 

doc/source/development/contributing.rst

@@ -0,0 +1,9 @@
+If you're new to pandas, you might want to first read through :ref:`10 Minutes to pandas<10min>`
+to familiarize yourself with the library.
+
+As is customary, we import pandas and NumPy as follows:
+
+.. ipython:: python
+
+    import pandas as pd
+    import numpy as np

doc/source/development/maintaining.rst

@@ -8,16 +8,7 @@ For potential users coming from `SAS <https://en.wikipedia.org/wiki/SAS_(softwar
 this page is meant to demonstrate how different SAS operations would be
 performed in pandas.
 
-If you're new to pandas, you might want to first read through :ref:`10 Minutes to pandas<10min>`
-to familiarize yourself with the library.
-
-As is customary, we import pandas and NumPy as follows:
-
-.. ipython:: python
-
-    import pandas as pd
-    import numpy as np
-
+.. include:: comparison_boilerplate.rst
 
 .. note::
 
@@ -48,14 +39,17 @@ General terminology translation
     ``NaN``, ``.``
 
 
-``DataFrame`` / ``Series``
-~~~~~~~~~~~~~~~~~~~~~~~~~~
+``DataFrame``
+~~~~~~~~~~~~~
 
 A ``DataFrame`` in pandas is analogous to a SAS data set - a two-dimensional
 data source with labeled columns that can be of different types. As will be
 shown in this document, almost any operation that can be applied to a data set
 using SAS's ``DATA`` step, can also be accomplished in pandas.
 
+``Series``
+~~~~~~~~~~
+
 A ``Series`` is the data structure that represents one column of a
 ``DataFrame``. SAS doesn't have a separate data structure for a single column,
 but in general, working with a ``Series`` is analogous to referencing a column