This is a bugfix release for problems found in 1.13.0. The major changes are
fixes for the new memory overlap detection and temporary elision as well as
reversion of the removal of the boolean binary - operator. Users of 1.13.0
should upgrade.
Thr Python versions supported are 2.7 and 3.4 - 3.6. Note that the Python 3.6
wheels available from PIP are built against 3.6.1, hence will not work when
used with 3.6.0 due to Python bug 29943_. NumPy 1.13.2 will be released shortly
after Python 3.6.2 is out to fix that problem. If you are using 3.6.0 the
workaround is to upgrade to 3.6.1 or use an earlier Python version.
A total of 19 pull requests were merged for this release.
9240 DOC: BLD: fix lots of Sphinx warnings/errors.
9255 Revert "DEP: Raise TypeError for subtract(bool, bool)."
9261 BUG: don't elide into readonly and updateifcopy temporaries for...
9262 BUG: fix missing keyword rename for common block in numpy.f2py
9263 BUG: handle resize of 0d array
9267 DOC: update f2py front page and some doc build metadata.
9299 BUG: Fix Intel compilation on Unix.
9317 BUG: fix wrong ndim used in empty where check
9319 BUG: Make extensions compilable with MinGW on Py2.7
9339 BUG: Prevent crash if ufunc doc string is null
9340 BUG: umath: un-break ufunc where= when no out= is given
9371 DOC: Add isnat/positive ufunc to documentation
9372 BUG: Fix error in fromstring function from numpy.core.records...
9373 BUG: ')' is printed at the end pointer of the buffer in numpy.f2py.
9374 DOC: Create NumPy 1.13.1 release notes.
9376 BUG: Prevent hang traversing ufunc userloop linked list
9377 DOC: Use x1 and x2 in the heaviside docstring.
9378 DOC: Add $PARAMS to the isnat docstring
9379 DOC: Update the 1.13.1 release notes
Contributors
A total of 12 people contributed to this release. People with a "+" by their
names contributed a patch for the first time.
Andras Deak +
Bob Eldering +
Charles Harris
Daniel Hrisca +
Eric Wieser
Joshua Leahy +
Julian Taylor
Michael Seifert
Pauli Virtanen
Ralf Gommers
Roland Kaufmann
Warren Weckesser
=========================
1.13.0
==========================
This release supports Python 2.7 and 3.4 - 3.6.
Highlights
Operations like a + b + c will reuse temporaries on some platforms,
resulting in less memory use and faster execution.
Inplace operations check if inputs overlap outputs and create temporaries
to avoid problems.
New __array_ufunc__ attribute provides improved ability for classes to
override default ufunc behavior.
New np.block function for creating blocked arrays.
New functions
New np.positive ufunc.
New np.divmod ufunc provides more efficient divmod.
New np.isnat ufunc tests for NaT special values.
New np.heaviside ufunc computes the Heaviside function.
New np.isin function, improves on in1d.
New np.block function for creating blocked arrays.
New PyArray_MapIterArrayCopyIfOverlap added to NumPy C-API.
See below for details.
Deprecations
Calling np.fix, np.isposinf, and np.isneginf with f(x, y=out)
is deprecated - the argument should be passed as f(x, out=out), which
matches other ufunc-like interfaces.
Use of the C-API NPY_CHAR type number deprecated since version 1.7 will
now raise deprecation warnings at runtime. Extensions built with older f2py
versions need to be recompiled to remove the warning.
np.ma.argsort, np.ma.minimum.reduce, and np.ma.maximum.reduce
should be called with an explicit axis argument when applied to arrays with
more than 2 dimensions, as the default value of this argument (None) is
inconsistent with the rest of numpy (-1, 0, and 0, respectively).
np.ma.MaskedArray.mini is deprecated, as it almost duplicates the
functionality of np.MaskedArray.min. Exactly equivalent behaviour
can be obtained with np.ma.minimum.reduce.
The single-argument form of np.ma.minimum and np.ma.maximum is
deprecated. np.maximum. np.ma.minimum(x) should now be spelt
np.ma.minimum.reduce(x), which is consistent with how this would be done
with np.minimum.
Calling ndarray.conjugate on non-numeric dtypes is deprecated (it
should match the behavior of np.conjugate, which throws an error).
Calling expand_dims when the axis keyword does not satisfy
-a.ndim - 1 <= axis <= a.ndim, where a is the array being reshaped,
is deprecated.
Future Changes
Assignment between structured arrays with different field names will change
in NumPy 1.14. Previously, fields in the dst would be set to the value of the
identically-named field in the src. In numpy 1.14 fields will instead be
assigned 'by position': The n-th field of the dst will be set to the n-th
field of the src array. Note that the FutureWarning raised in NumPy 1.12
incorrectly reported this change as scheduled for NumPy 1.13 rather than
NumPy 1.14.
Build System Changes
numpy.distutils now automatically determines C-file dependencies with
GCC compatible compilers.
Compatibility notes
Error type changes
numpy.hstack() now throws ValueError instead of IndexError when
input is empty.
Functions taking an axis argument, when that argument is out of range, now
throw np.AxisError instead of a mixture of IndexError and
ValueError. For backwards compatibility, AxisError subclasses both of
these.
Tuple object dtypes
Support has been removed for certain obscure dtypes that were unintentionally
allowed, of the form (old_dtype, new_dtype), where either of the dtypes
is or contains the object dtype. As an exception, dtypes of the form
(object, [('name', object)]) are still supported due to evidence of
existing use.
DeprecationWarning to error
See Changes section for more detail.
partition, TypeError when non-integer partition index is used.
NpyIter_AdvancedNew, ValueError when oa_ndim == 0 and op_axes is NULL
negative(bool_), TypeError when negative applied to booleans.
subtract(bool_, bool_), TypeError when subtracting boolean from boolean.
Previously bool(dtype) would fall back to the default python
implementation, which checked if len(dtype) > 0. Since dtype objects
implement __len__ as the number of record fields, bool of scalar dtypes
would evaluate to False, which was unintuitive. Now bool(dtype) == True
for all dtypes.
__getslice__ and __setslice__ are no longer needed in ndarray subclasses
When subclassing np.ndarray in Python 2.7, it is no longer necessary to
implement __*slice__ on the derived class, as __*item__ will intercept
these calls correctly.
Any code that did implement these will work exactly as before. Code that
invokesndarray.__getslice__ (e.g. through super(...).__getslice__) will
now issue a DeprecationWarning - .__getitem__(slice(start, end)) should be
used instead.
Indexing MaskedArrays/Constants with ... (ellipsis) now returns MaskedArray
This behavior mirrors that of np.ndarray, and accounts for nested arrays in
MaskedArrays of object dtype, and ellipsis combined with other forms of
indexing.
C API changes
GUfuncs on empty arrays and NpyIter axis removal
It is now allowed to remove a zero-sized axis from NpyIter. Which may mean
that code removing axes from NpyIter has to add an additional check when
accessing the removed dimensions later on.
The largest followup change is that gufuncs are now allowed to have zero-sized
inner dimensions. This means that a gufunc now has to anticipate an empty inner
dimension, while this was never possible and an error raised instead.
For most gufuncs no change should be necessary. However, it is now possible
for gufuncs with a signature such as (..., N, M) -> (..., M) to return
a valid result if N=0 without further wrapping code.
PyArray_MapIterArrayCopyIfOverlap added to NumPy C-API
Similar to PyArray_MapIterArray but with an additional copy_if_overlap
argument. If copy_if_overlap != 0, checks if input has memory overlap with
any of the other arrays and make copies as appropriate to avoid problems if the
input is modified during the iteration. See the documentation for more complete
documentation.
New Features
__array_ufunc__ added
This is the renamed and redesigned __numpy_ufunc__. Any class, ndarray
subclass or not, can define this method or set it to None in order to
override the behavior of NumPy's ufuncs. This works quite similarly to Python's
__mul__ and other binary operation routines. See the documentation for a
more detailed description of the implementation and behavior of this new
option. The API is provisional, we do not yet guarantee backward compatibility
as modifications may be made pending feedback. See the NEP and
documentation for more details.
This ufunc corresponds to unary +, but unlike + on an ndarray it will raise
an error if array values do not support numeric operations.
New divmod ufunc
This ufunc corresponds to the Python builtin divmod, and is used to implement
divmod when called on numpy arrays. np.divmod(x, y) calculates a result
equivalent to (np.floor_divide(x, y), np.remainder(x, y)) but is
approximately twice as fast as calling the functions separately.
np.isnat ufunc tests for NaT special datetime and timedelta values
The new ufunc np.isnat finds the positions of special NaT values
within datetime and timedelta arrays. This is analogous to np.isnan.
np.heaviside ufunc computes the Heaviside function
The new function np.heaviside(x, h0) (a ufunc) computes the Heaviside
function:
.. code::
{ 0 if x < 0,
heaviside(x, h0) = { h0 if x == 0,
{ 1 if x > 0.
np.block function for creating blocked arrays
Add a new block function to the current stacking functions vstack,
hstack, and stack. This allows concatenation across multiple axes
simultaneously, with a similar syntax to array creation, but where elements
can themselves be arrays. For instance::
While primarily useful for block matrices, this works for arbitrary dimensions
of arrays.
It is similar to Matlab's square bracket notation for creating block matrices.
isin function, improving on in1d
The new function isin tests whether each element of an N-dimensonal
array is present anywhere within a second array. It is an enhancement
of in1d that preserves the shape of the first array.
Temporary elision
On platforms providing the backtrace function NumPy will try to avoid
creating temporaries in expression involving basic numeric types.
For example d = a + b + c is transformed to d = a + b; d += c which can
improve performance for large arrays as less memory bandwidth is required to
perform the operation.
axes argument for unique
In an N-dimensional array, the user can now choose the axis along which to look
for duplicate N-1-dimensional elements using numpy.unique. The original
behaviour is recovered if axis=None (default).
np.gradient now supports unevenly spaced data
Users can now specify a not-constant spacing for data.
In particular np.gradient can now take:
A single scalar to specify a sample distance for all dimensions.
N scalars to specify a constant sample distance for each dimension.
i.e. dx, dy, dz, ...
N arrays to specify the coordinates of the values along each dimension of F.
The length of the array must match the size of the corresponding dimension
Any combination of N scalars/arrays with the meaning of 2. and 3.
This means that, e.g., it is now possible to do the following::
Support for returning arrays of arbitrary dimensions in apply_along_axis
Previously, only scalars or 1D arrays could be returned by the function passed
to apply_along_axis. Now, it can return an array of any dimensionality
(including 0D), and the shape of this array replaces the axis of the array
being iterated over.
.ndim property added to dtype to complement .shape
For consistency with ndarray and broadcast, d.ndim is a shorthand
for len(d.shape).
Support for tracemalloc in Python 3.6
NumPy now supports memory tracing with tracemalloc_ module of Python 3.6 or
newer. Memory allocations from NumPy are placed into the domain defined by
numpy.lib.tracemalloc_domain.
Note that NumPy allocation will not show up in tracemalloc_ of earlier Python
versions.
NumPy may be built with relaxed stride checking debugging
Setting NPY_RELAXED_STRIDES_DEBUG=1 in the environment when relaxed stride
checking is enabled will cause NumPy to be compiled with the affected strides
set to the maximum value of npy_intp in order to help detect invalid usage of
the strides in downstream projects. When enabled, invalid usage often results
in an error being raised, but the exact type of error depends on the details of
the code. TypeError and OverflowError have been observed in the wild.
It was previously the case that this option was disabled for releases and
enabled in master and changing between the two required editing the code. It is
now disabled by default but can be enabled for test builds.
Improvements
Ufunc behavior for overlapping inputs
Operations where ufunc input and output operands have memory overlap
produced undefined results in previous NumPy versions, due to data
dependency issues. In NumPy 1.13.0, results from such operations are
now defined to be the same as for equivalent operations where there is
no memory overlap.
Operations affected now make temporary copies, as needed to eliminate
data dependency. As detecting these cases is computationally
expensive, a heuristic is used, which may in rare cases result to
needless temporary copies. For operations where the data dependency
is simple enough for the heuristic to analyze, temporary copies will
not be made even if the arrays overlap, if it can be deduced copies
are not necessary. As an example,np.add(a, b, out=a) will not
involve copies.
To illustrate a previously undefined operation::
>>> x = np.arange(16).astype(float)
>>> np.add(x[1:], x[:-1], out=x[1:])
In NumPy 1.13.0 the last line is guaranteed to be equivalent to::
A similar operation with simple non-problematic data dependence is::
>>> x = np.arange(16).astype(float)
>>> np.add(x[1:], x[:-1], out=x[:-1])
It will continue to produce the same results as in previous NumPy
versions, and will not involve unnecessary temporary copies.
The change applies also to in-place binary operations, for example::
>>> x = np.random.rand(500, 500)
>>> x += x.T
This statement is now guaranteed to be equivalent to x[...] = x + x.T,
whereas in previous NumPy versions the results were undefined.
Partial support for 64-bit f2py extensions with MinGW
Extensions that incorporate Fortran libraries can now be built using the free
MinGW toolset, also under Python 3.5. This works best for extensions that only
do calculations and uses the runtime modestly (reading and writing from files,
for instance). Note that this does not remove the need for Mingwpy; if you make
extensive use of the runtime, you will most likely run into issues. Instead,
it should be regarded as a band-aid until Mingwpy is fully functional.
Extensions can also be compiled using the MinGW toolset using the runtime
library from the (moveable) WinPython 3.4 distribution, which can be useful for
programs with a PySide1/Qt4 front-end.
Performance improvements for packbits and unpackbits
The functions numpy.packbits with boolean input and numpy.unpackbits have
been optimized to be a significantly faster for contiguous data.
Fix for PPC long double floating point information
In previous versions of NumPy, the finfo function returned invalid
information about the double double_ format of the longdouble float type
on Power PC (PPC). The invalid values resulted from the failure of the NumPy
algorithm to deal with the variable number of digits in the significand
that are a feature of PPC long doubles. This release by-passes the failing
algorithm by using heuristics to detect the presence of the PPC double double
format. A side-effect of using these heuristics is that the finfo
function is faster than previous releases.
Subclasses of ndarray with no repr specialization now correctly indent
their data and type lines.
More reliable comparisons of masked arrays
Comparisons of masked arrays were buggy for masked scalars and failed for
structured arrays with dimension higher than one. Both problems are now
solved. In the process, it was ensured that in getting the result for a
structured array, masked fields are properly ignored, i.e., the result is equal
if all fields that are non-masked in both are equal, thus making the behaviour
identical to what one gets by comparing an unstructured masked array and then
doing .all() over some axis.
np.matrix with booleans elements can now be created using the string syntax
np.matrix failed whenever one attempts to use it with booleans, e.g.,
np.matrix('True'). Now, this works as expected.
More linalg operations now accept empty vectors and matrices
All of the following functions in np.linalg now work when given input
arrays with a 0 in the last two dimensions: det, slogdet, pinv,
eigvals, eigvalsh, eig, eigh.
Bundled version of LAPACK is now 3.2.2
NumPy comes bundled with a minimal implementation of lapack for systems without
a lapack library installed, under the name of lapack_lite. This has been
upgraded from LAPACK 3.0.0 (June 30, 1999) to LAPACK 3.2.2 (June 30, 2010). See
the LAPACK changelogs_ for details on the all the changes this entails.
While no new features are exposed through numpy, this fixes some bugs
regarding "workspace" sizes, and in some places may use faster algorithms.
reduce of np.hypot.reduce and np.logical_xor allowed in more cases
This now works on empty arrays, returning 0, and can reduce over multiple axes.
Previously, a ValueError was thrown in these cases.
Better repr of object arrays
Object arrays that contain themselves no longer cause a recursion error.
Object arrays that contain list objects are now printed in a way that makes
clear the difference between a 2d object array, and a 1d object array of lists.
Changes
argsort on masked arrays takes the same default arguments as sort
By default, argsort now places the masked values at the end of the sorted
array, in the same way that sort already did. Additionally, the
end_with argument is added to argsort, for consistency with sort.
Note that this argument is not added at the end, so breaks any code that
passed fill_value as a positional argument.
average now preserves subclasses
For ndarray subclasses, numpy.average will now return an instance of the
subclass, matching the behavior of most other NumPy functions such as mean.
As a consequence, also calls that returned a scalar may now return a subclass
array scalar.
array == None and array != None do element-wise comparison
Previously these operations returned scalars False and True respectively.
np.equal, np.not_equal for object arrays ignores object identity
Previously, these functions always treated identical objects as equal. This had
the effect of overriding comparison failures, comparison of objects that did
not return booleans, such as np.arrays, and comparison of objects where the
results differed from object identity, such as NaNs.
Boolean indexing changes
Boolean array-likes (such as lists of python bools) are always treated as
boolean indexes.
Boolean scalars (including python True) are legal boolean indexes and
never treated as integers.
Boolean indexes must match the dimension of the axis that they index.
Boolean indexes used on the lhs of an assignment must match the dimensions of
the rhs.
Boolean indexing into scalar arrays return a new 1-d array. This means that
array(1)[array(True)] gives array([1]) and not the original array.
np.random.multivariate_normal behavior with bad covariance matrix
It is now possible to adjust the behavior the function will have when dealing
with the covariance matrix by using two new keyword arguments:
tol can be used to specify a tolerance to use when checking that
the covariance matrix is positive semidefinite.
check_valid can be used to configure what the function will do in the
presence of a matrix that is not positive semidefinite. Valid options are
ignore, warn and raise. The default value, warn keeps the
the behavior used on previous releases.
assert_array_less compares np.inf and -np.inf now
Previously, np.testing.assert_array_less ignored all infinite values. This
is not the expected behavior both according to documentation and intuitively.
Now, -inf < x < inf is considered True for any real number x and all
other cases fail.
assert_array_ and masked arrays assert_equal hide less warnings
Some warnings that were previously hidden by the assert_array_
functions are not hidden anymore. In most cases the warnings should be
correct and, should they occur, will require changes to the tests using
these functions.
For the masked array assert_equal version, warnings may occur when
comparing NaT. The function presently does not handle NaT or NaN
specifically and it may be best to avoid it at this time should a warning
show up due to this change.
offset attribute value in memmap objects
The offset attribute in a memmap object is now set to the
offset into the file. This is a behaviour change only for offsets
greater than mmap.ALLOCATIONGRANULARITY.
np.real and np.imag return scalars for scalar inputs
Previously, np.real and np.imag used to return array objects when
provided a scalar input, which was inconsistent with other functions like
np.angle and np.conj.
The polynomial convenience classes cannot be passed to ufuncs
The ABCPolyBase class, from which the convenience classes are derived, sets
__array_ufun__ = None in order of opt out of ufuncs. If a polynomial
convenience class instance is passed as an argument to a ufunc, a TypeError
will now be raised.
Output arguments to ufuncs can be tuples also for ufunc methods
For calls to ufuncs, it was already possible, and recommended, to use an
out argument with a tuple for ufuncs with multiple outputs. This has now
been extended to output arguments in the reduce, accumulate, and
reduceat methods. This is mostly for compatibility with __array_ufunc;
there are no ufuncs yet that have more than one output.
==========================
pandas 0.20.1 -> 0.20.3
0.20.3
This is a minor bug-fix release in the 0.20.x series and includes some small regression fixes
and bug fixes. We recommend that all users upgrade to this version.
.. contents:: What's new in v0.20.3
:local:
:backlinks: none
.. _whatsnew_0203.bug_fixes:
Bug Fixes
- Fixed a bug in failing to compute rolling computations of a column-MultiIndexed ``DataFrame`` (:issue:`16789`, :issue:`16825`)
- Fixed a pytest marker failing downstream packages' tests suites (:issue:`16680`)
Conversion
^^^^^^^^^^
- Bug in pickle compat prior to the v0.20.x series, when ``UTC`` is a timezone in a Series/DataFrame/Index (:issue:`16608`)
- Bug in ``Series`` construction when passing a ``Series`` with ``dtype='category'`` (:issue:`16524`).
- Bug in :meth:`DataFrame.astype` when passing a ``Series`` as the ``dtype`` kwarg. (:issue:`16717`).
Indexing
^^^^^^^^
- Bug in ``Float64Index`` causing an empty array instead of ``None`` to be returned from ``.get(np.nan)`` on a Series whose index did not contain any ``NaN`` s (:issue:`8569`)
- Bug in ``MultiIndex.isin`` causing an error when passing an empty iterable (:issue:`16777`)
- Fixed a bug in a slicing DataFrame/Series that have a ``TimedeltaIndex`` (:issue:`16637`)
I/O
^^^
- Bug in :func:`read_csv` in which files weren't opened as binary files by the C engine on Windows, causing EOF characters mid-field, which would fail (:issue:`16039`, :issue:`16559`, :issue:`16675`)
- Bug in :func:`read_hdf` in which reading a ``Series`` saved to an HDF file in 'fixed' format fails when an explicit ``mode='r'`` argument is supplied (:issue:`16583`)
- Bug in :meth:`DataFrame.to_latex` where ``bold_rows`` was wrongly specified to be ``True`` by default, whereas in reality row labels remained non-bold whatever parameter provided. (:issue:`16707`)
- Fixed an issue with :meth:`DataFrame.style` where generated element ids were not unique (:issue:`16780`)
- Fixed loading a ``DataFrame`` with a ``PeriodIndex``, from a ``format='fixed'`` HDFStore, in Python 3, that was written in Python 2 (:issue:`16781`)
Plotting
^^^^^^^^
- Fixed regression that prevented RGB and RGBA tuples from being used as color arguments (:issue:`16233`)
- Fixed an issue with :meth:`DataFrame.plot.scatter` that incorrectly raised a ``KeyError`` when categorical data is used for plotting (:issue:`16199`)
Reshaping
^^^^^^^^^
- ``PeriodIndex`` / ``TimedeltaIndex.join`` was missing the ``sort=`` kwarg (:issue:`16541`)
- Bug in joining on a ``MultiIndex`` with a ``category`` dtype for a level (:issue:`16627`).
- Bug in :func:`merge` when merging/joining with multiple categorical columns (:issue:`16767`)
Categorical
^^^^^^^^^^^
- Bug in ``DataFrame.sort_values`` not respecting the ``kind`` parameter with categorical data (:issue:`16793`)
.. _whatsnew_0701:
### 0.20.2
----------------------
This is a minor bug-fix release in the 0.20.x series and includes some small regression fixes,
bug fixes and performance improvements.
We recommend that all users upgrade to this version.
.. contents:: What's new in v0.20.2
:local:
:backlinks: none
.. _whatsnew_0202.enhancements:
Enhancements
Unblocked access to additional compression types supported in pytables: 'blosc:blosclz, 'blosc:lz4', 'blosc:lz4hc', 'blosc:snappy', 'blosc:zlib', 'blosc:zstd' (:issue:14478)
Series provides a to_latex method (:issue:16180)
A new groupby method :meth:~pandas.core.groupby.GroupBy.ngroup,
parallel to the existing :meth:~pandas.core.groupby.GroupBy.cumcount,
has been added to return the group order (:issue:11642); see
:ref:here <groupby.ngroup>.
.. _whatsnew_0202.performance:
Performance Improvements
- Performance regression fix when indexing with a list-like (:issue:`16285`)
- Performance regression fix for MultiIndexes (:issue:`16319`, :issue:`16346`)
- Improved performance of ``.clip()`` with scalar arguments (:issue:`15400`)
- Improved performance of groupby with categorical groupers (:issue:`16413`)
- Improved performance of ``MultiIndex.remove_unused_levels()`` (:issue:`16556`)
.. _whatsnew_0202.bug_fixes:
Bug Fixes
Silenced a warning on some Windows environments about "tput: terminal attributes: No such device or address" when
detecting the terminal size. This fix only applies to python 3 (:issue:16496)
Bug in using pathlib.Path or py.path.local objects with io functions (:issue:16291)
Bug in Index.symmetric_difference() on two equal MultiIndex's, results in a TypeError (:issue 13490)
Bug in DataFrame.update() with overwrite=False and NaN values (:issue:15593)
Passing an invalid engine to :func:read_csv now raises an informative
ValueError rather than UnboundLocalError. (:issue:16511)
Bug in :func:unique on an array of tuples (:issue:16519)
Bug in :func:cut when labels are set, resulting in incorrect label ordering (:issue:16459)
Fixed a compatibility issue with IPython 6.0's tab completion showing deprecation warnings on Categoricals (:issue:16409)
Conversion
^^^^^^^^^^
Bug in :func:to_numeric in which empty data inputs were causing a segfault of the interpreter (:issue:16302)
Silence numpy warnings when broadcasting DataFrame to Series with comparison ops (:issue:16378, :issue:16306)
Indexing
^^^^^^^^
Bug in DataFrame.reset_index(level=) with single level index (:issue:16263)
Bug in partial string indexing with a monotonic, but not strictly-monotonic, index incorrectly reversing the slice bounds (:issue:16515)
Bug in MultiIndex.remove_unused_levels() that would not return a MultiIndex equal to the original. (:issue:16556)
I/O
^^^
Bug in :func:read_csv when comment is passed in a space delimited text file (:issue:16472)
Bug in :func:read_csv not raising an exception with nonexistent columns in usecols when it had the correct length (:issue:14671)
Bug that would force importing of the clipboard routines unnecessarily, potentially causing an import error on startup (:issue:16288)
Bug that raised IndexError when HTML-rendering an empty DataFrame (:issue:15953)
Bug in :func:read_csv in which tarfile object inputs were raising an error in Python 2.x for the C engine (:issue:16530)
Bug where DataFrame.to_html() ignored the index_names parameter (:issue:16493)
Bug where pd.read_hdf() returns numpy strings for index names (:issue:13492)
Bug in HDFStore.select_as_multiple() where start/stop arguments were not respected (:issue:16209)
Plotting
^^^^^^^^
Bug in DataFrame.plot with a single column and a list-like color (:issue:3486)
Bug in plot where NaT in DatetimeIndex results in Timestamp.min (:issue: 12405)
Bug in DataFrame.boxplot where figsize keyword was not respected for non-grouped boxplots (:issue:11959)
Groupby/Resample/Rolling
^^^^^^^^^^^^^^^^^^^^^^^^
Bug in creating a time-based rolling window on an empty DataFrame (:issue:15819)
Bug in rolling.cov() with offset window (:issue:16058)
Bug in .resample() and .groupby() when aggregating on integers (:issue:16361)
Sparse
^^^^^^
Bug in construction of SparseDataFrame from scipy.sparse.dok_matrix (:issue:16179)
Reshaping
^^^^^^^^^
Bug in DataFrame.stack with unsorted levels in MultiIndex columns (:issue:16323)
Bug in pd.wide_to_long() where no error was raised when i was not a unique identifier (:issue:16382)
Bug in Series.isin(..) with a list of tuples (:issue:16394)
Bug in construction of a DataFrame with mixed dtypes including an all-NaT column. (:issue:16395)
Bug in DataFrame.agg() and Series.agg() with aggregating on non-callable attributes (:issue:16405)
Numeric
^^^^^^^
Bug in .interpolate(), where limit_direction was not respected when limit=None (default) was passed (:issue:16282)
Categorical
^^^^^^^^^^^
Fixed comparison operations considering the order of the categories when both categoricals are unordered (:issue:16014)
Other
^^^^^
Bug in DataFrame.drop() with an empty-list with non-unique indices (:issue:16270)
.. _whatsnew_0191:
psycopg2 2.7.1 -> 2.7.3.2
2.7.3.2
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Wheel package compiled against PostgreSQL 10.0 libpq and OpenSSL 1.0.2l
(:tickets:601, 602)
2.7.3.1
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
Dropped libresolv from wheel package to avoid incompatibility with
glibc 2.26 (wheels ticket 2)
2.7.3
^^^^^^^^^^^^^^^^^^^^^^^^^^^
Restored default :sql:timestamptz[] typecasting to Python !datetime.
Regression introduced in Psycopg 2.7.2 (:ticket:578).
2.7.2
^^^^^^^^^^^^^^^^^^^^^^^^^^^
Fixed inconsistent state in externally closed connections
(:tickets:263, 311, 443). Was fixed in 2.6.2 but not included in
2.7 by mistake.
Fixed Python exceptions propagation in green callback (:ticket:410).
Don't display the password in connection.dsn when the connection
string is specified as an URI (:ticket:528).
Return objects with timezone parsing "infinity" :sql:timestamptz
(:ticket:536).
Dropped dependency on VC9 runtime on Windows binary packages
(:ticket:541).
Fixed segfault in ~connection.lobject() when mode\=\ !None
(:ticket:544).
Maybe fixed random import error on Python 3.6 in multiprocess
environment (:ticket:550).
Fixed random !SystemError upon receiving abort signal (:ticket:551).
Accept ~psycopg2.sql.Composable objects in
~psycopg2.extras.ReplicationCursor.start_replication_expert()
(:ticket:554).
Parse intervals returned as microseconds from Redshift (:ticket:558).
Added ~psycopg2.extras.Json!prepare() method to consider connection
params when adapting (:ticket:562).
~psycopg2.errorcodes map updated to PostgreSQL 10 beta 1.
dedupe 1.6.13 -> 1.8.0
1.8.0
matchBlocks is not a generator; match is now optionally a generator. If the
generator option is turned of for the Gazette match is lazy
1.7.8
Speed up blocking, on our way to 3-predicates
1.7.5
Significantly reduced memory footprint during connected_components
1.7.3
Significantly reduced memory footprint during scoreDuplicates
1.7.2
Improper release
1.7.1
TempShelve class that addresses various bugs related to cleaning up tempoary shelves
1.7.0
Added target argument to blocker and predicates for changing the behavior
of the predicates for the target and source dataset if we are linking.
fastcluster 1.1.23 -> 1.1.24
1.1.24
• R 3.5 corrects the formula for the “Canberra” metric. See
https://bugs.r-project.org/bugzilla/show_bug.cgi?id=17285.
The formula in the fastcluster package was changed accordingly. This
concerns only the R interface. SciPy and fastcluster's Python interface
always had the correct formula.
fastcluster: Fast hierarchical clustering routines for R and Python
Added py-limited-api {cp32|cp33|cp34|...} flag to produce cpNN.abi3.{arch}
tags on CPython 3.
Documented the license_file metadata key
Improved Python, abi tagging for wheel convert. Thanks Ales Erjavec.
Fixed > being prepended to lines starting with "From" in the long description
Added support for specifying a build number (as per PEP 427).
Thanks Ian Cordasco.
Made the order of files in generated ZIP files deterministic.
Thanks Matthias Bach.
Made the order of requirements in metadata deterministic. Thanks Chris Lamb.
Fixed wheel install clobbering existing files
Improved the error message when trying to verify an unsigned wheel file
Removed support for Python 2.6, 3.2 and 3.3.
flake8 3.3.0 -> 3.5.0
3.5.0
You can view the 3.5.0 milestone_ on GitLab for more details.
New Dependency Information
- Allow for PyFlakes 1.6.0 (See also `GitLab359`_)
- Start using new PyCodestyle checks for bare excepts and ambiguous identifier
(See also `GitLab361`_)
Features
Print out information about configuring VCS hooks (See also GitLab335_)
Allow users to develop plugins "local" to a repository without using
setuptools. See our documentation on local plugins for more information.
(See also GitLab357_)
Bugs Fixed
- Catch and helpfully report ``UnicodeDecodeError``\ s when parsing
configuration files. (See also `GitLab358`_)
.. all links
.. _3.5.0 milestone:
https://gitlab.com/pycqa/flake8/milestones/20
.. issue links
.. _GitLab335:
https://gitlab.com/pycqa/flake8/issues/335
.. _GitLab357:
https://gitlab.com/pycqa/flake8/issues/357
.. _GitLab358:
https://gitlab.com/pycqa/flake8/issues/358
.. _GitLab359:
https://gitlab.com/pycqa/flake8/issues/359
.. _GitLab361:
https://gitlab.com/pycqa/flake8/issues/361
.. merge request links
### 3.4.1
-------------------
You can view the `3.4.1 milestone`_ on GitLab for more details.
- Fix minor regression when users specify only a ``--select`` list with items
in the enabled/extended select list. (See also `GitLab354`_)
.. all links
.. _3.4.1 milestone:
https://gitlab.com/pycqa/flake8/milestones/19
.. issue links
.. _GitLab354:
https://gitlab.com/pycqa/flake8/issues/354
.. merge request links
### 3.4.0
-------------------
You can view the `3.4.0 milestone`_ on GitLab for more details.
- Refine logic around ``--select`` and ``--ignore`` when combined with the
default values for each. (See also `GitLab318`_)
- Handle spaces as an alternate separate for error codes, e.g.,
``--ignore 'E123 E234'``. (See also `GitLab329`_)
- Filter out empty select and ignore codes, e.g., ``--ignore E123,,E234``.
(See also `GitLab330`_)
- Specify dependencies appropriately in ``setup.py`` (See also `Gitlab341_`)
- Fix bug in parsing ``--quiet`` and ``--verbose`` from config files.
(See also `GitLab!193`_)
- Remove unused import of ``os`` in the git hook template (See also
`GitLab!194`_)
.. all links
.. _3.4.0 milestone:
https://gitlab.com/pycqa/flake8/milestones/18
.. issue links
.. _GitLab318:
https://gitlab.com/pycqa/flake8/issues/318
.. _GitLab329:
https://gitlab.com/pycqa/flake8/issues/329
.. _GitLab330:
https://gitlab.com/pycqa/flake8/issues/330
.. _GitLab341:
https://gitlab.com/pycqa/flake8/issues/341
.. merge request links
.. _GitLab!193:
https://gitlab.com/pycqa/flake8/merge_requests/193
.. _GitLab!194:
https://gitlab.com/pycqa/flake8/merge_requests/194
tox 2.7.0 -> 2.9.1
2.9.1
Misc
^^^^
integrated new release process and fixed changelog rendering for pypi.org -
by obestwalter <https://github.com/obestwalter>_.
2.9
2.9.0
Features
^^^^^^^^
tox --version now shows information about all registered plugins - by
obestwalter <https://github.com/obestwalter>
(544 <https://github.com/tox-dev/tox/issues/544>)
Bugfixes
^^^^^^^^
skip_install overrides usedevelop (usedevelop is an option to
choose the installation type if the package is installed and skip_install
determines if it should be installed at all) - by ferdonline <https://github.com/ferdonline>
(571 <https://github.com/tox-dev/tox/issues/571>)
Misc
^^^^
635 <https://github.com/tox-dev/tox/issues/635> inherit from correct exception -
by obestwalter <https://github.com/obestwalter>
(635 <https://github.com/tox-dev/tox/issues/635>_).
spelling and escape sequence fixes - by scoop <https://github.com/scoop>
(637 <https://github.com/tox-dev/tox/issues/637> and
638 <https://github.com/tox-dev/tox/issues/638>_).
add a badge to show build status of documentation on readthedocs.io -
by obestwalter <https://github.com/obestwalter>_.
Improved Documentation
^^^^^^^^^^^^^^^^^^^^^^
add towncrier <https://github.com/hawkowl/towncrier> to allow adding
changelog entries with the pull requests without generating merge conflicts;
with this release notes are now grouped into four distinct collections:
Features, Bugfixes, Improved Documentation and Deprecations and Removals. (614 <https://github.com/tox-dev/tox/issues/614>)
2.8.2
466 <https://github.com/tox-dev/tox/issues/466>_: stop env var leakage if popen failed with resultjson or redirect
2.8.1
pull request 599 <https://github.com/tox-dev/tox/pull/599>: fix problems with implementation of 515 <https://github.com/tox-dev/tox/issues/515>.
Substitutions from other sections were not made anymore if they were not in envlist.
Thanks to Clark Boylan (cboylan <https://github.com/cboylan>) for helping to get this fixed (pull request 597 <https://github.com/tox-dev/tox/pull/597>).
2.8
..
Everything below here is generated by towncrier <https://pypi.python.org/pypi/towncrier>_.
It is generated once as part of the release process rendering fragments from the changelog
folder. If necessary, the generated text can be edited afterwards to e.g. merge rc changes
into the final release notes.
.. towncrier release notes start
2.8.0
276 <https://github.com/tox-dev/tox/issues/276>_: Remove easyinstall from docs (TL;DR: use pip). Thanks Martin Andrysík (sifuraz <https://github.com/sifuraz>).
301 <https://github.com/tox-dev/tox/issues/301>: Expand nested substitutions in tox.ini. Thanks vlaci <https://github.com/vlaci>. Thanks to Eli Collins
(eli-collins <https://github.com/eli-collins>_) for creating a reproducer.
315 <https://github.com/tox-dev/tox/issues/315>: add --help and --version to helptox-quickstart. Thanks vlaci <https://github.com/vlaci>.
326 <https://github.com/tox-dev/tox/issues/326>: Fix OSError 'Not a directory' when creating env on Jython 2.7.0. Thanks Nick Douma (LordGaav <https://github.com/LordGaav>).
429 <https://github.com/tox-dev/tox/issues/429>: Forward MSYSTEM by default on Windows. Thanks Marius Gedminas (mgedmin <https://github.com/mgedmin>) for reporting this.
449 <https://github.com/tox-dev/tox/issues/449>: add multi platform example to the docs. Thanks Aleks Bunin (sashkab <https://github.com/sashkab>) and rndr <https://github.com/rndr>_.
474 <https://github.com/tox-dev/tox/issues/474>_: Start using setuptools_scm for tag based versioning.
484 <https://github.com/tox-dev/tox/issues/484>: Renamed py.test to pytest throughout the project. Thanks Slam (3lnc <https://github.com/3lnc>).
504 <https://github.com/tox-dev/tox/issues/504>: With -a: do not show additional environments header if there are none. Thanks rndr <https://github.com/rndr>.
515 <https://github.com/tox-dev/tox/issues/515>: Don't require environment variables in test environments where they are not used.
Thanks André Caron (AndreLouisCaron <https://github.com/AndreLouisCaron>).
517 <https://github.com/tox-dev/tox/issues/517>_: Forward NUMBER_OF_PROCESSORS by default on Windows to fix multiprocessor.cpu_count().
Thanks André Caron (AndreLouisCaron <https://github.com/AndreLouisCaron>_).
518 <https://github.com/tox-dev/tox/issues/518>: Forward USERPROFILE by default on Windows. Thanks André Caron (AndreLouisCaron <https://github.com/AndreLouisCaron>).
pull request 528 <https://github.com/tox-dev/tox/pull/528>: Fix some of the warnings displayed by pytest 3.1.0. Thanks Bruno Oliveira (nicoddemus <https://github.com/nicoddemus>).
pull request 547 <https://github.com/tox-dev/tox/pull/547>: Add regression test for 137 <https://github.com/tox-dev/tox/issues/137>. Thanks Martin Andrysík (sifuraz <https://github.com/sifuraz>_).
pull request 553 <https://github.com/tox-dev/tox/pull/553>: Add an XFAIL test to reproduce upstream bug 203 <https://github.com/tox-dev/tox/issues/203>. Thanks
Bartolomé Sánchez Salado (bartsanchez <https://github.com/bartsanchez>_).
pull request 556 <https://github.com/tox-dev/tox/pull/556>: Report more meaningful errors on why virtualenv creation failed. Thanks vlaci <https://github.com/vlaci>.
Also thanks to Igor Sadchenko (igor-sadchenko <https://github.com/igor-sadchenko>_) for pointing out a problem with that PR
before it hit the masses ☺
pull request 575 <https://github.com/tox-dev/tox/pull/575>_: Add announcement doc to end all announcement docs
(using only CHANGELOG and Github issues since 2.5 already).
pull request 580 <https://github.com/tox-dev/tox/pull/580>: Do not ignore Sphinx warnings anymore. Thanks Bernát Gábor (gaborbernat <https://github.com/gaborbernat>).
pull request 585 <https://github.com/tox-dev/tox/pull/585>: Expand documentation to explain pass through of flags from deps to pip
(e.g. -rrequirements.txt, -cconstraints.txt). Thanks Alexander Loechel (loechel <https://github.com/loechel>).
pull request 588 <https://github.com/tox-dev/tox/pull/588>_: Run pytest wit xfail_strict and adapt affected tests.
Sphinx 1.6.1 -> 1.6.5
1.6.5
=====================================
Features added
4107: Make searchtools.js compatible with pre-Sphinx1.5 templates
4112: Don't override the smart_quotes setting if it was already set
4125: Display reference texts of original and translated passages on
i18n warning message
4147: Include the exception when logging PO/MO file read/write
Bugs fixed
4085: Failed PDF build from image in parsed-literal using :align: option
4100: Remove debug print from autodoc extension
3987: Changing theme from alabaster causes HTML build to fail
4096: C++, don't crash when using the wrong role type. Thanks to mitya57.
4070, 4111: crashes when the warning message contains format strings (again)
4108: Search word highlighting breaks SVG images
3692: Unable to build HTML if writing .buildinfo failed
4152: HTML writer crashes if a field list is placed on top of the document
4063: Sphinx crashes when labeling directive .. todolist::
4134: [doc] :file:docutils.conf is not documented explicitly
4169: Chinese language doesn't trigger Chinese search automatically
1020: ext.todo todolist not linking to the page in pdflatex
3965: New quickstart generates wrong SPHINXBUILD in Makefile
3739: :module: option is ignored at content of pyobjects
4149: Documentation: Help choosing :confval:latex_engine
4090: [doc] :confval:latex_additional_files with extra LaTeX macros should
not use .tex extension
Failed to convert reST parser error to warning (refs: 4132)
1.6.4
=====================================
Features added
3926: Add autodoc_warningiserror to suppress the behavior of -W
option during importing target modules on autodoc
Bugs fixed
3924: docname lost after dynamically parsing RST in extension
3946: Typo in sphinx.sty (this was a bug with no effect in default context)
:pep: and :rfc: does not supports default-role directive (refs: 3960)
3960: default_role = 'guilabel' not functioning
Missing texinputs_win/Makefile to be used in latexpdf builder on windows.
4041: C++, remove extra name linking in function pointers.
4038: C, add missing documentation of member role.
4044: An empty multicolumn cell causes extra row height in PDF output
4049: Fix typo in output of sphinx-build -h
4062: hashlib.sha1() must take bytes, not unicode on Python 3
Avoid indent after index entries in latex (refs: 4066)
4070: crashes when the warning message contains format strings
4067: Return non-zero exit status when make subprocess fails
4055: graphviz: the :align: option does not work for SVG output
4055: graphviz: the :align: center option does not work for latex output
4051: warn() function for HTML theme outputs 'None' string
1.6.3
=====================================
Features added
latex: hint that code-block continues on next page (refs: 3764, 3792)
Bugs fixed
3821: Failed to import sphinx.util.compat with docutils-0.14rc1
3829: sphinx-quickstart template is incomplete regarding use of alabaster
3772: 'str object' has no attribute 'filename'
Emit wrong warnings if citation label includes hyphens (refs: 3565)
3858: Some warnings are not colored when using --color option
3775: Remove unwanted whitespace in default template
3835: sphinx.ext.imgmath fails to convert SVG images if project directory
name contains spaces
3850: Fix color handling in make mode's help command
3865: use of self.env.warn in sphinx extension fails
3824: production lists apply smart quotes transform since Sphinx 1.6.1
latex: fix \sphinxbfcode swallows initial space of argument
3878: Quotes in auto-documented class attributes should be straight quotes
in PDF output
3881: LaTeX figure floated to next page sometimes leaves extra vertical
whitespace
3885: duplicated footnotes raises IndexError
3873: Failure of deprecation warning mechanism of
sphinx.util.compat.Directive
3874: Bogus warnings for "citation not referenced" for cross-file citations
3860: Don't download images when builders not supported images
3860: Remote image URIs without filename break builders not supported remote
images
3833: command line messages are translated unintentionally with language
setting.
3840: make checking epub_uid strict
3851, 3706: Fix about box drawing characters for PDF output
3900: autosummary could not find methods
3902: Emit error if latex_documents contains non-unicode string in py2
1.6.2
=====================================
Incompatible changes
3789: Do not require typing module for python>=3.5
Bugs fixed
3754: HTML builder crashes if HTML theme appends own stylesheets
3756: epub: Entity 'mdash' not defined
3758: Sphinx crashed if logs are emitted in conf.py
3755: incorrectly warns about dedent with literalinclude
3742: RTD <https://readthedocs.org/> PDF builds of Sphinx own docs are
missing an index entry in the bookmarks and table of contents. This is
rtfd/readthedocs.org2857 <https://github.com/rtfd/readthedocs.org/issues/2857> issue, a workaround
is obtained using some extra LaTeX code in Sphinx's own :file:conf.py
3770: Build fails when a "code-block" has the option emphasize-lines and the
number indicated is higher than the number of lines
3774: Incremental HTML building broken when using citations
3763: got epubcheck validations error if epub_cover is set
3779: 'ImportError' in sphinx.ext.autodoc due to broken 'sys.meta_path'.
Thanks to Tatiana Tereshchenko.
3796: env.resolve_references() crashes when non-document node given
3803: Sphinx crashes with invalid PO files
3791: PDF "continued on next page" for long tables isn't internationalized
3788: smartquotes emits warnings for unsupported languages
3807: latex Makefile for make latexpdf is only for unixen
3781: double hyphens in option directive are compiled as endashes
3817: latex builder raises AttributeError
cryptography 1.8.1 -> 2.1.2
2.1.1
* Fixed support for install with the system ``pip`` on Ubuntu 16.04.
.. _v2-1:
### 2.1
FINAL DEPRECATION Python 2.6 support is deprecated, and will be removed
in the next release of cryptography.
BACKWARDS INCOMPATIBLE:Whirlpool, RIPEMD160, and
UnsupportedExtension have been removed in accordance with our
:doc:/api-stability policy.
BACKWARDS INCOMPATIBLE:
:attr:DNSName.value <cryptography.x509.DNSName.value>,
:attr:RFC822Name.value <cryptography.x509.RFC822Name.value>, and
:attr:UniformResourceIdentifier.value <cryptography.x509.UniformResourceIdentifier.value>
will now return an :term:A-label string when parsing a certificate
containing an internationalized domain name (IDN) or if the caller passed
a :term:U-label to the constructor. See below for additional deprecations
related to this change.
Installing cryptography now requires pip 6 or newer.
Deprecated passing :term:U-label strings to the
:class:~cryptography.x509.DNSName,
:class:~cryptography.x509.UniformResourceIdentifier, and
:class:~cryptography.x509.RFC822Name constructors. Instead, users should
pass values as :term:A-label strings with idna encoding if necessary.
This change will not affect anyone who is not processing internationalized
domains.
Added support for
:class:~cryptography.hazmat.primitives.ciphers.algorithms.ChaCha20. In
most cases users should choose
:class:~cryptography.hazmat.primitives.ciphers.aead.ChaCha20Poly1305
rather than using this unauthenticated form.
Added :meth:~cryptography.x509.CertificateRevocationList.is_signature_valid
to :class:~cryptography.x509.CertificateRevocationList.
Support :class:~cryptography.hazmat.primitives.hashes.BLAKE2b and
:class:~cryptography.hazmat.primitives.hashes.BLAKE2s with
:class:~cryptography.hazmat.primitives.hmac.HMAC.
Added support for
:class:~cryptography.hazmat.primitives.ciphers.modes.XTS mode for
AES.
Added support for using labels with
:class:~cryptography.hazmat.primitives.asymmetric.padding.OAEP when using
OpenSSL 1.0.2 or greater.
Improved compatibility with NSS when issuing certificates from an issuer
that has a subject with non-UTF8String string types.
Add support for the :class:~cryptography.x509.DeltaCRLIndicator extension.
Add support for the :class:~cryptography.x509.TLSFeature
extension. This is commonly used for enabling OCSP Must-Staple in
certificates.
Add support for the :class:~cryptography.x509.FreshestCRL extension.
.. _v2-0-3:
2.0.3
* Fixed an issue with weak linking symbols when compiling on macOS
versions older than 10.12.
.. _v2-0-2:
### 2.0.2
Marked all symbols as hidden in the manylinux1 wheel to avoid a
bug with symbol resolution in certain scenarios.
.. _v2-0-1:
2.0.1
* Fixed a compilation bug affecting OpenBSD.
* Altered the ``manylinux1`` wheels to statically link OpenSSL instead of
dynamically linking and bundling the shared object. This should resolve
crashes seen when using ``uwsgi`` or other binaries that link agai
pyup-bot
commented
7 years ago
Updates
Here's a list of all the updates bundled in this pull request. I've added some links to make it easier for you to find all the information you need.
Changelogs
numpy 1.12.1 -> 1.13.3
pandas 0.20.1 -> 0.20.3
psycopg2 2.7.1 -> 2.7.3.2
dedupe 1.6.13 -> 1.8.0
fastcluster 1.1.23 -> 1.1.24
wheel 0.29.0 -> 0.30.0
flake8 3.3.0 -> 3.5.0
tox 2.7.0 -> 2.9.1
Sphinx 1.6.1 -> 1.6.5
cryptography 1.8.1 -> 2.1.2