Add coerce_numeric to pipe.enforce_dtypes().
Setting this to False will not cast floats to Decimal if the corresponding dtype is int.
Improve JSON serialization when filtering for updates.
Add date_bound_only to pipe.filter_existing().
The argument date_bound_only means that samples retrieved by pipe.get_data() will only use begin and end for bounding. This may improve performance for custom instance connectors which have limited searchability.
Add safe_copy to pipe.enforce_types(), pipe.filter_existing(), filter_unseen_df().
By default, these functions will create copies of dataframes to avoid mutating the input dataframes. Setting safe_copy to False may be more memory efficient.
Add multiline support to extract_stats_from_message.
Multiple messages separated by newlines may be parsed at once.
Improve shell startup performance by removing support for cmd2.
The package cmd2 never behaved properly, so support has been removed and only the built-in cmd powers the shell. As such, the configuration key shell:cmd has been removed.
v2.1.7
Add
query_df()
tomeerschaum.utils.dataframe
.The function
query_df()
allows you to filter dataframes byparams
,begin
, andend
.Add
get_in_ex_params()
tomeerschaum.utils.misc
.This function parses a standard
params
dictionary into tuples of include and exclude parameters.coerce_numeric
topipe.enforce_dtypes()
.Setting this to
False
will not cast floats toDecimal
if the corresponding dtype isint
.date_bound_only
topipe.filter_existing()
.The argument
date_bound_only
means that samples retrieved bypipe.get_data()
will only usebegin
andend
for bounding. This may improve performance for custom instance connectors which have limited searchability.safe_copy
topipe.enforce_types()
,pipe.filter_existing()
,filter_unseen_df()
.By default, these functions will create copies of dataframes to avoid mutating the input dataframes. Setting
safe_copy
toFalse
may be more memory efficient.extract_stats_from_message
.Multiple messages separated by newlines may be parsed at once.
order by
check in SQL queries.cmd2
.The package
cmd2
never behaved properly, so support has been removed and only the built-incmd
powers the shell. As such, the configuration keyshell:cmd
has been removed.