PaddlePaddle / PaddleNLP

👑 Easy-to-use and powerful NLP and LLM library with 🤗 Awesome model zoo, supporting wide-range of NLP tasks from research to industrial applications, including 🗂Text Classification, 🔍 Neural Search, ❓ Question Answering, ℹ️ Information Extraction, 📄 Document Intelligence, 💌 Sentiment Analysis etc.
https://paddlenlp.readthedocs.io
Apache License 2.0
11.93k stars 2.91k forks source link

Project dependencies may have API risk issues #5197

Closed PyDeps closed 5 months ago

PyDeps commented 1 year ago

问题描述

Hi, In PaddleNLP, inappropriate dependency versioning constraints can cause risks.

Below are the dependencies and version constraints that the project is using

jieba
colorlog
seqeval
multiprocess<=0.70.12.2
datasets>=2.0.0
tqdm
sentencepiece
fastapi
typer
rich

The version constraint == will introduce the risk of dependency conflicts because the scope of dependencies is too strict. The version constraint No Upper Bound and * will introduce the risk of the missing API Error because the latest version of the dependencies may remove some APIs.

After further analysis, in this project, The version constraint of dependency tqdm can be changed to >=4.42.0,<=4.64.0.

The above modification suggestions can reduce the dependency conflicts as much as possible, and introduce the latest version as much as possible without calling Error in the projects.

The invocation of the current project includes all the following methods.

In version tqdm-4.41.1, the API tqdm.contrib.tzip whch is used by the current project in applications/question_answering/unsupervised_qa/tools/question_coverage.py is missing.

image
The calling methods from the tqdm
tqdm.trange
tqdm.auto.tqdm.get_lock
tqdm.contrib.tzip
tqdm.tqdm.close
tqdm.auto.tqdm.update
tqdm.auto.tqdm.set_postfix
tqdm.tqdm.update
tqdm.tqdm
tqdm.auto.tqdm.set_description
tqdm.auto.tqdm.set_lock
tqdm.auto.tqdm.close
tqdm.auto.tqdm
The calling methods from the all methods
paddle.tensor.matmul
head_mask.to.dim
self.quant.append
self.get_start_end_idx
self.test_dataloader.set_batch_generator
self.ErnieLMPredictionHead.super.__init__
self.out1
do_generation
text_encoder
model.LayoutXLMForTokenClassification_with_CRF.from_pretrained
tokenizer.update
tokenize_data
self._ocr_lang_choice.self._parser_map.parse
self._generate_example_mrpc_files
h5py.File.flush
sharding_world.tolist
self._get_encoder
args.dataset.METRIC_CLASSES
qag_col1.markdown
FunnelBaseModel
font_name.URLS.os.path.basename.split
TransformerService.set_gpus
utils.preprocess_prediction_data
self.REDecoder.super.__init__
unicodedata.combining
self.re.compile
inputs.detach
logits_fake.detach.mean
utils.tools.get_bool_ids_greater_than
ppdiffusers.LDMSuperResolutionPipeline.from_pretrained
MobileBertPooler
self.crit.mean
TokenBatchCreator
self.RemBertOnlyMLMHead.super.__init__
LayoutLMv2Output
self.features_all.append
self.final_conv1d_2
get_wemb_h
wrap_sharding_2_3
filename.endswith
self.hcg.get_data_parallel_group
CriterionWrapper
token_list.append
convert_csl
predictor.Predictor.evaluate
paddlenlp.trainer.Trainer.evaluate
super.generate
self.ErnieGramForTokenClassification.super.__init__
self._get_run_node_signature
self._prepare_qkv
k.endswith
orginal_vocab_file.SentencePieceExtractor.extract
self.height_emb
qa_generation_pipeline
super.evaluate
self.mobilebert
self._set_num_buckets
self._encode_text_prompt.tile
ds.features.values
model.PointwiseMatching.eval
paddle.nn.functional.label_smooth
cut_chinese_sent
paddle.to_tensor.tolist
T5Dataset
self._construct_trainer.train
self.activation_function
self._create_trie
self.ProjAdaptiveSoftmax.super.__init__
eval
args.lr_scheduler.LR_SCHEDULER_REGISTRY.build_scheculer
file_paths.append
data.MRCIterator.shuffle_sample
self.generate_coco_data
MsraNerConfig
vae.quant_conv.parameters
paddle.concat.reshape
_build_linear
self.XLNetRelativeAttention.super.__init__
self.LayoutXLMSelfAttention.super.__init__
v.subtract_
self.movements.rank
random_completion_id
Trainer
paddle.ones.dim
self.scheduler.set_timesteps
infer_inputs.append
self.context.append
nlp_format.format
filter_event_in_instance
self.clip_model.eval
globals
self._fc1
head_dim.num_heads.batch_size.v.reshape.transpose
self._pretokenized.get_string_split
batch_label.np.array.astype
cls._get_tokenizer_class_from_config
self.CrossEntropyLossForSQuAD.super.__init__
all_start_logits.extend
labels_to_index.append
encoder.enable_fast_encoder.load_dict
self.get_indices
self.collection.has_partition
super.find_class
self._preprocess_data
text2sql.optim.init_optimizer.set_state_dict
paddle.nn.decode.dynamic_decode
eval_group
lossfn.backward
self.ids_to_tokens.get
numpy.concatenate.mean
self._get_variance
previous_query_states.append
self.rule_choice
metric.MetricReport
paddle.concat.view
probs.append
self.TrainCallback.super.on_epoch_begin
result.re.search.group.lstrip.rstrip
tokens.append
self.Seq2SeqDecoderCell.super.__init__
df.sort_values.iterrows
paddle.reshape.matmul
StableDiffusionPipelineOutput
self.encoder.forward.inspect.signature.parameters.keys
instance.sort
self._create_soft_encoders
BpeEncoder
utils.preprocess_data
c.transpose
numpy.min
self.fourier_transform
new_states.extend
self.__dict__.items
self.upsample.reshape
self.init_encoder_seq
self.gen_self_attn_mask
batch_results.extend
token_score_dict.append
i.student.tinybert.fit_denses
train_program.global_block.all_parameters
C.pretokenizers.ByteLevelPreTokenizer
i.self.dropouts
prepare_input
_config.get
networkx.topological_sort
C.pretokenizers.PreTokenizedString
x_shape.x_shape.ones.paddle.tril.unsqueeze
self.save_model
self.pad_token_id.input_ids.astype.astype
self.dim_per_head.self.n_heads.x.reshape.transpose
generate_examples
examples.example.example.paddle.stack.cast
metrics.append
string.endswith
LIME.lime_base.LimeBase
feature.qas_id.example_index_to_features.append
pipeline_versatile_diffusion_dual_guided.VersatileDiffusionDualGuidedPipeline._swap_unet_attention_blocks
attention_mask.astype.expand
paddlenlp.metrics.CorrectionF1.accumulate
test_ds_10.map.map
subword_nmt.subword_nmt.create_apply_bpe_parser.parse_args
unet_2d_blocks.UNetMidBlock2DCrossAttn
str.replace
decoder_states.append
ppdiffusers.AutoencoderKL.from_pretrained.decode
text_input_ids.astype
CharLSTMEncoder
paddlenlp.transformers.BasicTokenizer.tokenize
GlyphEmbedding
pages.split.pop
self.lstm_encoder
gold_wo_agg.remove
utils.fn_args_to_dict
im_shape
self._process_batch
timesteps.timesteps_interpol.paddle.stack.flatten
i.results_concat.tolist
all_processor_names.append
masked_image.cast.cast
tqdm.trange.close
total_chunk_size.paddle.arange.unsqueeze.expand
paddle_infer_info.strip.split
paddlenlp.transformers.distill_utils.to_distill
paddle.fluid.io.load_vars
self._map
output.metrics.update
sampler.sort.batch
_decode_image
image.numpy
self.v_lin
_hash_ids.add
self.src_pos_embedding
self._load_rng_state
raw_forward
fr.readlines
paddle.fluid.dygraph.amp.auto_cast.amp_state
self.compute
tar.extractall
optim_cls
self.BitGroupNormActivation.super.__init__
tokenzier.convert_tokens_to_ids
answer.replace.replace
label_dict.items
tokenized_text.extend
word_pad
self.y_position_embeddings
inputs.reshape
nd_index.paddle.stack.paddle.transpose.astype
self.callback_handler.remove_callback
MODEL_CLASSES.values
current_sub_text.append
paddle.distributed.fleet.fleet._hcg.get_model_parallel_group
get_char_list
tgt_ids.np.zeros_like.reshape.tolist
batch_size.paddle.zeros.scores_dtype.beam_size.beam_size.batch_size.paddle.arange.scores.flatten.paddle.scatter.reshape
pythainlp.tokenize.word_tokenize
img.model.encode.latent_dist.sample
loss.mean.mean
string.strip.lower
is_start_piece
string.Template
self.learned_classifier_free_guidance_embeddings.unsqueeze
cand_list.append
results_concat.tolist
requests.post.json
batch_ids.np.zeros_like.astype
smooth_loss.sum.sum
self._upsample_2d
remove_missing_tables_from_select
self.preprocess_logits_for_metrics
utterances.append
_id.predictions.keys
query_emb.reshape.astype
self.LukeLMHead.super.__init__
self._generate_continue
self._predictor.get_outputs
paddle.nn.functional.conv2d
get_input_ids
tokenizer_class.from_pretrained
doc.to_dict
paddlenlp.transformers.roberta.tokenizer.RobertaTokenizer.from_pretrained
Vocab
PIL.ImageOps.autocontrast
numpy.concatenate
file.os.path.dirname.pathlib.Path.mkdir
self.__set_dir_properties
UnifiedTransformerEmbeddings
self.slice2.add_sublayer
interaction.start_interaction
ppdiffusers.StableDiffusionImageVariationPipeline
super._decode
paddle.matmul.cast
self.autolog.tic
self.word_ids
sample.clip.clip
h.astype.self.norm2.astype
convert_from_json_to_filtration_format
self.IpuBertForQuestionAnswering.super.__init__
modeling.GPTModel.guard
s_arc.max.reshape
LayoutLMv2Attention
paddlenlp.datasets.load_dataset.map
self.match_shape
is_paddle_available
i.infer_data.append
paddle.tensor.gather
self.anonymizer.is_anon_tok
cached_finished_seqs.sort
Runner.Run
self.collection.search
tokenized_datasets.map.save_to_disk
self._merge_hidden_size_dims.reshape
meta_fields.items
paddlenlp.metrics.glue.AccuracyAndF1.accumulate
ppdiffusers.VQDiffusionPipeline.from_pretrained
self.set_processor
self._check_input_text.strip
d.median.numpy
chunk_sequence_indices.flatten.flatten
string.Template.substitute
image.transpose.numpy
token_type_ids.input_ids.model.numpy
code_lines.append
text_embeddings_clip.image_embeddings_clip.spherical_dist_loss.mean
weight.reshape.reshape
self.vqvae.quantize.get_codebook_entry
get_wemb_bert
SqueezeBertEmbeddings
batchify
transformers.models.opt.modeling_opt.OPTForCausalLM.from_pretrained.generate
ProcessFn.tokenizer.convert_tokens_to_ids
query.self.query_proj.unsqueeze
atis_vocab.ATISVocabulary
transformers.GPT2LMHeadModel.from_pretrained
sys.modules.keys
evids_load.append
self._get_extension.lstrip
ssim_map.mean
logging.addLevelName
DocVQAExample
do_client
inspect.signature.items
len.dim
token_predictor.PredictionInputWithSchema
example_qas_id.split
values.append
numpy.interp
eos_pos.output.tolist
hnswlib.Index.add_items
BlipForConditionalGenerationModelOutput
self.layoutxlm
hnswlib.Index.set_ef
super.__new__
v.lower
self.template.parameters
fn_recursive_attn_processor
self.tensor_info_saver.add
x_in_grad.paddle.isnan.any
self.event_queue.put
html.unescape
paddlenlp.transformers.SkepTokenizer.from_pretrained
uie.seq2struct.utils.get_scheduler.get_lr
utils.OptionalDependencyNotAvailable
predict.extend
infer_channel_dimension_format
decoded_words.index
self.transform_act_fn
i.k.relations.keys
assign_to_checkpoint
self.ernie_m
i.convert
_create_dataloader
logging.warn
paddlenlp.transformers.UIEM.from_pretrained
spo.keys
find_subtree
offline_qa_generation
self.parameters
bucket.pop
FunnelDiscriminatorPredictions
FunnelClassificationHead
self.ci.interrogate_classic
C.pretokenizers.SplitPreTokenizer
self.callback_handler.on_epoch_end
type.concat
self.rdrop_loss
SentiData
processor.flatten
paddlenlp.transformers.GPTForPretraining.from_pretrained
self.create_partition
BiLSTM.parameters
contrastive_loss
ref_ngram.append
self.transpose_for_scores
filepath.os.path.splitext.split
self._ensure_format_supported
dataset.set_format
paddle.where.flatten
v.cpu.numpy
vec_list.append
paddle.square
utils.get_scheduler
_get_url_hashes
Cail2019_SCM_Accuracy.accumulate
r.maxc.g.maxc.cast
answers_clear.append
self.__module__.startswith
height_emb.unsqueeze.unsqueeze
self.ext_output_hanle.copy_to_cpu
remove_non_printing_char
data_id.numpy.numpy
TransformerDecoderLayer.type
dataset.create_pretraining_dataset
self._normalizer
_tokenize_chinese_chars.strip
self.unsqueeze.relative_pos
self.discriminator.detach
original_config.model.params.cond_stage_config.target.split
label_words.keys
compute_loss
grow_finished
inverse_relation.append
sql_util.fix_parentheses
hs.pop
tokens.join.replace
vocabulary.Vocabulary
self._tag_vocab.values
seek_by_string
self.InferTransformerDecoder.super.__init__
model_class.from_pretrained.train
paddlenlp.ops.TransformerGenerator.load
entities.append
obs.repeat.repeat
self.rel_pos_x_bias.rel_pos_x.paddle.matmul.transpose
short_input_texts.append
paddle.maximum
paddle.shape
input_ids.list.index
paddle.nn.Identity
BlenderbotSmallDecoderLayer
squad.RCInterpret.read.map
bk_tree.search_similar_word
mask.reshape.reshape
word_vocab.to_json
eval_dataloader
i.self.layers
paddle.nn.functional.margin_ranking_loss
interaction.load_function
unet_blocks.UNetMidBlock2D
paddle.to_tensor.expand
paddlenlp.ops.get_ft_para_conf
self.r_proj
feature_sim
snippet.assign_id
cls._build_tree
self.squeezebert
task_name.title
file_handler.read
_assert_strides_are_log2_contiguous
self.emoji.demojize
self.query_ernie
paddle.inference.Config.enable_xpu
paddle.ones_like.reshape
relation_prompt_list.append
utils.ie_utils.map_offset
do_eval
self.PretrainedModel.super.__getattr__
self.input_handles.copy_from_cpu
all_image_embeds.norm.norm
self.base.explain_instance_with_data
input_block_chans.append
obj.numpy
self.scheduler.add_noise
pymilvus.utility.has_collection
self.scheduler.config.get
answer.meta.update
model.to.eval
r_emb.unsqueeze.expand.unsqueeze
batch_ent_results.append
paddle.squeeze
KeyNotFoundError
model_class.resource_files_names.get
self.slf_out_bias.append
self._tokenize.append
self.get_ordered_dict
input.strip
loss_fn.item
self.create_optimizer_and_scheduler
scipy.ndimage.filters.convolve
ppdiffusers.UnCLIPPipeline.from_pretrained
LayoutLMv2PretrainingHeads
i.line_stripped.strip.split
build_pipelines
gradio.Row.style
group.title.args.update
paddle.vision.transforms.RandomCrop
x.unsqueeze
self.query_linear.unsqueeze
paddle.static.load_program_state
tokenizer.encode.extend
importable_classes.keys
paddlenlp.utils.log.logger.warning
cls.extract_values_from_column
paddlenlp.transformers.T5Tokenizer.from_pretrained.decode
paddlenlp.utils.import_utils.is_package_available
strategy.augment
offsets.append
join.append
paddlenlp.transformers.AutoModelForMaskedLM.from_pretrained.get_input_embeddings
self.linear_k
transformers.CLIPTextModel.from_pretrained
self._load_file
extract_attention_scores
decoding.run_custom
boomup.data_struct.Header
x.map
output.detach
subtokens.sqlparse.sql.TokenList.flatten
_is_valid_text_input
mask_pos.np.array.astype.reshape.append
loss_mask.y.unsqueeze.x.criterion.mean
batch_idx.next_scores.max.numpy.item
head_dim.num_heads.batch_size.v.reshape.transpose.reshape
self.dense_prediction
pooled_logits.dtype.labels.astype.flatten
huggingface_hub.HfFolder.get_token
read_file.strip
paddlenlp.utils.downloader.get_path_from_url
Tokenizer
reorder_head_matrix
flat_words
self.block_list.append
self._encode_image_prompt
construct_relation_prompt_set.add
proj_fn
_normalize
RelPartialLearnableDecoderLayer
self.export
self.sp_model.piece_to_id
copy.deepcopy.get
self.template.copy
self.domain_mapper.visualize_instance_html
rtd_loss.detach
paddle.framework.in_dygraph_mode
self.vae_model.decode
results.extend
time.sleep
vocab.to_tokens
paddlenlp.transformers.tokenizer_utils.AddedToken
token.np.argwhere.tolist
utils.record.AverageStatistical
reader
self.model
fastapi.APIRouter
cls._get_name_mappings
self.RoFormerv2ForQuestionAnswering.super.__init__
logs.items
self.numpy_to_pil.transpose
utils.init.init_pretraining_params
slow_tok_module_name.split
vecs_title.vecs_query.sum
fdtensor.to_dlpack
layer.q.weight.set_value
benchmark.modules.benchmark_utils.clone_inputs
metric_max_over_ground_truths
self.FasterUNIMOText.super.__init__
writer.add_scalar
start_index.start_logits.sum.backward
self.ELMo.super.__init__
self.class_embedding
diffusers_pipe.tokenizer.save_pretrained
util.uint2single
doc_parser.DocParser
axis.vector.shape.paddle.arange.reshape.astype
paddle.nn.functional.kl_div
numpy.prod
KeywordHighlighter
self.wordpiece_tokenizer.tokenize.extend
all_parameters.extend
ppdiffusers.DiffusionPipeline.from_pretrained.save_pretrained
fast_tokenizer.Tokenizer.token_to_id
posterior.mode.transpose
field.default_factory
target.unsqueeze
qa_validation.calculate_matches
state.state_dict.numpy
self.condition_score_with_grad
self.unsqueeze.init_weights
new_head.weight.set_value
paddle.fluid.layers.tensor_array_to_tensor
ppdiffusers.VQModel.from_config.set_dict
adjust_saturation
self._split_heads
paddle.framework.core.eager.Tensor
paddle.matmul.norm
probs.max.max
self._create_predictor
ids.numpy.tolist
line.split
self.postprocessor
suffix.suffix2converter.convert
self.SpanEvaluator.super.__init__
prediction.scores.F.softmax.cpu.numpy.tolist
scipy.sparse.csr_matrix.multiply
prompt_map
self.grammar.parse
FunnelEmbeddings
self.vqvae.encode
concept_idx.self.special_care_embeds_weights.item
adapt_stale_fwd_patch
noise.upper
glob.glob.sort
paddlenlp.transformers.CLIPTextModel.set_dict
pred_responses.extend
triton_python_backend_utils.get_input_tensor_by_name
text2sql.models.relational_transformer.RelationalTransformerEncoder
paddlenlp.ops.FasterUnifiedTransformer
SdeVeOutput
segment_ids1.append
self._tokenizer.add_tokens
_num_epochs
Runner
task.task_record_map.to_string
self.text_decoder.mean
reader_cls.read
image_utils.load_image
fast_tokenizer.normalizers.SequenceNormalizer
self._encode_prompt.reshape
paddlenlp.transformers.PPMiniLMForSequenceClassification.from_pretrained.eval
paddlenlp.transformers.UIE.from_pretrained.train
utils.load_txt
ppdiffusers.pipelines.paint_by_example.image_encoder.PaintByExampleImageEncoder
typer.Typer.command
encoder.enable_fast_encoder.prepare_encoder_decoder_kwargs_for_generation
tags_to_idx.values
self.mbart
self.__get_bpe_ranks
example.rstrip.split
f.close
utils.DataCollatorMLM
reprod_log.ReprodDiffHelper.compare_info
context.replace.replace
_ReversibleFunction.apply
nltk.download
model.reshape
requires_backends
self.file_read.append
string.replace.lower.count
text2sql.dataproc.dusql_dataset.load_tables
utils.sort_res.append
logits_fake.detach.mean.item
utils.is_scipy_available
bbox.squeeze.squeeze
state_dict_contains_prefix
self.MegatronBertForPreTraining.super.__init__
config.cpu_math_library_num_threads
self.__repr__
clip_interrogator.Interrogator.load_clip_model
prediction_tags.append
self.components.items.VersatileDiffusionImageVariationPipeline
paddlenlp.transformers.distill_utils.calc_minilm_loss
out.numpy.reshape
batch.append
tarfile.open.getnames
fullnames.append
ax.annotate
rebuild_col_unit_col
SentencePieceExtractor
evid_dict.keys
self.LayoutLMForSequenceClassification.super.__init__
self.process_image_tag.append
model.TextCNNModel.set_dict
pre_process_dot_numbers
_is_equal_o
self.GPTPretrainingCriterion.super.__init__
clean
merge_beams
model.ErnieForCSC.train
paddlenlp.ops.disable_fast_encoder
intermediate_state.self.state2copy_transform_Linear.squeeze
onnxruntime.InferenceSession
token_ids.index
model.config.to_dict
utils.BurkhardKellerTree
self.x_upd
self.o.reshape
io.BytesIO.write
self.num_special_tokens_to_add
TeacherModel
feature_extractors_params.get.get
min_encoding_indices.reshape.reshape
conds.pop
self.FusionBertEmbeddings.super.__init__
self.ffn
self.optimizer.set_state_dict
y.x.norm.asin.pow
self.apply_cumulative_transitions
_fix_cond_value
set_attr.values
self.value.weight.reshape
self.ErnieMModel.super.__init__
numpy.log10
self.top_db.self.top_db.log_S.clip.astype
remove_first_last_commas.strip
tok_to_orig_start_index.numpy
numpy.linalg.norm
out_seqs.append
convert_to_unicode.strip
ppdiffusers.optimization.get_scheduler
PretrainingTrainer.save_model
roberta.modeling.RobertaForQuestionAnswering.from_pretrained.set_dict
numpy.reshape.astype
PretrainingTrainer
framework.AdamW.step
numpy.int64.predicted_input_np.astype.tofile
self.ChineseBertModel.super.__init__
paddle.argmax.unsqueeze
file_reader
paddlenlp.transformers.AutoModel.from_pretrained.eval
self.Crf_decoding.super.__init__
self.filtration
modeling_utils.load_dict
list.transpose
parse_label
hashable_v.append
cls.conjoin_conds
create_pretraining_dataset
define_args_parser
paddle.get_device.count
self.num_heads.embed_dim.self.num_heads.tgt_len.bsz.hidden_states.self.qkv.reshape.transpose
self.word_embedding
_process_request
match_mlm_parameter.items
model.transformer_encoder.encoder
init_dict.items.pop
self.clip_model.get_image_features
self.unsqueeze.stride_pool_pos
self._batch_prepare_for_model
self.clean_up_tokenization
os.makedirs
sub_sql.strip.replace.replace.replace.replace
interaction.next_utterance.anonymized_gold_query
self.q_lin
disc_rtd_loss.sum.sum
dataset.OneBillionWordDataset
i.self.attentions
config.tensorrt_engine_enabled
self._examples.append
features.items
self.ParserEvaluator.super.__init__
data.ClassifierIterator.get_num_examples
self._update_param_group
origin_inputs.append
new_ids.collections.Counter.items
self.query_ernie.emb_reduce_linear
elems.append
self.callback_handler.add_callback
dataloader._batch_sampler.set_epoch
paddle.DataParallel.reset_length
prepare_predict
SinusoidalPositionalEmbedding
RelationalAttentionLayer
FNetIntermediate
paddlenlp.transformers.WordpieceTokenizer
self._get_predict_id
utils.sort_res
datetime.datetime.fromisoformat.isoformat
self.roformer
merged_data.append
ast.literal_eval
copy.deepcopy.update
self._prompt.copy
paddle.static.set_program_state
super.get_all_documents_generator
unet.attn_processors.keys
aps.extend
model.items
cls.get_subclass
part.pop
nested_defaultdict
numpy.cumsum
inspect.getfullargspec
paddle.add_n
output.paddle.argmax.reshape
dataset.SamplerHelper.batch
prediction
use_softmax_sample.generator_logits.self.sample_from_softmax.detach
stable_diffusion_utils.AutoencoderKL
para.rstrip.split
all_cross_attns.append
self.read_database_schema
self._word_distance.keys
Upsample
msg.format
self.bottom_up
paddlenlp.transformers.BertTokenizer.from_pretrained
self.bpe.process_line.split
model.mbart.get_decoder
self.image_rois.append
self.ErnieDocForQuestionAnswering.super.__init__
self.compute_scores
self.map_fc
LukeLMHead
input_ids.unsqueeze.clone
self.UnpackDataLoader.super.__iter__
paddle.fluid.layers.embedding
pymysql.connect
page.splitlines
self.LSTMEncoder.super.__init__
beta_t.unsqueeze.flatten
predict_exec_file.split
self.layer_norm1.append
self.decoder
tokenizer_model
self._get_config
UnimoTextOp
numpy.hstack
split_expression
condition.convert_to_elasticsearch
utterance.length_valid
infer_bart_decoding
utils.add_docstrings
re.escape
tokenizer.append
actual_bboxes.extend
pipe.scheduler.set_timesteps
self.helper2
gradio.update.append
self.compare_logits
downsampler
prompt_list.append
epoch.args.seed.random.Random.shuffle
init_args.parse_args
self.electra
out.tolist
context.replace.replace.replace.replace.replace.replace
model_class.pretrained_init_configuration.keys
model_class.state_dict
self.SP_CHAR_MAPPING.get
huggingface_hub.upload_folder
self.wordpiece_tokenizer.tokenize
source_inputs.append
pred_tags.numpy.tolist
pipelines.document_stores.MilvusDocumentStore.save
input_data.pop
cv2.getGaussianKernel.transpose
self.ssi_generator.full_asoc
np_labels.reshape
h.extend
index_sample
eval_key.role_metrics.compute_f1
self.model.encoder.state_dict
self._cls_vocabs.values
doc.get
hnswlib.Index.get_current_count
data_arr.np.expand_dims.repeat.reshape
self.plt.subplots
file_suffix.suffix2paths.append
weight.set_value
convert_diffusers_paintbyexample_to_ppdiffusers
XnliDataset
pair.strip
numpy.minimum
filter_inputs.append
self.tokenizer.as_numpy
self.DistilBertForMaskedLM.super.__init__
bisect.bisect_left
AttnDownBlock1D
self.text_model
new_model.named_parameters
quot_mark_pattern.match.groups
paddle.nn.initializer.Constant
all_predicted_indexes.append
paddle.nn.ClipGradByGlobalNorm
self._post_handler
self.SoftVerbalizer.super.process_outputs.reshape
self.criterion.backward
target_mask.numpy
self.faiss_indexes.get
question_answering.QuestionAnsweringTrainer.save_model
pip.main
res.reshape
image.transpose.astype
tokenizer_cls.from_pretrained
numpy.tile
pos_answers_flat.append
negative_examples.extend
parser.add_argument_group
hidden_state.hidden_state.paddle.concat.squeeze.append
calc_global_pred_results
self.ffn_ln_weight.append
self.emb
self.BaseInputEncoder.super.__init__
paddlenlp.transformers.WordEmbedding
n_infer.numpy
textwrap.dedent.lstrip
train_fh.write
self.average_word_embedding
args.task_name.METRIC_CLASSES
batch_padded_task_ids.np.array.astype.reshape
codecs.open
paddle.to_tensor.roll
paddle.fluid.layers.mean
re.compile.findall
collect_predict_from_logs.keys
predict.post_process_seq
key.reshape
self.normalize_embedding
node.name.result.setdefault.append
InceptionA
package.replace.strip.replace
paddlenlp.transformers.SkepForTokenClassification.from_pretrained
input_ids.squeeze.numpy.index
paddlenlp.transformers.BertForTokenClassification.from_pretrained.eval
to_py_obj
weight.paddle.flip.transpose
find_entity
self.record.paddle.diag.sum.item
new_objs.append
self.input_encoder.check
extract_integrated_gradient_scores
x.squeeze.transpose
table_name.split
paddle.where.astype
self.to_pil_image
paddle.divide
finetune_args.parser.parse_args
self.init_decoder_seq
self.condition_score
tokenizer_utils.whitespace_tokenize
self._get_rand_mask
get_input_mask
hashlib.md5.update
valid_idxs.append
utils.NERChunkEvaluator.update
prompt_tokenizer.MLMPromptTokenizer
self.safe_div
model.BiGruCrf.eval
bert_utils.get_bert_encoding
nll_loss.sum.sum
self.ja_tokenize
self.scheduler.step_pred
FunnelDecoder
cond_probs.append
query.unsqueeze
paddle.vision.transforms.Normalize
out_channels.np.array.prod
self.word_emb
column_names_embedder_input.append
head_mask.to.to
self.output_convs
text2sql.utils.nn_utils.sequence_mask
segments.append
pathlib.Path
model.ErnieCrfForTokenClassification.eval
self.rembert
q.to_dict
MetaDocumentORM.value.MetaDocumentORM.name.MetaDocumentORM.document_id.self.session.query.filter.all
self.ln_final.gather_nd
paddlenlp.transformers.BertTokenizer.tokenize
paddlenlp.transformers.ElectraTokenizer.pretrained_init_configuration.keys
pytorch_model
rel_pos.self.rel_pos_bias.transpose
RobertaBPETokenizer.from_pretrained
i.seq_tokens.encode.isalpha
resnet.Upsample2D
fig.canvas.tostring_rgb
LayoutXLMPretrainingHeads
answer_indices.strip
key.m_param.copy_
self.layer
mask_label.np.array.astype.reshape
self.validate_language
self.client.get_collection_info
paddleslim.nas.ofa.utils.dynabert_config
local_exps_q.items
line.rstrip.split.replace
sent_ids1.append
SequentialSampler
cli_args.mode.startswith
self.RelationalPointerNet.super.__init__
self.summary_to_excel
self.clip_preprocess
label_dict.append
title_emb.grad.title_emb.sum.detach.abs
paddlenlp.ops.FasterDecoder
current_chunk.append
ErnieLayoutPooler
relevant_hidden_states.reshape.reshape
img.unsqueeze.unsqueeze
any
self.BertEmbeddings.super.__init__
args.vars.items
db.get
pandas.DataFrame.from_records.sort_values
paddle.distributed.fleet.get_hybrid_communicate_group._set_check_group
self.queue.delete
FNetLayer
paddle.nn.LeakyReLU
data.SequenceLabelingIterator.get_num_examples
tokenizer_cls
self.FNetForMultipleChoice.super.__init__
max_position_embeddings.paddle.arange.reshape
column.func.row_number.over.label
self.scheduler.step
checkpointing.save_checkpoint
word.rfind
log.logger.disable
meta.os.path.basename.split
self.degradation_process
alpha_bar
tokenized_res.keys
self.qa_outputs.split
self._model.eval
sentece_idxs_vec.append
self.plt.axis
self.UTC.super.__init__
C.normalizers.NFDNormalizer
numpy.linalg.inv
uie_predictor.UIEPredictor
component_definition.pop
score_can.tolist
self._generate_sequence
simple_accuracy
ErnieForPreTrainingOutput
tokenize_with_bert_uncase
self.glyph_embeddings
self.cls_predictor.run
paddlenlp.ops.guard
self._additional_special_tokens.extend
AlbertEnglishTokenizer
self.GAUAlphaForMultipleChoice.super.__init__
value.keys
mismatched_keys.append
v.reshape
utils.downloader.DownloaderCheck
kl_loss.detach.mean
get_topk_coordinates
self.get_noise
text_embeddings.mean.previous_mean.unsqueeze
num_inference_steps.self.num_train_timesteps.np.linspace.round.copy
loss.numpy.item
paddlenlp.metrics.bleu.BLEU.add_inst
transformers.AddedToken
kwargs.keys
set.extend
query_answers.drop.to_dict
pymilvus.FieldSchema
d.pd.DataFrame.to_csv
data.GraphDataLoader
Predictor.extract_embedding
paddlenlp.transformers.SkepCrfForTokenClassification.set_dict
self.get_loss_fn
self.template.append
SoftTemplate
semantic_search_tutorial
self.target.append
self.load_state_dict_pre_hooks.values
_file_name
tok.endswith
self._get_batch_index
isinstance.pop
ap_list.append
positives.append
DPTNeck
loss_fn.backward
paddle.distributed.collective._c_split
old_cell.rstrip
del_bookname
segment_ids.input_ids.model.squeeze
gradio.Interface.launch
qlen.i.self.r_emb.view
self._gold_list.extend
train_bar.set_description
self.extractor
v.items
entry.strip
gold_query.replace.replace
self.output_handle.copy_to_cpu.tolist.append
used.inds.cast.sum
self.Relations.super.__init__
self.TrainCallback.super.on_eval_begin
get_args_parser
BlenderbotSmallEncoder
self.get_image_list
self.Rouge1.super.__init__
stable_diffusion_utils.LMSDiscreteScheduler
self.SimultaneousTransformer.super.__init__
self._make_output.copy
paddle.fluid.incubate.fleet.collective.fleet.distributed_optimizer
paddlenlp.transformers.PPMiniLMForSequenceClassification.from_pretrained.named_parameters
join_by_col
self.label_maps.keys
valid_word
paddle.nn.Sequential
paddle.is_empty
v.squeeze.transpose
self.CoreNet
mask_label.np.array.astype.reshape.append
dataset.MedicalCorpus
utils.get_scheduler.get_lr
re_labels.extend
train_file.split
MobileBertEncoder
self.mecab
paddlenlp.transformers.SkepForTokenClassification.from_pretrained.load_dict
T5LayerCrossAttention
logging.getLogger.hasHandlers
self.moses_punct_norm
paddle.nn.functional.softmax.reshape
entity_output.paddle.to_tensor.F.softmax.numpy
paddle.concat.detach
_extract_chunk
self.vae_decoder.zero_copy_infer
getattr.append
output_tokens.isdigit
self.Attention.super.__init__
ws.send
name.startswith
paddlenlp.utils.tools.get_bool_ids_greater_than.tolist
args.hidden_size.diff.np.zeros.astype
rnnlm.model.RnnLm
sents_order.append
self.src_embedder
self.input_ids_uncond.expand
recover_preds.append
seqeval.metrics.classification_report.items
ref_tokens.append
paddlenlp.transformers.is_chinese_char
self.FasterMBART.super.__init__
self.create_prompt_parameters
paddle.atan2
self.resolve_num_layer
self.loss_fn
self.ErnieSageV2Encoder.super.__init__
image_path.requests.get.raw.Image.open.convert
qid.length_dict.append
self.inorder_traversal
self.linear_start
ErnieOp
paddle.inference.Config.disable_gpu
Upsample1d
elmo.ELMo
model.get_semantic_embedding
img_url.download_image.resize
multiprocess.Pool.close
PIL.Image.fromarray.transpose
batch_qids.np.array.astype.reshape
self.mediums.rank
self.PrefixTemplate.super.parse_soft_prompt
numpy.random.seed
a.split
self.fetch_worker.join
self.get_embedding_count
write_instance_to_example_file
model_torch
head_mask.unsqueeze.unsqueeze.unsqueeze.dim
dataset.create_dataloader
PIL.ImageOps.autocontrast.clip
SerializationError
load_graph
_documents.append
self.hidden_size.self.attention_head_size.self.num_attention_heads.self.query_key.weight.reshape.transpose
self._convert_sql_row_to_label
image_utils.valid_images
join.find
benchmark.utils.record.AverageStatistical.get_average_per_sec
metrics.ChunkEvaluator.compute
do_train
pre_process_dates
run_query_batch_timed
sop_loss.detach
self.unparse_cond
signature.parameters.keys
is_fuhao
T5Attention
export_exec_file.split
model_outputs.tuple_output
format_sql_2.replace.replace.replace.replace.replace.replace.replace.replace.replace.replace.replace.replace.replace.replace.replace.replace.replace
attention_mask.paddle.unsqueeze.astype.unsqueeze
np_qids.reshape.tolist
self._get_best_indexes
field_map.items
self.uri_path
self.logger.info
self.__load_file
self.unsqueeze.to_dict
RobertaModel
self.sm.MosesPunctNormalizer.normalize
desc_enc.m2v_align_mat.index_select.max
self._bar.close
item.dict.get
args.to_sanitized_dict
compute_exact
example.keys
self.Seq2SeqEncoder.super.__init__
transformers.models.opt.modeling_opt.OPTForCausalLM.from_pretrained.to
text2sql.utils.linking_utils.build_relation_matrix
Downsample1d
kv_relations.append
GPTEmbeddings
paddle.jit.to_static
batch_data_id.np.array.astype.reshape
google.protobuf.symbol_database.Default
expanded_seq.append
tokenize.index
hidden_states.self.fourier_transform.real
MidResTemporalBlock1D
sub_data_ds.map
output.masked_select.masked_select
c.lower.append
group_idx.var_groups.setdefault.append
layer.shared.weight.set_value
paddlenlp.transformers.ErnieCtmWordtagModel.from_pretrained.set_dict
model_util.evaluate_interaction_sample
values.expand.transpose
responses.append
convert_from_json_to_answer_extraction_format
self.get_idx_from_word
nested_defaultdict.items
dict.copy.keys
basket_to_remove.append
self.update_vector_ids
RuntimeError
Output
args.model.MODEL_REGISTRY
all_results.extend
tqdm.auto.tqdm.close
EntityPredictionHead
LogUniformSampler
BurkhardKellerTree
self.do_remask
self.IpuBertPretrainingMLMAccAndLoss.super.__init__
numpy.mean.sum
utils.lock_predictor
LogitHooker.register_pytorch_model_hooks
self.ftfy.fix_text
self.vs.plot_aspect_with_sentiment
left_block.detach.clone
convert_diffusers_stable_diffusion_to_ppdiffusers
enumerate
lower
line.split.startswith
self.position_embeddings._forward
EulerDiscreteSchedulerOutput
self.trg_embedder
end_prob.tolist.tolist
ppdiffusers.utils.logging.get_logger.warn
returns.extend
ppdiffusers.FastDeployStableDiffusionInpaintPipelineLegacy
loss.mean.item
indexed_string.raw_string.append
doc.embedding.tolist
criterion.Criterion
self.fn.values
load_vocab
self._decode
ent_idxs_list.append
PIL.Image.fromarray.tobytes
doc_ids.append
self.ErnieGramForSequenceClassification.super.__init__
positive.append
self.ErnieDocBPETokenizer.super.__init__
GteOperation
BeamSearchOutput
schema.idMap.values
paddlenlp.metrics.rouge.RougeL.score
eval_examples.map
paddlenlp.seq2vec.BoWEncoder
col_enc.unsqueeze
trainer_callback.TrainerState.load_from_json
flatten.std.unsqueeze.unsqueeze.unsqueeze.transpose
self.sharding.split
_dev_path
self.to_json_string
cls._get_init_keys.union
self.decoder_layernorm_embedding
self.model.generate.cpu
x_in_d.detach.add
Lambda
self.unsqueeze.q_head
slot_names.append
self.mt5.encoder
...

@developer Could please help me check this issue? May I pull a request to fix it? Thank you very much.

sijunhe commented 1 year ago

@PyDeps Looking forward to your PR!