search

FedML-AI / FedNLP

FedNLP: An Industry and Research Integrated Platform for Federated Learning in Natural Language Processing, Backed by FedML, Inc. The Previous Research Version is Accepted to NAACL 2022
223 stars 45 forks source link

Come up problems in Running Text Classification model with distilbert #20

Open MuleiOnline opened 2 years ago

MuleiOnline commented 2 years ago

Our environment: Win10 During the installation, strictly follow the python version and configuration steps in the README.md file.

  1. When we run the test the dependencies command: python -m model.fed_transformers.test report an error: Some weights of the model checkpoint at distilbert-base-uncased were not used when initializing DistilBertForSequenceClassification: ['vocab_transform.weight', 'vocab_transform.bias', 'vocab_layer_norm.weight', 'vocab_layer_norm.bias', 'vocab_projector.weight', 'vocab_projector.bias']
  2. When we run Text Classification model with distilbert. Report an error: requests.exceptions.ProxyError: HTTPSConnectionPool(host='api.wandb.ai', port=443): Max retries exceeded with url: /graphql (Caused by ProxyError('Cannot connect to proxy.', OSError(0, 'Error'))) wandb: Network error (ProxyError), entering retry loop. wandb: Network error (ProxyError), entering retry loop. The specific error can be found in the file error_log.txt.error log.txt We have studied for a long time but have no clue, which is very confusing. Please give us some advice. Thank you!
DeviRule commented 2 years ago

Sorry, I do not think we support for windows environment. Can you rent a server on Alibaba Cloud and try it there?

MrigankRaman commented 2 years ago

Hi! We at FedML have launched a new platform for FedNLP. Can you please check whether you face the same issue there? Here is the new FedNLP platform: https://github.com/FedML-AI/FedML/tree/master/python/app/fednlp