-
硬件：Jetson Nano 2G
cuda：10.2
cudnn：8.0.0
paddlepaddle-gpu：2.0.2
paddlehub：2.0.0
paddlenlp：2.3.3
在Python终端中输入import paddlehub后输出以下报错
/usr/lib/python3/dist-packages/apport/report.py:13: Deprec…
-
# Efficiently processing large image datasets in Python | Basic Machine Learning
I have been working on Computer Vision projects for some time now and moving from NLP domain the first thing I realize…
-
데이터를 전처리하는 과정은 예측 성능에 아주 직접적인 영향을 줄 것이다. 전처리에는 대표적으로 토크나이저가 있다.
- 우리는 klue/roberta-large의 tokenizer를 아래 코드로 바로 가져오고 있다.
https://github.com/boostcampaitech4nlp2/level1_semantictextsimilarity_nlp-le…
-
Large language models (LLMs) encode parametric knowledge about world facts and have shown remarkable performance in knowledge-driven NLP tasks. However, their reliance on parametric knowledge may caus…
-
Hello, thanks for providing this awesome repository introducing different instruction datasets!
Could you consider adding our CoT Collection dataset? It's a massive instruction dataset consisted of 1…
-
你好，我无法找到文件： data_path=/wjn/nlp_task_datasets/kg-pre-trained-corpus/total_pretrain_kgicl_gpt，感觉看的有点模糊，麻烦指个路，谢谢！
-
## TDD Web sitesi
TDD sitesi, ve icinde bulunacak araclar tdd.ai altinda bulunacak. Bunun icin EC2 acilmis durumda ve Taner gelistirmeye baslamistir.
Alt moduller:
- [ ] Datasets explorer
…
-
### Describe the bug
The link provided for the dataset is broken,
data_files =
[https://the-eye.eu/public/AI/pile_preliminary_components/PUBMED_title_abstracts_2019_baseline.jsonl.zst](url)
The…
-
### System Info
```Shell
Accelerate 0.34.2
Numpy 1.26.4
(Singularity container based on Ubuntu 22.04)
```
### Information
- [X] The official example scripts
- [ ] My own modified scripts
### Ta…
-
您好，目前我正在用finetune_cosmopedia.sh进行继续预训练，用HuggingFaceTB上的数据集可以实现继续预训练，但是我目前想要使用自己的数据集，我的数据集格式是txt，我想知道有没有办法将我们自己的数据转变成可以用于继续预训练的方法，或者有没有类似的工具呢，谢谢。