-
I was failed to start the playground at first, the log message is very long:
Attaching to playground-gravitino, playground-hive, playground-jupyter, playground-mysql, playground-postgresql, playg…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
根据文档估计的显卡资源70B 模型大概需要600G，目前已经使用了双机 A100 80G总共16卡，远远超过600G，但是每张卡仍然会OOM:
训练脚本：
```
DISTRIBUTED_ARG…
-
# Hadoop 의 YARN 과 Eco System
## YARN
- Yet Another Resource Negotiator
- **빅데이터의 지휘자** 와 같은 역할
- 리소스를 분석해서 적절한 Job 에게 적절하게 할당함
- 하둡 클러스터에 데이터 처리를 동시에 담당
- Demon 을 통해 자원 관리 역할을 수행
- 태초의 리소스 매…
snaag updated
1 month ago
-
Currently the project use pyspark which depends on Spark and Hadoop, dependencies that do not natively run on Windows and make the script not Windows friendly, see #13 for the details. It seems that p…
-
### OpenLineage integration/client
Spark integration
### OpenLineage version
main branch
### Technology and package versions
_No response_
### Environment configuration
_No response_
### Deplo…
-
At the moment we use old versions with lots of exclusions for CVEs fixing
-
### Search before asking
- [X] I searched the [issues](https://github.com/IBM/data-prep-lab/issues) and found no similar issues.
### Component
Library/core
### Feature
While working, …
-
com.alibaba.datax.common.exception.DataXException: Code:[HdfsWriter-04], Description:[您配置的文件在写入时出现IO异常.]. - java.io.IOException: Unable to close file because the last block does not have enough number…
-
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
Offline sync…
-
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
采用seatunnel2…