-
### Which version of XXL-JOB do you using?
v2.3.0
### Expected behavior
执行glue(python),代码如下
![image](https://user-images.githubusercontent.com/28049052/125010667-8d4a3180-e099-11eb-89ec-004b3c9a…
-
**Describe the problem you faced**
We have a production transform job using AWS Glue version 4.0, Hudi version 0.12.1 that loads data into a hudi table on s3. At some point, this job starting taking…
-
### Describe the bug
I am trying to run dbt model from current AWS project and I am getting `AnalysisException: Table or view not found: `xxx.yyyy` as my source is in different AWS project glue cat…
-
I've been using a print queue plugin for Octoprint for my other printers for another year, and now that I'm running a pair of Carbon X1's alongside my other printers, I'm beginning to realise how much…
-
**Describe the problem you faced**
We have shifted to Hudi 0.13.0 on Spark 3.3 and using it as an external library JAR for ingestion of datasets using AWS Glue streaming jobs. We are noticing atlea…
-
Add functionality to the glue jobs that pull in data so that they partition the data based on year-mm-day. We'll need a bit of spark/dataframe code that computes the field and then sets that field as …
-
Assembling a single block currently consists of (roughly) these steps:
- print block bottom
- print block top
- clean rough edges of bottom and top as required based on the quality and calibratio…
-
프라이빗 환경에서 Deltalake 시험
- [X] Jupyter 에서 Delta 환경 사용
- [ ] Jupyter 에서 원격 Spark 클러스터 접속
- [ ] Kubernetes 기반 Delta + Delta 환경 구성
- [X] MinIO 기반 S3 서비스와 연동한 Delta 저장 시험
- [ ] Delta cache 이용한 캐싱 성능 시…
-
This is just the API glue that turns a webhook into a job.
-
## Bug
### Describe the problem
I have this setup: A AWS Glue Job `kinesis_consumer` that consumes a kinesis stream and stores the data in s3 bucket `kinesis_data`.
```
kinesis = (
…