-
## Spring Batch Application
CCTV / Police등에 대한 공공데이터 .csv파일에 대해 빅데이터 배치 프로세스를 진행한다.
- **spring-kafka**, **spring-batch** 등을 통해 kafka broker의 topic에 data를 저장한다. (producer)
- broker의 topic data…
-
# Bug Report
## Description
`dvc exp run` fails and `dvc repro` runs successfully when a cmd is executed from inside of a submodule and the submodule is included as a dependency.
### Reproduce
…
-
I get the following error message when run against spark 2.4.2
11-18-2020 04:58:26 INFO [Thread-10] com.linkedin.drelephant.ElephantRunner : Job queue size is 0
11-18-2020 04:58:26 INFO [dr-el-…
-
# Bug Report
## Description
`--force` is required to overwrite a file during move, but this isn't allowed as a parameter
### Reproduce
1. Create a directory with files `a` and …
-
Hi!
Seems that the Ruby update to 2.6.x caused a problem when you try to run `systemctl reload google-fluentd`. We get this error with the latest `google-fluentd` releases:
```
2020-01-21 00:00…
-
I'm packaging your module as an rpm package so I'm using the typical PEP517 based build, install and test cycle used on building packages from non-root account.
- `python3 -sBm build -w --no-isolatio…
-
This is used by https://github.com/datalad/datalad-fuse
The aim here would be simpler: Wrap around `fsspec.open()` to provide the standard operations `download`, `upload`, `sniff`, and possibly `de…
-
### I did this
When I upload a large file to HDFS, curl reports a memory overflow,This file has a size of 1.1G.
![1723519108243](https://github.com/user-attachments/assets/318c0585-6d11-4c9a-b6ab-…
-
I've been debugging Dr. Elephant on Spark 2.1 and noticed that some of the apps are never aggregated. Roughly it goes as follows:
1. `AnalyticJobGeneratorHadoop2` queries the RM for a list of finis…
-
WEBHDFS----------
https://community.hortonworks.com/questions/139351/how-to-upload-a-file-to-hdfs-using-webhdfs-rest-ap.html
https://data-flair.training/blogs/apache-spark-interview-questions-and-…