-
**Affected module**
Ingestion Framework
**Describe the bug**
We are currently trying to add OpenMetadata to our Lakehouse stack which centers around Databricks SQL. Some of our ingestions are pre…
-
在 ApacheCon Asia 2022 上,Apache Pulsar 社区成员分享了很多 Pulsar 相关的议题,涵盖用户案例、技术探究、周边生态等多个方向,其中不乏很多首次出现的干货。我们计划将这些演讲视频整理为博客,长期供社区小伙伴们阅读。欢迎认领任务。
# 本篇博客整理
- 标题:Another Way for Intergrating Pulsar and Lakehous…
-
## Feature request
### Overview
Publish the Python `delta-spark` package to a public Conda channel so that users of Conda can use Delta Lake. As of now, the package is only available at Pypi.
…
-
```
%pip install https://github.com/databricks-demos/dbdemos/raw/main/release/dbdemos-0.1-py3-none-any.whl --force
```
followed by
```
import dbdemos
dbdemos.list_demos()
dbdemos.install('lak…
-
# What
With the introduction of Iceberg a new vacuum operation was added, but when trying to run with pyathena I run in this issue:
```
pyathena.error.DatabaseError: An error occurred (InvalidReq…
-
The S3 destination is very useful as a component in building a data lake, but in order to make it usable in a lakehouse style architecture it is missing integration with the metastore for whichever qu…
-
メダリオンアーキテクチャのパイプラインの構築方法が CTAS となっているのですが、実践的な `append` や `Merge`を利用しなくていいのかを検討させてください。
最初の画像に bronze はスキーマを持たないという記載もあり、データ型を付与しているため文章等と整合がとれていない状況になっているのではと考えてます。
![image](https://user-images…
-
## Tell us about the new connector you’d like to have
* Which source and which destination?
* Source
* Do you need a specific version of the underlying data source e.g: you specifically need s…
-
### Configuration
I have a configuration with different modules.
Note that some things might have been configured by users in the databricks workspace GUI. The workspace has already been deployed f…
-
We need to make sure that we are good netizens and every external API we call should be called with a really low rate limit.