-
https://walio.github.io/2020/01/01/sparksql/
多年以来踩过许许多多spark的坑,查问题的时候也是各种艰辛,基本没有中文资料,记录一下防止自己忘记,也方便后来人,主要是分pyspark相关、sparksql相关。尽量按照问题与回答进行组织。本篇为sparksql相关问题。
walio updated
4 years ago
-
round() semantics is not HALF_UP in sparksql functions:
```
#Vanilla Spark behavior
round(1.025, 2) => 1.03
#Velox behavior
round(1.025, 2) => 1.02
```
cc @mbasmanova @aditi-pandit
-
### Feature & Improvement
1. Compile script refactoring optimization
2. Increase the import of csv format
3. Support pushdown of doris.filter.query on sparkSQL
4. Support doris datev2/datetimev2/d…
-
I'm using sql-language-server within JupyterLab that is using ipython magics %%sparksql and %%trino
https://github.com/CybercentreCanada/jupyterlab-sql-editor
In that environment each magic is a…
-
Dear @cryeo,
I really like your library as it makes possible to integrate SQL syntax directly into cells, that's a nice piece of work!
However I would like to hear from you what's the best way …
-
I want to try Mango with the ADAM Hive partitioning PR:
https://github.com/bigdatagenomics/adam/pull/1620
This is going to require some more changes than just bumping scala and spark versions, err…
jpdna updated
7 years ago
-
hey @joe-re when I run sql-language-server within jupyterlab-lsp I configure initialize 2 sql-language-server. One for sparksql and one for trino
```python
c.LanguageServerManager.language_servers…
-
in 92fcc89592e6a77c162e648c5b673c9c3d241683 two tests commented out to allow clean tests after merge #26. Should go away in the next release of sparkSQL in ~2weeks or will revisit.
-
when I use assembly-0.5.0.jar to access acid table , it seems that dataframe API works well, reading or writing table , either partitioned or not.
But I can not use spark.sql() to access acid tabl…
-
pr:https://github.com/vesoft-inc/nebula-exchange/pull/195
文档增加一项配置:
```
tags:[
{
filter: "name='Tom'"
}
]
edges: [
{
filter: "degree > 10"
}
]
```
说明: filter 可选配置…