mrpowers-io spark-daria issues

mrpowers-io / spark-daria

Essential Spark extensions and helper methods ✨😲

MIT License

754 stars 152 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Run CI only on project affected by changes

#169 zeotuan opened 3 weeks ago
0
flattenSchema: Support flattening map and array type

#168 zeotuan opened 1 month ago
0
SBT project changes

#167 alfonsorr closed 1 month ago
1
Rand uniform/normal

#166 zeotuan closed 2 weeks ago
0
support rand_gamma on spark 3.4+

#165 zeotuan closed 4 weeks ago
2
Updated SBT

#164 alfonsorr closed 1 month ago
1
Update sbt version

#163 alfonsorr opened 1 month ago
0
Add sortColumnsBy DataFraneExt

#162 zeotuan closed 1 month ago
1
Output create table from DataFrame

#161 MrPowers opened 1 month ago
0
run test on pull request.

#160 zeotuan closed 1 month ago
1
Implement arrayConcat using aggregator

#159 zeotuan closed 1 month ago
0
Update CI

#158 zeotuan opened 1 month ago
0
[Feature] Refactor ArrayConcat to use Aggregator

#157 zeotuan closed 1 month ago
0
Add randLaplace and native randGamma

#156 zeotuan closed 1 month ago
0
[Feature] Add function generate data conform a known statistical distribution

#155 zeotuan closed 2 weeks ago
0
Create release process that automatically attaches JAR file to release

#154 MrPowers opened 1 year ago
0
CustomTransform RequiredColumns & AddedColumns are case sensitive

#153 labbedaine opened 1 year ago
1
DariaWriters.writeSingleFile() needs to accept options parameter

#152 rangareddy opened 2 years ago
1
Create a better release process

#151 MrPowers opened 2 years ago
1
writeSingleFile doesn't create folders in s3

#150 jeremy-giaco opened 2 years ago
1
Question

#149 diogomrks closed 3 years ago
2
NotNull assertion expression

#148 skestle closed 3 years ago
4
Rename library to spark-helga

#147 8402sea closed 3 years ago
0
IntelliJ: Cannot resolve symbol transformations

#146 labbedaine opened 3 years ago
3
Lenient schema validation

#145 skestle opened 3 years ago
1
Ensured that schema validation matches nested structures that are in different order

#144 skestle closed 3 years ago
5
Support scala 2.13 (to enable full spark 3.2.0 support)

#143 skestle closed 3 years ago
5
Format sources and add formatting check to CI

#142 cbcoutinho closed 3 years ago
0
Add methods to modify column names to camelCase, snakeCase and upperCase

#141 santhoshdesikachari closed 3 years ago
1
ParquetCompactor can only work for parquet written by Spark

#140 yuxh opened 3 years ago
0
.Net for Spark

#139 dbeavon closed 3 years ago
3
Print createDataFrame syntax for a DataFrame

#138 MrPowers closed 3 years ago
0
Add schema safe Parquet writer

#137 MrPowers closed 3 years ago
1
Bump to Spark 3 and remove deprecated code

#135 MrPowers closed 3 years ago
0
Rename the primary branch to be "main"

#134 MrPowers closed 3 years ago
1
Add new functions: greatest and least

#133 igreenfield opened 3 years ago
0
Misleading error message in assertSmallDatarameEquality

#132 fibona44i opened 4 years ago
0
WIP: adding safeGetXXX functions

#131 jesinity closed 3 years ago
3
Add new process to publish JAR files

#130 MrPowers closed 4 years ago
0
New release soon?

#129 colindean closed 4 years ago
2
Update sbt-scalafmt plugin version and format source

#128 cbcoutinho closed 4 years ago
1
Does withColumnRenamed have a hidden cost similar to the hidden cost of withColumn

#127 MrPowers closed 3 years ago
1
Add extract, load, transform generic code

#126 MrPowers closed 4 years ago
0
add helpers for writing out data in a single file with a specific name

#125 MrPowers closed 4 years ago
0
Excel epoch converter col functions

#124 cmftall closed 4 years ago
5
Wanted to understand how can i use your this repo

#123 pankajpkh24 closed 4 years ago
1
ParquetCompactor should accept SparkSession as a dependency

#122 MrPowers opened 4 years ago
0
Prepping for Spark 3

#121 MrPowers closed 3 years ago
12
Add an evalString Column extension so users don't need to chain so ma…

#120 MrPowers closed 4 years ago
0
Cannot deploy project - Spark Packages is broken

#119 MrPowers closed 3 years ago
6