search

ShifuML / shifu

An end-to-end machine learning and data mining framework on Hadoop
https://github.com/ShifuML/shifu/wiki
Apache License 2.0
251 stars 109 forks source link

Add column config cache for UDFs #740

Closed Liu-Delin closed 3 years ago

Liu-Delin commented 3 years ago

Description

Issue: https://github.com/ShifuML/shifu/issues/738

This change provides cache for column config in UDFs. Each UDF instance will load column config. It costs much memory if the column config is large.

Tests

Unit test added.