I am using training LSTM on time-series data. I want to perform regression using LSTM. I have created a vectorassembler. I am able to scale it using standardscaler transformer. I want to scale target variable also using standaredscaler.
IllegalArgumentException: 'requirement failed: Column adjclose must be of type org.apache.spark.ml.linalg.VectorUDT@3bfc3ba7 but was actually DoubleType.'
I am using training LSTM on time-series data. I want to perform regression using LSTM. I have created a vectorassembler. I am able to scale it using standardscaler transformer. I want to scale target variable also using standaredscaler.
standard_scaler = StandardScaler(inputCol="adjclose", outputCol="adjclose_n", withStd=True,withMean=True)standard_scaler_model = standard_scaler.fit(dataset)dataset = standard_scaler_model.transform(dataset)But it is showing an error.
IllegalArgumentException: 'requirement failed: Column adjclose must be of type org.apache.spark.ml.linalg.VectorUDT@3bfc3ba7 but was actually DoubleType.'