-
This is a fascinating set of ideas. However, with
```
%vjcair> *1/bin/sparkling-shell
-----
Spark master (MASTER) : local-cluster[3,2,2048]
Spark home (SPARK_HOME) : /Users/stvjc/Researc…
-
I really like Flintrock as I was able to completely set up my EC2 cluster with relative ease.
One thing that would be nice is to handle user templated configuration files for hadoop and spark.
I w…
-
## Description
When disabling `create_iam_instance_profile`, the Terraform apply will fail due to `aws_iam_policy.service_pass_role` not containing any resource.
![SCR-20240703-ktdq](https://git…
-
I've launched a cluster with spark-ec2 branch-2.0 using the following:
`
$SPARK_HOME/spark-ec2/spark-ec2 --key-pair=ec2key --identity-file=$HOME/ec2key.pem --vpc-id=vpc-nnncnnnn --slaves=3 --instanc…
-
Now I have already build CaffeOnSpark successfully , my own data is CIFAR-10(256*256) LMDB-9.8GB,How can I trans this into DF? Thank you!
kceil updated
7 years ago
-
Hi,
I'm having issues when stopping and restarting the cluster.
Stop is working fine (i.e. flintrock stop my-cluster).
However when trying to start again (flintrock start my-cluster) the instances…
-
In Trino 444 with Alluxio cache enabled, when dropping and then recreating a delta table, I occasionally get the following error:
```
io.trino.spi.TrinoException: Error getting snapshot for my_schem…
-
I have installed dd-agent (version 6) in one of our EC2 instances and changed spark conf so I can monitor my EMR cluster
```
init_config:
instances:
- spark_url: http://10.0.0.1:8088
clus…
-
I'm writing parquet to S3 from Spark 1.6.1 on EMR. And when it got to the last few files to write to S3, I received this stacktrace in the log with no other errors before or after it. It's very cons…
-
Hi All,
I am trying to automate the EMR cluster creation using Boto3. Which i am using to create the EMR cluster. I need a cluster created with Impala configured.
Here is the parmas i passed to run_j…