weld-project / weld

High-performance runtime for data analytics applications
https://www.weld.rs
BSD 3-Clause "New" or "Revised" License
2.99k stars 260 forks source link

Getting compile error: Invalid input token: 'name' #511

Closed ConcurrencyPractitioner closed 4 years ago

ConcurrencyPractitioner commented 4 years ago

I was testing the data frame snippet from the example in the dataframe PR (#510). However, when running inside the repl (built from tip of master), I got the below error:

Richards-MacBook-Air-2:weld richardyu$ ./target/release/repl
[info] 20:08:05.228: Weld Version 0.4.0 (Build dcbba9a)
Log Level set to 'debug'
>>> df = GrizzlyDataFrame({'name': ['mike', 'sam', 'sally'], 'age': [20, 22, 56]})
[debug] 20:08:13.772: ParsedConf { memory_limit: 1000000000, threads: 1, trace_run: false, enable_sir_opt: true, enable_experimental_passes: false, optimization_passes: [Pass { transforms: [Transformation(experimental=false)], pass_name: "inline-zip" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "inline-apply" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "inline-let" }, Pass { transforms: [Transformation(experimental=false), Transformation(experimental=false), Transformation(experimental=false), Transformation(experimental=false), Transformation(experimental=false), Transformation(experimental=true), Transformation(experimental=true)], pass_name: "loop-fusion" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "unroll-static-loop" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "infer-size" }, Pass { transforms: [Transformation(experimental=false), Transformation(experimental=false)], pass_name: "algebraic" }, Pass { transforms: [Transformation(experimental=false), Transformation(experimental=false), Transformation(experimental=false)], pass_name: "inline-literals" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "cse" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "short-circuit-booleans" }, Pass { transforms: [Transformation(experimental=false), Transformation(experimental=false)], pass_name: "predicate" }, Pass { transforms: [Transformation(experimental=false)], pass_name: "vectorize" }], enable_bounds_checks: false, llvm: LLVMConfig { opt_level: 2, llvm_unroller: true, llvm_vectorizer: true, target_analysis_passes: true, module_optimizations: true, func_optimizations: true, run_func_name: "run" }, dump_code: DumpCodeConfig { enabled: false, filename: "code-1587784093-dd", directory: ".", formats: {LLVMOpt, SIR, Assembly, LLVM, Weld, WeldOpt} } }
REPL: Compile error: Invalid input token: 'name':
sppalkia commented 4 years ago

You'll need to run this inside the Python REPL, not the Weld REPL; the Weld REPL is just to test compiling Weld language expressions :)

ConcurrencyPractitioner commented 4 years ago

Oh, I see. Thanks for the help.

ConcurrencyPractitioner commented 4 years ago

Hi @sppalkia. After a little bit of experimenting, I encountered an error. For context, I was trying to run the following commands on Mac under weld-python:

$ rustup default nightly
$ python setup.py develop

It was on the second command that I had a problem. (I just used python3 instead of python). The following error was reported:

Traceback (most recent call last):
  File "./setup.py", line 8, in <module>
    from setuptools_rust import RustExtension
ModuleNotFoundError: No module named 'setuptools_rust'

I did try to pip3 install the above module (which passed), and then try the command again. However, that failed, with the same error. Do you know what might be the cause of this error?

Here is my OS: Darwin Richards-Air-2.attlocal.net 19.2.0 Darwin Kernel Version 19.2.0: Sat Nov 9 03:47:04 PST 2019; root:xnu-6153.61.1~20/RELEASE_X86_64 x86_64 Python version: 3.7.2