awk argument issues

[sethsabar]

PaSh has been failing to run some scripts containing awk. I believe the issue is that PaSh is interpreting arguments to awk (ex: $1) as the first argument to the entire script, when it should be interpreting it as the first argument piped into awk (at least this is my interpretation as someone relatively new to shell scripting). I've pash-awk-issue-files.zip attached some scripts that run with bash, but have awk issues with PaSh.

[angelhof]

Hi Seth, could you paste a small example script where that happens and the output of pash with -d 1 when running it? :)

[sethsabar]

Sure, here's the script: `cd $1 ( export SGDIR=/tmp/sg-$$.0 rm -rf $SGDIR mkdir $SGDIR { find ( -name *.c -or -name *.h ) -type f -print0 }</dev/null >$SGDIR/npi-1.0.0 ln $SGDIR/npi-1.0.0 $SGDIR/npi-1.1.0 FNAMELEN=$( { tr \0 \n | sed 's|^.*/||' | awk '{s += length($1); n++} END {print s / n}' # shell is interperting $1 as argument from sed

but PaSh is interpreting $1 as original $1

} <$SGDIR/npi-1.0.0 ) echo $FNAMELEN )`

and here's the output: `Daemon: SocketManager: Made sure that socket does not exist Daemon: SocketManager: Created socket Daemon: SocketManager: Successfully bound to socket Daemon: SocketManager: Listenting on socket Daemon: Received data: Daemon Start

PaSh: Arguments: PaSh: input ['./3-simp.sh', '../'] PaSh: preprocess_only False PaSh: output_preprocessed False PaSh: interactive False PaSh: command None PaSh: a False PaSh: v False PaSh: x False PaSh: expand_using_bash_mirror False PaSh: output_time False PaSh: debug 1 PaSh: log_file PaSh: width 4 PaSh: no_optimize False PaSh: dry_run_compiler False PaSh: assert_compiler_success False PaSh: avoid_pash_runtime_completion False PaSh: profile_driven False PaSh: output_optimized False PaSh: graphviz no PaSh: graphviz_dir /tmp PaSh: no_eager False PaSh: no_daemon False PaSh: parallel_pipelines False PaSh: r_split_batch_size 1000000 PaSh: r_split False PaSh: dgsh_tee False PaSh: speculative False PaSh: speculation no_spec PaSh: termination clean_up_graph PaSh: daemon_communicates_through_unix_pipes False PaSh: distributed_exec False PaSh: config_path PaSh: preprocess_mode pash PaSh: ---------------------------------------- PaSh Preprocessor: Preprocessing -- Parsing time: 0.443 ms PaSh Preprocessor: Preprocessing -- PaSh time: 1.053 ms PaSh Preprocessor: Preprocessing -- Unparsing time: 1.327 ms PaSh: Preprocessed script stored in: /tmp/pash_lYG2xjY/tmp2zial07f PaSh: Executing: PASH_TMP_PREFIX=/tmp/pash_lYG2xjY/ pash_shell_name=./3-simp.sh /usr/bin/env bash +a -c source /tmp/pash_lYG2xjY/tmp2zial07f ./3-simp.sh ../ 524736: (1) Previous exit status: 0 524736: (1) Previous set state: hBc Writing vars to: /tmp/pash_lYG2xjY//pash_156062311225329 524736: (1) Bash variables saved in: /tmp/pash_lYG2xjY//pash_156062311225329 524736: (1) Bash set state at start of execution: hBc From set: hBc To set: huB To add: u To remove: 524736: (1) Set state reverted to PaSh-internal set state: huBc 524736: (2) Before asking the daemon for compilation... Sending msg to compilation-server: Compile:/tmp/pash_lYG2xjY//pash_32511117413296| Variable File:/tmp/pash_lYG2xjY//pash_156062311225329| Input IR File:/tmp/pash_lYG2xjY/tmpl3yvx3se Daemon: Received data: Compile:/tmp/pash_lYG2xjY//pash_32511117413296| Variable File:/tmp/pash_lYG2xjY//pash_156062311225329| Input IR File:/tmp/pash_lYG2xjY/tmpl3yvx3se

Daemon: Reading variables from: /tmp/pash_lYG2xjY//pash_156062311225329 Daemon: Variable Reading time: 0.01 ms Daemon: Variable Tokenizing time: 2.156 ms Daemon: Variable Loading time: 2.299 ms Daemon: Selected width: 4 Daemon: Retrieving candidate DF region: /tmp/pash_lYG2xjY/tmpl3yvx3se ... Daemon: Done! Daemon: Var: 1 value: ../ Daemon: WARNING: Exception caught: InputOutputInformation for cd not provided so considered side-effectful. Daemon: Daemon Compile time: 0.154 ms Daemon: Unsafe running: False Daemon: Waiting for all processes to finish. There are 0 processes remaining. Daemon: Request handling time: 2.478 ms Got response from compilation-server: ERROR: 1 failed to compile 524736: (2) Compiler exited with code: 1 524736: (2) Traps set: Sending msg to compilation-server: Exit:1|Time: Daemon: Received data: Exit:1|Time:

Daemon: Time part is: Time:

Daemon: Process: 1 exited. Exec time was: None Daemon: The following process exited: 1 Got response from compilation-server: From set: huBc To set: hBc To add: To remove: u 524736: (3) Reverted to BaSh set state: hBc 524736: (3) Array: ../ 524736: (3) Number of arguments: 1 524736: (3) Reverted to BaSh input arguments: ../ 524736: (3) Number of arguments: 1 524736: (4) Restoring previous exit code: 0 524736: (4) Will execute script in /tmp/pash_lYG2xjY/tmppdsademd: cd $1 524736: (5) BaSh script exited with ec: 0 524736: (5) Writing current BaSh set state to: /tmp/pash_lYG2xjY//pash_JfgblpUgIG 524736: (5) Current BaSh shell: hBc From set: hBc To set: huBc To add: u To remove: 524736: (5) Reverted to PaSh set state to: huBc Writing vars to: /tmp/pash_lYG2xjY//pash_JqSsTgiOyy Execution time: 9.580 ms 524736: (7) Recovering BaSh variables from: /tmp/pash_lYG2xjY//pash_JqSsTgiOyy /dev/fd/63: line 11: FUNCNAME: variable may not be assigned value /dev/fd/63: line 11: declare: FUNCNAME: variable may not be assigned value /dev/fd/63: line 40: declare: PPID: readonly variable /dev/fd/63: line 51: declare: SHELLOPTS: readonly variable /dev/fd/63: line 59: declare: UID: readonly variable 524736: (7) Reading current BaSh set state from: /tmp/pash_lYG2xjY//pash_JfgblpUgIG 524736: (7) Current BaSh set state: hBc 524736: (7) Arguments (might) have been updated to be: ../ 524736: (7) Current PaSh set state: huBc From set: huBc To set: hBc To add: To remove: u 524736: (7) Reverted to BaSh set state before exiting: hBc 524736: (7) Reverting last BaSh exit code: 0 524736: (1) Previous exit status: 0 524736: (1) Previous set state: hBc Writing vars to: /tmp/pash_lYG2xjY//pash_15216515429467 524736: (1) Bash variables saved in: /tmp/pash_lYG2xjY//pash_15216515429467 524736: (1) Bash set state at start of execution: hBc From set: hBc To set: huB To add: u To remove: 524736: (1) Set state reverted to PaSh-internal set state: huBc 524736: (2) Before asking the daemon for compilation... Sending msg to compilation-server: Compile:/tmp/pash_lYG2xjY//pash_55572525822152| Variable File:/tmp/pash_lYG2xjY//pash_15216515429467| Input IR File:/tmp/pash_lYG2xjY/tmpw9tg_j Daemon: Received data: Compile:/tmp/pash_lYG2xjY//pash_55572525822152| Variable File:/tmp/pash_lYG2xjY//pash_15216515429467| Input IR File:/tmp/pash_lYG2xjY/tmpw9tg_j

Daemon: Reading variables from: /tmp/pash_lYG2xjY//pash_15216515429467 Daemon: Variable Reading time: 0.006 ms Daemon: Variable Tokenizing time: 2.65 ms Daemon: Variable Loading time: 2.792 ms Daemon: Selected width: 4 Daemon: Retrieving candidate DF region: /tmp/pash_lYG2xjY/tmp__w9tg_j ... Daemon: Done! Daemon: Var: $ value: None Daemon: WARNING: Exception caught: InputOutputInformation for export not provided so considered side-effectful. Daemon: Daemon Compile time: 0.139 ms Daemon: Unsafe running: False Daemon: Waiting for all processes to finish. There are 0 processes remaining. Daemon: Request handling time: 2.953 ms Got response from compilation-server: ERROR: 2 failed to compile 524736: (2) Compiler exited with code: 1 524736: (2) Traps set: Sending msg to compilation-server: Exit:2|Time: Daemon: Received data: Exit:2|Time:

Daemon: Time part is: Time:

Daemon: Process: 2 exited. Exec time was: None Daemon: The following process exited: 2 Got response from compilation-server: From set: huBc To set: hBc To add: To remove: u 524736: (3) Reverted to BaSh set state: hBc 524736: (3) Array: ../ 524736: (3) Number of arguments: 1 524736: (3) Reverted to BaSh input arguments: ../ 524736: (3) Number of arguments: 1 524736: (4) Restoring previous exit code: 0 524736: (4) Will execute script in /tmp/pash_lYG2xjY/tmpqk9esnus: export SGDIR=/tmp/sg-${$}.0 524736: (5) BaSh script exited with ec: 0 524736: (5) Writing current BaSh set state to: /tmp/pash_lYG2xjY//pash_uvU4WPohFW 524736: (5) Current BaSh shell: hBc From set: hBc To set: huBc To add: u To remove: 524736: (5) Reverted to PaSh set state to: huBc Writing vars to: /tmp/pash_lYG2xjY//pash_qsqPsDocYc Execution time: 8.580 ms 524736: (7) Recovering BaSh variables from: /tmp/pash_lYG2xjY//pash_qsqPsDocYc /dev/fd/63: line 12: FUNCNAME: variable may not be assigned value /dev/fd/63: line 12: declare: FUNCNAME: variable may not be assigned value /dev/fd/63: line 41: declare: PPID: readonly variable /dev/fd/63: line 53: declare: SHELLOPTS: readonly variable /dev/fd/63: line 61: declare: UID: readonly variable 524736: (7) Reading current BaSh set state from: /tmp/pash_lYG2xjY//pash_uvU4WPohFW 524736: (7) Current BaSh set state: hBc 524736: (7) Arguments (might) have been updated to be: ../ 524736: (7) Current PaSh set state: huBc From set: huBc To set: hBc To add: To remove: u 524736: (7) Reverted to BaSh set state before exiting: hBc 524736: (7) Reverting last BaSh exit code: 0 524736: (1) Previous exit status: 0 524736: (1) Previous set state: hBc Writing vars to: /tmp/pash_lYG2xjY//pash_23751072121834 524736: (1) Bash variables saved in: /tmp/pash_lYG2xjY//pash_23751072121834 524736: (1) Bash set state at start of execution: hBc From set: hBc To set: huB To add: u To remove: 524736: (1) Set state reverted to PaSh-internal set state: huBc 524736: (2) Before asking the daemon for compilation... Sending msg to compilation-server: Compile:/tmp/pash_lYG2xjY//pash_26386710611541| Variable File:/tmp/pash_lYG2xjY//pash_23751072121834| Input IR File:/tmp/pash_lYG2xjY/tmpbasdpmqx Daemon: Received data: Compile:/tmp/pash_lYG2xjY//pash_26386710611541| Variable File:/tmp/pash_lYG2xjY//pash_23751072121834| Input IR File:/tmp/pash_lYG2xjY/tmpbasdpmqx

Daemon: Reading variables from: /tmp/pash_lYG2xjY//pash_23751072121834 Daemon: Variable Reading time: 0.008 ms Daemon: Variable Tokenizing time: 2.541 ms Daemon: Variable Loading time: 2.702 ms Daemon: Selected width: 4 Daemon: Retrieving candidate DF region: /tmp/pash_lYG2xjY/tmpbasdpmqx ... Daemon: Done! Daemon: Var: SGDIR value: /tmp/sg-524736.0 Daemon: WARNING: Exception caught: Command rm has outputs other than streaming. Daemon: Daemon Compile time: 0.161 ms Daemon: Unsafe running: False Daemon: Waiting for all processes to finish. There are 0 processes remaining. Daemon: Request handling time: 2.885 ms Got response from compilation-server: ERROR: 3 failed to compile 524736: (2) Compiler exited with code: 1 524736: (2) Traps set: Sending msg to compilation-server: Exit:3|Time: Daemon: Received data: Exit:3|Time:

Daemon: Time part is: Time:

Daemon: Process: 3 exited. Exec time was: None Daemon: The following process exited: 3 Got response from compilation-server: From set: huBc To set: hBc To add: To remove: u 524736: (3) Reverted to BaSh set state: hBc 524736: (3) Array: ../ 524736: (3) Number of arguments: 1 524736: (3) Reverted to BaSh input arguments: ../ 524736: (3) Number of arguments: 1 524736: (4) Restoring previous exit code: 0 524736: (4) Will execute script in /tmp/pash_lYG2xjY/tmp6eufb1j3: rm -rf ${SGDIR} 524736: (5) BaSh script exited with ec: 0 524736: (5) Writing current BaSh set state to: /tmp/pash_lYG2xjY//pash_zkkWCyZNMA 524736: (5) Current BaSh shell: hBc From set: hBc To set: huBc To add: u To remove: 524736: (5) Reverted to PaSh set state to: huBc Writing vars to: /tmp/pash_lYG2xjY//pash_lryjCncz27 Execution time: 9.956 ms 524736: (7) Recovering BaSh variables from: /tmp/pash_lYG2xjY//pash_lryjCncz27 /dev/fd/63: line 12: FUNCNAME: variable may not be assigned value /dev/fd/63: line 12: declare: FUNCNAME: variable may not be assigned value /dev/fd/63: line 41: declare: PPID: readonly variable /dev/fd/63: line 53: declare: SHELLOPTS: readonly variable /dev/fd/63: line 61: declare: UID: readonly variable 524736: (7) Reading current BaSh set state from: /tmp/pash_lYG2xjY//pash_zkkWCyZNMA 524736: (7) Current BaSh set state: hBc 524736: (7) Arguments (might) have been updated to be: ../ 524736: (7) Current PaSh set state: huBc From set: huBc To set: hBc To add: To remove: u 524736: (7) Reverted to BaSh set state before exiting: hBc 524736: (7) Reverting last BaSh exit code: 0 524736: (1) Previous exit status: 0 524736: (1) Previous set state: hBc Writing vars to: /tmp/pash_lYG2xjY//pash_45002642519855 524736: (1) Bash variables saved in: /tmp/pash_lYG2xjY//pash_45002642519855 524736: (1) Bash set state at start of execution: hBc From set: hBc To set: huB To add: u To remove: 524736: (1) Set state reverted to PaSh-internal set state: huBc 524736: (2) Before asking the daemon for compilation... Sending msg to compilation-server: Compile:/tmp/pash_lYG2xjY//pash_34183009622011| Variable File:/tmp/pash_lYG2xjY//pash_45002642519855| Input IR File:/tmp/pash_lYG2xjY/tmphc2xe3sv Daemon: Received data: Compile:/tmp/pash_lYG2xjY//pash_34183009622011| Variable File:/tmp/pash_lYG2xjY//pash_45002642519855| Input IR File:/tmp/pash_lYG2xjY/tmphc2xe3sv

Daemon: Reading variables from: /tmp/pash_lYG2xjY//pash_45002642519855 Daemon: Variable Reading time: 0.005 ms Daemon: Variable Tokenizing time: 2.156 ms Daemon: Variable Loading time: 2.297 ms Daemon: Selected width: 4 Daemon: Retrieving candidate DF region: /tmp/pash_lYG2xjY/tmphc2xe3sv ... Daemon: Done! Daemon: Var: SGDIR value: /tmp/sg-524736.0 Daemon: WARNING: Exception caught: InputOutputInformation for mkdir not provided so considered side-effectful. Daemon: Daemon Compile time: 0.121 ms Daemon: Unsafe running: False Daemon: Waiting for all processes to finish. There are 0 processes remaining. Daemon: Request handling time: 2.44 ms Got response from compilation-server: ERROR: 4 failed to compile 524736: (2) Compiler exited with code: 1 524736: (2) Traps set: Sending msg to compilation-server: Exit:4|Time: Daemon: Received data: Exit:4|Time:

Daemon: Time part is: Time:

Daemon: Process: 4 exited. Exec time was: None Daemon: The following process exited: 4 Got response from compilation-server: From set: huBc To set: hBc To add: To remove: u 524736: (3) Reverted to BaSh set state: hBc 524736: (3) Array: ../ 524736: (3) Number of arguments: 1 524736: (3) Reverted to BaSh input arguments: ../ 524736: (3) Number of arguments: 1 524736: (4) Restoring previous exit code: 0 524736: (4) Will execute script in /tmp/pash_lYG2xjY/tmphhyxu_5w: mkdir ${SGDIR} 524736: (5) BaSh script exited with ec: 0 524736: (5) Writing current BaSh set state to: /tmp/pash_lYG2xjY//pash_VJ8doO7mPI 524736: (5) Current BaSh shell: hBc From set: hBc To set: huBc To add: u To remove: 524736: (5) Reverted to PaSh set state to: huBc Writing vars to: /tmp/pash_lYG2xjY//pash_ANsYcQdyWX Execution time: 9.444 ms 524736: (7) Recovering BaSh variables from: /tmp/pash_lYG2xjY//pash_ANsYcQdyWX /dev/fd/63: line 12: FUNCNAME: variable may not be assigned value /dev/fd/63: line 12: declare: FUNCNAME: variable may not be assigned value /dev/fd/63: line 41: declare: PPID: readonly variable /dev/fd/63: line 53: declare: SHELLOPTS: readonly variable /dev/fd/63: line 61: declare: UID: readonly variable 524736: (7) Reading current BaSh set state from: /tmp/pash_lYG2xjY//pash_VJ8doO7mPI 524736: (7) Current BaSh set state: hBc 524736: (7) Arguments (might) have been updated to be: ../ 524736: (7) Current PaSh set state: huBc From set: huBc To set: hBc To add: To remove: u 524736: (7) Reverted to BaSh set state before exiting: hBc 524736: (7) Reverting last BaSh exit code: 0 524736: (1) Previous exit status: 0 524736: (1) Previous set state: hBc Writing vars to: /tmp/pash_lYG2xjY//pash_254241593418064 524736: (1) Bash variables saved in: /tmp/pash_lYG2xjY//pash_254241593418064 524736: (1) Bash set state at start of execution: hBc From set: hBc To set: huB To add: u To remove: 524736: (1) Set state reverted to PaSh-internal set state: huBc 524736: (2) Before asking the daemon for compilation... Sending msg to compilation-server: Compile:/tmp/pash_lYG2xjY//pash_2874125554959| Variable File:/tmp/pash_lYG2xjY//pash_254241593418064| Input IR File:/tmp/pash_lYG2xjY/tmpru9hc3dd Daemon: Received data: Compile:/tmp/pash_lYG2xjY//pash_2874125554959| Variable File:/tmp/pash_lYG2xjY//pash_254241593418064| Input IR File:/tmp/pash_lYG2xjY/tmpru9hc3dd

Daemon: Reading variables from: /tmp/pash_lYG2xjY//pash_254241593418064 Daemon: Variable Reading time: 0.004 ms Daemon: Variable Tokenizing time: 2.18 ms Daemon: Variable Loading time: 2.315 ms Daemon: Selected width: 4 Daemon: Retrieving candidate DF region: /tmp/pash_lYG2xjY/tmpru9hc3dd ... Daemon: Done! Daemon: WARNING: Exception caught: InputOutputInformation for find not provided so considered side-effectful. Daemon: Daemon Compile time: 0.165 ms Daemon: Unsafe running: False Daemon: Waiting for all processes to finish. There are 0 processes remaining. Daemon: Request handling time: 2.502 ms Got response from compilation-server: ERROR: 5 failed to compile 524736: (2) Compiler exited with code: 1 524736: (2) Traps set: Sending msg to compilation-server: Exit:5|Time: Daemon: Received data: Exit:5|Time:

Daemon: Time part is: Time:

Daemon: Process: 5 exited. Exec time was: None Daemon: The following process exited: 5 Got response from compilation-server: From set: huBc To set: hBc To add: To remove: u 524736: (3) Reverted to BaSh set state: hBc 524736: (3) Array: ../ 524736: (3) Number of arguments: 1 524736: (3) Reverted to BaSh input arguments: ../ 524736: (3) Number of arguments: 1 524736: (4) Restoring previous exit code: 0 524736: (4) Will execute script in /tmp/pash_lYG2xjY/tmpv_hj6a92: find ( -name *.c -or -name *.h ) -type f -print0 524736: (5) BaSh script exited with ec: 0 524736: (5) Writing current BaSh set state to: /tmp/pash_lYG2xjY//pash_QbFQe6voCQ 524736: (5) Current BaSh shell: hBc From set: hBc To set: huBc To add: u To remove: 524736: (5) Reverted to PaSh set state to: huBc Writing vars to: /tmp/pash_lYG2xjY//pash_TLCAgfgsqO Execution time: 11.394 ms 524736: (7) Recovering BaSh variables from: /tmp/pash_lYG2xjY//pash_TLCAgfgsqO /dev/fd/63: line 12: FUNCNAME: variable may not be assigned value /dev/fd/63: line 12: declare: FUNCNAME: variable may not be assigned value /dev/fd/63: line 41: declare: PPID: readonly variable /dev/fd/63: line 53: declare: SHELLOPTS: readonly variable /dev/fd/63: line 61: declare: UID: readonly variable 524736: (7) Reading current BaSh set state from: /tmp/pash_lYG2xjY//pash_QbFQe6voCQ 524736: (7) Current BaSh set state: hBc 524736: (7) Arguments (might) have been updated to be: ../ 524736: (7) Current PaSh set state: huBc From set: huBc To set: hBc To add: To remove: u 524736: (7) Reverted to BaSh set state before exiting: hBc 524736: (7) Reverting last BaSh exit code: 0 524736: (1) Previous exit status: 0 524736: (1) Previous set state: hBc Writing vars to: /tmp/pash_lYG2xjY//pash_81192990326443 524736: (1) Bash variables saved in: /tmp/pash_lYG2xjY//pash_81192990326443 524736: (1) Bash set state at start of execution: hBc From set: hBc To set: huB To add: u To remove: 524736: (1) Set state reverted to PaSh-internal set state: huBc 524736: (2) Before asking the daemon for compilation... Sending msg to compilation-server: Compile:/tmp/pash_lYG2xjY//pash_48391410932480| Variable File:/tmp/pash_lYG2xjY//pash_81192990326443| Input IR File:/tmp/pash_lYG2xjY/tmp0ehkoyj9 Daemon: Received data: Compile:/tmp/pash_lYG2xjY//pash_48391410932480| Variable File:/tmp/pash_lYG2xjY//pash_81192990326443| Input IR File:/tmp/pash_lYG2xjY/tmp0ehkoyj9

Daemon: Reading variables from: /tmp/pash_lYG2xjY//pash_81192990326443 Daemon: Variable Reading time: 0.007 ms Daemon: Variable Tokenizing time: 2.612 ms Daemon: Variable Loading time: 2.764 ms Daemon: Selected width: 4 Daemon: Retrieving candidate DF region: /tmp/pash_lYG2xjY/tmp0ehkoyj9 ... Daemon: Done! Daemon: Var: SGDIR value: /tmp/sg-524736.0 Daemon: Var: SGDIR value: /tmp/sg-524736.0 Daemon: WARNING: Exception caught: InputOutputInformation for ln not provided so considered side-effectful. Daemon: Daemon Compile time: 0.136 ms Daemon: Unsafe running: False Daemon: Waiting for all processes to finish. There are 0 processes remaining. Daemon: Request handling time: 2.923 ms Got response from compilation-server: ERROR: 6 failed to compile 524736: (2) Compiler exited with code: 1 524736: (2) Traps set: Sending msg to compilation-server: Exit:6|Time: Daemon: Received data: Exit:6|Time:

Daemon: Time part is: Time:

Daemon: Process: 6 exited. Exec time was: None Daemon: The following process exited: 6 Got response from compilation-server: From set: huBc To set: hBc To add: To remove: u 524736: (3) Reverted to BaSh set state: hBc 524736: (3) Array: ../ 524736: (3) Number of arguments: 1 524736: (3) Reverted to BaSh input arguments: ../ 524736: (3) Number of arguments: 1 524736: (4) Restoring previous exit code: 0 524736: (4) Will execute script in /tmp/pash_lYG2xjY/tmpfe6_58mb: ln ${SGDIR}/npi-1.0.0 ${SGDIR}/npi-1.1.0 524736: (5) BaSh script exited with ec: 0 524736: (5) Writing current BaSh set state to: /tmp/pash_lYG2xjY//pash_K0THWlIBDB 524736: (5) Current BaSh shell: hBc From set: hBc To set: huBc To add: u To remove: 524736: (5) Reverted to PaSh set state to: huBc Writing vars to: /tmp/pash_lYG2xjY//pash_x2TavCIfON Execution time: 9.553 ms 524736: (7) Recovering BaSh variables from: /tmp/pash_lYG2xjY//pash_x2TavCIfON /dev/fd/63: line 12: FUNCNAME: variable may not be assigned value /dev/fd/63: line 12: declare: FUNCNAME: variable may not be assigned value /dev/fd/63: line 41: declare: PPID: readonly variable /dev/fd/63: line 53: declare: SHELLOPTS: readonly variable /dev/fd/63: line 61: declare: UID: readonly variable 524736: (7) Reading current BaSh set state from: /tmp/pash_lYG2xjY//pash_K0THWlIBDB 524736: (7) Current BaSh set state: hBc 524736: (7) Arguments (might) have been updated to be: ../ 524736: (7) Current PaSh set state: huBc From set: huBc To set: hBc To add: To remove: u 524736: (7) Reverted to BaSh set state before exiting: hBc 524736: (7) Reverting last BaSh exit code: 0 awk: 1: unexpected character '.'`

at which point execution freezes.

[angelhof]

Could try to shrink this test (make it smaller) and make it to work without input files and also print here what bash returns when you run it? I can't reproduce the error. Also what branch of PaSh are you using?

[sethsabar]

I did a little more toying around and came up with this simple example which works normally but not with PaSh. rm -f output.txt ( awk 'length($1) > 5' data.txt > output.txt )

I made data.txt a few lines of data where some have their first field's value more than 5 characters and some don't. I found that with bash, it works as expected (only the lines for which the first field are more than 5 characters are written to output.txt). But with PaSh all lines of data.txt are written to output.txt. I'm only able to reproduce this error, however, when the awk command is run in a subshell (without the subshell this works fine). My best guess as to what's happening is that in the subshell, PaSh is interpreting $1 to be the first argument to the script (I found that giving this script an argument of any length changed the behavior of PaSh such that nothing was written to output.txt).

I'm using the most up-to-date version of standard PaSh on the main branch.

[angelhof]

Thank you very much for this! I am really perplexed... it works for me. I paste the output of my PaSh below running on the main branch:

$ git pull
Already up to date.
$ cat data.txt
123456
1234
123456
123456
123456
1234
1234
123456
$ ./pa.sh test.sh
$ cat output.txt
123456
123456
123456
123456
123456

[angelhof]

I remember that we had the issue that you are describing in the past, but this example works for me... I am not sure why haha

[angelhof]

A minimal test case for this bug:

$ cat test.sh
echo "abcd" > /tmp/data.txt
echo "abcde" >> /tmp/data.txt
echo "abc" >> /tmp/data.txt
awk 'length($1) > 3' /tmp/data.txt
$ bash test.sh foo
abcd
abcde
$ ./pa.sh test.sh foo
## No output

The culprit is that PaSh messes up single quotes and prints them as double quotes (see output of ./pa.sh -d 1 test.sh foo):

...
## This is what PaSh executes
{ awk "length($1) > 5" data.txt & }
...