SHORT_LOOPS syntax "while {....} {....}" not recognized

[arkzo]

It is possible to write a loop using a different syntax like:

while (( i++ < 10 )) { echo i is $i } 

Issue:

The syntax highlighting fails on the { echo i is $i } part. Has this been a conscious decision made in the past? If not is it possible to fix this?

[danielshahaf]

No. Yes.

[another-strange-cat]

Hi, can I take this up? What could be a possible fix?

[danielshahaf]

Sure. Welcome aboard.

The fix is going to involve state machine work in the main highlighter, but we're not there yet. We should first establish exactly which syntaxes are / aren't valid, both when SHORT_LOOPS is set and when it isn't.

Upstream's documentation doesn't fully answer the question: it just says "suitably delimited, such as […]" but doesn't give a complete specification of valid and invalid cases.

Thanks :)

[another-strange-cat]

I have read the part of the documentation in the link, and if I'm understanding it correctly, invalid cases exist only for if, while and until when the condition part is not delimited.

The delimited part should be of the form '[[ ... ]]` or '(( ... ))'.

Do we have to establish valid syntaxes for these two forms? If yes, what should be taken into consideration for defining which are valid and which aren't? Also, what exactly is going wrong here, is the highlighter not able to distinguish between the condition part and the body?

[danielshahaf]

I have read the part of the documentation in the link, and if I'm understanding it correctly, invalid cases exist only for if, while and until when the condition part is not delimited.

The delimited part should be of the form '[[ ... ]]` or '(( ... ))'.

Do we have to establish valid syntaxes for these two forms?

I'm not asking you to establish valid syntaxes for shell tests and for arithmetic expressions. I'm asking what, apart from the [[ builtin and the arithmetic evaluation statement-like syntax (( … )), zsh's manual means when it says "suitably delimited".

Also, what exactly is going wrong here, is the highlighter not able to distinguish between the condition part and the body?

No. The highlighter gets a stream of tokens —

% () { print -raC1 -- "${(@qqqq)${(z)argv}}" } 'while (( i++ < 10 )) { echo i is $i }'  
$'while'
$'(( i++ < 10 ))'
$'{'
$'echo'
$'i'
$'is'
$'$i'
$'}'

— and has to determine whether that { introduces a block (as it does in f() { foo; }), is an ordinary word (as in echo bar { baz), or is a syntax error (as in the last brace of { } }, and as in repeat 42 pwd with SHORT_LOOPS and SHORT_REPEAT both unset).

[danielshahaf]

I guess what specifically happens is that the } is recognized as special but the { isn't, so the ${braces_stack} logic kicks in and flags the } as an error.

[another-strange-cat]

Thanks for the detailed reply. The manual does not mention any other forms apart from [[ ... ]] and (( ... )), so I think we can safely assume that these are the only two.

[danielshahaf]

Thanks for the detailed reply. The manual does not mention any other forms apart from `[[ ... ]]` and `(( ... ))`,

I'm well aware of that.

so I think we can safely assume that these are the only two.

Please check that assumption. If it's correct, we should report a documentation bug to zsh upstream. If it's not, we can move on to implementing this in z-sy-h.

[another-strange-cat]

Could you please tell me how to check that assumption? I tried searching through the zsh source code repository to find the exact implementation of the syntax but couldn't find it.

[danielshahaf]

grepping for instances of SHORTLOOPS finds several instances in Src/parse.c. The easiest of them to read seems to be the one in par_while(), which parses its condition here:

https://github.com/zsh-users/zsh/blob/5c9713603d571fd228efc4c25c0efc9064d95a87/Src/parse.c#L1523-L1524

The meaning of SEPER wasn't very clear, so I committed zsh-users/zsh@5c97136.

This suggests "suitably delimited" means "is a zshmisc(1) 'list' that, when parsed, is followed by do or by { that's a token" (let's not worry about the CSH_JUNKIE_LOOPS case for now).

This checks out: while (( 1 )) && (( 2 )) { pwd } works, and with the braces removed, it works iff SHORT_LOOPS is set.

So:

• Can we make upstream's docs clearer about this, now that we know what the rule is?
• What can we reasonably support in z-sy-h?
• What are some test cases that do and don't work? For starters, there's the two I just mentioned:
  • while (( 1 )) && (( 2 )) { pwd }
  • while (( 1 )) && (( 2 )) pwd

[danielshahaf]

Those two cases should be tested both with and without SHORT_LOOPS.