igordejanovic / parglare

A pure Python LR/GLR parser - http://www.igordejanovic.net/parglare/
MIT License
135 stars 32 forks source link

Separate imports of the same file result in multiple "instances" #151

Open Tiger-Tom opened 2 months ago

Tiger-Tom commented 2 months ago

Description

When two grammar files import the same file (lets say root imports a and b, and a imports b), one file (root) will have a different "version" (root.b) of the imported file (b) from the other file (a, root.a.b)

When the first file overrides a terminal in the imported file, the second terminal should, in theory, use that override (a.b.B), however it does not (b.B)

What I Did

root.pg

import './a.pg' ;
import './b.pg' ;

start: a.a ;

terminals
b.B: 'C' ;

a.pg

import './b.pg' ;

a: b.B ;

b.pg

terminals
B: 'B' ;

Given the above examples, upon constructing the grammar (parglare.Grammar.from_file('./root.pg')), the terminals are as such:

I would expect there to be only one, a.b.B, as having each import potentially separate makes overriding complex multi-file grammars much more difficult.

Tiger-Tom commented 2 months ago

I created a pull request with a small, somewhat untested simple fix at #152 for a starting point. If you approve of the base concept, I will add tests and update anything else as necessary.

igordejanovic commented 2 months ago

@Tiger-Tom Thanks for the contributions! I expect to find time for the review during the next week.

igordejanovic commented 2 months ago

Looks good as a starting point. Watch out for file_path which is relative to the importing file. That should probably be normalized to be e.g. relative to the root file to be sure that we always get the same file back no matter where we are importing it from.