Refine and extend texting of rs.inputs.py and rs.rs.py

[epogrebnyak]

rs.rs.py and linked files allow reading raw data and parsing specification + producting output as stream of flat dictionaries, which can be stored in database or transformed to pandas dataframes.

rs.rs.py bottom section also demonstartes some rs methods for diagnostics.

Todo:

• [ ] run rs.py + doctests + py.test, fix minor errors
• [ ] move RESERVED_FILENAMES to config
• [ ] https://github.com/epogrebnyak/rosstat-kep-data/blob/master/rs/test_inputs_and_rs.py#L7-L48:
  • [ ] make it a separate file () if cannot import in rs.py due to curcular reference
  • [ ] write_temp_files() must write to tempdata
  • [ ] write_temp_files() must return absolute path to tempdata, possibly using config.py and CurrentFolder class
• [ ] replicate test https://github.com/epogrebnyak/rosstat-kep-data/blob/master/rowsystem/tests/test_end_end_testdata.py
  • [ ] NOTE: this will require setting databases amd emitters (new class name Dataset)
• [ ] add fiscal row to testcase

Minor todo:

• [ ] pure tabulate without itertools
• [ ] word.py may use inputs.py
• [ ] ...

Notes:

• not a package for now
• may want to replicate test_mwe.py - to extent coverage of label, stream, etc
• version without dataset package?

[epogrebnyak]

write_temp_files() must write to tempdata

TEMPDATA_DIR = "path to tempdata directory from config"

class TestfolderFile(File):

    def __init__(self, filename):
        self.filename=os.path.join(TEMPDATA_DIR, filename)

def write_tempdata():        
    TestfolderFile('temp.txt').save_text("123456")       
    return TEMPDATA_DIR