search

opendatasicilia / tansignari

"T'ansignari e t'appeddiri"
http://tansignari.opendatasicilia.it
Creative Commons Attribution 4.0 International
18 stars 10 forks source link

[visidata] come creare uno script a partire da file di log #147

Open pigreco opened 4 years ago

pigreco commented 4 years ago

In Visidata:

  1. come salvare il file di log
  2. come usarlo per fare uno script
aborruso commented 4 years ago

Parti da qui https://www.visidata.org/docs/save-restore/

image

pigreco commented 4 years ago

Parti da qui https://www.visidata.org/docs/save-restore/

ottima guida, grazie per la segnalazione.

Ho fatto delle prove, direi che è molto semplice e di una potenza incredibile.

Credo non occorre ricetta, giusto??

aborruso commented 4 years ago

@pigreco non sarebbe carina una guida di base, in cui mostri come applicare la stessa procedura che hai registrato su un file (anche cancellare una colonna), ad un altro file con la stessa struttura?

A tua scelta

pigreco commented 4 years ago

@pigreco non sarebbe carina una guida di base, in cui mostri come applicare la stessa procedura che hai registrato su un file (anche cancellare una colonna), ad un altro file con la stessa struttura?

A tua scelta

Buona idea

pigreco commented 4 years ago

Ho notato che se uno stesso file varia nel tempo il numero di righe, la registrazione non funziona in quanto alcune procedure potrebbero dipendere dagli stessi dati e se questi cambiano mandano in crisi il file *.vd

questo è un file *.vd dove è palese che dipende dai dati:

sheet   col row longname    input   keystrokes  comment
    override    null_value  set-option          
            open-file   merge_mod.csv   o   
merge_mod   Description     hide-col        -   
merge_mod   Milestone       hide-col        -   
merge_mod   Merged      hide-col        -   
merge_mod   tags        hide-col        -   
merge_mod   Author      key-col     !   
merge_mod   PR      aggregate-col   max +   
merge_mod   PR      pivot       W   
merge_mod_pivot_PR          columns-sheet       C   
merge_mod_pivot_PR_columns      キTotal_PR_max   delete-row      d   
merge_mod_pivot_PR_columns  name        select-col-regex    PR_ |   
merge_mod_pivot_PR_columns      キPR_max_[36303](https://github.com/qgis/QGIS/pull/36303)    join-cols       &   
merge_mod_pivot_PR_columns          delete-selected     gd  
merge_mod_pivot_PR_columns  name    キPR_max_[36303](https://github.com/qgis/QGIS/pull/36303)+PR_max_[36300](https://github.com/qgis/QGIS/pull/36300)+PR_max_[36299](https://github.com/qgis/QGIS/pull/36299)+PR_max_[36245](https://github.com/qgis/QGIS/pull/36245)+PR_max_[36243](https://github.com/qgis/QGIS/pull/36243)+PR_max_[36236](https://github.com/qgis/QGIS/pull/36236)+PR_max_[36224](https://github.com/qgis/QGIS/pull/36224)+PR_max_[36222](https://github.com/qgis/QGIS/pull/36222)+PR_max_[36202](https://github.com/qgis/QGIS/pull/36202)+PR_max_[36190](https://github.com/qgis/QGIS/pull/36190)+PR_max_[36171](https://github.com/qgis/QGIS/pull/36171)+PR_max_[36166](https://github.com/qgis/QGIS/pull/36166)+PR_max_[36162](https://github.com/qgis/QGIS/pull/36162)+PR_max_[36136](https://github.com/qgis/QGIS/pull/36136)+PR_max_[36131](https://github.com/qgis/QGIS/pull/36131)+PR_max_[36130](https://github.com/qgis/QGIS/pull/36130)+PR_max_[36106](https://github.com/qgis/QGIS/pull/36106)+PR_max_[36099](https://github.com/qgis/QGIS/pull/36099)+PR_max_[36089](https://github.com/qgis/QGIS/pull/36089)+PR_max_[36069](https://github.com/qgis/QGIS/pull/36069)+PR_max_[36013](https://github.com/qgis/QGIS/pull/36013)+PR_max_[35974](https://github.com/qgis/QGIS/pull/35974)+PR_max_[35933](https://github.com/qgis/QGIS/pull/35933)+PR_max_[35928](https://github.com/qgis/QGIS/pull/35928)+PR_max_[35926](https://github.com/qgis/QGIS/pull/35926)+PR_max_[35909](https://github.com/qgis/QGIS/pull/35909)+PR_max_[35901](https://github.com/qgis/QGIS/pull/35901)+PR_max_[35889](https://github.com/qgis/QGIS/pull/35889)+PR_max_[35863](https://github.com/qgis/QGIS/pull/35863)+PR_max_[35839](https://github.com/qgis/QGIS/pull/35839)+PR_max_[35821](https://github.com/qgis/QGIS/pull/35821)+PR_max_[35815](https://github.com/qgis/QGIS/pull/35815)+PR_max_[35808](https://github.com/qgis/QGIS/pull/35808)+PR_max_[35790](https://github.com/qgis/QGIS/pull/35790)+PR_max_[35778](https://github.com/qgis/QGIS/pull/35778)+PR_max_[35764](https://github.com/qgis/QGIS/pull/35764)+PR_max_[35760](https://github.com/qgis/QGIS/pull/35760)+PR_max_[35748](https://github.com/qgis/QGIS/pull/35748)+PR_max_[35738](https://github.com/qgis/QGIS/pull/35738)+PR_max_[35727](https://github.com/qgis/QGIS/pull/35727)+PR_max_[35694](https://github.com/qgis/QGIS/pull/35694)+PR_max_[35689](https://github.com/qgis/QGIS/pull/35689)+PR_max_[35688](https://github.com/qgis/QGIS/pull/35688)+PR_max_[35657](https://github.com/qgis/QGIS/pull/35657)+PR_max_[35644](https://github.com/qgis/QGIS/pull/35644)+PR_max_[35641](https://github.com/qgis/QGIS/pull/35641)+PR_max_[35606](https://github.com/qgis/QGIS/pull/35606)+PR_max_[35591](https://github.com/qgis/QGIS/pull/35591)+PR_max_[35576](https://github.com/qgis/QGIS/pull/35576)+PR_max_[35559](https://github.com/qgis/QGIS/pull/35559)+PR_max_[35531](https://github.com/qgis/QGIS/pull/35531)+PR_max_[35518](https://github.com/qgis/QGIS/pull/35518)+PR_max_[35511](https://github.com/qgis/QGIS/pull/35511)+PR_max_[35494](https://github.com/qgis/QGIS/pull/35494)+PR_max_[35488](https://github.com/qgis/QGIS/pull/35488)+PR_max_[35484](https://github.com/qgis/QGIS/pull/35484)+PR_max_[35475](https://github.com/qgis/QGIS/pull/35475)+PR_max_[35474](https://github.com/qgis/QGIS/pull/35474)+PR_max_[35473](https://github.com/qgis/QGIS/pull/35473)+PR_max_[35466](https://github.com/qgis/QGIS/pull/35466)+PR_max_[35454](https://github.com/qgis/QGIS/pull/35454)+PR_max_[35452](https://github.com/qgis/QGIS/pull/35452)+PR_max_[35446](https://github.com/qgis/QGIS/pull/35446)+PR_max_[35438](https://github.com/qgis/QGIS/pull/35438)+PR_max_[35419](https://github.com/qgis/QGIS/pull/35419)+PR_max_[35408](https://github.com/qgis/QGIS/pull/35408)+PR_max_[35396](https://github.com/qgis/QGIS/pull/35396)+PR_max_[35382](https://github.com/qgis/QGIS/pull/35382)+PR_max_[35364](https://github.com/qgis/QGIS/pull/35364)+PR_max_[35341](https://github.com/qgis/QGIS/pull/35341)+PR_max_[35324](https://github.com/qgis/QGIS/pull/35324)+PR_max_[35321](https://github.com/qgis/QGIS/pull/35321)+PR_max_[35319](https://github.com/qgis/QGIS/pull/35319)+PR_max_[35292](https://github.com/qgis/QGIS/pull/35292)+PR_max_[35264](https://github.com/qgis/QGIS/pull/35264)+PR_max_[35251](https://github.com/qgis/QGIS/pull/35251)+PR_max_[35244](https://github.com/qgis/QGIS/pull/35244)+PR_max_[35238](https://github.com/qgis/QGIS/pull/35238)+PR_max_[35225](https://github.com/qgis/QGIS/pull/35225)+PR_max_[35224](https://github.com/qgis/QGIS/pull/35224)+PR_max_[35216](https://github.com/qgis/QGIS/pull/35216)+PR_max_[35211](https://github.com/qgis/QGIS/pull/35211)+PR_max_[35208](https://github.com/qgis/QGIS/pull/35208)+PR_max_[35197](https://github.com/qgis/QGIS/pull/35197)+PR_max_[35160](https://github.com/qgis/QGIS/pull/35160)+PR_max_[35130](https://github.com/qgis/QGIS/pull/35130)+PR_max_[35097](https://github.com/qgis/QGIS/pull/35097)+PR_max_[35085](https://github.com/qgis/QGIS/pull/35085)+PR_max_[35084](https://github.com/qgis/QGIS/pull/35084)+PR_max_[35076](https://github.com/qgis/QGIS/pull/35076)+PR_max_[35056](https://github.com/qgis/QGIS/pull/35056)+PR_max_[35035](https://github.com/qgis/QGIS/pull/35035)+PR_max_[34987](https://github.com/qgis/QGIS/pull/34987)+PR_max_[34968](https://github.com/qgis/QGIS/pull/34968)+PR_max_[34955](https://github.com/qgis/QGIS/pull/34955)+PR_max_[34945](https://github.com/qgis/QGIS/pull/34945)+PR_max_[34938](https://github.com/qgis/QGIS/pull/34938)+PR_max_[34936](https://github.com/qgis/QGIS/pull/34936)+PR_max_[34914](https://github.com/qgis/QGIS/pull/34914)+PR_max_[34898](https://github.com/qgis/QGIS/pull/34898)+PR_max_[34895](https://github.com/qgis/QGIS/pull/34895)+PR_max_[34876](https://github.com/qgis/QGIS/pull/34876)+PR_max_[34871](https://github.com/qgis/QGIS/pull/34871)+PR_max_[34856](https://github.com/qgis/QGIS/pull/34856)+PR_max_[34848](https://github.com/qgis/QGIS/pull/34848)+PR_max_[34827](https://github.com/qgis/QGIS/pull/34827)+PR_max_[34760](https://github.com/qgis/QGIS/pull/34760)+PR_max_[34654](https://github.com/qgis/QGIS/pull/34654)+PR_max_[34617](https://github.com/qgis/QGIS/pull/34617)+PR_max_[34610](https://github.com/qgis/QGIS/pull/34610)+PR_max_[34590](https://github.com/qgis/QGIS/pull/34590)+PR_max_[34547](https://github.com/qgis/QGIS/pull/34547)+PR_max_[34532](https://github.com/qgis/QGIS/pull/34532)+PR_max_[34497](https://github.com/qgis/QGIS/pull/34497)+PR_max_[34040](https://github.com/qgis/QGIS/pull/34040)+PR_max_[33950](https://github.com/qgis/QGIS/pull/33950)+PR_max_[33622](https://github.com/qgis/QGIS/pull/33622)+PR_max_[31387](https://github.com/qgis/QGIS/pull/31387)    edit-cell   PR  e   
merge_mod_pivot_PR_columns          quit-sheet      q   
merge_mod_pivot_PR  PR      freeze-col      '   
merge_mod_pivot_PR  PR      hide-col        -   
merge_mod_pivot_PR          select-rows     gs  
merge_mod_pivot_PR          setcol-subst-all     +/     gz* 
merge_mod_pivot_PR          setcol-subst-all    ^ / gz* 
merge_mod_pivot_PR          setcol-subst-all     $/ gz* 
merge_mod_pivot_PR  PR_frozen       rename-col  PR  ^   
merge_mod_pivot_PR          unselect-rows       gu  
merge_mod_pivot_PR  Total_count     sort-asc        [   
merge_mod_pivot_PR  Total_count     sort-desc       ]   
merge_mod_pivot_PR          save-sheet  merge_mod_pivot_PR.tsv  ^S

questo file è stato registrato con visidata 1.5.2, la stessa procedura in visidata 2 non mette più PR_max_ durante le aggregazioni e non crea la riga Total_PR_max

pigreco commented 4 years ago

questo è la registrazione della stessa procedura in visidata 2:

sheet   col row longname    input   keystrokes  comment
    SqliteSheet header  set-option  0       
    UsvSheet    delimiter   set-option  ␞       
    UsvSheet    row_delimiter   set-option  ␟       
    override    null_value  set-option          
            open-file   merge_mod.csv   o   
merge_mod   Description     hide-col        -   hide current column
merge_mod   Milestone       hide-col        -   hide current column
merge_mod   Merged      hide-col        -   hide current column
merge_mod   tags        hide-col        -   hide current column
merge_mod   Author      key-col     !   toggle current column as a key column
merge_mod   PR      aggregate-col   max +   add aggregator to current column
merge_mod   PR      pivot       W   open Pivot Table: group rows by key column and summarize current column
merge_mod_pivot_PR          columns-sheet       C   open Columns Sheet: edit column properties for current sheet
merge_mod_pivot_PR_columns  name        select-col-regex    ^[[]    |   select rows matching regex in current column
merge_mod_pivot_PR_columns          join-cols       &   add column from concatenating selected source columns
merge_mod_pivot_PR_columns          delete-selected     gd  delete (cut) selected rows and move them to clipboard
merge_mod_pivot_PR_columns  name    キ[36324](https://github.com/qgis/QGIS/pull/36324)_[36313](https://github.com/qgis/QGIS/pull/36313)_[36309](https://github.com/qgis/QGIS/pull/36309)_[36304](https://github.com/qgis/QGIS/pull/36304)_[36303](https://github.com/qgis/QGIS/pull/36303)_[36300](https://github.com/qgis/QGIS/pull/36300)_[36299](https://github.com/qgis/QGIS/pull/36299)_[36245](https://github.com/qgis/QGIS/pull/36245)_[36243](https://github.com/qgis/QGIS/pull/36243)_[36236](https://github.com/qgis/QGIS/pull/36236)_[36224](https://github.com/qgis/QGIS/pull/36224)_[36222](https://github.com/qgis/QGIS/pull/36222)_[36202](https://github.com/qgis/QGIS/pull/36202)_[36190](https://github.com/qgis/QGIS/pull/36190)_[36171](https://github.com/qgis/QGIS/pull/36171)_[36166](https://github.com/qgis/QGIS/pull/36166)_[36162](https://github.com/qgis/QGIS/pull/36162)_[36136](https://github.com/qgis/QGIS/pull/36136)_[36131](https://github.com/qgis/QGIS/pull/36131)_[36130](https://github.com/qgis/QGIS/pull/36130)_[36106](https://github.com/qgis/QGIS/pull/36106)_[36099](https://github.com/qgis/QGIS/pull/36099)_[36089](https://github.com/qgis/QGIS/pull/36089)_[36069](https://github.com/qgis/QGIS/pull/36069)_[36013](https://github.com/qgis/QGIS/pull/36013)_[35974](https://github.com/qgis/QGIS/pull/35974)_[35933](https://github.com/qgis/QGIS/pull/35933)_[35928](https://github.com/qgis/QGIS/pull/35928)_[35926](https://github.com/qgis/QGIS/pull/35926)_[35909](https://github.com/qgis/QGIS/pull/35909)_[35901](https://github.com/qgis/QGIS/pull/35901)_[35889](https://github.com/qgis/QGIS/pull/35889)_[35863](https://github.com/qgis/QGIS/pull/35863)_[35839](https://github.com/qgis/QGIS/pull/35839)_[35821](https://github.com/qgis/QGIS/pull/35821)_[35815](https://github.com/qgis/QGIS/pull/35815)_[35808](https://github.com/qgis/QGIS/pull/35808)_[35790](https://github.com/qgis/QGIS/pull/35790)_[35778](https://github.com/qgis/QGIS/pull/35778)_[35764](https://github.com/qgis/QGIS/pull/35764)_[35760](https://github.com/qgis/QGIS/pull/35760)_[35748](https://github.com/qgis/QGIS/pull/35748)_[35738](https://github.com/qgis/QGIS/pull/35738)_[35727](https://github.com/qgis/QGIS/pull/35727)_[35694](https://github.com/qgis/QGIS/pull/35694)_[35689](https://github.com/qgis/QGIS/pull/35689)_[35688](https://github.com/qgis/QGIS/pull/35688)_[35657](https://github.com/qgis/QGIS/pull/35657)_[35644](https://github.com/qgis/QGIS/pull/35644)_[35641](https://github.com/qgis/QGIS/pull/35641)_[35606](https://github.com/qgis/QGIS/pull/35606)_[35591](https://github.com/qgis/QGIS/pull/35591)_[35576](https://github.com/qgis/QGIS/pull/35576)_[35559](https://github.com/qgis/QGIS/pull/35559)_[35531](https://github.com/qgis/QGIS/pull/35531)_[35518](https://github.com/qgis/QGIS/pull/35518)_[35511](https://github.com/qgis/QGIS/pull/35511)_[35494](https://github.com/qgis/QGIS/pull/35494)_[35488](https://github.com/qgis/QGIS/pull/35488)_[35484](https://github.com/qgis/QGIS/pull/35484)_[35475](https://github.com/qgis/QGIS/pull/35475)_[35474](https://github.com/qgis/QGIS/pull/35474)_[35473](https://github.com/qgis/QGIS/pull/35473)_[35466](https://github.com/qgis/QGIS/pull/35466)_[35454](https://github.com/qgis/QGIS/pull/35454)_[35452](https://github.com/qgis/QGIS/pull/35452)_[35446](https://github.com/qgis/QGIS/pull/35446)_[35438](https://github.com/qgis/QGIS/pull/35438)_[35419](https://github.com/qgis/QGIS/pull/35419)_[35408](https://github.com/qgis/QGIS/pull/35408)_[35396](https://github.com/qgis/QGIS/pull/35396)_[35382](https://github.com/qgis/QGIS/pull/35382)_[35364](https://github.com/qgis/QGIS/pull/35364)_[35341](https://github.com/qgis/QGIS/pull/35341)_[35324](https://github.com/qgis/QGIS/pull/35324)_[35321](https://github.com/qgis/QGIS/pull/35321)_[35319](https://github.com/qgis/QGIS/pull/35319)_[35292](https://github.com/qgis/QGIS/pull/35292)_[35264](https://github.com/qgis/QGIS/pull/35264)_[35251](https://github.com/qgis/QGIS/pull/35251)_[35244](https://github.com/qgis/QGIS/pull/35244)_[35238](https://github.com/qgis/QGIS/pull/35238)_[35225](https://github.com/qgis/QGIS/pull/35225)_[35224](https://github.com/qgis/QGIS/pull/35224)_[35216](https://github.com/qgis/QGIS/pull/35216)_[35211](https://github.com/qgis/QGIS/pull/35211)_[35208](https://github.com/qgis/QGIS/pull/35208)_[35197](https://github.com/qgis/QGIS/pull/35197)_[35160](https://github.com/qgis/QGIS/pull/35160)_[35130](https://github.com/qgis/QGIS/pull/35130)_[35097](https://github.com/qgis/QGIS/pull/35097)_[35085](https://github.com/qgis/QGIS/pull/35085)_[35084](https://github.com/qgis/QGIS/pull/35084)_[35076](https://github.com/qgis/QGIS/pull/35076)_[35056](https://github.com/qgis/QGIS/pull/35056)_[35035](https://github.com/qgis/QGIS/pull/35035)_[34987](https://github.com/qgis/QGIS/pull/34987)_[34968](https://github.com/qgis/QGIS/pull/34968)_[34955](https://github.com/qgis/QGIS/pull/34955)_[34945](https://github.com/qgis/QGIS/pull/34945)_[34938](https://github.com/qgis/QGIS/pull/34938)_[34936](https://github.com/qgis/QGIS/pull/34936)_[34914](https://github.com/qgis/QGIS/pull/34914)_[34898](https://github.com/qgis/QGIS/pull/34898)_[34895](https://github.com/qgis/QGIS/pull/34895)_[34876](https://github.com/qgis/QGIS/pull/34876)_[34871](https://github.com/qgis/QGIS/pull/34871)_[34856](https://github.com/qgis/QGIS/pull/34856)_[34848](https://github.com/qgis/QGIS/pull/34848)_[34827](https://github.com/qgis/QGIS/pull/34827)_[34760](https://github.com/qgis/QGIS/pull/34760)_[34654](https://github.com/qgis/QGIS/pull/34654)_[34617](https://github.com/qgis/QGIS/pull/34617)_[34610](https://github.com/qgis/QGIS/pull/34610)_[34590](https://github.com/qgis/QGIS/pull/34590)_[34547](https://github.com/qgis/QGIS/pull/34547)_[34532](https://github.com/qgis/QGIS/pull/34532)_[34497](https://github.com/qgis/QGIS/pull/34497)_[34040](https://github.com/qgis/QGIS/pull/34040)_[33950](https://github.com/qgis/QGIS/pull/33950)_[33622](https://github.com/qgis/QGIS/pull/33622)_[31387](https://github.com/qgis/QGIS/pull/31387)  edit-cell   PR  e   edit contents of current cell
merge_mod_pivot_PR  PR      freeze-col      '   add a frozen copy of current column with all cells evaluated
merge_mod_pivot_PR  PR      hide-col        -   hide current column
merge_mod_pivot_PR          select-rows     gs  select all rows
merge_mod_pivot_PR          setcol-subst-all     +/     gz* modify selected rows in all visible columns, replacing regex with subst (may include \1 backrefs)
merge_mod_pivot_PR          setcol-subst-all    ^ / gz* modify selected rows in all visible columns, replacing regex with subst (may include \1 backrefs)
merge_mod_pivot_PR          setcol-subst-all     $/ gz* modify selected rows in all visible columns, replacing regex with subst (may include \1 backrefs)
merge_mod_pivot_PR          unselect-rows       gu  unselect all rows
merge_mod_pivot_PR          sheets-stack        S   open Sheets Stack: join or jump between the active sheets on the current stack
merge_mod_pivot_PR          save-sheet  final.tsv   ^S  save current sheet to filename in format determined by extension (default .tsv)
aborruso commented 4 years ago

Caro totò, per seguirti e testare dovresti allegare in file sorgente di input e la registrazione. E poi anche un secondo file di input che creerai tu a mano a partire dal primo, a cui applicando la registrazione la trasformazione voluta non va in porto.

Il numero di righe variabili, nel tuo caso, non dovrebbe influenzare la cosa. Ma per capirlo per bene ci vogliono i file di test.

On Mon, 11 May 2020 at 19:33, Salvatore Fiandaca notifications@github.com wrote:

Ho notato che se uno stesso file varia nel tempo il numero di righe, la registrazione non funziona in quanto alcune procedure potrebbero dipendere dagli stessi dati e se questi cambiano mandano in crisi il file *.vd

— You are receiving this because you commented. Reply to this email directly, view it on GitHub https://github.com/opendatasicilia/tansignari/issues/147#issuecomment-626844827, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAAHPD5ONIA6DMT66MK7QDTRRAZF7ANCNFSM4M3GEFTQ .

--

Andrea Borruso website: https://medium.com/tantotanto 38° 7' 48" N, 13° 21' 9" E, EPSG:4326

"cercare e saper riconoscere chi e cosa, in mezzo all’inferno, non è inferno, e farlo durare, e dargli spazio"

Italo Calvino