issues
search
multiversx
/
multiversx-etl
ETL (extract, transform and load) tools for publishing MultiversX blockchain data on Google BigQuery.
MIT License
1
stars
0
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Counts errata & indexer credentials
#36
andreibancioiu
closed
2 months ago
0
Fix rewind flow (deletion of records), minor adjustments
#35
andreibancioiu
closed
3 months ago
0
Temporary issue: interrupted data publishing for some tables
#34
andreibancioiu
opened
3 months ago
1
Prepare "extract" part of ETL flow to work with Elasticsearch 8
#33
andreibancioiu
closed
6 months ago
0
Fix schema (accounts, tokens)
#32
andreibancioiu
closed
8 months ago
0
Update schema (Sirius)
#31
andreibancioiu
closed
8 months ago
0
Skip table truncation if table is missing
#30
andreibancioiu
closed
9 months ago
0
Update wrt. Sirius (Protocol v1.6)
#29
andreibancioiu
closed
9 months ago
0
Use global counts when possible (cheaper)
#28
andreibancioiu
closed
9 months ago
0
Do not perform automatic de-duplication anymore
#27
andreibancioiu
closed
10 months ago
0
Truncate table instead of delete. Fix some column descriptions
#26
andreibancioiu
closed
11 months ago
0
Update schema, add description
#25
andreibancioiu
closed
11 months ago
0
Rename dataset
#24
andreibancioiu
closed
11 months ago
0
Fix URLs towards datasets
#23
andreibancioiu
closed
1 year ago
0
Re-design ETL controller components (plan, work, check, deduplicate)
#22
andreibancioiu
closed
11 months ago
0
Fixes: transformers, schema
#21
andreibancioiu
closed
1 year ago
0
Add "group" parameter (better organize ETL tasks)
#20
andreibancioiu
closed
1 year ago
0
Handle grpc "Corruption detected" errors
#19
andreibancioiu
closed
1 year ago
0
Check "end-time" when planning tasks. Do not allow a time that is too recent
#18
andreibancioiu
closed
1 year ago
0
Make workers multi-threaded
#17
andreibancioiu
closed
1 year ago
0
Adjust logging, adjust filtering
#16
andreibancioiu
closed
1 year ago
0
Improvements (workers, deduplication, warnings, refactoring)
#15
andreibancioiu
closed
1 year ago
0
Allow one to plan ETL tasks for specific ES indices
#14
andreibancioiu
closed
1 year ago
0
Update schema and readme
#13
andreibancioiu
closed
1 year ago
0
Add load job and transform job
#12
andreibancioiu
closed
1 year ago
0
Add a few sample queries
#11
andreibancioiu
closed
1 year ago
0
Do not review: add transform job and load job
#10
andreibancioiu
closed
1 year ago
1
Optimization: instead of using "elasticsearch.helpers.scan", do proper "scroll" management
#9
andreibancioiu
opened
1 year ago
0
Implement "ExtractJob" (and "Indexer" client)
#8
andreibancioiu
closed
1 year ago
0
Review follow-up (rename commands etc.)
#7
andreibancioiu
closed
1 year ago
0
Add E-T-L CLI commands
#6
andreibancioiu
closed
1 year ago
0
Add tasks planner
#5
andreibancioiu
closed
1 year ago
0
Schema generation (transformation)
#4
andreibancioiu
closed
1 year ago
0
Add schema for BigQuery tables
#3
andreibancioiu
closed
1 year ago
0
Init python package
#2
andreibancioiu
closed
1 year ago
0
Copy ES indexes to Google Big Query
#1
andreibancioiu
closed
1 year ago
1