search

produvia / kryptos

Kryptos AI is a virtual investment assistant that manages your cryptocurrency portfolio
http://twitter.com/kryptos_ai
MIT License
48 stars 8 forks source link

Data Sources #8

Closed slavakurilyak closed 5 years ago

slavakurilyak commented 6 years ago

Goal

As a developer, I want to integrate various data sources, also known as datasets, so I can leverage a diverse set of cryptocurrency-related data.

  1. Enigma Data Marketplace (See #7)
  2. Twitter - activity, announcements and news
  3. Yahoo - News, articles and traders’ sentiment
  4. Investing.com - Economic calendar events, news, traders’ sentiment data
  5. Direct Parsing - News, articles and other information

Completed Work

1. Google Trends

2. Quadl

BraveNewCoin Indexes:

Bitcoin Market Size:

Bitcoin Activity:

Bitcoin Transaction Fees:

Bitcoin Mining:

slavakurilyak commented 6 years ago

Consider Number of Bitcoin Transactions as initial dataset. It contains volume information about Bitcoin without relying on the price.

slavakurilyak commented 6 years ago

Consider Order Book as another dataset. The dataset can give us X bids/asks sampled every Y minutes/days. Example: 20 bids/asks sampled every minute. Thanks to Alex Galea (@agalea91) for the idea.

slavakurilyak commented 6 years ago

Consider Bitcoin Market Capitalization dataset to understand the dynamics between number of cryptocurrencies and market capitalization.

Fact: There is an increasing number of cryptocurrencies over time. On Jan 7, 2018, there were 1384 cryptocurrencies (Wikipedia, 2018). As of Mar 10, 2018, there are 1556 (CoinMarketCap, 2018). That's 12.4% increase over three months.

Trend: Recently Bitcoin dominance in terms of market capitalization has been decreasing.

I assume that investors or traders are shifting their cryptoassets from Bitcoin to other altcoins (i.e. Ethereum or others).

slavakurilyak commented 6 years ago

We can also gather Blockchain.info data to create our own datasets using the Blockchain.info Charts API:

  1. avg-block-size - The average block size in MB
  2. bip-9-segwit - Percentage of blocks signalling SegWit support
  3. bitcoin-unlimited-share - Percentage of blocks signalling Bitcoin Unlimited support
  4. blocks-size - The total size of all block headers and transactions
  5. cost-per-transaction - A chart showing miners revenue divided by the number of transactions
  6. cost-per-transaction-percent - A chart showing miners revenue as percentage of the transaction volume
  7. difficulty - A relative measure of how difficult it is to find a new block
  8. estimated-transaction-volume - The total estimated value of transactions on the Bitcoin blockchain
  9. estimated-transaction-volume-usd - The estimated transaction value in USD value
  10. hash-rate - The estimated number of tera hashes per second the Bitcoin network is performing
  11. market-cap - The total USD value of bitcoin supply in circulation
  12. market-price - Average USD market price across major bitcoin exchanges
  13. median-confirmation-time - The median time for a transaction to be accepted into a mined block
  14. mempool-count - The number of transactions waiting to be confirmed
  15. mempool-growth - The rate at which the mempool is growing per second
  16. mempool-size - The aggregate size of transactions waiting to be confirmed
  17. mempool-state-by-fee-level - Mempool State By Fee Level
  18. miners-revenue - Total value of coinbase block rewards and transaction fees paid to miners
  19. my-wallet-n-users - The total number of Blockchain wallets created
  20. n-orphaned-blocks - The total number of blocks mined but ultimately not attached to the main Bitcoin blockchain
  21. n-transactions - The number of daily confirmed Bitcoin transactions
  22. n-transactions-excluding-chains-longer-than-100 - The total number of Bitcoin transactions per day excluding long transaction chains
  23. n-transactions-excluding-popular - The total number of Bitcoin transactions, excluding the 100 most popular addresses
  24. n-transactions-per-block - The average number of transactions per block
  25. n-transactions-total - Total number of transactions
  26. n-unique-addresses - The total number of unique addresses used on the Bitcoin blockchain
  27. nya-support - Percentage of blocks signalling for the New York Agreement
  28. output-volume - The total value of all transaction outputs per day
  29. pools - An estimation of hashrate distribution amongst the largest mining pools
  30. total-bitcoins - The total number of bitcoins that have already been mined
  31. trade-volume - The total USD value of trading volume on major bitcoin exchanges
  32. transaction-fees - The total value of all transaction fees paid to miners (not including the coinbase value of block rewards)
  33. transaction-fees-usd - The total value of all transaction fees paid to miners (not including the coinbase value of block rewards)
  34. transactions-per-second - The number of Bitcoin transactions added to the mempool per second
  35. utxo-count - The number of unspent Bitcoin transactions outputs (UTXO set size)
slavakurilyak commented 6 years ago
  1. Tiigo - Crypto data is available! See relevant code example and relevant API documentation. Also, a python package simplifying access is available on github.
  2. IEX - N/A
  3. Robinhood - N/A
  4. Alpha Vantage - Crypto data is available! See relevant code example and relevant API documentation. Also, a python package simplifying access is available on github.
  5. Enigma - N/A
  6. Quandl - Already integrated at Kryptos
  7. FRED - Crypto data is available! See relevant code example and relevant API documentation.
  8. Fama/French - N/A
  9. World Bank - N/A
  10. OECD - N/A
  11. Eurostat - N/A
  12. TSP Fund Data - N/A
  13. Nasdaq Trader Symbol Definitions - N/A
  14. Stooq Index Data - Crypto data is available! See relevant API documentation
  15. MOEX Data - Crypto data is available! See relevant API documentation
slavakurilyak commented 5 years ago

Closing issue to focus on existing datasets (Price, Volume, Google Trends, and Quadl)