Nava2 / cs9864-realtime-bluemix

Repository for CS 9864 project
1 stars 0 forks source link

Implement Import script for Cloudant #1

Closed Nava2 closed 8 years ago

Nava2 commented 8 years ago

Implement a script to unrar -> process -> upload to cloudera.

Nava2 commented 8 years ago

Cloudant layout:


"date:int": {
  "time:int": {
    "ticker": [ time:int, price:int, size:int, exchange:char, condition, suspicous:bool ] 
  }
} 

Exchange values:

A – NYSE MKT Stock Exchange B – NASDAQ OMX BX Stock Exchange C – National Stock Exchange D – FINRA I – International Securities Exchange J – Direct Edge A Stock Exchange K – Direct Edge X Stock Exchange M – Chicago Stock Exchange N – New York Stock Exchange T – NASDAQ OMX Stock Exchange P – NYSE Arca SM S – Consolidated Tape System T/Q – NASDAQ Stock Exchange W – CBOE Stock Exchange X – NASDAQ OMX PSX Stock Exchange Y – BATS Y-Exchange Z – BATS Exchange

Sale condition:

CTS issues: Blank or ‘@’ - Regular Sale (no condition) ‘B’ = Average Price Trade ‘C’ = Cash Trade (same day clearing) ‘E’ = Automatic Execution ‘F’ = Intermarket Sweep Order ‘G’ = Opening/Reopening Trade Detail ‘H’ = Intraday Trade Detail ‘I’ = CAP Election Trade ‘K’ = Rule 127 trade (NYSE only) or Rule 155 trade

(NYSE MKT only) ‘L’ = Sold Last (late reporting) ‘N’ = Next Day Trade (next day clearing) ‘O’ = Market Center Opening Trade ‘R’ = Seller ‘T’= Extended Hours Trade ‘U’ = Extended Hours (Sold Out of Sequence) ‘Z’ = Sold (out of sequence) ‘4’ - Derivatively Priced ‘5’ – Market Center Re-opening Prints ‘6’ – Market Center Closing Prints

NASD issues: ‘@’ = Regular Trade ‘A’ = Acquisition ‘B’ = Bunched Trade ‘C’ = Cash Trade ‘D’ = Distribution ‘F’ – Intermarket Sweep ‘G’ = Bunched Sold Trade ‘K’ = Rule 155 Trade (NYSE MKT Only) ‘L’ = Sold Last ‘M’ = Market Center Close Price ‘N’ = Next Day ‘O’ = Opening Prints ‘P’ = Prior Reference Price ‘Q’ = Market Center Open Price ‘R’ = Seller (Long-Form Message Formats Only) ‘S’ = Split Trade ‘T’ = Form - T Trade ‘U’ = Extended Hours (Sold Out of Sequence) ‘W’ = Average Price Trade ‘Y’ – Yellow Flag ‘Z’ = Sold (Out of Sequence) ‘1’ = Stopped Stock - Regular Trade ‘2’ = Stopped Stock - Sold Last ‘3’ = Stopped Stock - Sold Last 3 = Stopped Stock - Sold ‘4’ Derivatively Priced ‘5’ – Re-opening Prints ‘6’ – Closing Prints ‘7’ – Placeholder for 611 Exempt ‘8’ - Placeholder for 611 Exempt ‘9’ - Placeholder for 611 Exempt