決定範例方向 - Githubissues

c3h3 / PyCrawler101-201510-temp

0 stars 0 forks source link

決定範例方向 #2

Open c3h3 opened 9 years ago

c3h3 commented 9 years ago

先把學習目標表列出來：

(1) GET Page Render (2) POST Download File (3) Ajax (4) Request headers (5) Chinese url: url encode (6) CSS / XPATH selector in Python (7) JSON / XML parser in Python (8) Table parser (pandas) in Python (9) Database (SQLite / MongoDB)

suensummit commented 9 years ago

先列出 R Crawler 101 的範例

PTT 八卦版 - GET / POST
全家便利超商 - GET / POST
7-11便利超商
自製留言板，匿名留言
公開資訊觀測站 - POST
Yahoo新聞 - Chinese url / url encode
捷安特 - POST

suensummit commented 9 years ago

Yahoo news (Windows編碼) (GET / URLencode / URLdecode / xpath / css / output csv)
公開資訊觀測站 (撈所有股票ID)
GIANT JSON with html
POST / URLencode / csv / table parser / output csv
PTT八卦版 (GET / cookie / xpath / css / output csv)