jms0522 / Streaming-Data

โœ… ๋‹ค์–‘ํ•œ ๋ฐฉ๋ฒ•์˜ ํŒŒ์ดํ”„๋ผ์ธ์„ ๊ตฌ์ถ•ํ•ฉ๋‹ˆ๋‹ค.
3 stars 0 forks source link

โš’๏ธ ELK stack #7

Open jms0522 opened 2 months ago

jms0522 commented 2 months ago

๐Ÿ“… 8.14

โ—๏ธ์‹ค์‹œ๊ฐ„ ๋กœ๊ทธ ๋ฐ์ดํ„ฐ ์ฒ˜๋ฆฌ๋ฅผ ์œ„ํ•œ elk stack ์‚ฌ์šฉ.

image

jms0522 commented 2 months ago

๐Ÿ“… 8.15

โ—๏ธ ๊ธฐ๋ณธ์ ์ธ docker-compose์™€ filebeat

แ„‰แ…ณแ„แ…ณแ„…แ…ตแ†ซแ„‰แ…ฃแ†บ 2024-08-15 23 11 57

แ„‰แ…ณแ„แ…ณแ„…แ…ตแ†ซแ„‰แ…ฃแ†บ 2024-08-15 23 17 29

jms0522 commented 2 months ago

๐Ÿ“… 8.18

โš’๏ธ Elasticsearch index

๐Ÿ“Š Kibana๋กœ ๊ฐ„๋‹จํ•œ ์‹œ๊ฐํ™”

แ„‰แ…ณแ„แ…ณแ„…แ…ตแ†ซแ„‰แ…ฃแ†บ 2024-08-18 23 31 57

jms0522 commented 2 months ago

๐Ÿ“… 8.19

โ€ผ๏ธ Index Mapping ๋ฌธ์ œ

๐Ÿ”ซ kafka ๋ฐ์ดํ„ฐ ์ˆ˜์‹ 

แ„‰แ…ณแ„แ…ณแ„…แ…ตแ†ซแ„‰แ…ฃแ†บ 2024-08-19 20 43 50

๐Ÿ”ซ Elasticsearch index ์ƒ์„ฑ ๋ฐ mapping

instagram -profile-indexแ„‰แ…ขแ†ผแ„‰แ…ฅแ†ผ

instagram-index-input

โŒ Mapping ๋ฌธ์ œ๋กœ empty-filed ๋ฐœ์ƒ

แ„‰แ…ณแ„แ…ณแ„…แ…ตแ†ซแ„‰แ…ฃแ†บ 2024-08-19 20 41 09 แ„‰แ…ณแ„แ…ณแ„…แ…ตแ†ซแ„‰แ…ฃแ†บ 2024-08-19 20 40 26