decodingml / llm-twin-course

🤖 𝗟𝗲𝗮𝗿𝗻 for 𝗳𝗿𝗲𝗲 how to 𝗯𝘂𝗶𝗹𝗱 an end-to-end 𝗽𝗿𝗼𝗱𝘂𝗰𝘁𝗶𝗼𝗻-𝗿𝗲𝗮𝗱𝘆 𝗟𝗟𝗠 & 𝗥𝗔𝗚 𝘀𝘆𝘀𝘁𝗲𝗺 using 𝗟𝗟𝗠𝗢𝗽𝘀 best practices: ~ 𝘴𝘰𝘶𝘳𝘤𝘦 𝘤𝘰𝘥𝘦 + 12 𝘩𝘢𝘯𝘥𝘴-𝘰𝘯 𝘭𝘦𝘴𝘴𝘰𝘯𝘴
MIT License
2.6k stars 432 forks source link

Getting issue with docker logs #34

Open solvusAI opened 2 months ago

solvusAI commented 2 months ago

{"statusCode": 200, "body": "Link processed successfully"}% (llm-twin) goutamgupta@goutamguptas-MacBook-Pro llm-twin-course % docker logs llm-twin-bytewax 2024-08-07 10:04:59 [info ] Couldn't access the collection. Creating a new one... cls=data_flow.stream_output collection_name=cleaned_posts 2024-08-07 10:04:59 [info ] Couldn't access the collection. Creating a new one... cls=data_flow.stream_output collection_name=cleaned_articles 2024-08-07 10:04:59 [info ] Couldn't access the collection. Creating a new one... cls=data_flow.stream_output collection_name=cleaned_repositories 2024-08-07 10:04:59 [info ] Couldn't access the collection. Creating a new one... cls=data_flow.stream_output collection_name=vector_posts 2024-08-07 10:04:59 [info ] Couldn't access the collection. Creating a new one... cls=data_flow.stream_output collection_name=vector_articles 2024-08-07 10:04:59 [info ] Couldn't access the collection. Creating a new one... cls=data_flow.stream_output collection_name=vector_repositories 2024-08-07 10:04:59 [error ] Error while fetching message from queue. cls=data_flow.stream_input queue_name=default 2024-08-07 10:05:09 [error ] Error while fetching message from queue. cls=data_flow.stream_input queue_name=default 2024-08-07 10:05:19 [info ] Received message. cls=data_logic.dispatchers data_type=users thread '' panicked at src/operators/mod.rs:169:33: Box note: run with RUST_BACKTRACE=1 environment variable to display a backtrace

Traceback (most recent call last): File "", line 198, in _run_module_as_main File "", line 88, in _run_code File "/usr/local/lib/python3.11/site-packages/bytewax/run.py", line 354, in cli_main(**kwargs) ValueError: (src/operators/mod.rs:177:80) error calling mapper in step "Streaming ingestion pipeline.raw dispatch.flat_map_batch" Caused by => ValueError: (src/operators/mod.rs:86:28) error while iterating through batch Caused by => ValueError: Unsupported data type Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/bytewax/operators/init.py", line 1199, in return (mapper(x) for x in xs) ^^^^^^^^^ File "/usr/src/app/data_logic/dispatchers.py", line 41, in handle_mq_message raise ValueError("Unsupported data type")

Process ended. Keeping container alive...

zhangruotian commented 2 months ago

{"statusCode": 200, "body": "Link processed successfully"}% (llm-twin) goutamgupta@goutamguptas-MacBook-Pro llm-twin-course % docker logs llm-twin-bytewax 2024-08-07 10:04:59 [info ] Couldn't access the collection. Creating a new one... cls=data_flow.stream_output collection_name=cleaned_posts 2024-08-07 10:04:59 [info ] Couldn't access the collection. Creating a new one... cls=data_flow.stream_output collection_name=cleaned_articles 2024-08-07 10:04:59 [info ] Couldn't access the collection. Creating a new one... cls=data_flow.stream_output collection_name=cleaned_repositories 2024-08-07 10:04:59 [info ] Couldn't access the collection. Creating a new one... cls=data_flow.stream_output collection_name=vector_posts 2024-08-07 10:04:59 [info ] Couldn't access the collection. Creating a new one... cls=data_flow.stream_output collection_name=vector_articles 2024-08-07 10:04:59 [info ] Couldn't access the collection. Creating a new one... cls=data_flow.stream_output collection_name=vector_repositories 2024-08-07 10:04:59 [error ] Error while fetching message from queue. cls=data_flow.stream_input queue_name=default 2024-08-07 10:05:09 [error ] Error while fetching message from queue. cls=data_flow.stream_input queue_name=default 2024-08-07 10:05:19 [info ] Received message. cls=data_logic.dispatchers data_type=users thread '' panicked at src/operators/mod.rs:169:33: Box note: run with RUST_BACKTRACE=1 environment variable to display a backtrace

Traceback (most recent call last): File "", line 198, in _run_module_as_main File "", line 88, in _run_code File "/usr/local/lib/python3.11/site-packages/bytewax/run.py", line 354, in cli_main(kwargs) ValueError: (src/operators/mod.rs:177:80) error calling mapper in step "Streaming ingestion pipeline.raw dispatch.flat_map_batch" Caused by => ValueError: (src/operators/mod.rs:86:28) error while iterating through batch Caused by => ValueError: Unsupported data type Traceback (most recent call last): File "/usr/local/lib/python3.11/site-packages/bytewax/operators/init**.py", line 1199, in return (mapper(x) for x in xs) ^^^^^^^^^ File "/usr/src/app/data_logic/dispatchers.py", line 41, in handle_mq_message raise ValueError("Unsupported data type")

Process ended. Keeping container alive...

Same here. Have you found a workaround? @solvusAI

solvusAI commented 2 months ago

@zhangruotian no fix found yet.

iusztinpaul commented 1 month ago

Hello,

I fixed this issue.

If you want to progress, pull the latest code, rebuild the Docker image, and it should work.