search

FoloToy / folotoy-server-self-hosting

Config files for self-hosting the FoloToy Server. Documents: https://docs.folotoy.com
https://tool.folotoy.com
GNU General Public License v3.0
446 stars 82 forks source link

兔子录音不回复，flyio后台日志如下 #106

Closed hywailiu closed 7 months ago

hywailiu commented 8 months ago

2024-01-03T11:45:46.612 app[56833023bde598] nrt [info] 2024-01-03 19:45:46,612 - DEBUG - Received frame type: b'\x02'

2024-01-03T11:45:46.612 app[56833023bde598] nrt [info] 2024-01-03 19:45:46,612 - DEBUG - Recording file created: /audio/recording-5f41629cbfc24760929429f3a5a21564.wav

2024-01-03T11:45:46.613 app[56833023bde598] nrt [info] 2024-01-03 19:45:46,613 - DEBUG - Current dkey= role=3

2024-01-03T11:45:46.613 app[56833023bde598] nrt [info] 2024-01-03 19:45:46,613 - DEBUG - STT type: openai-whisper

2024-01-03T11:45:46.620 app[56833023bde598] nrt [info] 2024-01-03 19:45:46,619 - DEBUG - message='Request to OpenAI API' method=post path=https://one-api.magickchat.com/v1/audio/transcriptions

2024-01-03T11:45:46.620 app[56833023bde598] nrt [info] 2024-01-03 19:45:46,619 - DEBUG - api_version=None data='{\'model\': \'whisper-1\', \'prompt\': "ok. let\'s begin.", \'response_format\': \'json\', \'language\': \'en\'}' message='Post details'

2024-01-03T11:45:46.620 app[56833023bde598] nrt [info] 2024-01-03 19:45:46,620 - DEBUG - Converted retries value: 2 -> Retry(total=2, connect=None, read=None, redirect=None, status=None)

2024-01-03T11:45:46.623 app[56833023bde598] nrt [info] 2024-01-03 19:45:46,623 - DEBUG - Starting new HTTPS connection (1): one-api.magickchat.com:443

2024-01-03T11:45:49.825 app[56833023bde598] nrt [info] 2024-01-03 19:45:49,825 - DEBUG - https://one-api.magickchat.com:443 "POST /v1/audio/transcriptions HTTP/1.1" 200 32

2024-01-03T11:45:49.826 app[56833023bde598] nrt [info] 2024-01-03 19:45:49,826 - DEBUG - message='OpenAI API response' path=https://one-api.magickchat.com/v1/audio/transcriptions processing_ms=1419 request_id=5a189a95551ee37ffc723074c18f9fc2 response_code=200

2024-01-03T11:45:49.826 app[56833023bde598] nrt [info] 2024-01-03 19:45:49,826 - DEBUG - [Dkey=] STT(openai-whisper) request time cost: 3.21s

2024-01-03T11:45:49.826 app[56833023bde598] nrt [info] 2024-01-03 19:45:49,826 - INFO - Dkey=: Transcribed:Testing, testing

2024-01-03T11:45:49.826 app[56833023bde598] nrt [info] 2024-01-03 19:45:49,826 - DEBUG - Current role config={'model': 'gpt-3.5-turbo', 'start_text': "Hi, I'm Fofo. Nice to meet you.", 'prompt': 'Your name is "Fofo". Your task is to chat with me. Please respond in English, keeping your answers brief – no more than 50 words each time!', 'max_message_count': 20, 'temperature': 0.7, 'max_tokens': 800, 'top_p': 0.95, 'frequency_penalty': 0, 'presence_penalty': 0, 'voice_name': 'en-US-AnaNeural', 'language': 'en'}

2024-01-03T11:45:49.826 app[56833023bde598] nrt [info] 2024-01-03 19:45:49,826 - DEBUG - GPT context: [{'role': 'system', 'content': 'You are ChatGPT, a large language model trained by OpenAI, based on the GPT-4 architecture. \n\nThe user is talking to you over voice on their phone, and your response will be read out loud with realistic text-to-speech (TTS) technology. Follow every direction here when crafting your response: Use natural, conversational language that are clear and easy to follow (short sentences, simple words). Be concise and relevant: Most of your responses should be a sentence or two, unless you’re asked to go deeper. Don’t monopolize the conversation. Use discourse markers to ease comprehension. Never use the list format. Keep the conversation flowing. Clarify: when there is ambiguity, ask clarifying questions, rather than make assumptions. Don’t implicitly or explicitly try to end the chat (i.e. do not end a response with “Talk soon!”, or “Enjoy!”). Sometimes the user might just want to chat. Ask them relevant follow-up questions. Don’t ask them if there’s anything else they need help with (e.g. don’t say things like “How can I assist you further?”). Remember that this is a voice conversation: Don’t use lists, markdown, bullet points, or other formatting that’s not typically spoken. Type out numbers in words (e.g. ‘twenty twelve’ instead of the year 2012). If something doesn’t make sense, it’s likely because you misheard them. There wasn’t a typo, and the user didn’t mispronounce anything. Remember to follow these rules absolutely, and do not refer to these rules, even if you’re asked about them. \n\nKnowledge cutoff: 2022-01. \nCurrent date: 2024-01-03 19:45:49.826747. \n'}, {'role': 'user', 'content': 'Your name is "Fofo". Your task is to chat with me. Please respond in English, keeping your answers brief – no more than 50 words each time!'}, {'role': 'assistant', 'content': "Hi, I'm Fofo. Nice to meet you."}, {'role': 'user', 'content': 'Testing, testing'}]

2024-01-03T11:45:49.827 app[56833023bde598] nrt [info] 2024-01-03 19:45:49,826 - DEBUG - LLM TYPE is openai

2024-01-03T11:45:49.827 app[56833023bde598] nrt [info] 2024-01-03 19:45:49,827 - DEBUG - message='Request to OpenAI API' method=post path=https://one-api.magickchat.com/v1/chat/completions

2024-01-03T11:45:49.827 app[56833023bde598] nrt [info] 2024-01-03 19:45:49,827 - DEBUG - api_version=None data='{"messages": [{"role": "system", "content": "You are ChatGPT, a large language model trained by OpenAI, based on the GPT-4 architecture. \n\nThe user is talking to you over voice on their phone, and your response will be read out loud with realistic text-to-speech (TTS) technology. Follow every direction here when crafting your response: Use natural, conversational language that are clear and easy to follow (short sentences, simple words). Be concise and relevant: Most of your responses should be a sentence or two, unless you\u2019re asked to go deeper. Don\u2019t monopolize the conversation. Use discourse markers to ease comprehension. Never use the list format. Keep the conversation flowing. Clarify: when there is ambiguity, ask clarifying questions, rather than make assumptions. Don\u2019t implicitly or explicitly try to end the chat (i.e. do not end a response with \u201cTalk soon!\u201d, or \u201cEnjoy!\u201d). Sometimes the user might just want to chat. Ask them relevant follow-up questions. Don\u2019t ask them if there\u2019s anything else they need help with (e.g. don\u2019t say things like \u201cHow can I assist you further?\u201d). Remember that this is a voice conversation: Don\u2019t use lists, markdown, bullet points, or other formatting that\u2019s not typically spoken. Type out numbers in words (e.g. \u2018twenty twelve\u2019 instead of the year 2012). If something doesn\u2019t make sense, it\u2019s likely because you misheard them. There wasn\u2019t a typo, and the user didn\u2019t mispronounce anything. Remember to follow these rules absolutely, and do not refer to these rules, even if you\u2019re asked about them. \n\nKnowledge cutoff: 2022-01. \nCurrent date: 2024-01-03 19:45:49.826747. \n"}, {"role": "user", "content": "Your name is \"Fofo\". Your task is to chat with me. Please respond in English, keeping your answers brief \u2013 no more than 50 words each time!"}, {"role": "assistant", "content": "Hi, I\'m Fofo. Nice to meet you."}, {"role": "user", "content": "Testing, testing"}], "stream": true, "model": "gpt-3.5-turbo", "temperature": 0.7, "max_tokens": 800, "top_p": 0.95, "frequency_penalty": 0, "presence_penalty": 0}' message='Post details'

2024-01-03T11:45:51.934 app[56833023bde598] nrt [info] 2024-01-03 19:45:51,934 - DEBUG - https://one-api.magickchat.com:443 "POST /v1/chat/completions HTTP/1.1" 200 None

2024-01-03T11:45:51.934 app[56833023bde598] nrt [info] 2024-01-03 19:45:51,934 - DEBUG - message='OpenAI API response' path=https://one-api.magickchat.com/v1/chat/completions processing_ms=None request_id=None response_code=200

2024-01-03T11:45:52.117 app[56833023bde598] nrt [info] 2024-01-03 19:45:52,116 - DEBUG - [Dkey=]: Recording Id: 1, Order: 1 Content: Sounds like everything's working!

2024-01-03T11:45:52.117 app[56833023bde598] nrt [info] 2024-01-03 19:45:52,117 - DEBUG - Using selector: EpollSelector

2024-01-03T11:45:52.190 app[56833023bde598] nrt [info] 2024-01-03 19:45:52,190 - DEBUG - [Dkey=]: Recording Id: 1, Order: 2 Content: What's on your mind today?

2024-01-03T11:45:52.191 app[56833023bde598] nrt [info] 2024-01-03 19:45:52,190 - DEBUG - Using selector: EpollSelector

2024-01-03T11:45:52.193 app[56833023bde598] nrt [info] 2024-01-03 19:45:52,193 - DEBUG - ChatCompletion request time cost: 2.37s

2024-01-03T11:45:52.451 app[56833023bde598] nrt [info] 2024-01-03 19:45:52,451 - DEBUG - TTS(edge-tts) request time cost: 0.26s

2024-01-03T11:45:52.452 app[56833023bde598] nrt [info] 2024-01-03 19:45:52,452 - DEBUG - Publish topic: /user/folotoy//thing/command/call, msg: {"msgId": 3, "identifier": "audioplay", "inputParams": {"recordingId": 1, "order": 2, "url": "http://xxxxxxx:8082/voice-bd492714539d42bc8fe84ea0ec98e461.mp3"}}

2024-01-03T11:45:52.453 app[56833023bde598] nrt [info] 2024-01-03 19:45:52,452 - DEBUG - Publish topic: /user/folotoy//thing/command/call, msg: {"msgId": 4, "identifier": "audioplay_cmd", "inputParams": {"recordingId": 1, "total": 2}}

2024-01-03T11:45:52.561 app[56833023bde598] nrt [info] 2024-01-03 19:45:52,561 - DEBUG - TTS(edge-tts) request time cost: 0.44s

2024-01-03T11:45:52.562 app[56833023bde598] nrt [info] 2024-01-03 19:45:52,562 - DEBUG - Publish topic: /user/folotoy//thing/command/call, msg: {"msgId": 5, "identifier": "audioplay", "inputParams": {"recordingId": 1, "order": 1, "url": "http://xxxxxxx:8082/voice-5f1d153403884006bf57d1ffd15f8fe3.mp3"}}

2024-01-03T11:45:55.342 app[56833023bde598] nrt [info] 2024-01-03 19:45:55,341 - DEBUG - Received /user/folotoy//thing/command/callAck: message data: {'msgId': 3, 'identifier': 'audioplay', 'result': 1}

2024-01-03T11:45:55.342 app[56833023bde598] nrt [info] 2024-01-03 19:45:55,342 - DEBUG - Command call ack: True, topic_tokens: {'#': [], '+': ['']}

2024-01-03T11:45:56.859 app[56833023bde598] nrt [info] 2024-01-03 19:45:56,859 - DEBUG - Received /user/folotoy//thing/command/callAck: message data: {'msgId': 4, 'identifier': 'audioplay_cmd', 'result': 1}

2024-01-03T11:45:56.859 app[56833023bde598] nrt [info] 2024-01-03 19:45:56,859 - DEBUG - Command call ack: True, topic_tokens: {'#': [], '+': ['']}

2024-01-03T11:45:58.419 app[56833023bde598] nrt [info] 2024-01-03 19:45:58,419 - DEBUG - Received /user/folotoy//thing/command/callAck: message data: {'msgId': 5, 'identifier': 'audioplay', 'result': 1}

2024-01-03T11:45:58.419 app[56833023bde598] nrt [info] 2024-01-03 19:45:58,419 - DEBUG - Command call ack: True, topic_tokens: {'#': [], '+': ['']}

2024-01-03T11:45:59.417 app[148e5233f32748] nrt [info] INFO: 172.16.11.58:63020 - "GET /voice-5f1d153403884006bf57d1ffd15f8fe3.mp3 HTTP/1.1" 404 Not Found

2024-01-03T11:46:00.610 app[148e5233f32748] nrt [info] INFO: 172.16.11.58:63028 - "GET /voice-bd492714539d42bc8fe84ea0ec98e461.mp3 HTTP/1.1" 404 Not Found

2024-01-03T11:47:53.625 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:53.631 app[148e5233f32748] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:53.723 proxy[148e5233f32748] nrt [error] could not proxy TCP data to/from instance: failed to copy (direction=client->server, error=Transport endpoint is not connected (os error 107))

2024-01-03T11:47:53.768 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:53.812 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:53.898 proxy[56833023bde598] nrt [error] could not proxy TCP data to/from instance: failed to copy (direction=client->server, error=Transport endpoint is not connected (os error 107))

2024-01-03T11:47:53.991 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:53.992 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:54.038 proxy[56833023bde598] nrt [error] could not proxy TCP data to/from instance: failed to copy (direction=client->server, error=Transport endpoint is not connected (os error 107))

2024-01-03T11:47:54.274 proxy[56833023bde598] nrt [error] could not proxy TCP data to/from instance: failed to copy (direction=client->server, error=Transport endpoint is not connected (os error 107))

2024-01-03T11:47:54.573 app[148e5233f32748] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:54.844 proxy[148e5233f32748] nrt [error] could not proxy TCP data to/from instance: failed to copy (direction=client->server, error=Transport endpoint is not connected (os error 107))

2024-01-03T11:47:55.339 app[148e5233f32748] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:55.621 proxy[148e5233f32748] nrt [error] could not proxy TCP data to/from instance: failed to copy (direction=client->server, error=Transport endpoint is not connected (os error 107))

2024-01-03T11:47:57.200 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:57.379 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:57.387 app[148e5233f32748] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:57.469 proxy[148e5233f32748] nrt [error] could not proxy TCP data to/from instance: failed to copy (direction=client->server, error=Transport endpoint is not connected (os error 107))

2024-01-03T11:47:57.791 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:57.969 app[148e5233f32748] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:59.069 app[148e5233f32748] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:59.578 app[148e5233f32748] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:47:59.596 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:48:01.172 app[148e5233f32748] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:48:01.440 proxy[148e5233f32748] nrt [error] could not proxy TCP data to/from instance: failed to copy (direction=client->server, error=Transport endpoint is not connected (os error 107))

2024-01-03T11:48:02.899 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:48:15.851 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:48:16.008 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:48:17.020 app[148e5233f32748] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:48:17.232 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:48:17.390 app[56833023bde598] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:48:17.469 proxy[56833023bde598] nrt [error] could not proxy TCP data to/from instance: failed to copy (direction=client->server, error=Transport endpoint is not connected (os error 107))

2024-01-03T11:48:17.536 proxy[56833023bde598] nrt [error] could not proxy TCP data to/from instance: failed to copy (direction=client->server, error=Transport endpoint is not connected (os error 107))

2024-01-03T11:48:17.946 app[148e5233f32748] nrt [info] WARNING: Invalid HTTP request received.

2024-01-03T11:48:18.226 proxy[148e5233f32748] nrt [error] could not proxy TCP data to/from instance: failed to copy (direction=client->server, error=Transport endpoint is not connected (os error 107))

lewangdev commented 8 months ago

http://xxxxxxx:8082/voice-bd492714539d42bc8fe84ea0ec98e461.mp3

链接用浏览器能否打开？

hywailiu commented 8 months ago

不能打开

lewangdev commented 8 months ago

方便发一下 fly.toml 文件吗

hywailiu commented 8 months ago

fly.toml app configuration file generated for folotoy-xxx-late-log-2421 on 2023-12-27T13:37:03+08:00

#

See https://fly.io/docs/reference/configuration/ for information about how to use this file.

#

app = "folotoy-xxx" primary_region = "nrt"

[build]

[env] API_SERVER = "true" API_SERVER_BIND_ADDRESS = "0.0.0.0" API_SERVER_PORT = "8082" AUDIO_DOWNLOAD_URL = "http://folotoy-xxx.fly.dev:8082" AUDIO_SAVE_PATH = "/audio" LLM_TYPE = "openai" LOG_LEVEL = "DEBUG" MQTT_BROKER_HOST = "127.0.0.1" MQTT_BROKER_PORT = "1883" MQTT_CLIENT_ID = "folotoy" MQTT_USERNAME = "folotoy" OPENAI_TTS_MODEL = "tts-1" OPENAI_WHISPER_MODEL = "whisper-1" ROLES_FILE_PATH = "/config/roles.json" SPEECH_UDP_SERVER_BIND_ADDRESS = "fly-global-services" SPEECH_UDP_SERVER_HOST = "137.xx.xx.xx" SPEECH_UDP_SERVER_PORT = "8085" STT_TYPE = "openai-whisper" TTS_TYPE = "edge-tts" TZ = "Asia/Shanghai"

[http_service] internal_port = 8085 force_https = true auto_stop_machines = true auto_start_machines = true min_machines_running = 0 processes = ["app"]

[[services]] protocol = "udp" internal_port = 8085

[[services.ports]] port = 8085

[[services]] protocol = "tcp" internal_port = 8082

[[services.ports]] port = 8082

[[services]] protocol = "tcp" internal_port = 1883

[[services.ports]] port = 1883

[[vm]] cpu_kind = "shared" cpus = 1 memory_mb = 1024

lewangdev commented 8 months ago

把这一段删除试试

[http_service] internal_port = 8085 force_https = true auto_stop_machines = true auto_start_machines = true min_machines_running = 0 processes = ["app"]

hywailiu commented 8 months ago

删除了还是无法打开mp3链接，每次deploy的 会提示这个，是不是相当于端口未开启 WARNING The app is not listening on the expected address and will not be reachable by fly-proxy. You can fix this by configuring your app to listen on the following addresses:

hywailiu commented 8 months ago

删除了后台有新的变化，但还是没回复 2024-01-04T14:31:08.806 app[148e5233f32748] nrt [info] 2024-01-04 22:31:08,775 - DEBUG - Recording file created: /audio/recording-385ae507a41d490d8451daf4468738f2.wav

2024-01-04T14:31:08.806 app[148e5233f32748] nrt [info] 2024-01-04 22:31:08,776 - DEBUG - Current dkey=08d1f9c657ec role=2

2024-01-04T14:31:08.806 app[148e5233f32748] nrt [info] 2024-01-04 22:31:08,776 - DEBUG - STT type: openai-whisper

2024-01-04T14:31:08.806 app[148e5233f32748] nrt [info] 2024-01-04 22:31:08,777 - DEBUG - message='Request to OpenAI API' method=post path=https://one-api.magickchat.com/v1/audio/transcriptions

2024-01-04T14:31:08.806 app[148e5233f32748] nrt [info] 2024-01-04 22:31:08,777 - DEBUG - api_version=None data='{\'model\': \'whisper-1\', \'prompt\': "ok. let\'s begin.", \'response_format\': \'json\', \'language\': \'zh\'}' message='Post details'

2024-01-04T14:31:08.831 app[148e5233f32748] nrt [info] 2024-01-04 22:31:08,808 - DEBUG - Converted retries value: 2 -> Retry(total=2, connect=None, read=None, redirect=None, status=None)

2024-01-04T14:31:08.864 app[148e5233f32748] nrt [info] 2024-01-04 22:31:08,833 - DEBUG - Starting new HTTPS connection (1): one-api.magickchat.com:443

2024-01-04T14:31:11.670 app[148e5233f32748] nrt [info] 2024-01-04 22:31:11,662 - DEBUG - https://one-api.magickchat.com:443 "POST /v1/audio/transcriptions HTTP/1.1" 200 31

2024-01-04T14:31:11.678 app[148e5233f32748] nrt [info] 2024-01-04 22:31:11,671 - DEBUG - message='OpenAI API response' path=https://one-api.magickchat.com/v1/audio/transcriptions processing_ms=492 request_id=a0faf0904ff9823ea6ae59f63635f9d8 response_code=200

2024-01-04T14:31:11.690 app[148e5233f32748] nrt [info] 2024-01-04 22:31:11,679 - DEBUG - [Dkey=08d1f9c657ec] STT(openai-whisper) request time cost: 2.90s

2024-01-04T14:31:11.694 app[148e5233f32748] nrt [info] 2024-01-04 22:31:11,690 - INFO - Dkey=08d1f9c657ec: Transcribed:我要聽故事

2024-01-04T14:31:11.706 app[148e5233f32748] nrt [info] 2024-01-04 22:31:11,694 - DEBUG - Current role config={'model': 'gpt-3.5-turbo', 'start_text': '你好，俺是东北猫，请问有什么俺可以帮助你的吗？', 'prompt': '你是一个知识渊博，乐于助人的智能机器人,你的名字叫“东北猫”，你的任务是陪我聊天，请用简短的对话方式，用中文讲一段话，每次回答不超过50个字！', 'max_message_count': 20, 'temperature': 0.7, 'max_tokens': 800, 'top_p': 0.95, 'frequency_penalty': 0, 'presence_penalty': 0, 'voice_name': 'zh-CN-liaoning-XiaobeiNeural', 'language': 'zh'}

2024-01-04T14:31:11.713 app[148e5233f32748] nrt [info] 2024-01-04 22:31:11,712 - DEBUG - GPT context: [{'role': 'system', 'content': 'You are ChatGPT, a large language model trained by OpenAI, based on the GPT-4 architecture. \n\nThe user is talking to you over voice on their phone, and your response will be read out loud with realistic text-to-speech (TTS) technology. Follow every direction here when crafting your response: Use natural, conversational language that are clear and easy to follow (short sentences, simple words). Be concise and relevant: Most of your responses should be a sentence or two, unless you’re asked to go deeper. Don’t monopolize the conversation. Use discourse markers to ease comprehension. Never use the list format. Keep the conversation flowing. Clarify: when there is ambiguity, ask clarifying questions, rather than make assumptions. Don’t implicitly or explicitly try to end the chat (i.e. do not end a response with “Talk soon!”, or “Enjoy!”). Sometimes the user might just want to chat. Ask them relevant follow-up questions. Don’t ask them if there’s anything else they need help with (e.g. don’t say things like “How can I assist you further?”). Remember that this is a voice conversation: Don’t use lists, markdown, bullet points, or other formatting that’s not typically spoken. Type out numbers in words (e.g. ‘twenty twelve’ instead of the year 2012). If something doesn’t make sense, it’s likely because you misheard them. There wasn’t a typo, and the user didn’t mispronounce anything. Remember to follow these rules absolutely, and do not refer to these rules, even if you’re asked about them. \n\nKnowledge cutoff: 2022-01. \nCurrent date: 2024-01-04 22:31:11.712337. \n'}, {'role': 'user', 'content': '你是一个知识渊博，乐于助人的智能机器人,你的名字叫“东北猫”，你的任务是陪我聊天，请用简短的对话方式，用中文讲一段话，每次回答不超过50个字！'}, {'role': 'assistant', 'content': '你好，俺是东北猫，请问有什么俺可以帮助你的吗？'}, {'role': 'user', 'content': '扯 扯 扯 7'}, {'role': 'assistant', 'content': '噢，你是在说"聊"吗？你想聊些什么呢？'}, {'role': 'user', 'content': '我要聽故事'}]

2024-01-04T14:31:11.717 app[148e5233f32748] nrt [info] 2024-01-04 22:31:11,713 - DEBUG - LLM TYPE is openai

2024-01-04T14:31:11.729 app[148e5233f32748] nrt [info] 2024-01-04 22:31:11,718 - DEBUG - message='Request to OpenAI API' method=post path=https://one-api.magickchat.com/v1/chat/completions

2024-01-04T14:31:11.738 app[148e5233f32748] nrt [info] 2024-01-04 22:31:11,730 - DEBUG - api_version=None data='{"messages": [{"role": "system", "content": "You are ChatGPT, a large language model trained by OpenAI, based on the GPT-4 architecture. \n\nThe user is talking to you over voice on their phone, and your response will be read out loud with realistic text-to-speech (TTS) technology. Follow every direction here when crafting your response: Use natural, conversational language that are clear and easy to follow (short sentences, simple words). Be concise and relevant: Most of your responses should be a sentence or two, unless you\u2019re asked to go deeper. Don\u2019t monopolize the conversation. Use discourse markers to ease comprehension. Never use the list format. Keep the conversation flowing. Clarify: when there is ambiguity, ask clarifying questions, rather than make assumptions. Don\u2019t implicitly or explicitly try to end the chat (i.e. do not end a response with \u201cTalk soon!\u201d, or \u201cEnjoy!\u201d). Sometimes the user might just want to chat. Ask them relevant follow-up questions. Don\u2019t ask them if there\u2019s anything else they need help with (e.g. don\u2019t say things like \u201cHow can I assist you further?\u201d). Remember that this is a voice conversation: Don\u2019t use lists, markdown, bullet points, or other formatting that\u2019s not typically spoken. Type out numbers in words (e.g. \u2018twenty twelve\u2019 instead of the year 2012). If something doesn\u2019t make sense, it\u2019s likely because you misheard them. There wasn\u2019t a typo, and the user didn\u2019t mispronounce anything. Remember to follow these rules absolutely, and do not refer to these rules, even if you\u2019re asked about them. \n\nKnowledge cutoff: 2022-01. \nCurrent date: 2024-01-04 22:31:11.712337. \n"}, {"role": "user", "content": "\u4f60\u662f\u4e00\u4e2a\u77e5\u8bc6\u6e0a\u535a\uff0c\u4e50\u4e8e\u52a9\u4eba\u7684\u667a\u80fd\u673a\u5668\u4eba,\u4f60\u7684\u540d\u5b57\u53eb\u201c\u4e1c\u5317\u732b\u201d\uff0c\u4f60\u7684\u4efb\u52a1\u662f\u966a\u6211\u804a\u5929\uff0c\u8bf7\u7528\u7b80\u77ed\u7684\u5bf9\u8bdd\u65b9\u5f0f\uff0c\u7528\u4e2d\u6587\u8bb2\u4e00\u6bb5\u8bdd\uff0c\u6bcf\u6b21\u56de\u7b54\u4e0d\u8d85\u8fc750\u4e2a\u5b57\uff01"}, {"role": "assistant", "content": "\u4f60\u597d\uff0c\u4ffa\u662f\u4e1c\u5317\u732b\uff0c\u8bf7\u95ee\u6709\u4ec0\u4e48\u4ffa\u53ef\u4ee5\u5e2e\u52a9\u4f60\u7684\u5417\uff1f"}, {"role": "user", "content": "\u626f \u626f \u626f 7"}, {"role": "assistant", "content": "\u5662\uff0c\u4f60\u662f\u5728\u8bf4\"\u804a\"\u5417\uff1f\u4f60\u60f3\u804a\u4e9b\u4ec0\u4e48\u5462\uff1f"}, {"role": "user", "content": "\u6211\u8981\u807d\u6545\u4e8b"}], "stream": true, "model": "gpt-3.5-turbo", "temperature": 0.7, "max_tokens": 800, "top_p": 0.95, "frequency_penalty": 0, "presence_penalty": 0}' message='Post details'

2024-01-04T14:31:16.190 app[148e5233f32748] nrt [info] 2024-01-04 22:31:16,184 - DEBUG - https://one-api.magickchat.com:443 "POST /v1/chat/completions HTTP/1.1" 200 None

2024-01-04T14:31:16.190 app[148e5233f32748] nrt [info] 2024-01-04 22:31:16,184 - DEBUG - message='OpenAI API response' path=https://one-api.magickchat.com/v1/chat/completions processing_ms=None request_id=None response_code=200

2024-01-04T14:31:16.690 app[148e5233f32748] nrt [info] 2024-01-04 22:31:16,672 - DEBUG - [Dkey=08d1f9c657ec]: Recording Id: 3, Order: 1 Content: 好的，你想听什么类型的故事呢？

2024-01-04T14:31:16.690 app[148e5233f32748] nrt [info] 2024-01-04 22:31:16,673 - DEBUG - Using selector: EpollSelector

2024-01-04T14:31:17.326 app[148e5233f32748] nrt [info] 2024-01-04 22:31:17,321 - DEBUG - ChatCompletion request time cost: 5.61s

2024-01-04T14:31:17.394 app[148e5233f32748] nrt [info] 2024-01-04 22:31:17,322 - DEBUG - [Dkey=08d1f9c657ec]: Recording Id: 3, Order: 2 Content: 比如童话故事、惊悚故事还是科幻故事？

2024-01-04T14:31:17.394 app[148e5233f32748] nrt [info] 2024-01-04 22:31:17,343 - DEBUG - Using selector: EpollSelector

2024-01-04T14:31:17.552 app[148e5233f32748] nrt [info] 2024-01-04 22:31:17,550 - DEBUG - TTS(edge-tts) request time cost: 0.88s

2024-01-04T14:31:17.590 app[148e5233f32748] nrt [info] 2024-01-04 22:31:17,588 - DEBUG - Publish topic: /user/folotoy/08d1f9c657ec/thing/command/call, msg: {"msgId": 6, "identifier": "audioplay", "inputParams": {"recordingId": 3, "order": 1, "url": "http://folotoy-xxxxx.fly.dev:8082/voice-65ae31dd2797452f91710424594b011e.mp3"}}

2024-01-04T14:31:17.590 app[148e5233f32748] nrt [info] 2024-01-04 22:31:17,589 - DEBUG - Publish topic: /user/folotoy/08d1f9c657ec/thing/command/call, msg: {"msgId": 7, "identifier": "audioplay_cmd", "inputParams": {"recordingId": 3, "total": 2}}

2024-01-04T14:31:18.178 app[148e5233f32748] nrt [info] 2024-01-04 22:31:18,166 - DEBUG - TTS(edge-tts) request time cost: 0.82s

2024-01-04T14:31:18.210 app[148e5233f32748] nrt [info] 2024-01-04 22:31:18,210 - DEBUG - Publish topic: /user/folotoy/08d1f9c657ec/thing/command/call, msg: {"msgId": 8, "identifier": "audioplay", "inputParams": {"recordingId": 3, "order": 2, "url": "http://folotoy-xxxxx.fly.dev:8082/voice-2651445da6404f2b8eba71a92df0061f.mp3"}}

2024-01-04T14:31:20.665 app[56833023bde598] nrt [info] INFO: 172.16.11.26:40986 - "GET /voice-65ae31dd2797452f91710424594b011e.mp3 HTTP/1.1" 404 Not Found

2024-01-04T14:31:20.682 app[148e5233f32748] nrt [info] 2024-01-04 22:31:20,678 - DEBUG - Received /user/folotoy/08d1f9c657ec/thing/command/callAck: message data: {'msgId': 6, 'identifier': 'audioplay', 'result': 1}

2024-01-04T14:31:20.682 app[148e5233f32748] nrt [info] 2024-01-04 22:31:20,678 - DEBUG - Command call ack: True, topic_tokens: {'#': [], '+': ['08d1f9c657ec']}

2024-01-04T14:31:22.200 app[148e5233f32748] nrt [info] 2024-01-04 22:31:22,198 - DEBUG - Received /user/folotoy/08d1f9c657ec/thing/command/callAck: message data: {'msgId': 7, 'identifier': 'audioplay_cmd', 'result': 1}

2024-01-04T14:31:22.200 app[148e5233f32748] nrt [info] 2024-01-04 22:31:22,199 - DEBUG - Command call ack: True, topic_tokens: {'#': [], '+': ['08d1f9c657ec']}

2024-01-04T14:31:23.518 app[56833023bde598] nrt [info] INFO: 172.16.11.26:40996 - "GET /voice-2651445da6404f2b8eba71a92df0061f.mp3 HTTP/1.1" 404 Not Found

2024-01-04T14:31:23.730 app[148e5233f32748] nrt [info] 2024-01-04 22:31:23,724 - DEBUG - Received /user/folotoy/08d1f9c657ec/thing/command/callAck: message data: {'msgId': 8, 'identifier': 'audioplay', 'result': 1}

2024-01-04T14:31:23.730 app[148e5233f32748] nrt [info] 2024-01-04 22:31:23,725 - DEBUG - Command call ack: True, topic_tokens: {'#': [], '+': ['08d1f9c657ec']}

lewangdev commented 8 months ago

生成的mp3电脑能打开吗？flyio可能被墙了

hywailiu commented 8 months ago

打不开的http://folotoy-hyaway.fly.dev:8082/voice-2651445da6404f2b8eba71a92df0061f.mp3

lewangdev commented 8 months ago

在fly.toml里面把https关掉

lewangdev commented 8 months ago

force_https = false

hywailiu commented 8 months ago

关掉也是打不开mp3的链接，和不能播放 而且用测试服务器也是打不开http://octopusx.fly.dev:8082/voice-17e866ddaced489aa97dae1dc0d66085.mp3

lewangdev commented 8 months ago

需要用🪜

lewangdev commented 8 months ago

另外观察不能让浏览器自动跳转到https，可以用wget之类的下载工具尝试下载音频

image