I am trying to explore the backend server. After resolving dependencies issues, I tried to start the server but system doesn’t shows any running backend server neither logs helps out to identify the issue.
kill: (148079): No such process
User settings:
KMP_AFFINITY=granularity=fine,compact,1,0
KMP_BLOCKTIME=1
KMP_SETTINGS=1
OMP_NUM_THREADS=56
Effective settings:
KMP_ABORT_DELAY=0
KMP_ADAPTIVE_LOCK_PROPS='1,1024'
KMP_ALIGN_ALLOC=64
KMP_ALL_THREADPRIVATE=384
KMP_ATOMIC_MODE=2
KMP_BLOCKTIME=1
KMP_CPUINFO_FILE: value is not defined
KMP_DETERMINISTIC_REDUCTION=false
KMP_DEVICE_THREAD_LIMIT=2147483647
KMP_DISP_NUM_BUFFERS=7
KMP_DUPLICATE_LIB_OK=false
KMP_ENABLE_TASK_THROTTLING=true
KMP_FORCE_MONOTONIC_DYNAMIC_SCHEDULE=false
KMP_FORCE_REDUCTION: value is not defined
KMP_FOREIGN_THREADS_THREADPRIVATE=true
KMP_FORKJOIN_BARRIER='2,2'
KMP_FORKJOIN_BARRIER_PATTERN='hyper,hyper'
KMP_FORKJOIN_FRAMES=true
KMP_FORKJOIN_FRAMES_MODE=3
KMP_GTID_MODE=3
KMP_HANDLE_SIGNALS=false
KMP_HOT_TEAMS_MAX_LEVEL=1
KMP_HOT_TEAMS_MODE=0
KMP_INIT_AT_FORK=true
KMP_ITT_PREPARE_DELAY=0
KMP_LIBRARY=throughput
KMP_LOCK_KIND=queuing
KMP_MALLOC_POOL_INCR=1M
KMP_MWAIT_HINTS=0
KMP_NESTING_MODE=0
KMP_NUM_LOCKS_IN_BLOCK=1
KMP_PLAIN_BARRIER='2,2'
KMP_PLAIN_BARRIER_PATTERN='hyper,hyper'
KMP_REDUCTION_BARRIER='1,1'
KMP_REDUCTION_BARRIER_PATTERN='hyper,hyper'
KMP_SCHEDULE='static,balanced;guided,iterative'
KMP_SETTINGS=true
KMP_SPIN_BACKOFF_PARAMS='4096,100'
KMP_STACKOFFSET=64
KMP_STACKPAD=0
KMP_STACKSIZE=8M
KMP_STORAGE_MAP=false
KMP_TASKING=2
KMP_TASKLOOP_MIN_TASKS=0
KMP_TASK_STEALING_CONSTRAINT=1
KMP_TEAMS_PROC_BIND=spread
KMP_TEAMS_THREAD_LIMIT=96
KMP_TOPOLOGY_METHOD=all
KMP_TPAUSE=0
KMP_USER_LEVEL_MWAIT=false
KMP_USE_YIELD=1
KMP_VERSION=false
KMP_WARNINGS=true
LIBOMP_NUM_HIDDEN_HELPER_THREADS=8
LIBOMP_USE_HIDDEN_HELPER_TASK=true
OMP_AFFINITY_FORMAT='OMP: pid %P tid %i thread %n bound to OS proc set {%A}'
OMP_ALLOCATOR=omp_default_mem_alloc
OMP_CANCELLATION=false
OMP_DEFAULT_DEVICE=0
OMP_DISPLAY_AFFINITY=false
OMP_DISPLAY_ENV=false
OMP_DYNAMIC=false
OMP_MAX_ACTIVE_LEVELS=1
OMP_MAX_TASK_PRIORITY=0
OMP_NESTED: deprecated; max-active-levels-var=1
OMP_NUM_TEAMS=0
OMP_NUM_THREADS='56'
OMP_PLACES='threads'
OMP_PROC_BIND='intel'
OMP_SCHEDULE='static'
OMP_STACKSIZE=8M
OMP_TARGET_OFFLOAD=DEFAULT
OMP_TEAMS_THREAD_LIMIT=0
OMP_THREAD_LIMIT=2147483647
OMP_TOOL=enabled
OMP_TOOL_LIBRARIES: value is not defined
OMP_TOOL_VERBOSE_INIT: value is not defined
OMP_WAIT_POLICY=PASSIVE
KMP_AFFINITY='noverbose,warnings,respect,granularity=thread,compact,1,0'
Warning: please export TSAN_OPTIONS='ignore_noninstrumented_modules=1' to avoid false positive reports from the OpenMP runtime!
here is my yaml file:
#################################################################################
# SERVER SETTING #
#################################################################################
host: 0.0.0.0
port: 8888
#model_name_or_path: "Intel/neural-chat-7b-v3-1"
model_name_or_path: "/home/intel/ritu/models/neural-chat-7b-v3-1.Q4_K_M.gguf"
device: "cpu"
asr:
enable: true
args:
# support cpu, hpu, xpu, cuda
device: "cpu"
# support openai/whisper series
model_name_or_path: "openai/whisper-small"
# only can be set to true when the device is set to "cpu"
bf16: false
tts:
enable: false
args:
device: "cpu"
voice: "default"
stream_mode: true
output_audio_path: "./output_audio"
tts_multilang:
enable: true
args:
device: "cpu"
precision: "fp32"
stream_mode: true
# task choices = ['textchat', 'voicechat', 'retrieval', 'text2image', 'finetune']
#tasks_list: ['voicechat']
tasks_list: ['textchat']
objective is to run neural-chat for speech-to-text later speech-to-speech (first test on intel cpu and then xpu)
I am trying to explore the backend server. After resolving dependencies issues, I tried to start the server but system doesn’t shows any running backend server neither logs helps out to identify the issue.
Followed below guidelines: document followed
here is the log out:
here is my yaml file:
objective is to run neural-chat for speech-to-text later speech-to-speech (first test on intel cpu and then xpu)