Sprint 26 Planning

[gabrielle-ong]

1.0.4 scope: https://github.com/janhq/cortex.cpp/milestone/25

Sprint 25 In progress / QA + Release next week

• janhq/cortex.cpp#1567
• janhq/cortex.cpp#1675
• janhq/cortex.cpp#1662
• janhq/cortex.cpp#1729
• release name alignment to upstream llamacpp janhq/cortex.cpp#303

---

Sprint 25 Not yet started + Sprint 26 stories

Jan: Engine Management, Hardware Settings

Jan Bugs that should be solved (requires QA)

• janhq/cortex.cpp#1467
• janhq/cortex.cpp#1457

Jan Bugs that needs investigation (to prioritise)

• https://github.com/janhq/jan/issues/4035 Sub tasks:

• Wrong NGL maximum settings (e.g., NGL number limits at 30 layers but the user can set it to 100 in Jan UI): https://discord.com/channels/1107178041848909847/1306758623325851689/1307651904171540512

• https://github.com/janhq/cortex.cpp/issues/1668

• https://github.com/janhq/jan/issues/4014

• janhq/cortex.cpp#1459 - computer going to sleep

• janhq/cortex.cpp#1140

• janhq/cortex.cpp#1469

• janhq/cortex.cpp#1099, janhq/cortex.cpp#985 Tokens per second calculation:

  Need technical help understanding:

• janhq/cortex.cpp#1097: is this fixed by proxy?

• janhq/cortex.cpp#1717

Jan x Cortex implements Hardware Detection

• janhq/cortex.cpp#1104
• janhq/cortex.cpp#1468

Cortex supports new Engines

• https://github.com/janhq/cortex.cpp/issues/1731
• https://github.com/janhq/cortex.cpp/issues/1732

New Features

P0: Model sources - needed for Jan Hub

• planning: Cortex API supports /model/sources #15

P0: Jan x Cortex supports Python

• janhq/jan-internal#8

Assistants

• janhq/cortex.cpp#1573
• Planning: RAG = Assistant specific File Search janhq/cortex.cpp#20

QA

• janhq/cortex.cpp#1565
• janhq/cortex.cpp#1069
• https://github.com/janhq/qa/issues/3

Cortex UX Improvements

• janhq/cortex.cpp#1685
• janhq/cortex.cpp#1060

• janhq/cortex.cpp#1656

  Sprint 27 / beyond

Support Ichigo & TTS & STT -> Sprint 27, blocked on Python

• Jan Parent issue: https://github.com/janhq/jan/issues/3488
  • janhq/cortex.cpp#1247
  • janhq/cortex.cpp#23
    • janhq/cortex.cpp#743

RAG

• janhq/cortex.cpp#1597

Supports Vision, upstream llama.cpp -> Move to Sprint 27

• janhq/cortex.cpp#1728
• janhq/cortex.cpp#1493

Unprioritised / Icebox

• janhq/cortex.cpp#1185
• janhq/cortex.cpp#1101
• janhq/cortex.cpp#985
• CI for VNNI support janhq/cortex.cpp#60

Jan & Cortex supports Multi GPU -> Create parent Jan issue

• janhq/cortex.cpp#1679
• janhq/cortex.cpp#1391
• Fixes Jan multiple GPUs #1458

Docs / Website:

• https://github.com/janhq/cortex.cpp/issues/1736
• Decision: Are we publicly marketing Cortex or focusing on Jan?

[gabrielle-ong]

Suggested Jan Epics (as parent issues for Cortex)

cc @imtuyethan @dan-homebrew @0xSage

3. Jan & Cortex fixes Vulkan acceleration

• Need Eng planning / investigation
• https://github.com/janhq/cortex.cpp/issues/1525
• https://github.com/janhq/jan/issues/3874

4. Jan & Cortex supports Multi GPU

• https://github.com/janhq/cortex.cpp/issues/1391
• https://github.com/janhq/cortex.cpp/issues/1679
• Will fix: https://github.com/janhq/cortex.cpp/issues/1458

[gabrielle-ong]

Closing after sprint planning discussion, now on kanban boards