search

khoj-ai / khoj

Your AI second brain. Get answers to your questions, whether they be online or in your own notes. Use online AI models (e.g gpt4) or private, local LLMs (e.g llama3). Self-host locally or use our cloud instance. Access from Obsidian, Emacs, Desktop app, Web or Whatsapp.
https://khoj.dev
GNU Affero General Public License v3.0
12.35k stars 620 forks source link

[FIX] notion import not working #637

Closed danrthompson closed 6 months ago

danrthompson commented 6 months ago

Describe the bug

A clear and concise description of what the bug is. Please include what you were expecting to happen vs. what actually happened.

when i try to setup notion by adding my token, adding the connection to a page (i tried a demo page with basically no contents and no databases), then hitting reinitialize, the loading of the notion contents fails

the demo page has title "Test" and contents "Testing!"

To Reproduce

Steps to reproduce the behavior: install the server on a mac with docker compose (using the 1.5.0, 1.4.0, or 1.1.0 backend version), then create notion integration, add notion connection to a page, save token to backend, and reinitialize

Screenshots

If applicable, add screenshots to help explain your problem.

Platform

If self-hosted

Additional context

Add any other context about the problem here.

stack trace: khoj-server-1 | [20:59:13] INFO 📬 Initializing content index... configure.py:236 khoj-server-1 | DEBUG 🚨 No Content configuration available. indexer.py:338 khoj-server-1 | INFO 🌖 Khoj is ready to use main.py:157 khoj-server-1 | INFO Started server process [1] server.py:75 khoj-server-1 | INFO Waiting for application startup. on.py:45 khoj-server-1 | INFO Application startup complete. on.py:59 khoj-server-1 | INFO Uvicorn running on http://0.0.0.0:42110 (Press server.py:206 khoj-server-1 | CTRL+C to quit) khoj-server-1 | [21:00:27] INFO 192.168.65.1:49632 - "GET h11_impl.py:431 khoj-server-1 | /config/content-source/notion HTTP/1.1" 200 khoj-server-1 | INFO 192.168.65.1:49632 - "GET h11_impl.py:431 khoj-server-1 | /static/assets/pico.min.css HTTP/1.1" 200 khoj-server-1 | INFO 192.168.65.1:49633 - "GET h11_impl.py:431 khoj-server-1 | /static/assets/khoj.css HTTP/1.1" 200 khoj-server-1 | INFO 192.168.65.1:49634 - "GET h11_impl.py:431 khoj-server-1 | /static/assets/utils.js HTTP/1.1" 200 khoj-server-1 | INFO 192.168.65.1:49636 - "GET h11_impl.py:431 khoj-server-1 | /static/assets/icons/khoj-logo-sideways-500. khoj-server-1 | png HTTP/1.1" 200 khoj-server-1 | INFO 192.168.65.1:49635 - "GET h11_impl.py:431 khoj-server-1 | /static/assets/icons/notion.svg HTTP/1.1" khoj-server-1 | 200 khoj-server-1 | INFO 192.168.65.1:49635 - "GET h11_impl.py:431 khoj-server-1 | /static/assets/icons/favicon-128x128.png khoj-server-1 | HTTP/1.1" 200 khoj-server-1 | [21:00:30] INFO 192.168.65.1:49635 - "POST h11_impl.py:431 khoj-server-1 | /api/config/data/content-source/notion khoj-server-1 | HTTP/1.1" 200 khoj-server-1 | [21:00:31] INFO 📬 Updating content index... configure.py:239 khoj-server-1 | INFO 🔌 Setting up search for notion indexer.py:311 khoj-server-1 | [21:00:34] DEBUG Getting all pages via search endpoint: 2.821 helpers.py:156 khoj-server-1 | seconds khoj-server-1 | [21:00:36] DEBUG Processing page helpers.py:156 khoj-server-1 | ae4b8b05-af30-4efb-9dfd-72723fc3ea9e: 1.668 khoj-server-1 | seconds khoj-server-1 | DEBUG Processing response: 1.671 seconds helpers.py:156 Hashing Entries: 100%|██████████| 1/1 [00:00<00:00, 11618.57it/s] khoj-server-1 | DEBUG Constructed current entry hashes in: 0.006 helpers.py:156 khoj-server-1 | seconds Identify new entries: 100%|██████████| 1/1 [00:00<00:00, 63.05it/s] khoj-server-1 | DEBUG Identified entries to add to database in: helpers.py:156 khoj-server-1 | 0.016 seconds Batches: 100%|██████████| 1/1 [00:00<00:00, 2.06it/s] khoj-server-1 | DEBUG Generated embeddings for entries to add to helpers.py:156 khoj-server-1 | database in: 0.503 seconds Add entries to database: 0it [00:00, ?it/s] khoj-server-1 | DEBUG Added entries to database in: 0.001 seconds helpers.py:156 khoj-server-1 | DEBUG Identify new or updated entries: 0.533 helpers.py:156 khoj-server-1 | seconds khoj-server-1 | ERROR 🚨 Failed to setup Notion: ['“None” is not a indexer.py:322 khoj-server-1 | valid UUID.'] khoj-server-1 | ╭──── Traceback (most recent call last) ────╮ khoj-server-1 | │ /usr/local/lib/python3.10/dist-packages/d │ khoj-server-1 | │ jango/db/models/fields/init.py:2688 │ khoj-server-1 | │ in to_python │ khoj-server-1 | │ │ khoj-server-1 | │ 2685 │ │ if value is not None and n │ khoj-server-1 | │ 2686 │ │ │ input_form = "int" if │ khoj-server-1 | │ 2687 │ │ │ try: │ khoj-server-1 | │ ❱ 2688 │ │ │ │ return uuid.UUID(* │ khoj-server-1 | │ 2689 │ │ │ except (AttributeError │ khoj-server-1 | │ 2690 │ │ │ │ raise exceptions.V │ khoj-server-1 | │ 2691 │ │ │ │ │ self.errormes │ khoj-server-1 | │ │ khoj-server-1 | │ /usr/lib/python3.10/uuid.py:177 in │ khoj-server-1 | │ init │ khoj-server-1 | │ │ khoj-server-1 | │ 174 │ │ │ hex = hex.replace('urn: │ khoj-server-1 | │ 175 │ │ │ hex = hex.strip('{}').r │ khoj-server-1 | │ 176 │ │ │ if len(hex) != 32: │ khoj-server-1 | │ ❱ 177 │ │ │ │ raise ValueError('b │ khoj-server-1 | │ 178 │ │ │ int = int(hex, 16) │ khoj-server-1 | │ 179 │ │ if bytes_le is not None: │ khoj-server-1 | │ 180 │ │ │ if len(bytes_le) != 16: │ khoj-server-1 | ╰───────────────────────────────────────────╯ khoj-server-1 | ValueError: badly formed hexadecimal UUID khoj-server-1 | string khoj-server-1 | khoj-server-1 | During handling of the above exception, khoj-server-1 | another exception occurred: khoj-server-1 | khoj-server-1 | ╭──── Traceback (most recent call last) ────╮ khoj-server-1 | │ /app/src/khoj/routers/indexer.py:312 in │ khoj-server-1 | │ configure_content │ khoj-server-1 | │ │ khoj-server-1 | │ 309 │ │ │ search_type == state.Se │ khoj-server-1 | │ state.SearchType.Notion.value │ khoj-server-1 | │ 310 │ │ ) and notion_config: │ khoj-server-1 | │ 311 │ │ │ logger.info("🔌 Setting │ khoj-server-1 | │ ❱ 312 │ │ │ text_search.setup( │ khoj-server-1 | │ 313 │ │ │ │ NotionToEntries, │ khoj-server-1 | │ 314 │ │ │ │ None, │ khoj-server-1 | │ 315 │ │ │ │ regenerate=regenera │ khoj-server-1 | │ │ khoj-server-1 | │ /app/src/khoj/search_type/text_search.py: │ khoj-server-1 | │ 202 in setup │ khoj-server-1 | │ │ khoj-server-1 | │ 199 │ config=None, │ khoj-server-1 | │ 200 ) -> None: │ khoj-server-1 | │ 201 │ if config: │ khoj-server-1 | │ ❱ 202 │ │ num_new_embeddings, num_del │ khoj-server-1 | │ 203 │ │ │ files=files, full_corpu │ khoj-server-1 | │ 204 │ │ ) │ khoj-server-1 | │ 205 │ else: │ khoj-server-1 | │ │ khoj-server-1 | │ /app/src/khoj/processor/content/notion/no │ khoj-server-1 | │ tion_to_entries.py:115 in process │ khoj-server-1 | │ │ khoj-server-1 | │ 112 │ │ │ │ │ │ │ page_en │ khoj-server-1 | │ 113 │ │ │ │ │ │ │ current │ khoj-server-1 | │ 114 │ │ │ khoj-server-1 | │ ❱ 115 │ │ return self.updateentries │ khoj-server-1 | │ 116 │ │ khoj-server-1 | │ 117 │ def process_page(self, page): │ khoj-server-1 | │ 118 │ │ page_id = page["id"] │ khoj-server-1 | │ │ khoj-server-1 | │ /app/src/khoj/processor/content/notion/no │ khoj-server-1 | │ tion_to_entries.py:247 in │ khoj-server-1 | │ update_entries_with_ids │ khoj-server-1 | │ │ khoj-server-1 | │ 244 │ def update_entries_with_ids(sel │ khoj-server-1 | │ 245 │ │ # Identify, mark and merge │ khoj-server-1 | │ 246 │ │ with timer("Identify new or │ khoj-server-1 | │ ❱ 247 │ │ │ num_new_embeddings, num │ khoj-server-1 | │ 248 │ │ │ │ current_entries, │ khoj-server-1 | │ 249 │ │ │ │ DbEntry.EntryType.N │ khoj-server-1 | │ 250 │ │ │ │ DbEntry.EntrySource │ khoj-server-1 | │ │ khoj-server-1 | │ /app/src/khoj/processor/content/text_to_e │ khoj-server-1 | │ ntries.py:141 in updateembeddings │ khoj-server-1 | │ │ khoj-server-1 | │ 138 │ │ │ │ │ │ │ corpus │ khoj-server-1 | │ 139 │ │ │ │ │ │ ) │ khoj-server-1 | │ 140 │ │ │ │ │ ) │ khoj-server-1 | │ ❱ 141 │ │ │ │ added_entries += Db │ khoj-server-1 | │ 142 │ │ │ logger.debug(f"Added {l │ khoj-server-1 | │ 143 │ │ │ khoj-server-1 | │ 144 │ │ new_dates = [] │ khoj-server-1 | │ │ khoj-server-1 | │ /usr/local/lib/python3.10/dist-packages/d │ khoj-server-1 | │ jango/db/models/manager.py:87 in │ khoj-server-1 | │ manager_method │ khoj-server-1 | │ │ khoj-server-1 | │ 84 │ │ def create_method(name, met │ khoj-server-1 | │ 85 │ │ │ @wraps(method) │ khoj-server-1 | │ 86 │ │ │ def manager_method(self │ khoj-server-1 | │ ❱ 87 │ │ │ │ return getattr(self │ khoj-server-1 | │ 88 │ │ │ │ khoj-server-1 | │ 89 │ │ │ return manager_method │ khoj-server-1 | │ 90 │ khoj-server-1 | │ │ khoj-server-1 | │ /usr/local/lib/python3.10/dist-packages/d │ khoj-server-1 | │ jango/db/models/query.py:803 in │ khoj-server-1 | │ bulk_create │ khoj-server-1 | │ │ khoj-server-1 | │ 800 │ │ │ │ │ obj_with_pk._s │ khoj-server-1 | │ 801 │ │ │ if objs_without_pk: │ khoj-server-1 | │ 802 │ │ │ │ fields = [f for f │ khoj-server-1 | │ ❱ 803 │ │ │ │ returned_columns = │ khoj-server-1 | │ 804 │ │ │ │ │ objs_without_p │ khoj-server-1 | │ 805 │ │ │ │ │ fields, │ khoj-server-1 | │ 806 │ │ │ │ │ batch_size, │ khoj-server-1 | │ │ khoj-server-1 | │ /usr/local/lib/python3.10/dist-packages/d │ khoj-server-1 | │ jango/db/models/query.py:1831 in │ khoj-server-1 | │ _batched_insert │ khoj-server-1 | │ │ khoj-server-1 | │ 1828 │ │ for item in [objs[i : i + │ khoj-server-1 | │ 1829 │ │ │ if bulkreturn and on │ khoj-server-1 | │ 1830 │ │ │ │ inserted_rows.exte │ khoj-server-1 | │ ❱ 1831 │ │ │ │ │ self._insert( │ khoj-server-1 | │ 1832 │ │ │ │ │ │ item, │ khoj-server-1 | │ 1833 │ │ │ │ │ │ fields=fie │ khoj-server-1 | │ 1834 │ │ │ │ │ │ using=self │ khoj-server-1 | │ │ khoj-server-1 | │ /usr/local/lib/python3.10/dist-packages/d │ khoj-server-1 | │ jango/db/models/query.py:1805 in _insert │ khoj-server-1 | │ │ khoj-server-1 | │ 1802 │ │ │ unique_fields=unique_f │ khoj-server-1 | │ 1803 │ │ ) │ khoj-server-1 | │ 1804 │ │ query.insert_values(fields │ khoj-server-1 | │ ❱ 1805 │ │ return query.get_compiler( │ khoj-server-1 | │ 1806 │ │ khoj-server-1 | │ 1807 │ _insert.alters_data = True │ khoj-server-1 | │ 1808 │ _insert.queryset_only = False │ khoj-server-1 | │ │ khoj-server-1 | │ /usr/local/lib/python3.10/dist-packages/d │ khoj-server-1 | │ jango/db/models/sql/compiler.py:1821 in │ khoj-server-1 | │ execute_sql │ khoj-server-1 | │ │ khoj-server-1 | │ 1818 │ │ opts = self.query.get_meta │ khoj-server-1 | │ 1819 │ │ self.returningfields = re │ khoj-server-1 | │ 1820 │ │ with self.connection.curso │ khoj-server-1 | │ ❱ 1821 │ │ │ for sql, params in sel │ khoj-server-1 | │ 1822 │ │ │ │ cursor.execute(sql │ khoj-server-1 | │ 1823 │ │ │ if not self.returning │ khoj-server-1 | │ 1824 │ │ │ │ return [] │ khoj-server-1 | │ │ khoj-server-1 | │ /usr/local/lib/python3.10/dist-packages/d │ khoj-server-1 | │ jango/db/models/sql/compiler.py:1745 in │ khoj-server-1 | │ as_sql │ khoj-server-1 | │ │ khoj-server-1 | │ 1742 │ │ result.append("(%s)" % ", │ khoj-server-1 | │ 1743 │ │ │ khoj-server-1 | │ 1744 │ │ if self.query.fields: │ khoj-server-1 | │ ❱ 1745 │ │ │ value_rows = [ │ khoj-server-1 | │ 1746 │ │ │ │ [ │ khoj-server-1 | │ 1747 │ │ │ │ │ self.prepare_v │ khoj-server-1 | │ 1748 │ │ │ │ │ for field in f │ khoj-server-1 | │ │ khoj-server-1 | │ /usr/local/lib/python3.10/dist-packages/d │ khoj-server-1 | │ jango/db/models/sql/compiler.py:1746 in │ khoj-server-1 | │ │ khoj-server-1 | │ │ khoj-server-1 | │ 1743 │ │ │ khoj-server-1 | │ 1744 │ │ if self.query.fields: │ khoj-server-1 | │ 1745 │ │ │ value_rows = [ │ khoj-server-1 | │ ❱ 1746 │ │ │ │ [ │ khoj-server-1 | │ 1747 │ │ │ │ │ self.prepare_v │ khoj-server-1 | │ 1748 │ │ │ │ │ for field in f │ khoj-server-1 | │ 1749 │ │ │ │ ] │ khoj-server-1 | │ │ khoj-server-1 | │ /usr/local/lib/python3.10/dist-packages/d │ khoj-server-1 | │ jango/db/models/sql/compiler.py:1747 in │ khoj-server-1 | │ │ khoj-server-1 | │ │ khoj-server-1 | │ 1744 │ │ if self.query.fields: │ khoj-server-1 | │ 1745 │ │ │ value_rows = [ │ khoj-server-1 | │ 1746 │ │ │ │ [ │ khoj-server-1 | │ ❱ 1747 │ │ │ │ │ self.prepare_v │ khoj-server-1 | │ 1748 │ │ │ │ │ for field in f │ khoj-server-1 | │ 1749 │ │ │ │ ] │ khoj-server-1 | │ 1750 │ │ │ │ for obj in self.qu │ khoj-server-1 | │ │ khoj-server-1 | │ /usr/local/lib/python3.10/dist-packages/d │ khoj-server-1 | │ jango/db/models/sql/compiler.py:1686 in │ khoj-server-1 | │ prepare_value │ khoj-server-1 | │ │ khoj-server-1 | │ 1683 │ │ │ │ │ "Window expres │ khoj-server-1 | │ 1684 │ │ │ │ │ % (field.name, │ khoj-server-1 | │ 1685 │ │ │ │ ) │ khoj-server-1 | │ ❱ 1686 │ │ return field.get_db_prep_s │ khoj-server-1 | │ 1687 │ │ khoj-server-1 | │ 1688 │ def pre_save_val(self, field, │ khoj-server-1 | │ 1689 │ │ """ │ khoj-server-1 | │ │ khoj-server-1 | │ /usr/local/lib/python3.10/dist-packages/d │ khoj-server-1 | │ jango/db/models/fields/init.py:954 in │ khoj-server-1 | │ get_db_prep_save │ khoj-server-1 | │ │ khoj-server-1 | │ 951 │ │ """Return field's value pr │ khoj-server-1 | │ 952 │ │ if hasattr(value, "as_sql" │ khoj-server-1 | │ 953 │ │ │ return value │ khoj-server-1 | │ ❱ 954 │ │ return self.get_db_prep_va │ khoj-server-1 | │ 955 │ │ khoj-server-1 | │ 956 │ def has_default(self): │ khoj-server-1 | │ 957 │ │ """Return a boolean of whe │ khoj-server-1 | │ │ khoj-server-1 | │ /usr/local/lib/python3.10/dist-packages/d │ khoj-server-1 | │ jango/db/models/fields/init.py:2678 │ khoj-server-1 | │ in get_db_prep_value │ khoj-server-1 | │ │ khoj-server-1 | │ 2675 │ │ if value is None: │ khoj-server-1 | │ 2676 │ │ │ return None │ khoj-server-1 | │ 2677 │ │ if not isinstance(value, u │ khoj-server-1 | │ ❱ 2678 │ │ │ value = self.to_python │ khoj-server-1 | │ 2679 │ │ │ khoj-server-1 | │ 2680 │ │ if connection.features.has │ khoj-server-1 | │ 2681 │ │ │ return value │ khoj-server-1 | │ │ khoj-server-1 | │ /usr/local/lib/python3.10/dist-packages/d │ khoj-server-1 | │ jango/db/models/fields/init.py:2690 │ khoj-server-1 | │ in to_python │ khoj-server-1 | │ │ khoj-server-1 | │ 2687 │ │ │ try: │ khoj-server-1 | │ 2688 │ │ │ │ return uuid.UUID(* │ khoj-server-1 | │ 2689 │ │ │ except (AttributeError │ khoj-server-1 | │ ❱ 2690 │ │ │ │ raise exceptions.V │ khoj-server-1 | │ 2691 │ │ │ │ │ self.error_mes │ khoj-server-1 | │ 2692 │ │ │ │ │ code="invalid" │ khoj-server-1 | │ 2693 │ │ │ │ │ params={"value │ khoj-server-1 | ╰───────────────────────────────────────────╯ khoj-server-1 | ValidationError: ['“None” is not a valid khoj-server-1 | UUID.'] khoj-server-1 | [21:00:37] ERROR 🚨 Failed to update server via API: Failed to api.py:204 khoj-server-1 | update content index khoj-server-1 | ╭────── Traceback (most recent call last) ──────╮ khoj-server-1 | │ /app/src/khoj/routers/api.py:201 in update │ khoj-server-1 | │ │ khoj-server-1 | │ 198 │ │ logger.warning(error_msg) │ khoj-server-1 | │ 199 │ │ raise HTTPException(status_code │ khoj-server-1 | │ 200 │ try: │ khoj-server-1 | │ ❱ 201 │ │ configure_server(state.config, │ khoj-server-1 | │ 202 │ except Exception as e: │ khoj-server-1 | │ 203 │ │ error_msg = f"🚨 Failed to upda │ khoj-server-1 | │ 204 │ │ logger.error(error_msg, exc_inf │ khoj-server-1 | │ │ khoj-server-1 | │ /app/src/khoj/configure.py:228 in │ khoj-server-1 | │ configure_server │ khoj-server-1 | │ │ khoj-server-1 | │ 225 │ │ state.search_models = configure │ khoj-server-1 | │ state.config.search_type) │ khoj-server-1 | │ 226 │ │ initialize_content(regenerate, │ khoj-server-1 | │ 227 │ except Exception as e: │ khoj-server-1 | │ ❱ 228 │ │ raise e │ khoj-server-1 | │ 229 │ khoj-server-1 | │ 230 │ khoj-server-1 | │ 231 def initialize_content(regenerate: bool │ khoj-server-1 | │ init=False, user: KhojUser = None): │ khoj-server-1 | │ │ khoj-server-1 | │ /app/src/khoj/configure.py:226 in │ khoj-server-1 | │ configure_server │ khoj-server-1 | │ │ khoj-server-1 | │ 223 │ │ │ khoj-server-1 | │ 224 │ │ state.SearchType = configure_se │ khoj-server-1 | │ 225 │ │ state.search_models = configure │ khoj-server-1 | │ state.config.search_type) │ khoj-server-1 | │ ❱ 226 │ │ initialize_content(regenerate, │ khoj-server-1 | │ 227 │ except Exception as e: │ khoj-server-1 | │ 228 │ │ raise e │ khoj-server-1 | │ 229 │ khoj-server-1 | │ │ khoj-server-1 | │ /app/src/khoj/configure.py:253 in │ khoj-server-1 | │ initialize_content │ khoj-server-1 | │ │ khoj-server-1 | │ 250 │ │ │ │ if not status: │ khoj-server-1 | │ 251 │ │ │ │ │ raise RuntimeError( │ khoj-server-1 | │ 252 │ │ except Exception as e: │ khoj-server-1 | │ ❱ 253 │ │ │ raise e │ khoj-server-1 | │ 254 │ khoj-server-1 | │ 255 │ khoj-server-1 | │ 256 def configure_routes(app): │ khoj-server-1 | │ │ khoj-server-1 | │ /app/src/khoj/configure.py:251 in │ khoj-server-1 | │ initialize_content │ khoj-server-1 | │ │ khoj-server-1 | │ 248 │ │ │ │ │ user=user, │ khoj-server-1 | │ 249 │ │ │ │ ) │ khoj-server-1 | │ 250 │ │ │ │ if not status: │ khoj-server-1 | │ ❱ 251 │ │ │ │ │ raise RuntimeError( │ khoj-server-1 | │ 252 │ │ except Exception as e: │ khoj-server-1 | │ 253 │ │ │ raise e │ khoj-server-1 | │ 254 │ khoj-server-1 | ╰───────────────────────────────────────────────╯ khoj-server-1 | RuntimeError: Failed to update content index khoj-server-1 | [21:00:38] INFO 192.168.65.1:49636 - "GET h11_impl.py:431

danrthompson commented 6 months ago

let me know if there is any additional info i should provide

i gave the notion integration all permissions

danrthompson commented 6 months ago

added a print statement here:

    def update_entries_with_ids(self, current_entries, user: KhojUser = None):
        # Identify, mark and merge any new entries with previous entries
        print(current_entries)
        with timer("Identify new or updated entries", logger):
            num_new_embeddings, num_deleted_embeddings = self.update_embeddings(
                current_entries,
                DbEntry.EntryType.NOTION,
                DbEntry.EntrySource.NOTION,
                key="compiled",
                logger=logger,
                user=user,
            )

        return num_new_embeddings, num_deleted_embeddings

console output:

[{'raw': 'Hea\n\nTest\n', 'compiled': 'Hea\n\nTest\n', 'heading': 'Ysys', 'file': 'https://www.notion.so/Ysys-e8932da8e48b4228b069aede4b17bea5', 'corpus_id': 'None'}, {'raw': "\n<b>Hea</b>\n<a href='https://www.notion.so/a4341eac0f374c0f997302f6d0d89a03'>Untitled</a> ", 'compiled': "\n<b>Hea</b>\n<a href='https://www.notion.so/a4341eac0f374c0f997302f6d0d89a03'>Untitled</a> ", 'heading': 'Ysys', 'file': 'https://www.notion.so/Ysys-e8932da8e48b4228b069aede4b17bea5', 'corpus_id': 'None'}, {'raw': '\n<b>Hea</b>\nReminder: gauche', 'compiled': '\n<b>Hea</b>\nReminder: gauche', 'heading': 'Ysys', 'file': 'https://www.notion.so/Ysys-e8932da8e48b4228b069aede4b17bea5', 'corpus_id': 'None'}, {'raw': 'Testing!', 'compiled': 'Testing!', 'heading': 'Test', 'file': 'https://www.notion.so/Test-ae4b8b05af304efb9dfd72723fc3ea9e', 'corpus_id': 'None'}]

so the corpus id is None