Freature: Save episode ids BEFORE completion for previous_episode_uuids #1283
Description
The Problem
Lets say we have different knowledge events that happen in quick succession which are all related to each other becasue they are happening in a knowledge gathering process.
Right now the episodes that are supposed to be related might not have been indexed yet and are therefore not being able to get picked up to give related context even when available.
The Solution
pre save the minimal episodes info like the id, timestamp in the database and have it in a "waiting" state so later episode injestion can reference these in the previous_episode_uuids. This way, we are able to get strong linking between the episodes even when not all of it is processed yet.
This means, We can have a detection that if those relations have been all indexed, we are able to one more processing of it and have the full relations loaded and can therefore have the best understanding between these without needing to rely on embedding after the fact.
Disclaimer
I am not 100% if i understand the structure fully to have gotten this right, please let me know if my reqeust is BS or if it could actually help. I certainly need something simelar in my current project