Chat template with Aspire loses ingestion state on every app restart

[SteveSandersonMS]

Because it's using Aspire's SQLite hosting:

var ingestionCache = builder.AddSqlite("ingestionCache");

... it makes up a new random filename for the ingestion cache DB on every restart, and hence always has to re-ingest the content. This means that ingestion doesn't work as an incremental process as designed.

Ideally we'll remove the ingestion cache entirely in the next update, but if we can't, we should definitely fix this (e.g., by doing builder.AddSqlite("ingestionCache", builder.AppHostDirectory, "ingestionCache.sqlite")).

[davidfowl]

Maybe worthwhile changing this behavior https://github.com/CommunityToolkit/Aspire/blob/d628ab35b67437c3dbbf7d4ef8498c31e2fa38c1/src/CommunityToolkit.Aspire.Hosting.Sqlite/SqliteResourceBuilderExtensions.cs#L25

@aaronpowell ?

orrr use postgres?

[jongalloway]

or use postgres?

Currently there's a split that's kind of awkward. For local dev, sqlite is quick and easy assuming this issue is fixed and the user doesn't select .NET Aspire. sqlite won't work for .NET Aspire deployment super simple if .NET Aspire is selected. If the template could assume .NET Aspire, postgres is better all around since it's a real database that works with .NET Aspire deployment to ACA.

[aaronpowell]

Maybe worthwhile changing this behavior https://github.com/CommunityToolkit/Aspire/blob/d628ab35b67437c3dbbf7d4ef8498c31e2fa38c1/src/CommunityToolkit.Aspire.Hosting.Sqlite/SqliteResourceBuilderExtensions.cs#L25

@aaronpowell ?

orrr use postgres?

The behaviour was designed to mimic how other database engines work by default, where the data isn't persisted between app host restarts, and if you want persistence you would provide a folder + filename for the database.

[SteveSandersonMS]

We don't need anything changed in Aspire to fix this - the issue here is proposing to change the AI Web Chat template code to set the file path. Also as mentioned above we intend to remove the sqlite dependency entirely from the Aspire version of this template very soon.

There will also continue to be a non-Aspire version that does use Sqlite, but that's not affected by this issue.