Support for streaming SSE?

[hsearcy]

Hey all, I am loving the project and have been using it to run my little Rails webapp for a few months. I am currently building out some ai chat integration stuff and want to stream the response back (in this case from Perplexity)

This works fine locally just running with Puma, but once deployed the response doesn't display to the user until I finally close the response stream.

Anyone know if this is even doable in Lambda? The only info I can find from AWS on streaming responses in Lambda just references Node runtimes, so I'm at a loss.

[jeremiahlukus]

You should be able to use websockets in a lambda it’s a few more steps but it can be done. It might be expensive though so just keep that in mind. Pretty sure you Is this what you were asking?

https://aws.amazon.com/blogs/compute/announcing-websocket-apis-in-amazon-api-gateway/

[hsearcy]

No, I am actually looking for Server-Sent Events (SSE) support, which many LLM APIs support, so that I can have responses stream in progressively instead of having users staring at nothing while the entire response comes in.

I do have a different use case for wanting to broadcast turbo-stream updates with websockets, but that's much less important to me at the moment.

[jeremiahlukus]

I’ll have to look into this a bit more I’ve never use this so I’m pretty unfamiliar with what is available. I’m more than happy to add this feature if I can ha.

Do you have an example repo I could play with?

[hsearcy]

Here you go

A simple rails app that uses SSE to stream numbers back 😆