I don’t see mention of pi. Does anyone whether it works? I am going to check out.

Yup https://github.com/docker/sbx-kits-contrib/tree/main/pi https://docs.docker.com/ai/sandboxes/customize/kits/

Reads like an add to Omnigent or whatever harness (wait it’s meta harness?.

Is that the core/tech behind Kitesurf?

TL;DR

Initial bet didn’t work out and it also became irrelevant.

Company is focusing on computer for agents. Founder CEO replaced with a new CEO.

Building https://github.com/viggy28/streambed - a full Postgres running on S3 using DuckDB as the query engine.

Certainly interested.

Agree. Appreciate the reminder.

Tomas Vondra, a major Postgres contributor recently revived a thread on using Bloom filters - https://www.postgresql.org/message-id/flat/5cd8c20c-14b5-4b0...

So there is more core work happening on support OLAP but I do think it will take some time.

In the meantime, I think we have all the pieces (storage, query engine, table format) to set up a true OLAP. For instance, I created https://github.com/viggy28/streambed to pressure test this idea.

The challenge with any CDC is making it reliable. Curious, how are you exporting to S3? - Debezium or some service in AWS or home grown tool?

Currently, Strembed expects REPLICA IDENTITY FULL for getting the before and after value of TOAST column. Since we have the data in object storage, we could populate it without the need for REPLICA IDENTITY FULL. Created an issue https://github.com/viggy28/streambed/issues/25 to track this feature.