On: Creating a search engine with PostgreSQL

[lyu07282]

you can also just use a CDC to import from Postgres into Kafka using Debezium and then on the other end Kafka Connect to write into Elasticsearch, no need to write any code at all with this setup ymmv ofc

[paulryanrogers → lyu07282]

Sounds like a lot of moving parts though, unless the team is already familiar with maintaining all those parts

[lyu07282 → paulryanrogers]

if you already use Kafka anyway its a valid solution, I wouldn't introduce Kafka for this obviously. Also Kafka Connect and Debezium are mature well maintained open source projects in case that wasn't clear enough.

https://debezium.io/

https://docs.confluent.io/platform/current/connect/index.htm...