davidmezzetti
davidmezzetti OP t1_ja34bm6 wrote
Reply to comment by SatoshiNotMe in [P] Introducing txtchat, next-generation conversational search and workflows by davidmezzetti
Thanks, appreciate it. Not much I can do with down votes unless someone provides their rationale, which no one ever does.
davidmezzetti OP t1_ja345mn wrote
Reply to comment by dancingnightly in [P] Introducing txtchat, next-generation conversational search and workflows by davidmezzetti
Thank you.
This application is RAG with a local vector index combined with a LLM from the FLAN-T5 series of models.
The whole solution can be locally hosted with no remote runtime API dependencies.
davidmezzetti OP t1_j9y7tmq wrote
Reply to comment by visarga in [P] Introducing txtchat, next-generation conversational search and workflows by davidmezzetti
With the current version, yes it runs an embeddings query for each message. I plan to handle threaded conversations shortly. In that scenario, the chat history will be provided to the prompt.
davidmezzetti OP t1_ix3dmzx wrote
Reply to comment by fvonich in Semantic search made simple by davidmezzetti
Thanks, appreciate it.
davidmezzetti OP t1_ix3dm01 wrote
Reply to comment by DangerousElement in Semantic search made simple by davidmezzetti
Great!
davidmezzetti OP t1_iwzn0fv wrote
Reply to comment by iceytomatoes in Semantic search made simple by davidmezzetti
Thanks, glad you like it.
davidmezzetti OP t1_ja44q0n wrote
Reply to comment by SatoshiNotMe in [P] Introducing txtchat, next-generation conversational search and workflows by davidmezzetti
Yes, the HN "chat" approach would work. There is a section in the README covering this. https://github.com/neuml/txtchat#connect-your-own-data
You would need to extract those comments and then load them into an Embeddings index.