Crafting your own RAG system: Leveraging 30+ LLMs for enhanced performance
Conference (INTERMEDIATE level)
Room 3 - Alexandros
In this talk you'll learn how to set up a RAG (Retrieval-Augmented Generation) system against 30+ different Large Language Models using Java. I'll show you step-by-step how to ingest documents, choose the best text splitter strategies, find similar documents, answer questions, and create a chatbot. Then, we’ll see how to test and compare different AI models, both from open sources and private ones, and whether they are stored on your own computer or accessed online.
You'll walk away knowing how to setup a well balanced RAG system using Java and the best performing and/or cheapest LLM.
You'll walk away knowing how to setup a well balanced RAG system using Java and the best performing and/or cheapest LLM.
Stephan Janssen
Devoxx
As an organizer of Devoxx Belgium, I am passionate about conducting research and development (R&D) that leads to new features in Devoxx-related applications like the CFP web app, Devoxx Genie IDEA plugin and Rag Genie. In recent years, I have been exploring and experimenting with cutting-edge technologies such as large language models (LLMs), convolutional neural networks (CNNs), and of course keeping track of the different Java language releases.