Menu

Post image 1
Post image 2
Post image 3
Post image 4
Post image 5
Post image 6
Post image 7
Post image 8
Post image 9
Post image 10
Post image 11
1 / 11
0

LLM wiki for the historical research

DEV Community·szymon-szym·28 days ago
#M0guafzT
#ai#opensource#software#coding#wiki#model
Reading 0:00
15s threshold

Introduction I wouldn't call myself a historian, as I switched careers a long time ago, and my skills and knowledge have faded away. However, when I look at the current AI revolution changing for better or worse the software industry, I am wondering how historical studies will be impacted. Recently, I have been exploring the idea by Andrej Karpathy of creating a wiki as a knowledge base for LLMs. I thought it would be interesting to test this concept using the historical documents. Background When working with LLMs, one of the crucial parts is to provide them with the relevant context. Frontier models have incredible knowledge stored in their parameters, yet usually it is not enough to navigate through a specific domain. RAG is a set of techniques that are meant to solve this issue and provide LLM with relevant information as a context. It is a state-of-the-art strategy. The thing is that a lot of RAG systems are based on semantic searches, which should yield relevant documents.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.

Read More