I have a couple questions about the default schema that the scraper creates. We've been using that to crawl a dozen or so static sites and its 'just worked' so I never really questioned it. We're looking at switching from text queries to vector searches. Is that schema just a 'good starting point' or are there special meanings for the various fields? In other words, is there some special meaning behind the scenes for

hierarchy.lvlN

? I'm wondering if I need all those other fields, or if I just need to store the vectors and url?

The schema is specifically required for the Docsearch UI library - it expects that format of data to render