How does Odyssey AI pretrain/finetune and sync its domain-specific private langugage model?

How does Odyssey AI pretrain/finetune and sync its domain-specific private langugage model?

For security and privacy, each instance of Odyssey AI includes its own privately hosted Language Model (e.g. Llama3). The language model used by default can be changed upon request at an additional cost by the owner of the Odyssey AI instance.

Fine-tuning/Pre-train
We currently do not fine-tune an LLM. We use them as is. Fine-tuning an LLM is possible, this will result in a domain-specific private LLM(s) for Odyssey AI. But this requires compute resources and periodic re-training of the fine-tuning to ensure that it remains relevant to the changing domain-specific data. This is an expensive proposition for a private LLM.
For large enterprise customers this option can be offered for additional fees.

Sync of new data within Odyssey AI
Odyssey AI implements Active Learning using topic models. The process of ingesting a document/data into Odyssey AI involves extracting the data from the data-source using our proprietary DocuTableAI algorithm, learn the topics using the Topic Model(s) and then using another proprietary algorithm InteliCompress to dynamically chunk the data and retain what is important and discard noise. This is done for every document or file that is ingested into Odyssey AI. So, when a new file or document is added to the data-sources integrated with Odyssey AI, the ingestion process is automatically trigged to synchronize the newly added data into the existing vectorized data within Odyssey AI.

    • Related Articles

    • Release Notes December 2024

      Odyssey AI launches AgenFrame™ and Agentic XAI™ to detect latent insights from your data The Agentic AI layer in Odyssey AI now uses the following to provide even better contextually relevant responses to your questions: AI Reasoning Autonomous ...
    • What kind of results can I expect from using Odyssey AI?

      With Odyssey AI, you can expect: Private and secure usage of your data Domain-specific insights tailored to your organization Precise, zero-hallucination responses Ability to fact-check with source snippets
    • How do I get started with Odyssey AI?

      Getting started with Odyssey AI is quick and easy: Sign up for your free trial Connect your data sources Start gaining unlimited insights from all your data Get started here: https://www.inteligems.io/odyssey-ai-pricing
    • What types of data can I use with Odyssey AI?

      Odyssey AI supports the following data types: Unstructured data: Audio Video Images PDF documents CSV Database JSON
    • How does Odyssey AI ensure the security and privacy of my data?

      Odyssey AI ensures data security and privacy by: Creating a separate instance of Odyssey AI which contains the representation of your data. This instance is for your organization and is not shared with any other organization. Your users access this ...