GenAI Stack Script
Intro :
Introducing, NStarX’s Gen AI Stack, an enterprise-grade, open source based solution that
accelerates Generative AI adoption in your organization.
The stack contains 3 layers:
Platform layer: A fully containerized, secure, scalable, and configurable platform that allows you
select from a wide range of language models, vector databases, embedding models etc. to your
specific business needs.
Microservices Layer: Using available open source solutions, we have pre-built a set of
microservices that can be easily consumed by your specific use case. Example: you can select Text-
to-Speech microservice to build your multi-modal chatbot.
User Experience Layer: Finally the stack allows you to build user experiences that can be tailored
to your specific use case or workflow requirements
The GenAI stack is platform agnostic allowing you to deploy the solution either on-premise or
across any of the cloud platforms. In addition we
<< Use platform architecture image in this section, Shantanu can create some better quality
visuals based on diagrams that we already have >>
Uniqueness:
So, what makes the Gen AI Stack truly unique?
NStarX’s GenAI stack helps you to rapidly prototype and deploy use cases. You no longer need to
spend a lot of time engineering the platform by glueing together a lot of components. We have done
the hard work for you. Using our GenAI stack, you can prototype use cases in 2-6 weeks, and go
live within 8-12 weeks. Our GenAI Stack allows you to:
Reduces your internal engineering effort
Accelerates you time-to-value
Hide the complexities from end-users through intuitive User Experience thereby increasing
adoption within you user community.
We do this keeping in mind your security requirements:
1. Access Control: The solution can be integrated with your Identity and Access Management
solution so you don’t need to worry about who has access to your systems.
2. Data security: Your sensitive information stays protected, ensuring compliance and peace
of mind.
3. Local Inferencing: Your Language models stays within your infrastructure, delivering
faster results while maintaining complete control over your data.
<< Use a use case workflow image in this section, Shantanu can create some better quality
visuals based on diagrams that we already have >>
Pre-Built GenAI Use Case Patterns:
We have prebuilt the standard use case patterns that can be customized for you needs. We continue
to add to the patterns regularly. Here are some example:
RAG:
The RAG pattern allows powerful capabilities, including the integration of custom contextual
information using your own data, real-time document retrieval, configurable hyperparameter tuning,
and the flexibility to choose from multiple embedding and inference models.
Chatbot:
The Chatbot pattern supports dual input and output modalities of text and voice, and features a
customizable persona and accent selection feature that allows you to give the chatbot a personality.
Report:
The Report pattern allows you to combine data from structured sources with unstructured data to
build reports in both summarized and detailed form.
There are many other patterns that are part of the GenAI Stack, and we are constantly adding new
patterns.
<< Use screen shots from GenAI Hub>>
In Summary:
So, how does this benefit you? By using NStarX’s GenAI Stack you:
Accelerates you time-to-value of your GenAI initiatives
Reduces your internal engineering effort
Build engaging User Experience thereby increasing adoption within you user community.
In a secure environment keeping sensitive information under your control. Additionally our stack
offers the flexibility to adapt to a variety of business scenarios, ensuring that the system can meet
the unique needs of your organization.