⚒️How to build a Knowledgebot
Last updated
Last updated
Building a Knowledge Bot is your first step towards creating an AI-powered assistant tailored to your specific needs. This process transforms your data and documents into an interactive, intelligent system that can answer questions, perform tasks, and support your team's daily operations.
Please note that not all steps are required for a quick bot setup. Specifically, steps 3, 4, 5, 6, and 9 are optional and delve deeper into the details. These steps can be configured at a later time if needed. For a quick bot setup, simply follow steps 0, 1, 2, 7, 8, and 10.
Go to your Workshop dashboard. Choose whether you want to build a Nexus or a Retriever. Then Click "Create +".
Here you will configure the bots you want to share with others in your organization.
Begin by giving your bot a unique and memorable name. This is how users will identify your bot. You can also upload an Avatar so your bot may also be identified visually.
Define your bot's core mission, writing style, and any context it should be aware of. Think of it like a brief job description that the bot will always consider in its responses. Use the default template or write your own instructions to customize the bot to fit your use case. For most business use cases, a simple and more generic prompt can perform better than long and complex descriptions.
This is the Initial instruction prompt we recommend:
Your task is to provide precise and relevant information. Your communication should be professional yet easy to understand. Your responses must be thorough and detailed, using professional formatting. Clarify Ambiguous or General Inquiries: Ask specific questions to gather additional context. If a query can have multiple interpretations or answers, ask the user for clarification. Inform Users About the Scope of Answers: Let users know that answers may not always be exhaustive, indicating that further research and verification might be necessary. Encourage users to consult the original documents in the reference if they wish to look up more information themselves, or they can ask follow-up questions for further assistance. Methodical Approach: Guide users through the answer to their question methodically. Clearly state the steps to be taken and, where possible, refer to specific sections, figures, and tables in the guidelines and forms. Your ultimate goal is to enhance the expertise and efficiency of users, enabling them to perform their tasks more effectively through quicker access to relevant information.
If you want the Knowledge Bot to behave in a more specific way and limit the scope of its tasks, we recommend to include more context in the instruction prompt, expanding on the default template:
Role/Context: Provide the bot with your unique business context and needs.
e.g. "You are assisting the tech staff with internal IT support."
Task: Describe the bot's main functionality in a concise way.
e.g. "Provide factual responses and step-by-step guides using the provided knowledge base."
For most use cases where the bot's responses are based on a typical knowledge base, the default prompt does not need to be changed.
Tonality: Tailor the writing style to your use case and user group.
e.g. "You write in a professional, yet easy to understand tone. Your answers are very precise and brief. You use professional formatting, like headlines, sub-headlines, bold, italic, underline, or numbering."
Note: When the bot's main purpose it to create content in a certain tone, it is advisable to upload branding guidelines and past content pieces into a knowledge base or into the context as references to teach the bot the required writing style.
e.g. "You write in the same style and tonality as the documents provided by the user."
Guidelines: It is recommended to set guidelines that minimizes the likelihood of hallucinations.
e.g. "Do not make up an answer when you cannot offer a factual answer based on your knowledge base. Tell the user what information you are missing to respond."
The welcome message is your bot's first interaction with users and sets the tone for all future engagements. Navigate to Bot Settings to begin crafting your greeting. Your message should introduce your bot's purpose while outlining its key capabilities. Include clear instructions for getting started and set realistic expectations about what the bot can and cannot do. A well-crafted welcome message guides users naturally into their first interaction and helps them make the most of your bot's capabilities.
Pro Tip: Test your welcome message with new users to ensure it effectively guides them into their first interaction with your bot.
A clear and comprehensive bot description helps users understand your bot's capabilities and intended use. Navigate to Bot Settings to create or edit your bot's description. Your description should explain the bot's primary purpose, its area of expertise, and the types of tasks it can handle. This information appears in your bot's profile and helps users decide if this bot matches their needs. Keep the description concise but informative, focusing on practical use cases and specific features that set your bot apart.
Note: A well-written description can significantly improve user engagement and ensure appropriate use of your bot.
Conversation starters and follow-up questions help guide users through meaningful interactions with your bot. Navigate to Bot Settings > Conversation Design to configure these elements.
Conversation starters are pre-defined questions or prompts that users can click to begin their interaction. Create starters that showcase your bot's key capabilities and common use cases. These appear as clickable suggestions when users first engage with your bot, eliminating the guesswork of how to begin.
Follow-up questions maintain conversation flow and deepen user engagement. These dynamic suggestions appear after your bot's responses, encouraging users to explore related topics or get more detailed information. Design follow-ups that naturally extend from previous answers and guide users toward valuable insights.
Pro Tip: Regularly review and update your conversation starters and follow-ups based on actual user interactions and feedback.
Configure your bot's voice output by enabling OpenAI's text-to-speech capability. Select from a range of pre-defined voices and use the sample playback feature to find the perfect voice for your bot's personality and purpose.
Enable voice command functionality to allow natural spoken interactions with your bot. Users can speak their queries directly, creating a more intuitive and accessible experience.
Enhance your bot's visual capabilities with Smart Image Recognition and Image Retrieval features. These are crucial when working with image-based content in your databases and documents, allowing your bot to understand and reference visual information effectively.
The Inline Citations toggle determines how your bot references its sources. When enabled, it seamlessly integrates source citations directly within responses, providing transparency and credibility to your bot's answers.
Index Search Traditional full-text search provides precise matching for straightforward queries. This method excels at finding exact matches within your content.
AI Search Semantic search capabilities enable your bot to understand context and meaning beyond exact word matches. This method is particularly effective for complex, nuanced queries
Hybrid Search A sophisticated combination of full-text and semantic search, offering the best of both worlds. This method balances precise matching with contextual understanding, making it ideal for diverse use cases.
Note: Choose your search method based on your specific needs - Index Search for precision, AI Search for context understanding, or Hybrid Search for versatile applications.
Choose from a variety of leading Language Learning Models (LLMs) from providers including Azure, Vertex, OpenAI, and Anthropic. Each model differs in key aspects:
Context window size
Response quality
Performance
Cost efficiency
Hosting location
Specialized capabilities
Select your preferred model with a simple click based on your specific requirements.
Fine-tune your bot's behavior with these essential parameters:
Controls the balance between creativity and consistency:
Higher values: More creative, varied, but less predictable responses
Lower values: More factual and consistent outputs
Adjusts the breadth of language used:
Higher values: More diverse vocabulary, potentially less relevant
Lower values: More focused vocabulary, higher relevance
Manages the introduction of new ideas:
Higher values: More varied topics and fresh perspectives
Lower values: More focused discussion, higher coherence
Controls vocabulary repetition:
Higher values: Broader word choice, fewer repetitions
Lower values: More familiar vocabulary, consistent terminology
Defines the range of information considered:
Higher values: Broader document search, more comprehensive but potentially less precise
Lower values: Focused search, higher relevance but narrower context
Note: Adjust these parameters based on your specific use case and desired bot behavior.
To train the bot on your business context and use case, you'll need to equip it with relevant documents. Connect your bot to existing databases or create new knowledge bases to enhance its capabilities. Access this feature through the Database tab in your bot settings.
View a complete list of available databases on your instance. Simply click on any database to connect it to your bot.
Click the "Create Database" button in the top right corner
Enter the required information:
Database name
Description
Embedding Model selection
Access Advanced Settings via the button in the bottom left - don't miss this crucial step!
Configure additional parameters:
Access Settings (Private/Public)
Character Chunk Size
Chunk Overlap
Smart Table Processing
Smart Image Processing
Note: Enable Smart Table and Image Processing if your database contains tables or images that need analysis.
The Agents tab provides access to your Agent Library, where you can browse and manage pre-configured agents for various tasks. On the left side, you'll find different categories to explore, while the right side displays available agents within each category. Each agent includes a detailed description of its category and specific tasks it can perform.
Within the Source tab, you have complete control over your agents. Edit prompts to customize behavior, delete unused agents, or mark frequently used ones as favorites. Adding an agent to your bot is straightforward - simply click the plus icon next to the desired agent, and it will appear under the Selected tab, automatically integrating with your bot.
Create new agents using the "Add Agent Task" buttons in the top-right corner, allowing you to build custom solutions for your specific needs. Under Instructions you should give a detailed explanation of what you want the agent to do.
Start by clicking the New Workflow button on the left side. Access workflow settings through the three-dot menu in the top-right corner of the New Workflow box, where you can edit the title and description of your automation sequence.
The right window displays your workflow steps as individual tabs. Add new steps using the plus icon and arrange them in your preferred order using drag and drop functionality. For each step, configure the name, instructions (prompt), and select the specific LLM model to be used.
Choose between two execution modes for your workflow: 1. Autopilot Mode
Fully automated execution
Runs through all steps without interruption
Best for standardized processes
Maximum efficiency
Human-in-the-Loop Mode
Requires manual approval between steps
Offers greater control over the process
Can be configured globally or per step
Ideal for sensitive tasks requiring oversight
Note: Workflows transform individual agents into powerful automated sequences, enabling complex task completion with minimal user intervention.
After configuring your bot, it's crucial to save your settings to ensure all customizations are preserved. To do this, simply click the Save button. This action will securely store all the changes you've made, safeguarding your bot's setup. In the Sharing Preferences you can also select your Bot to be Private or Public. If you turn this feature on, all your coworkers will be able to use this bot as well.
