Release notes

24.34 (latest)

Updates for the week of September 3, 2024

Build, deploy, & review

• When modifying digitization settings, the before-and-after preview now shows a heatmap overlay using a red-to-green gradient to represent OCR confidence for each word, as well as a summary confidence score for the entire document.

• A new derived field field type lets you generate values based on preceding fields in the class. For example, Identify the state in Customer address.

• In list extraction fields, the number of allowed attributes is increased from 10 to 30. In benchmark testing, result accuracy degrades with more than 10 attributes. If accuracy is critical, consider extracting attributes in multiple list extraction fields.

• In document reasoning fields, a new Enhance prompt option relies on the selected model to optimize your prompt, checking for clarity, concision, and coherence while eliminating contradictions and redundancies.

• In the Hub, you can now search for apps by app name.

• Resolved issue | Clicking a project name in the project sidebar caused classes to disappear from the editing panel.

• Resolved issue | In projects with tables and checkboxes enabled, app runs didn’t correctly and consistently highlight data source in documents.

24.32

Updates for the week of August 19, 2024

Build, deploy, & review

• File, class, and field limitations have been increased. You can now upload up to 500 files and create up to 250 classes per project, and each class may include up to 100 fields. The previous limit for files, classes, and fields was 50.

• Attachments included in email files (.eml) are now separated from the source file and treated as separate files. When uploading email files, any embedded attachments are automatically added to the project as well.

• You can now extract barcodes and their embedded values from a document. Both numeric and non-numeric barcode formats can be extracted.

• When generating results for fields, different field types are now processed in parallel instead of sequentially. In benchmark testing, this change cut processing time roughly in half.

• Document reasoning fields now assume the current date and time unless you specify otherwise in your prompt.

• For organization members, a new custom function field type lets you compute values or import third-party data directly to your project schema.

• Table and list field types with cleaning prompts now return partially cleaned results instead of no result when parts of the result can’t be cleaned.

• For organization members, error handling is improved in cases where renaming a field breaks a custom function reference. Now, you’re warned if you attempt to rename a referenced field, and projects with field reference errors display a warning icon at top right which links to error details.

• The default model is renamed to the standard model.

• Resolved issue | Tables extracted with the table data type erroneously reported 100 percent confidence. This value was hard-coded, rather than reflecting actual confidence. Now, tables more accurately report unknown confidence.

• Resolved issue | When generating results for fields, an error in a single field could cause all fields to error.

• Resolved issue | An out-of-memory error sometimes occurred when indexing Excel files.

• Resolved issue | Workspace managers couldn’t successfully close reviews.

Converse & chatbots

• Converse now automatically uses the best model for your query based on the number of documents in the message’s scope. Likewise, chatbots use the best model based on the number of documents in the chatbot’s knowledge base. Single document queries use the advanced model and multiple document queries use the multistep model.

  Regardless of the number of documents you’re querying, you can enable the new research mode toggle for any query. Research mode uses a more powerful variant of the multistep model and is suited for complex reasoning queries, but can result in longer execution times. Research mode follows the multistep model’s pricing.

• The standard model, previously called the default model, is no longer supported in the Converse user interface. The Conversations endpoint still supports the standard model and the advanced model, but not the multistep model or research mode.

• The new Chatbots API lets you send and retrieve chatbot queries asynchronously. A supporting guide is available to help integrate chatbot queries into your workflow.

• Attachments included in email files (.eml) are now separated from the source file and treated as separate files. When uploading email files, any embedded attachments are automatically uploaded as well.

• You can now extract barcodes and their embedded values from a document. Both numeric and non-numeric barcode formats can be extracted.

• When generating responses, models now assume the current date and time as a reference point unless you specify otherwise in your prompt.

Administration

• AI Hub’s unit consumption rates have been updated. For organization accounts, the updated rates take effect on the first billing cycle to begin after release 24.32 is available. Until the start of your organization’s next billing cycle, the previous rates apply, as outlined in the archived pricing policy. For community accounts, the updated rates take effect with the 24.32 release.

  It was previously announced that community accounts would receive the updated pricing upon their account’s migration to postpaid billing. The migration from prepaid to postpaid billing for community accounts is still planned but, to avoid delays in benefiting from our reduced rates, the updated rates have been implemented for all community accounts.

• You can now activate an AI Hub Commercial subscription yourself from the Subscription & Billing tab. Previously, to continue your organization’s AI Hub Commercial subscription after a free trial had ended, you needed to connect with AI Hub.

24.30

Updates for the week of August 5, 2024

Build, deploy, & review

• Classes and fields are now autosaved as you work, and the Save button is removed from the editing panel. For certain actions, such as adding descriptions to classes or fields, you can click Run to generate results.

• For organization users, OCR confidence scores are now available alongside field results, and you can establish OCR confidence validation rules.

• Processing improvements for extraction fields provide faster results. In benchmark testing, results were returned almost 50 percent faster.

• Processing improvements for document reasoning fields provide more accurate identification of tables and improve results overall when tables are enabled in digitization settings.

• Table headers are now identified more accurately when tables are enabled in digitization settings.

• Resolved issue | Custom functions encountered errors when returning bytes or non-JSON serializable objects.

Converse & chatbots

• Error messages for several categories of errors are improved. For example, streaming errors now communicate if the problem is arising from AI Hub or from your network connection.

• Processing improvements provide more accurate identification of tables and improve results overall when tables are enabled in digitization settings.

24.28

Updates for the week of July 22, 2024

Build, deploy, & review

• The file upload window is streamlined in this version, making it easier to drag and drop files.

• When you upload files, you now see a progress bar that represents actual upload progress across all files.

• The option to preview your app has been removed. Instead, create a new app or update an existing app, and use version controls to facilitate testing.

• For commercial and enterprise customers, when you change the class of a document in human review, you can now specify how the schema for the new class is applied. By default, the app reprocesses the document to identify field results for the new class. Reprocessing incurs usage charges at the same rates as regular app runs. To apply the schema for the new class without reprocessing, deselect Extract fields for the updated class.

• Resolved issue | Extracting table data types from CSV files resulted in extraction failed errors, because CSV files weren’t treated as tables by default.

• Resolved issue | In list data types with attributes, source data wasn’t highlighted consistently in documents.

• Resolved issue | The Run app with API code generated by the API runner tool used the incorrect endpoint and had a data type error in the request body.

• Resolved issue | The Run app with API button didn’t display for some apps.

Converse & chatbots

• The file upload window is streamlined in this version, making it easier to drag and drop files.

• In Converse, multiple document queries no longer support the advanced model. All multiple document queries use the multistep model.

• The AI Hub SDK’s conversations.converse function now supports the mode argument. The mode argument lets you specify the model to use to answer your question. Upgrade to the most recent version of the SDK, 0.3.0, by running pip install instabase-aihub --upgrade.

Administration

• In release 24.32, AI Hub will make several changes related to pricing, model support and selection, and billing. AI Hub release 24.32 is scheduled for release no earlier than August 19, 2024 and the current pricing policy remains in effect until then. The changes to pricing take effect on the first billing cycle to begin after 24.32 is available. For community accounts being migrated to postpaid billing, the changes to pricing take effect when the migration is complete, unless otherwise notified. Updates include:

  Pricing

  • Generally, rates are decreasing for all models and the rate cap is lowered. For example, the current rate cap for the Multistep model is 176 Units/query and the new cap will be 50 Units/query. See the updated rate tables for Converse, Chatbots, and Build and Build app runs.

  Model support and selection

  • The Default model is renamed to the Standard model.

  • Converse will automatically use the best model for your query based on the number of documents in the prompt’s scope. Likewise, chatbots will use the best model based on the number of documents in the chatbot’s knowledge base. Single document queries use the Advanced model and multiple document queries use the Multistep model.

  • Converse and chatbots will offer the ability to toggle Research mode for all queries. Research mode uses a more powerful variant of the Multistep model and is suited for complex reasoning prompts, but can result in longer execution times. Research mode follows the Multistep model’s pricing.

  • The Standard model will no longer be supported in the Converse user interface. The Conversations endpoint still supports the Standard model and the Advanced model, but not the Multistep model or Research mode.

  • There are no changes to model support and selection in Build or Build apps.

  Billing

  • Community accounts will begin migrating from prepaid to postpaid billing. Instead of purchasing consumption units before using them, all usage will be tracked and billed at the end of each month. If you have any prepurchased consumption units remaining after the migration, the value of those units will be applied to your next bill. You’ll be notified when your account has been migrated.

24.26

Updates for the week of July 8, 2024.

With this release, the AI Hub homepage has an updated design. The homepage now includes shortcuts to recently opened work, one-click project and chat creation, and, for organization members, a summary of deployments and review queues.

Build

• Resolved issue | In languages that use special characters, encoded information from email headers wasn’t correctly digitized.

Converse & chatbots

• When uploading files to a conversation, you now see a progress circle representing actual upload progress rather than a generic loading spinner.

• When creating or updating a chatbot, queries from your origin conversation are automatically imported to the sample prompts list. You can also edit the sample prompts list, including defining new prompts.

• Resolved issue | When using the AI Hub SDK, files couldn’t be added to existing conversations. SDK users, upgrade to the most recent version of the SDK, 0.2.1, by running pip install instabase-aihub --upgrade.

• Resolved issue | In languages that use special characters, encoded information from email headers wasn’t correctly digitized.

• Resolved issue | Excel files didn’t display correctly in Converse if they were uploaded as email attachments.

Administration

• Organization members can now access a shortcut to open a customer support ticket. Click the user initials icon, then select Support.

24.24

Updates for the week of June 24, 2024.

With this release, AI Hub is reorganized into Workspaces and the Hub. Workspaces provide an entry point to create apps or chatbots, and enable organization members to deploy apps and review runs. The Hub contains all apps you have access to, whether prebuilt, created by you, or shared within an organization.

AI Hub Enterprise

A new subscription-based enterprise offering is now available in AI Hub. AI Hub Enterprise is suitable for organizations with advanced requirements. Compare AI Hub subscription plans and reach out to Customer Support to learn more.

Updates for the week of June 10, 2024.

Build

• Enterprise customers can now request advanced apps to address complex use cases that aren’t natively supported in AI Hub. For more details, reach out to Customer Support.

• You can now configure deployments, which let you run apps at scale with automation, integration, and human review.

• Human review is now integrated into Workspaces and deployments. When a review-enabled deployment run fails a validation, all documents from the run are added to a review tab in Workspaces. Any member of a workspace can review documents, but only workspace managers can close reviews. Additionally, enterprise customers can specify service-level agreements for reviews as part of a deployment.

• The field type selector has been simplified. You can now select from a unified dropdown menu: text, table, or list extraction, or document reasoning.

• You can now add sample files to apps you create. Sample files enable users to preview app functionality. You can add sample files when you create an app, or from the App info page of a published app. Sample runs incur usage charges at the same rate as regular app runs.

• You can now run an app or deployment using APIs from within AI Hub using autogenerated code and integrated step-by-step guidance. Click Run with API from any app or deployment to access the API runner.

• The Run results endpoint supports additional query parameters. You can now include review and validation details in run results when running apps or deployments by API.

  As part of this update, the structure of the files/documents/fields parameter in the response has changed from a dictionary to a list. This change makes the response structure more coherent but is not backward compatible. SDK users, upgrade to the most recent version of the SDK, 0.2.0, by running pip install instabase-aihub --upgrade.

• Resolved issue | Classes in the document list and editing panel weren’t displayed in the same order.

• Resolved issue | When you edited the field name for an extraction field without a description, the Run button didn’t appear as intended.

• Resolved issue | Existing projects couldn’t be updated if they included class, field, or attribute descriptions that exceeded the 360-character limit introduced in 24.18. With this release, the character limit for descriptions is increased to 1,000 characters, but you’re warned that a description this long might result in a No value found result because the entire input isn’t conveyed to the model.

• Resolved issue | If custom functions couldn’t be resolved due to a renamed, moved, or deleted reference field, app generation failed with a generic error message. With this release, a more specific message appears with details about the unresolved reference.

Converse & chatbots

• You can now configure chatbot disclaimers, letting you append a disclaimer message to each chatbot response.

• When making multiple document queries, you can see which pages the multistep model referenced when developing its response. Each chat response includes a list of pages where relevant information was found and used. Provenance might not display if the model used general knowledge from its training to develop a response.

24.22

Updates for the week of June 10, 2024.

Build

• For commercial and enterprise customers, custom cleaning functions and custom validation functions provide improved error handling. Custom functions now return basic error messages instead of reporting misleading messages about failure or no value returned. Additionally, if a custom function results in any logs or errors, the logs panel opens automatically, and an alert icon displays for errors.

• Resolved issue | Existing projects couldn’t be updated if they included reasoning prompts that exceeded the 360-character limit introduced in 24.18. With this release, the character limit for reasoning prompts is increased to 1,000 characters, but you’re warned that a prompt this long might result in a No value found result because the entire input isn’t conveyed to the model.

• Resolved issue | When you clicked to edit a field, the document list switched to the first document in the class.

• Resolved issue | Editing custom functions, especially with many fields or validations, caused the custom function editor to lag and eventually freeze.

• Resolved issue | Custom cleaning functions, when applied to tables, returned a JSON string instead of a properly formatted table.

• Resolved issue | Apps generated successfully even if custom functions contained missing field references. With this release, app generation fails if custom functions can’t be resolved.

Converse

• Tables are now copied from responses in tab-separated values (TSV) format, which preserves table structure when pasted into spreadsheets. Downloaded tables are still in CSV format.

• Resolved issue | In some languages, .eml files were incorrectly digitized upon upload, with non-Latin characters being replaced by question marks.

• Resolved issue | Converse failed to extract all tables when querying across multiple documents.

Administration

• You can now update security credentials for connected drives. Previously, to update a drive’s credentials, the drive needed to be removed and reconnected.

24.20

Updates for the week of May 27, 2024.

Build

• You can now configure how documents are converted to machine-readable text with more fine-grained digitization settings. Additionally, commercial users can now process non-Latin languages such as Arabic, Bengali, Chinese Simplified, Chinese Traditional, Greek, Hebrew, Hindi, Japanese, Korean, Russian, Thai, and Urdu. For details, see Supported languages.

• You can now provide class descriptions to help the model better classify documents. If necessary, use the class editing panel to add a description that includes unique identifying details about a document class. For example, Documents include the phrase “Criteria for use”.

• When you add a field, you’re taken directly to the field editing panel so you can immediately edit your prompt.

• For enterprise users, confidence scores are now available for document classification results, and you can establish classification confidence validation rules.

• For commercial users, confidence scores are now available for reasoning prompts, and you can establish field confidence validation rules for reasoning prompts.

• For commercial users, validation prompts let you tell Build how you want to validate a field in your own words. Your prompt is used to generate a custom validation rule written in Python code.

• Resolved issue | In projects with many classes and documents, in the document list with classes grouped, you couldn’t expand or scroll through the last grouped class of documents.

• Resolved issue | When object detection was enabled, data source was incorrectly identified in certain documents.

• Resolved issue | Extracting all tables from Excel or CSV source documents in Russian provided faulty results.

Converse & chatbots

• Community users can now create chatbots and share them with others. Previously, chatbot creation was available only at the commercial tier.

• Resolved issue | When object detection was enabled, data source was incorrectly identified in certain documents.

• Resolved issue | When editing a conversation’s scope and selecting a single file, the currently displayed file would be used instead of the selected file.

Administration

• Commercial organizations can access and test preview features before they become generally available. Organization admins can enable preview features for their commercial organization.

• Object detection, such as for signatures, tables, and checkboxes, is more reliable during large batch runs.

24.18

Updates for the week of May 13, 2024.

Build

• Commercial users can fast-track project development by copying an existing project schema or importing prebuilt classes. These methods enable quickly adding classes and fields from another project in the organization, or from a library of established schemas.

• Commercial users can now opt to use an advanced model for individual fields. The advanced model tends to give more accurate and detailed results, and is better at handling dense or complex documents. The advanced model is charged at a higher unit cost, which is detailed in the updated pricing policy.

• In extraction prompts, the previously unnamed prompt field is now labeled Description and both field name and description are now sent to the model as a key:value pair, where previously only the prompt was sent. In internal testing, this processing change reduced No value found results while not significantly impacting accuracy; however, we recommend re-verifying the results of extraction fields with this release.

• You can now version apps and specify more robust app metadata, including adding unique icons. Additionally, you can create pre-production versions of apps, which remain accessible only to you. App versioning supports iterative development within a typical solution lifecycle, enabling you to refine and improve your app over time.

• Resolved issue | Inputs that exceeded certain lengths resulted in No value found results, because the entire input wasn’t conveyed to the model. With this release, character limits are enforced: 48 characters for field and attribute names and 360 characters for descriptions (field and attribute) and prompts (reasoning and cleaning).

• Resolved issue | In extraction fields with the list data type, results were inconsistent, especially in complex documents. Additionally, attributes with nested values weren’t formatted correctly.

• Resolved issue | The results table sometimes incorrectly showed documents in the wrong classes and showed intermittent Extraction failed errors while editing fields.

• Resolved issue | Validation rules were sorted alphabetically (1, 10, 11…) instead of numerically.

• Resolved issue | If you created a field but didn’t save it, validation functions had invalid arguments.

• Resolved issue | After uploading a new document to a project, validations sometimes failed immediately without completing the validation script.

• Resolved issue | The documented list of supported libraries available to use in custom functions was incorrect.

Converse & chatbots

• When you create a new chatbot, all prompts from the origin conversation are included by default. You can change this during creation.

• You can now interact with sample prompts in a chatbot from the chatbot page, instead of seeing them as part of chat history.

• The chat dialog in chatbots is now full page by default. To switch to a document view of the documents, with the chat on the side, click the document icon at the top of the chatbot page.

• The Create conversations endpoint is updated to make the org and workspace parameters optional. These values are now inferred from the IB-Context header value. Previously, commercial users needed to define these parameters to create a conversation in their commercial organization’s personal workspace.

• Resolved issue | The close button in the expanded table viewer overlapped with the download tooltip.

Administration

• AI Hub now charges for classification and split classification in Build and Build app runs. For commercial subscriptions, this change applies at the start of the next billing cycle to begin on or after May 13th, 2024.

• Chatbot usage is added as a category in your usage history. Previously, chatbot usage and Converse usage were grouped.

• Table extraction queries latency is improved.

• Resolved issue | An error was sometimes returned when digitizing documents with object detection when a table was identified but no words were associated with it.

24.16

Updates for the week of April 29, 2024.

Build

• Resolved issue | When uploading files, if you dropped files outside of the upload dialog, the files failed to upload.

• Resolved issue | In projects with 10 or more classes, documents were misclassified in the default other class under certain circumstances.

• Resolved issue | In tables, special symbols and numeric data in exponential format weren’t extracted correctly under certain circumstances.

• Resolved issue | When an app was run in production, source wasn’t highlighted within documents for fields with cleaning functions.

Converse

• Converse models can now remember your questions, so you can ask follow-up questions without providing the context each time.

• Resolved issue | Chatbots can now be shared by both creators and users.

• Resolved issue | When uploading files, if you dropped files outside of the upload dialog box, the files failed to upload.

• Resolved issue | In tables, special symbols and numeric data in exponential format weren’t extracted correctly under certain circumstances.

• Resolved issue | JSON wasn’t formatted correctly in extracted tables.

Administration

• An AI Hub Python SDK is now available. See the developer quickstart for how to install and set up the SDK.

• The App runs endpoint introduces a streamlined way to create an app run, check its status, and return app run results–actions which previously required three separate endpoints. The App runs endpoint is designed to work with the Batches endpoint, so you can pass a batch of files as input to your app run.

  The App runs endpoint replaces the Run apps, Job status, and Run results endpoints and is the preferred approach to running AI Hub apps by API. These legacy endpoints are deprecated but still supported.

• The Conversations endpoint introduces a simpler way to create a Converse conversation by API. This endpoint lets you create and manage conversations, including uploading and querying documents.

• Commercial organization admins can now view billing history from the Subscription & Billing tab on the settings page. From there, you can view past invoices and pay any outstanding invoices. Community users also see an updated view, where you can compare subscription offerings and sign up for a free trial of AI Hub Commercial.

24.14

Updates for the week of April 15, 2024.

Build

• You can now upload a much broader range of supported file types, including most text and code files. Additionally, Excel and CSV files are now uploaded and viewable in their native format.

• For custom functions, if your code execution environment is deprecated, you’re now prompted to update your environment and you can’t run the custom function until you update.

• Resolved issue | The revised order for reordered fields wasn’t reflected in app runs, and validation rules that referenced another field could break accordingly.

• Resolved issue | Creating or updating apps failed if the associated project included incomplete prompt-based validation rules. Now, you’re prevented from creating or updating apps until you fix or delete incomplete rules.

• Resolved issue | Custom validation functions with errors didn’t report failed validations when the associated app was run in production.

Converse

• You can now upload a much broader range of supported file types, including most text and code files. Additionally, Excel and CSV files are now uploaded and viewable in their native format.

• When you create a chatbot, the description field is now optional.

Administration

• The AI Hub pricing policy has been updated ahead of a scheduled pricing change. In release 24.18, AI Hub will begin charging for classification and split classification. The current Build and Build app runs pricing remains in effect until 24.18 is released.

24.12

Updates for the week of April 1, 2024.

Build

• Commercial users can now split multipage documents into appropriate classes by enabling document splitting in project settings.

• In extraction prompts, commercial users can now select text, list, or table data types, which helps Build return more accurate results. The list data type supports extracting multiple occurrences of an object along with attributes you specify.

• For commercial apps that include downstream integrations, if any document in a run fails validation, the run is now paused for review with the status Review required. After completing review, results are sent to downstream integrations.

• You can now reorder fields in the field editor using the up and down arrows that display when you hover over a field. Fields are displayed in processed results in the same order as in the field editor, so reordering fields can be helpful to speed up reviews or support downstream integrations. For commercial users, field order can also impact custom cleaning functions, which optionally reference preceding fields.

• Reasoning fields now highlight the general region within the document that information was gleaned from.

• Source data is more accurately identified for extraction prompts due to improved OCR token matching.

• When collaborating on a shared project, you can dismiss the banner indicating if you’re in edit or read mode.

• Resolved issue | If you accessed Build without logging in to AI Hub, you received the error, Unable to create project. With this release, you’re prompted to log in before accessing Build.

• Resolved issue | If you enabled object detection while documents were being digitized, the object detection setting wasn’t applied. With this release, the object detection setting is disabled during digitization.

• Resolved issue | Errors during document digitization caused the digitization job to hang indefinitely.

• Resolved issue | In the document list, if you applied filters with Group By: Class disabled, documents weren’t filtered appropriately.

• Resolved issue | In the document list, selecting a document in a different class didn’t consistently open the appropriate class in the editing panel.

• Resolved issue | Deleting a class that included validation rules resulted in “phantom” rules that threw off rule numbering.

• Resolved issue | Fields with cleaning actions, when an app was run in production, didn’t report confidence scores and failed any validations related to confidence threshold

• Resolved issue | Underscores in field names were replaced with double-underscores when an app was run in production.

Converse

• Resolved issue | Converse projects with names containing an ampersand (&) didn’t save correctly.

• Resolved issue | The conversation settings dialog was viewable by users who weren’t logged in.

• Resolved issue | Errors during document digitization caused the digitization job to hang indefinitely.

• Resolved issue | When running queries with the multistep model, the Show Steps button displayed briefly and then disappeared.

Administration

• Commercial organization admins can now disable the Instabase Drive to hide it from members’ view. The same limitations apply as when removing a drive.

• Usability and design improvements across AI Hub include:

  • Clearer messaging when creating a commercial organization, so you can better understand what your permanent organization ID will be.
  • Updated redirecting when you attempt to access a page that requires you to be logged in. Previously you might be redirected to the wrong login screen.

24.10

Updates for the week of March 18, 2024.

Build

• You can now dynamically view results across various contexts. The document table icon
  
  in the Documents header now represents the Results table. Clicking this icon displays results that correspond to the current view in the editing panel, so the results you see change depending on your current task.

• Table extraction is improved by more accurately interpreting prompts that request a table, and by better identifying a specific table among many.

• Resolved issue | If you deleted a file and re-uploaded a file with the same name, the document preview wasn’t updated without reloading.

Converse

• Table extraction is improved by more accurately interpreting prompts that request a table, and by better identifying a specific table among many.

• Resolved issue | If you deleted a file and re-uploaded a file with the same name, the document preview wasn’t updated without reloading.

• Resolved issue | Window resizing sometimes differed between a Converse project and a chatbot.

• Resolved issue | The Manage integrations button, which is used for AI Hub apps, has been removed from chatbots.

• Resolved issue | A display issue with long document lists in Converse has been fixed.

Administration

• The page definition section of the pricing policy is updated to:

  • Clarify how Logical Page Count is calculated for email and spreadsheet files.

  • Adjust how Logical Page Count is calculated for multi-threaded emails. Previously, only the longest thread in a multi-threaded email was included when calculating Logical Page Count, now all threads in a multi-threaded email are included.

• The Batches endpoint introduces a simpler way to upload and manage input files. A batch is a RESTful object that contains a user-defined list of files. Each batch has a unique batch ID that can be used as input for an API-based app run.

The Batches endpoint replaces the Filesystem endpoint as the preferred approach to API-based file operations. Specifying a file path as input for an API-based app run is still supported.

• You can now remove any drive you previously connected. Previously, you could only remove a Google Drive and restrict other types of connected drives.

• Usability and design improvements across AI Hub include:

• Clearer error messaging when attempting to upload an empty folder.

• Updates to the file picker, including file type icons, visual cues and tooltips when a file or folder isn’t supported, and the ability to resize columns.

• User icons now reflect first and last name initials.

• Commercial organization admins and workspace managers can add members to a shared workspace directly from My Hub. Admins can also now create a shared workspace directly from My Hub.

24.08

Updates for the week of March 4, 2024.

Build

• Commercial users can now configure downstream integrations, which automatically send results from app runs to an email address, connected drive, or any app or system indicated in a custom function. You can add one integration for each app.

• For commercial users, extraction confidence scores are improved in several ways:

  • Confidence scores are now based on log probabilities, which provide a mathematical measure of how likely a result is. In benchmark testing, this method results in similar accuracy as the previous method of asking the model to return confidence scores, but with seemingly fewer overconfident results.
  • Confidence scores are now supported for documents longer than 20 pages.

• When highlighting the source of extracted data in documents, results are now moderately more consistent and accurate, particularly in certain marginal cases.

• Resolved issue | When highlighting source data in a document, scrolling behavior was inconsistent.

• Resolved issue | In the document viewer, in files that contained pages of varying widths, some pages weren’t centered in the display.

• Resolved issue | In the document viewer, the page number from the previous document was sometimes displayed when you switched to a different document.

• Resolved issue | With the results table displayed, if you attempted to save field changes, the error Something went wrong appeared.

• Resolved issue | If you renamed a field that included a custom validation function, the field argument was removed from the function. With this fix, the field argument is automatically renamed to match the field name.

Converse

• For commercial users, you can now create and share a chatbot from any conversation in Converse. Upload a set of documents to act as a knowledge base, and anyone in your organization can query your policies, documentation, or other documents for quick answers.

• Resolved issue | In the document viewer, in files that contained pages of varying widths, some pages weren’t centered in the display.

• Resolved issue | In the document viewer, the page number from the previous document was sometimes displayed when you switched to a different document.

Administration

• Users’ names with multiple first names now store correctly. Previously, a second first name would be stored as part of the last name.

24.06

Updates for the week of February 19, 2024.

Build

• For commercial users, lightweight human review has been replaced with a more full-featured offering. When reviewing run results, you can now:

• Remap documents and edit values by selecting the appropriate value directly in the document preview.

• Enable Toggle bounding boxes to view selectable text.

• Pop out the document view for a multi-monitor review experience.

• For documents with validation, see updated validation results when you enter a new value.

• Mark documents reviewed to help track your review progress.

• When loading documents, thumbnails now appear while full-resolution images load, so you can preview content and annotations more quickly.

Converse

• CSV files are now supported in all Converse models.

• If a table in a document was rotated, the table source returned was incorrect.

• Non-Latin characters and symbols were sometimes removed from table cells.

Administration

• There is enhanced support for using Google Drive as a connected drive:

  • Shared drives, as well as specific files and folders shared with you, now appear in the file picker when browsing your Google Drive. Previously, only your own drive and content was visible.
  • You can now upload select native Google file types, including Google Docs (.gdoc), Google Sheets (.gsheet), and Google Slides (.gslides). When uploading native Google files to AI Hub, the file is imported as a PDF. The PDF reflects the file as it appeared in Google Drive at the time of upload and the PDF doesn’t refresh if changes are made to the original file in Google Drive.

  Some limitations still apply when using Google Drive as connected storage.

24.04

Updates for the week of February 5, 2024.

Build

• Resolved issue | When adding many fields, the Create fields panel could expand beyond the screen boundary, making the Create button inaccessible.

• Resolved issue | The title case quick clean option sometimes failed if results included a quote symbol.

Administration

• The AI Hub pricing policy has been updated. For community accounts, the new rates apply starting February 5th, 2024. For commercial subscriptions, the new rates apply at the start of the next billing cycle to begin on or after February 5th, 2024. Until the start of that next commercial subscription billing cycle, the previous rates apply. Key changes include:

  • Converse and Build have more granular pricing tiers, with more categories based on number of pages. For example, a 2-page document now falls under the 1–2 pages tier, rather than the up to 5 pages tier.

  • Reduced pricing for advanced and multistep models.

  • Elimination of batch-run pricing. Any documents processed through Build apps are charged at the Build rate.

• All v2 API endpoints now return a 401 status code in the event of an authorization error. This can be caused by an invalid API token or IB-Context header. Previously, a 200 status code was returned, with an error message in the response body, for v2 API authorization errors. See API errors for more information, including v1 API error responses.

24.02

Updates for the week of January 22, 2024.

Build

• For commercial users, you can now create cleaning functions and validation functions, enabling highly customizable fine-tuning of extraction results.

• You can now extract information about signatures, including whether a document is signed, who the signer was, and the signature date.

• When extracting tables, you can now filter columns or rows, sort columns, and perform other manipulation of table data. To help with table extraction, you can enable display of tables detected in the document, and directly copy or download tables. Additionally, tables extracted using a reasoning prompt with object detection enabled are now consistent with results from Converse.

• You can now search the text of a selected document or toggle between image and text views in the document preview pane:

• The character limit for class names has increased from 31 to 75.

• Cleaning prompts are now speedier, especially with very long documents, due to simplified processing.

• Resolved issue | When adding files, failed uploads weren’t retried, and upload success or failure wasn’t correctly indicated for individual documents.

• Resolved issue | When creating classes, before classifying documents, the selected document was flagged as belonging to a class and, in the document list, the option to group by class wasn’t disabled.

• Resolved issue | Suggested field names beyond a certain length extended past the boundary of the editing panel.

• Resolved issue | With object detection enabled, when using an extraction prompt, the source for extracted data wasn’t highlighted in the corresponding document.

• Resolved issue | The format date quick clean option inserted missing date parts. For example, the original date 11/2020 was quick-cleaned to 11/01/2020.

Converse

• Multiple table extraction improvements are included in this release.

  • When extracting tables, you can now filter columns or rows, sort columns, and perform other manipulation of table data.
  • When advanced table and checkbox detection is enabled, the provenance, or location of the information Converse used to answer, is included in the response.
  • You can now highlight all detected tables in a document so that you can view, copy, and download them. To enable detected object highlighting, click the highlight icon
    
    at the top of the document viewer.

• You can now extract information about signatures, including whether a document is signed, who the signer was, and the signature date.

Apps

• A new Apps API endpoint allows you to send Base64 representations of your files to AI Hub and run them in memory. Running apps in memory eliminates certain file service operations, making the app run faster. Internal testing showed marginal time savings of 1–2 seconds on a 25-second flow.

Administration

• A community account has been created for all commercial accounts created before release 23.49. The community account uses the same email address and login credentials as your commercial account but all usage and content is kept separate. Previously, only commercial accounts created after release 23.49 could have a community account under the same email address. To switch between accounts, use the context switcher in the top navigation bar.

23.49

Build

• If results for a given field aren’t formatted as needed, you can now clean data using quick clean options or, for commercial users, a natural language prompt.

• For commercial users, a new validations aggregate view lets you compare the results of validation rules across documents. To access this view, in the editing panel on the Validations tab, click any validation rule.

• When adding classes and fields, changes to the editing panel provide a more intuitive user experience, particularly in projects with classification.

• Resolved issue | Model confidence scores displayed Unknown for documents longer than approximately 4–5 pages or on particularly dense documents of any length. Confidence scores are now available for documents up to 20 pages in length.

Converse

• Single-table extraction is available for the default and advanced models in Converse. To extract information from a single table in a document, include the title or header of the table in your prompt.

• Multiple document conversations are now supported. Query up to 50 documents at one time to find information or compare data across documents. Converse can identify information from single or multiple sources and select the relevant information for the response.

Administration

• You can now have one community account and one commercial account under the same email address. When you have multiple accounts under the same email, a context switcher displays in the top navigation bar, letting you switch between your accounts without needing to log out. For new and existing accounts, this means:

• Existing community accounts can now join one commercial organization using the same email address.

• New commercial accounts automatically have a community account created using the same email address. Content in both accounts is kept separate.

• Existing commercial accounts don’t have a community account automatically created for them.

• If you have a community account and a commercial account under different emails, you can continue using both accounts, but you can’t use the context switcher to switch between them.

• The Converse and Run apps APIs now support including an IB-Context header, which is used to specify whether a user’s commercial or community account is making the call. The header is optional but defaults to assuming a user’s community account is making the call, so all API calls from commercial accounts must use the header to specify an organization ID.

  ACTION REQUIRED: All existing Converse and Run apps API calls from commercial users must be updated to include an IB-Context header that specifies the organization ID, or the calls fails.

• Resolved issue | Organization admins can remove users from an organization and later re-add them. Previously, organization members couldn’t be added again using the same email address.

• Known issue | If you’ve published an app to a commercial organization and deleted the Build project underlying the app, that app no longer displays on the Apps tab. You must recreate the Build project and the app. Only apps published in commercial organizations before this release are affected.

• Commercial organizations have several new storage-related features and enhancements that give you more control over data residency and access:

  • Support for saving processed AI Hub files to your own connected storage. Previously, connected drives could be used as a source of input files only and all processed files were saved to the Instabase Drive. You can also select your own storage as the default drive, the location where all processed files are stored by default.
  • You can connect storage at the organization or workspace level. Drives connected at the organization level are available to all workspaces in the organization. There are some limitations around removing organization drives.
  • You can now connect Azure Blob storage as an external drive.

• Commercial organizations have an updated Usage page that provides more ways to group and filter your organization’s usage history.

• Any user with a community account can now initiate a one-time free trial of AI Hub Commercial.

23.47

Build

• Commercial users can collaborate on Build projects created in shared workspaces.

Converse

• Checkbox and table detection can be enabled for a conversation even after uploading documents. When you enable table detection, all existing documents are redigitized.

Administration

• Commercial subscriptions now include support for shared workspaces, workspace that multiple members of an organization can join. Shared workspaces let you share access to resources and collaborate on projects. The launch of shared workspaces includes the following supporting features:

  • The ability to collaborate on Build projects created in shared workspaces. All members of a shared workspace can view and edit projects in the workspace.
  • The ability to move Build projects between workspaces.
  • The option to select a workspace in which to run an app. The app run’s results display in the selected workspace.
  • An updated My Hub page, where you can view and switch between your personal workspace and all shared workspaces of which you’re a member. From the My Hub view of a shared workspace you can also view all projects in the workspace and all app run results for app runs in the workspace.
  • A new workspace manager role that can be assigned at the workspace level.
  • Comprehensive workspace management features for organization admins and workspace managers.

23.45

Build

• In projects with classification, as you add or edit classes and fields, the document display now behaves more sensibly.

  • When you select a class, the displayed document remains the same if it belongs to the selected class. Previously, selecting a class caused the display to jump to the first document of that class in the document list.
  • When classification or extraction changes are pending, you can select a document that doesn’t belong to the selected class. A message displays indicating that the displayed document doesn’t match the selected class, with an option to switch classes.

• For commercial users, a new validations tab in the editing panel lets you view, create, and edit validation rules across your project.

Converse

• A new multistep model is available in Converse. The multistep model responds dynamically to prompts, determining and executing each step before deciding on its next step. This step-by-step approach allows the multistep model to perform more complex reasoning and mathematics, better understand context, and return more robust and detailed answers.

• Responses are returned more quickly, as Converse streams the response, rather than waiting until the entire answer is composed.

• Resolved issue | When uploading files to Converse mobile, file status didn’t update after upload and digitization completed.

Administration

• You can now share your custom apps with other users. Community users can share a link to their app with other AI Hub users. Commercial users can share an app with the rest of their organization.

• The Apps tab has improved search and filtering capabilities, including an option to filter for recently used apps. Commercial users can also filter for all shared apps in their organization.

23.43

Build

• The process for creating a new project is simplified to skip confirmation of project settings. All new projects use intelligent defaults, which you can modify as needed.

• When you modify classes, the change indicator on any reclassified documents in the document list persists until you select the document.

• For commercial users, fields with validation now display icons indicating validation success or failure in the class or field panel.

• Resolved issue | With a basic prompt, apps could produce different results in production than they did in development, even on the same set of documents. Due to a change in how fields are processed in development versus production, results are now largely consistent across environments.

• Resolved issue | If you changed project settings—including enabling object detection—after uploading files, the new settings weren’t applied to existing documents. You no longer need to re-upload files to apply new project settings.

Administration

• AI Hub now offers a dark mode color scheme. You can enable dark mode using the sun icon in the header.

• All AI Hub and custom apps are now accessible from the Apps tab.

• The My Hub tab has been updated to serve as a central location to view workspace-specific content and settings. From the My Hub tab you can view all projects, conversations, app runs, and workspace drives tied to the workspace.

• Commercial users can now connect AWS S3 buckets as a workspace drive. AWS S3 buckets are supported as a source of input files only.

• You can now connect drives directly from the AI Hub file picker. If you select Browse external drives when uploading files and no drives are connected to the current or selected workspace, an Add drive option displays.

• The AI Hub file picker now supports selecting multiple files and folders when uploading content to a conversation, project, or app.

• For API requests that require an organization ID, commercial users can find their organization ID on the APIs settings page.

23.41

Build

• In the field editor, the complex prompt toggle has been replaced with the option to select an extraction prompt or a reasoning prompt.

  Use an extraction prompt to identify existing values in a document. Use a reasoning prompt for queries that require summarization, calculation, extrapolation, or concatenation of multipage tables.

• When you initially add classes, the group-by-class filter is automatically applied to the document list, improving visibility of classification results.

• You can now view results across documents for a given field.

• Build now supports uploading .xlsx and .csv files.

• When you open a legacy Build project, it’s now automatically migrated to the updated user interface introduced in version 23.39.

Converse

• Converse with your documents on your phone with the AI Hub Converse mobile experience:

  • Upload or take a photo of a document to begin a conversation. All common image types, PDFs, and text files are compatible with mobile Converse. In the initial release, you can upload only one document at a time.

  • Select either a default or advanced model for your conversations.

  • Access conversations saved to your account on both mobile and desktop versions of Converse.

• With the Converse API, you can now delete conversations or delete specific documents from conversations.

23.39

AI Hub Commercial

A new subscription-based commercial offering is now available in AI Hub. AI Hub Commercial is suitable for companies and organizations. Commercial features and capabilities include:

• Organization-based user management, with dedicated admin and user roles.

• Organization-managed billing, with consumption units shared between all members of your organization and consumption details to monitor usage.

• Personal workspaces for organization members, with the ability to connect Google Drive storage and work with external files in projects and conversations.

• In Build, model confidence scores that provide immediate feedback about the effectiveness of prompts and support field-level validation.

• In Build, validation rules based on model confidence scores. Fields that fail validation are flagged in production runs, so they can be identified and corrected.

• In Build, lightweight human review so you can correct data in production runs.

For details about AI Hub offerings and pricing, see Instabase pricing.

Build

The Build user interface has been overhauled for improved usability. The new interface includes these enhancements:

• More guidance during project creation, including the opportunity to review and modify project settings before creating a project.

• Options to filter, sort, and group documents in the document list.

• Multiple ways to view documents, including single document preview, thumbnails, or a table.

• A unified class and field editor, so you can see the relationship between classes and fields.

Administration

• Account multifactor authentication (MFA) is now enabled, and is required for accounts created with an email address instead of a Google account. If you created an account without MFA, you must set up MFA the next time you sign in.

23.37

• Public Preview | In Build and Converse, you can extract multipage tables and checkboxes by enabling Advanced table and checkbox extraction in your project or conversation settings. Advanced extraction applies only to files uploaded after the setting is enabled. To extract multipage tables in Build, use a complex prompt and include the phrasing Extract all tables.

• The Converse API lets you integrate the functionality to chat with documents into your workflow. See the Converse API guide for usage details.

• The Run Apps API lets you create and integrate end-to-end file processing, including uploading files and returning results. See the Run Apps API guide for usage details.

• You can create and manage your own API authorization tokens from your user settings. See the API authorization documentation for details.

• All user settings, including account settings and billing and usage details, are now grouped together on a unified settings page. For more information, see the administration documentation.

23.35

• Registered accounts now receive 500 free consumption units to try AI Hub capabilities.

23.33

• You can now copy and download Converse responses in various formats. You can copy a response in full, copy rich content such as tables, code blocks, and lists, and download responses in other formats, such as .csv. See the Converse documentation for details.

• Rich graph support is available in Converse. When using Converse, you can now have your data returned in graph or chart formats, including line, bar column, pie, scatter, and multi-axis charts. See Converse results formats for details.

• Responses returned as JSON, tables, or lists are now more neatly rendered as a table.

23.07

• You can now clear your Converse chat history by clicking Clear chat and confirming your action in the confirmation dialog. Clearing the chat deletes the chat history.

• You can now repeat prompts using the up arrow key in the chat box, allowing for smoother interactions and a more efficient workflow.

• The model selector in the Converse chat box now explains the differences between the default model (good quality, low cost, and high speed) and the advanced model (better quality, higher cost, lower speed). This selector replaces the separate model information icon present in previous versions.

• You can now create an account on AI Hub using any email. After creating your account, you must set up multifactor authentication using either SMS or an authenticator app to complete the sign-in process. You can change your (MFA) in your account settings under your profile.

• You can repeat prompts by using the up arrow key in the chat box.

• You can now find an informative dialog directly within the model selection dropdown menu, explaining the differences between default and advanced models.