Omnitool blocks are versatile utility blocks designed for enhancing user interaction and data processing in the recipe. These blocks include:

Chat Input and Output

Facilitate communication through a built-in chat window, allowing users to interact with recipes effectively.

Data Input

Comprises various data types input like text, number, image, document, file etc. providing convenient way for data entry and manipulation.

Text Manipulation

Essential for text formatting and processing during interactions between various models. These blocks, particularly the Text Template block, are specialized in adapting text to specific formats, ensuring optimal output within the recipe.

Data Transformation

Blocks that are essential for converting and manipulating text within recipe, allowing you to transform text into structured JSON formats, manipulate JSON objects with expressions, and even convert arrays of images and captions into markdown documents. These functionalities are key for users who need to reformat and prepare data for further processing or presentation within a recipe.

File Operation

Cater to file output needs, including saving files in specific formats and adding metadata, enhancing accessibility.

Recipe Operation

The blocks streamline the execution and integration of recipes with external systems, enabling the output of recipe results to be utilized in REST API calls.

A block is the essential building block of any recipe. Each block possesses a distinct function. By linking blocks together, you begin to craft a flow, culminating in a recipe. Omnitool's architecture promotes effortless interoperability between blocks, facilitating smooth data format transfers and integration.

Omnitool employs a Bring Your Own Key (BYOK) approach for API keys, ensuring your keys remain secure and private on your local environment. To activate the blocks corresponding to each supported API, simply input your API keys into the API management page.

Prerequisites

Ensure you have the following before you begin:

• OpenAI Account: Sign up or log in at .

• API Token: Generate your API token on the .

Setup

Adding OpenAI API Key

1. Navigate to the API Key Manager in the left panel.

2. Enter your OpenAI API token here.

Using OpenAI Blocks

After adding your OpenAI API key, you can access various OpenAI blocks within Omnitool:

1. Go to the "Add Block" collection in Omnitool.

2. Search openai namespace

Additional Resources

For developers and users seeking more advanced configurations and troubleshooting resources for these blocks, refer to the OpenAPI and block specifications on the

For more detailed information about OpenAI API's offerings and capabilities, visit the .

The OpenRouter Block is a unified API that specializes in providing access to a diverse range of supported Large Language Models (LLMs).

Prerequisites

Before you begin, ensure you have:

• OpenRouter Account: Register or sign in at .

• API Key: Obtain your .

• Credits: Ensure you have enough API credits. (You have a small usage allowance (< $1) before you need to pay).

Setup

Adding API Key

1. Access the API Key Manager in Omnitool's left panel.

2. Input your OpenRouter API key.

Using the OpenRouter Block

1. Navigate to the "Add Block" collection within Omnitool.

2. Search for the openrouter namespace to locate its LLM block.

3. There are two distinct LLM blocks provided. One of these is the vision transformer LLM model block, which is designed to process image input.

Additional Resources

For developers and users seeking more advanced configurations and troubleshooting resources for these blocks, refer to the OpenAPI and block specifications on the .

For additional details on the OpenRouter API, refer to the .

HuggingFace is renowned for its comprehensive collection of open-source natural language processing (NLP) models and tools. The HuggingFace blocks in Omnitool enable easy access to these models, offering a seamless experience for users looking to integrate the latest models into their recipes.

Prerequisites

Before you begin, ensure you have the following:

• HuggingFace Account: Sign up or log in at .

• Access Token: Generate your Access token from your HuggingFace account.

Setup

Adding API Key

1. Navigate to API Key Manager in the left panel.

2. Add your HuggingFace Access token.

Using the HuggingFace Block

1. Navigate to the "Add Block" collection in Omnitool.

2. Search huggingface namespace, which provides access to various blocks.

1. Identify the category of the model you're interested in from the extensive collection at . Once you've selected a model, simply copy its name and apply the corresponding block in Omnitool. And just like that, you're all set to use the model!

Additional Resources

For developers and users seeking more advanced configurations and troubleshooting resources for these blocks, refer to the OpenAPI and block specifications on the .

For more information of HuggingFace API, visit the .

ElevenLabs stands out in the realm of AI with its advanced voice synthesis technology. By integrating the ElevenLabs Block into Omnitool, users can effortlessly leverage its API, such as Text-to-Speech.

Prerequisites

Before starting, ensure you have the following:

Replicate is a platform that enables users to effortlessly host and run AI models on the cloud. With the Replicate Extension for Omnitool, you can conveniently access and use a wide range of AI models available on replicate.com with just a single click.

Prerequisites

Before you begin, ensure you have the following:

• Replicate Account: Sign up or log in at .

• API Token: Generate your API token at .

Setup

Installing the Replicate Extension

1. Navigate to Extensions Manager

2. Select and install the Replicate Extension.

Adding API Key

1. Navigate to API Key Manager in the left panel.

2. Add your Replicate API token.

Using Replicate Blocks

Adding Replicate Model

1. Go to the Extension Manager.

2. Open the Replicate Extension.

3. Import models:

Using Replicate Blocks

• Find in Block Collection: Once model added, the Replicate model's block will appear in the "Add Block" collection.

• Direct Add: Or, right after importing the model, a button will appear in the Chat interface. Click on this button to directly add the Replicate block to your canvas.

Additional Resources

For developers and users seeking more advanced configurations and troubleshooting resources for these blocks, refer to the OpenAPI and block specifications on the .

For more detailed information, visit the .

Sharp Image Processing blocks are based on the Sharp Node.js library, offering a suite of advanced image manipulation capabilities. These blocks enable users to apply a range of image processing techniques, such as blurring, resizing, preparing format, compositing and more, directly within the recipes.

Setup

• Install the Sharp Image Processing extension