Omnitool employs a Bring Your Own Key (BYOK) approach for API keys, ensuring your keys remain secure and private on your local environment. To activate the blocks corresponding to each supported API, simply input your API keys into the API management page.

A block is the essential building block of any recipe. Each block possesses a distinct function. By linking blocks together, you begin to craft a flow, culminating in a recipe. Omnitool's architecture promotes effortless interoperability between blocks, facilitating smooth data format transfers and integration.

Prerequisites

Ensure you have the following before you begin:

Setup

Adding OpenAI API Key

1. Navigate to the API Key Manager in the left panel.

2. Enter your OpenAI API token here.

Using OpenAI Blocks

After adding your OpenAI API key, you can access various OpenAI blocks within Omnitool:

1. Go to the "Add Block" collection in Omnitool.

2. Search openai namespace

Additional Resources

Omnitool blocks are versatile utility blocks designed for enhancing user interaction and data processing in the recipe. These blocks include:

Chat Input and Output

Facilitate communication through a built-in chat window, allowing users to interact with recipes effectively.

Data Input

Comprises various data types input like text, number, image, document, file etc. providing convenient way for data entry and manipulation.

Text Manipulation

Essential for text formatting and processing during interactions between various models. These blocks, particularly the Text Template block, are specialized in adapting text to specific formats, ensuring optimal output within the recipe.

Data Transformation

Blocks that are essential for converting and manipulating text within recipe, allowing you to transform text into structured JSON formats, manipulate JSON objects with expressions, and even convert arrays of images and captions into markdown documents. These functionalities are key for users who need to reformat and prepare data for further processing or presentation within a recipe.

File Operation

Cater to file output needs, including saving files in specific formats and adding metadata, enhancing accessibility.

Recipe Operation

The blocks streamline the execution and integration of recipes with external systems, enabling the output of recipe results to be utilized in REST API calls.

Replicate is a platform that enables users to effortlessly host and run AI models on the cloud. With the Replicate Extension for Omnitool, you can conveniently access and use a wide range of AI models available on replicate.com with just a single click.

Prerequisites

Before you begin, ensure you have the following:

Setup

Installing the Replicate Extension

1. Navigate to Extensions Manager

2. Select and install the Replicate Extension.

Adding API Key

1. Navigate to API Key Manager in the left panel.

2. Add your Replicate API token.

Using Replicate Blocks

Adding Replicate Model

1. Go to the Extension Manager.

2. Open the Replicate Extension.

3. Import models:

   • Preset Models: Choose from a list of preset models provided in the portal.

Using Replicate Blocks

• Find in Block Collection: Once model added, the Replicate model's block will appear in the "Add Block" collection.

• Direct Add: Or, right after importing the model, a button will appear in the Chat interface. Click on this button to directly add the Replicate block to your canvas.

Additional Resources

ElevenLabs stands out in the realm of AI with its advanced voice synthesis technology. By integrating the ElevenLabs Block into Omnitool, users can effortlessly leverage its API, such as Text-to-Speech.

Prerequisites

Before starting, ensure you have the following:

• API Key: Generate your API key from your ElevenLabs profile.

• Characters: Ensure you have enough characters available for use in Subscription > Characters Used.

Setup

Adding API Key

1. Go to the API Key Manager in the left panel of Omnitool.

2. Enter your ElevenLabs API key.

Using the ElevenLabs Block

1. Navigate to the "Add Block" collection in Omnitool.

2. Search for the elevenlabs namespace to find its TTS block.

Additional Resources

Prerequisites

Before you begin, ensure you have:

• Credits: Ensure you have enough API credits. (You have a small usage allowance (< $1) before you need to pay).

Setup

Adding API Key

1. Access the API Key Manager in Omnitool's left panel.

2. Input your OpenRouter API key.

Using the OpenRouter Block

1. Navigate to the "Add Block" collection within Omnitool.

2. Search for the openrouter namespace to locate its LLM block.

3. There are two distinct LLM blocks provided. One of these is the vision transformer LLM model block, which is designed to process image input.

Additional Resources

HuggingFace is renowned for its comprehensive collection of open-source natural language processing (NLP) models and tools. The HuggingFace blocks in Omnitool enable easy access to these models, offering a seamless experience for users looking to integrate the latest models into their recipes.

Prerequisites

Before you begin, ensure you have the following:

• Access Token: Generate your Access token from your HuggingFace account.

Setup

Adding API Key

1. Navigate to API Key Manager in the left panel.

2. Add your HuggingFace Access token.

Using the HuggingFace Block

1. Navigate to the "Add Block" collection in Omnitool.

2. Search huggingface namespace, which provides access to various blocks.

Additional Resources

Sharp Image Processing blocks are based on the Sharp Node.js library, offering a suite of advanced image manipulation capabilities. These blocks enable users to apply a range of image processing techniques, such as blurring, resizing, preparing format, compositing and more, directly within the recipes.

Setup

• Install the Sharp Image Processing extension via the Extension Manager found in the left panel.

Using Sharp Blocks

• Once installed, navigate to the "Add Block" collection within Omnitool.

• Search for the sharp namespace to locate all the image manipulation blocks.

Additional Resources