Key Features

Self-hosted and Open Source

Omnitool transforms your local machine into a powerful AI Lab.

  • You install Omnitool and it runs on your Mac, Windows or Linux notebook, desktop or server, not cloud servers.

  • It stores data locally and only transmitting data to third-party APIs of your choice. Updates are managed via GitHub.

  • A Docker Image is under testing.

  • A HuggingFace Space is available.

  • If you're interested in cloud-based operation, reach out to us at contact@omnitool.ai

Open Standards

Omnitool is licensed as open-source software and heavily leverages open standards, such as OpenAPI, making it interoperable and extensible.

Rapid Access to Generative AI
  • Minimal Time-to-AI: It allows you to try out models and services in minutes without having to study API docs, write boilerplate code, manage python venvs or figuring out new user interfaces. Because of it's integration of many leading AI platforms, the lag time between "paper with code" to hands on experimentation often is cut down to days.

  • It presents the vast world of generative AI - image, video, audio, text, and classification APIs - through a single, unified user interface without oversimplifying or hiding the power of the APIs.

Comprehensive AI Provider Support

Seamlessly provides access to 1000s of AI model and utility APIs from an rapidly growing list leading AI providers and aggregators, exposing them all via interoperable blocks.

Omnitool offers seamless access to thousands of AI models and utility APIs from a growing list of leading AI providers and aggregators, all available as interoperable blocks. The current version (https://github.com/omnitool-ai/omni-core-blocks/tree/main/server/apis) supports a wide array of providers, including Civitai.com, Deepl.com, ElevenLabs.io, Getimg.ai, Google services (Gmail, Vertex AI, Google Translate, etc.), Huggingface.com, OpenAI.com, Replicate.com, and many others. Upcoming support includes various open-source APIs like Automatic1111/SDNext API and Ollama API (https://github.com/omnitool-ai/omni-core-blocks/tree/main/server/templates).

Omnitool is able to generate blocks from any openapi.json definitions via URL or directly supplied file. We support a number of custom x- annotations that can be added to openapi definitions to allow omnitool to guide the block generation. It also supports creating "patches" on top of existing APIs to create customized blocks. With integrated JSONATA support, it is possible to build powerful data processing blocks using pure data.

Extensible Architecture

Inspired by the common modding architecture found in video game toolsets, Omnitool is built, from the ground up, to be extensible via multiple mechanisms:

  • Simple Client and Server Scripts: Allowing addition of /commands that are hot-reloaded, so editing and building is a breeze.

  • Client Extensions - any web-app/webpage can be turned into an extension and integrated directly on Omnitool's desktop via it's window system. Omnitool's client SDK exposes the full range of platform functionality to extensions, allowing you to write apps or tools using every API or recipe enabled in Omnitool.

  • Server Extensions: Add new blocks, APIs, and core functionalities in JavaScript.

Visit the Extension tab in app or see our Omnitool Community Github for a list of currently available extensions, for examples:

  • omni-core-replicate: a core extensions that allows import of any AI model on replicate.com into a ready to use block in Omnitool

  • omni-extension-sharp: an extension adding an array of Image Manipulation blocks such as format conversion, masking, composition and more based on the powerful sharp image processing library.

  • omni-extension-minipaint: a powerful photo editing tool useful for quickly creating and editing images without switching out of the app.

  • omni-extension-openpose: a OpenPose based pose estimation and generation toolkit useful for creating guidance images for controlnet/diffusion models.

  • omni-extension-tldraw: a whiteboarding/sketching extension built on TLDraw, useful for generating input for visual transformers and diffusion models

  • omni-extension-wavacity: a full wasm implementation of Audacity, a state of the art audio recorder/editor useful for generating and editing audio content.

Last updated