All pages
Powered by GitBook
1 of 2

Loading...

Loading...

Key Features

Self-hosted and Open Source

Omnitool transforms your local machine into a powerful AI Lab.

  • You install Omnitool and it runs on your Mac, Windows or Linux notebook, desktop or server, not cloud servers.

  • It stores data locally and only transmitting data to third-party APIs of your choice. Updates are managed via GitHub.

  • A Docker Image is under testing.

  • A HuggingFace Space is available.

  • If you're interested in cloud-based operation, reach out to us at contact@omnitool.ai

Open Standards

Omnitool is licensed as open-source software and heavily leverages open standards, such as OpenAPI, making it interoperable and extensible.

Rapid Access to Generative AI
  • Minimal Time-to-AI: It allows you to try out models and services in minutes without having to study API docs, write boilerplate code, manage python venvs or figuring out new user interfaces. Because of it's integration of many leading AI platforms, the lag time between "paper with code" to hands on experimentation often is cut down to days.

  • It presents the vast world of generative AI - image, video, audio, text, and classification APIs - through a single, unified user interface without oversimplifying or hiding the power of the APIs.

Comprehensive AI Provider Support

Omnitool offers seamless access to thousands of AI models and utility APIs from a growing list of leading AI providers and aggregators, all available as interoperable blocks. The current version (https://github.com/omnitool-ai/omni-core-blocks/tree/main/server/apis) supports a wide array of providers, including Civitai.com, Deepl.com, ElevenLabs.io, Getimg.ai, Google services (Gmail, Vertex AI, Google Translate, etc.), Huggingface.com, OpenAI.com, Replicate.com, and many others. Upcoming support includes various open-source APIs like Automatic1111/SDNext API and Ollama API (https://github.com/omnitool-ai/omni-core-blocks/tree/main/server/templates).

Omnitool is able to generate new blocks from any openapi.json definitions via URL or directly supplied file. We support a number of custom x- annotations that can be added to openapi definitions to allow omnitool to guide the block generation. It also supports creating "patches" on top of existing APIs to create customized blocks.

Extensible Architecture

Inspired by the common modding architecture found in video game toolsets, Omnitool is built, from the ground up, to be extensible via multiple mechanisms:

  • Simple Client and Server Scripts: Allowing addition of /commands that are hot-reloaded, so editing and building is a breeze.

  • Client Extensions - any web-app/webpage can be turned into an extension and integrated directly on Omnitool's desktop via it's window system. Omnitool's client SDK exposes the full range of platform functionality to extensions, allowing you to write apps or tools using every API or recipe enabled in Omnitool.

  • Server Extensions: Add new blocks, APIs, and core functionalities in JavaScript.

Visit the Extension tab in app or see our Omnitool Community Github for a list of currently available extensions.

Welcome to Omnitool.ai

Omnitool.ai is an open-source, downloadable "AI Lab in a box" built for learners, enthusiasts and anyone with interest in the current wave of AI innovation. It provides an extensible browser based desktop environment for streamlined, hands-on interacting with the latest AI models from OpenAI, replicate.com, Stable Diffusion, Google, or other leading providers through a single, unified interface

Check out this demo:

With thousands of preprints and countless "AI tools" released each week, it is incredibly challenging to stay on top of the rapidly evolving AI ecosystem, to separate hype and facts and to extract durable long term skills and learning. PapersWithCode and GitHub repositories attached to arXiv papers provide ability to hands-on validate and apply the latest discoveries, but the fragile nature of the Python ecosystem and often steep hardware requirments dramatically limits accessibility. Likewise implementing and testing cloud based models requires delving deep into API documentation and wrestling with connecting code.

We believe that is a serious problem. AI may represent the first large scale technological disruption unbounded by logistical challenges, scaling along existing wires, API infastructure and app delivery platforms. Meanwhile, market pressure to adopt AI is felt by many businesses and teams.

Without educated decision makers and technical experts, businesses and public organisations alike are at high risk of falling for hype and magical narratives and expensive misadventures.

Our Initiative

Omnitool is our attempt to improve this situation: A single, unified interface capable of connecting with as many AI models as possible and to reduce the "time to hands on AI" to an absolute minimum.

Omnitool is highly extensible and interoperable. Most OpenAPI3 based services can be connected and turned into "blocks" without writing code. It's extension framework enables deeper integrations of anything from custom UIs (Like Stability Dream Studio) to Game Engines (like BabyonJS or Phaser) to Image manipulation libraries.

  • Not a Multi-User Cloud SaaS: Omnitool is a locally installed application, not a cloud-based SaaS product designed for multiple users.

  • Not a No-Code Tool: While it simplifies interactions with AI, Omnitool is not intended to replace coding or to enable non-engineers to code. It focuses on AI use cases rather than general-purpose software development.

  • Not Production-Ready (Yet): Omnitool is akin to a lab, prioritizing access to cutting-edge technologies over stability. As with any lab environment, occasional disruptions can occur.