Velora

Solving Problems with the Magic of Technology

ODS – Osmantic Deployment System: Turn Your PC Into a Private AI Server

We specialize in crafting unique digital presence that help businesses grow and stand out in their industries.

Overview

ODS (Osmantic Deployment System) is an open-source platform that turns your PC, Mac, or Linux box into a private AI server. It installs and wires together everything needed to run AI locally, including local model inference, chat interfaces, dashboards, voice agents, workflows, RAG, and privacy tools.

Key Features

  • Local Model Inference: Run open models on your own hardware with llama-server and LiteLLM integration
  • Chat Interface: Full-featured chat UI via Open WebUI with conversation history and web search
  • Control Dashboard: Manage models, services, setup, GPU status, and extensions from one centralized place
  • Voice, Agents & Workflows: Build automations that can listen, speak, call tools, and perform tasks
  • RAG and Search: Connect local documents with private search and retrieval workflows
  • Image Generation: Run local image tools without sending prompts to hosted APIs
  • Privacy First: No cloud required – inference, chat history, and files stay on your machine

One-Command Installation

ODS supports multiple platforms with simple installation commands:

  • Linux/macOS: curl -fsSL https://install.osmantic.com/ods.sh | bash
  • Windows PowerShell: Guided Ubuntu/WSL2 setup with Pixel/Portal integration
  • Manual Install: git clone https://github.com/Osmantic/ODS.git && cd ODS/ods && ./install.sh

Bundled Services

ODS includes a comprehensive stack of AI services out of the box:

  • Chat & Inference: Open WebUI, llama-server, LiteLLM, TEI Embeddings
  • Voice: Whisper (speech-to-text), Kokoro (text-to-speech)
  • Agents & Automation: Portal agent, Hermes Agent, n8n, APE, OpenCode, Memory Shepherd
  • Knowledge & Search: Qdrant (vector DB), SearXNG, Perplexica, Brave Search
  • Creative: ComfyUI for image generation
  • Privacy & Ops: Privacy Shield, Token Spy, Langfuse observability

Hardware Support

ODS auto-detects your GPU and selects the best model for your hardware:

  • NVIDIA: RTX 4060 to RTX PRO 6000 with Qwen models (4-24+ GB VRAM)
  • AMD: Strix Halo with unified memory support
  • Apple Silicon: M1+ chips with native Metal acceleration
  • Intel Arc: Experimental support (Linux SYCL)

Extensibility

Every service in ODS is an extension – just a folder with a manifest.yaml and compose.yaml. Enable extensions with ods enable my-service and disable them when not needed. The entire system is built to be modded.

CLI Management

The ods CLI manages your entire stack:

ods status                # Health checks + GPU status
ods list                  # All services and their state
ods restart [service]     # Restart one or all services
ods mode cloud            # Switch to cloud APIs via LiteLLM
ods model swap T3         # Switch to a different hardware tier

Investigate ODS on GitHub | Install ODS

  • FAQ

Frequently Asked Questions

Does Velorasupport e-commerce?

Yes, Velorais fully compatible with WooCommerce, the most popular e-commerce plugin for WordPress. You can easily set up an online store, manage products, and process payments with just a few clicks.

Is VeloraSEO-friendly?

Yes, Velorais built with SEO best practices in mind. It includes clean code, fast loading times, and compatibility with popular SEO plugins like Yoast SEO and Rank Math, helping your website rank higher in search engine results.

What kind of support is available for Velora?

Veloracomes with dedicated customer support to help you with any questions or issues. You can access our documentation, video tutorials, and contact our support team via email or live chat for assistance.

  • Join Us Now

Each Project we Undertake is a Unique Opportunity.

Ready to take the next step? Join us now and start transforming your vision into reality with expert support.