janhq/jan

Experience offline AI with this powerful ChatGPT alternative that prioritizes user privacy and control. Running on Cortex, this versatile assistant supports popular LLMs and works seamlessly across multiple hardware configurations.

Open source alternatives to:

Screenshot of jan website

Revolutionizing Personal AI: A Comprehensive Look at Jan

In an era where AI accessibility meets privacy concerns, Jan emerges as a groundbreaking solution for those seeking complete control over their AI interactions. This innovative ChatGPT alternative operates entirely offline on your personal device, powered by the robust Cortex engine.

Unmatched Versatility and Performance

Jan's architecture stands out through its remarkable adaptability across different hardware configurations. Whether you're working with high-powered NVIDIA GPUs or Apple's M-series processors, Jan delivers optimal performance. The platform's universal compatibility extends to multiple operating systems, including:

  • NVIDIA GPU systems with enhanced speed capabilities
  • Apple M-series devices offering accelerated performance
  • Traditional Apple Intel machines
  • Linux Debian environments
  • Windows x64 systems

Core Features and Capabilities

At the heart of Jan lies a comprehensive suite of features designed to deliver a superior AI experience:

Advanced Model Integration

Access a diverse Model Library featuring industry-leading LLMs including:

  • Llama - for versatile natural language processing
  • Gemma - offering cutting-edge language understanding
  • Mistral - providing advanced text generation
  • Qwen - delivering sophisticated language capabilities

Flexible Connectivity

Jan goes beyond local operations by offering seamless integration with remote AI services. Connect effortlessly to advanced platforms like Groq and OpenRouter, expanding your AI capabilities while maintaining control over your interactions.

Developer-Friendly Architecture

The platform includes a Local API Server that maintains OpenAI-equivalent API compatibility, making it an ideal choice for developers looking to build and integrate AI applications. The extensible nature of Jan allows for customization through its robust extensions system.

Technical Foundation

Jan is built on Cortex.cpp, a sophisticated local AI engine that sets new standards in embedded AI technology. This foundation enables Jan to handle everything from basic personal computing to complex multi-GPU cluster operations, ensuring scalability and performance across different use cases.

Privacy and Control

In today's digital landscape, Jan stands out by prioritizing user privacy and control. By operating completely offline, it ensures that sensitive interactions remain secure and private. This approach makes Jan particularly valuable for:

  • Organizations handling sensitive data
  • Individuals prioritizing privacy in their AI interactions
  • Developers requiring secure, local AI processing

System Requirements

To ensure optimal performance, Jan requires specific system configurations:

For MacOS Users:

Version 13 or higher is required for smooth operation.

For Windows Systems:

  • Windows 10 or later
  • For GPU acceleration: CUDA Toolkit 11.7+ and compatible NVIDIA drivers (470.63.01+)

For Linux Environments:

  • glibc 2.27 or higher
  • gcc 11, g++ 11, cpp 11 or higher
  • Similar GPU requirements as Windows for NVIDIA acceleration

Technology Integration

Jan leverages several cutting-edge open-source technologies to deliver its capabilities:

  • llama.cpp for efficient language model processing
  • LangChain for enhanced language understanding
  • TensorRT and TensorRT-LLM for optimized performance

This integration of technologies ensures that Jan remains at the forefront of local AI processing capabilities while maintaining its commitment to privacy and user control.