Skip to content

getmaxun/maxun

Repository files navigation

Transform the Web into Structured Intelligence

✨ Turn any website into clean, contextualized data pipelines for your AI applications ✨

Go To AppDocumentationWebsiteDiscordWatch Tutorials

getmaxun%2Fmaxun | Trendshift

What is Maxun?

Maxun helps you transform websites into structured APIs, clean markdown for AI workflows, and production-ready data pipelines — all in minutes.

Ecosystem

  1. Extract – Emulate real user behavior and collect structured data from any website.

    • Recorder Mode - Record your actions as you browse; Maxun turns them into a reusable extraction robot.
    • AI Mode - Describe what you want in natural language and let LLM-powered extraction do the rest.
  2. Scrape – Convert full webpages into clean Markdown or HTML and capture screenshots.

  3. Crawl - Crawl entire websites and extract content from every relevant page, with full control over scope and discovery.

  4. Search - Run automated web searches to discover or scrape results, with support for time-based filters.

  5. SDK – A complete developer toolkit for scraping, extraction, scheduling, and end-to-end data automation.

How Does It Work?

Maxun robots are automated tools that help you collect data from websites without writing any code. Think of them as your personal web assistants that can navigate websites, extract information, and organize data just like you would manually - but faster and more efficiently.

There are four types of robots, each designed for a different job.

1. Extract

Extract emulates real user behavior and captures structured data.

  • Recorder Mode - Record your actions as you browse; Maxun turns them into a reusable extraction robot.

Example: Extract 10 Property Listings from Airbnb

Maxun_Airbnb.mp4
  • AI Mode - Describe what you want in natural language and let LLM-powered extraction do the rest.

Example: Extract Names, Rating & Duration of Top 50 Movies from IMDb

maxun_ai_mode_extraction.mp4

Learn more here.

2. Scrape

Scrape converts full webpages into clean Markdown, HTML and can capture screenshots. Ideal for AI workflows, agents, and document processing.

Learn more here.

3. Crawl

Crawl entire websites and extract content from every relevant page, with full control over scope and discovery.

Learn more here.

4. Search

Run automated web searches to discover or scrape results, with support for time-based filters.

Learn more here.

Quick Start

Getting Started

The simplest & fastest way to get started is to use the hosted version: https://app.maxun.dev. You can self-host if you prefer!

Installation

Maxun can run locally with or without Docker

  1. Setup with Docker Compose
  2. Setup without Docker
  3. Environment Variables
  4. SDK

Upgrading & Self Hosting

  1. Self Host Maxun With Docker & Portainer
  2. Upgrade Maxun With Docker Compose Setup
  3. Upgrade Maxun Without Docker Compose Setup

Sponsors




LambdaTest

GenAI-powered Quality Engineering Platform that empowers teams to test intelligently, smarter, and ship faster.

Features

  • Extract Data With No-Code – Point and click interface
  • LLM-Powered Extraction – Describe what you want; use LLMs to scrape structured data
  • Developer SDK – Programmatic extraction, scheduling, and robot management
  • Handle Pagination & Scrolling – Automatic navigation
  • Run Robots On Schedules – Set it and forget it
  • Turn Websites to APIs – RESTful endpoints from any site
  • Turn Websites to Spreadsheets – Direct data export to Google Sheets & Airtable
  • Adapt To Website Layout Changes – Auto-recovery from site updates
  • Extract Behind Login – Handle authentication seamlessly
  • Integrations – Connect with your favorite tools
  • MCP Support – Model Context Protocol integration
  • LLM-Ready Data – Clean Markdown for AI applications
  • Self-Hostable – Full control over your infrastructure
  • Open Source – Transparent and community-driven

Demos

Maxun can be used for various use-cases, including lead generation, market research, content aggregation and more. View demos here: https://www.maxun.dev/usecases

Note

This project is in early stages of development. Your feedback is very important for us - we're actively working on improvements.

License

This project is licensed under AGPLv3.

Support Us

Star the repository, contribute if you love what we’re building, or sponsor us.

Contributors

Thank you to the combined efforts of everyone who contributes!