Unstructured
Document preprocessing โ any format to LLM-ready chunks
๐ Overview
Unstructured provides document preprocessing that converts any file format (PDF, Word, Excel, HTML, images) into LLM-ready chunks. Unlike Marker (which focuses on PDFs), Unstructured handles 20+ file formats with a unified API. It provides a comprehensive solution for modern AI workflows. The library provides pre-built connectors for popular data sources including databases, cloud storage, and SaaS applications. It handles complex document layouts, tables, and embedded images with high accuracy. The output is structured and ready for LLM ingestion, making it ideal for RAG pipelines and knowledge base construction.
โจ Key Features
- โข12K+ GitHub stars โ multi-format document preprocessing
- โข20+ file formats supported
- โขOCR for images and scanned documents
- โขTable extraction and preservation
- โขOpen-source library and cloud API
- โขApache 2.0 licensed
- โขUnified API
- โขCloud option
๐ฏ The Problem It Solves
RAG pipelines need to ingest documents in many formats โ each requiring different parsing logic. Unstructured provides a unified API for all formats.
๐ง How It Works
Unstructured detects file type, applies appropriate parsing (OCR for images, table extraction for PDFs, structure detection for HTML), and outputs clean chunks with metadata.
๐ Installation & Quick Start
Installation
See websiteQuick Start
- See documentation
โ Pros
- โขMost versatile document preprocessing
- โข20+ file formats
- โขOCR built-in
- โขApache 2.0 licensed
- โขUnified API
- โขCloud option
โ Cons
- โขOpen-source library requires setup
- โขCloud API costs add up
- โขComplex documents need review
- โขSetup required
๐ฌ Practitioner Verdict
โUnstructured is the most versatile document preprocessing tool โ the multi-format support is genuinely differentiated. The trade-off: the open-source library requires significant setup, the cloud API costs add up, and complex documents still need review.โ
Self-Hosted (Free)
Open source, MIT/Apache licensed. Run it yourself.
โญ Star & Clone on GitHubFree forever. Your infrastructure, your data.
Unstructured Cloud Free
1K pages/mo
- 1K pages
- Basic parsing
Unstructured Cloud Pro
Pay-per-page
- Unlimited pages
- Priority parsing
๐ Specifications
- Language
- Python
- License
- Apache-2.0
- Platform
- Linux, macOS, Windows
- Supported Models
- REST API, CLI
๐ฐ Pricing Reality
Open-source library is free Apache 2.0. Cloud API: Free tier (1K pages/mo), Pro $0.01/page.