Rust-Powered Full-Text Search w/Tantivy

I built a full-text search engine in Rust using Tantivy to ingest and index Brazil’s Diário Oficial da União–the federal government’s daily journal. It scans new publications for key phrases and sends real-time email alerts.

April 24, 2025

High-Throughput S3 Object Hashing: 3GB/s with Rust and Tokio

A high-speed S3 object hasher built with Rust, processing at up to 3 GB/s. We use a channel-based architecture to concurrently stream and hash S3 objects. We process a 12 TB dataset in just over an hour, demonstrating Rust’s capability for efficient, large-scale data processing.

July 30, 2024