Point Infino at your raw data and query it in less than a day.

Hydrate makes the structured and unstructured files already in your bucket ready for agents to query. Your team builds no pipelines and needs no AI expertise.

YOUR BUCKET parquet json csv iceberg delta lake es snapshot hydrate plan · chunk · embed · index table cards · join keys QUERY-READY tickets.sf.parquet
infino hydrate --plan

Six jobs your team stops doing.

By hand With hydrate

01Export every source into files the engine can read.

Reads Parquet, JSON, CSV, Iceberg and Delta Lake where they already sit.

02Decide which columns get keyword search and which get search by meaning.

Reads the values and decides for each column. You can override any choice.

03Pick an embedding model and chunk the text.

Chunks and embeds the text on Infino’s GPUs.

04Tune for table design and big loads so memory and speed hold up.

Compacts the files and builds the vector index as it loads.

05Write down what every column and code means, and which tables join.

A model writes a card for each table and proposes joins, and the engine checks each one against the data.

06Give agents the tools and the context to query it.

Agents connect over MCP or the Supermodel API and read the cards and joins.

cat SETUP.diff

What the same work takes elsewhere.

Elasticsearch or OpenSearch

  1. Write a mapping for every field, and reindex when one changes
  2. Reshape each source with Logstash or an ingest pipeline
  3. Configure an inference endpoint for embeddings
  4. Size shards and replicas before the data arrives
  5. Keep the index in step with the source of truth

Databricks

  1. Land every source as a Delta table
  2. Chunk the documents and pick an embedding endpoint
  3. Create a Vector Search endpoint and an index per table
  4. Curate a Genie space with instructions and example queries

Snowflake

  1. Load the files with COPY INTO or Snowpipe
  2. Chunk the text and create a Cortex Search service over it
  3. Write a semantic model for Cortex Analyst

Infino

  1. Point hydrate at the bucket

all comparisons →

ls s3://your-bucket/raw/

What it reads.

  • Parquet files
  • Newline-delimited JSON
  • CSV, tab and other delimited text
  • Apache Iceberg tables
  • Delta Lake tables
  • Elasticsearch and OpenSearch snapshots
  • Files uploaded from your machine

migrate from a snapshot →

infino hydrate --sync

New data shows up in answers without anyone touching it.

Always in sync

Infino finds the files that are new, rewritten or gone. Only the rows that changed are embedded again.

Every source adds context

A new source gets its own cards, and its joins are checked against the tables already there.

Picks up where it stopped

Every commit is checkpointed, so a stopped load resumes without duplicate rows.

Read only

Hydrate never changes the files it reads.

Point Infino at your bucket.

or run it yourself: pip install infino · Apache-2.0 · quickstart →