Agent skill · software engineering · jeremylongshore
glean-migration-deep-dive
Migrate from Elasticsearch/Algolia: 1) Export all documents from source,
Why this skill is useful
Adds executable scripts for migrating data from Elasticsearch/Algolia to Glean, including document transformation and bulk indexing.
What it needs
Requires bash installed locally. Requires glean account access. About 4k tokens when loaded. Last updated 2026-08-07. 2,604 stars on the source repository.
What this skill does
Glean Migration Deep Dive Overview Comprehensive guide for migrating enterprise search from Elasticsearch or Algolia to Glean. Covers connector migration (replacing custom crawlers with Glean's push indexing API), permission model changes (mapping ACLs to Glean's datasource-level permissions), and full index rebuilds using bulkindexdocuments. Typical timeline is 2-4 weeks for a mid-size deployment with 100K-1M documents across multiple datasources. Migration Assessment Step-by-Step Migration Phase 1: Prepare Export all documents from the current search provider and map them to Glean's document schema. Each document needs id, title, url, body, and permissions. Phase 2: Migrate Create the Glean datasource and bulk-index all transformed documents. Phase 3: Validate Run test queries against both old and new systems and compare result quality. Rollback Plan Migration Checklist [ ] Inventory all source indices and document counts [ ] Map permission model (index-level ACLs to Glean datasource permissions) [ ] Export and transform documents to Glean schema [ ] Create datasource via adddatasource API [ ] Bulk index all documents in batches of 200 [ ] Run validation queries and compare relevance [ ] Update search UI to use Glean Client API [ ] Decommission old search crawlers and indices [ ] Monitor search quality metrics for 7 days post-migration [ ] Remove old provider SDK dependencies from codebase Error Handling Issue Cause Fix ------- ------- ----- 401 Unauthorized Invalid Glean API token Regenerate token in admin console 409 Datasource exists Name collision Delete or rename existing datasource 413 Payload Too Large Batch exceeds 10 MB Reduce batch size from 200 422 Invalid document Missing required field Validate id, title, url before indexing Stale search results Index not refreshed Wait 5 min or trigger manual refresh Prerequisites A signed migration plan with data owners, source ACL authority, retention requirements, and a cutover/rollback decision owner. …
How to use it
Reference it in AdaL, Claude Code, Cursor or any coding agent — nothing to install:
@skills jeremylongshore/glean-migration-deep-dive