Skip to main content

Using Own Crawler And Push To Algolia Index

Algolia Search Api Features​

  • Thin & minimal low-level HTTP client to interact with Algolia's API
  • Works both on the browser and node.js
  • UMD compatible, you can use it with any module loader
  • Built with TypeScript

Getting started​

Repo: https://github.com/algolia/docsearch-scraper

APPLICATION_ID set to your Algolia Application ID

API_KEY set to your API Key.

# Setup Env
pip install --user pipx
pipx install pipenv

## If error with Python venv
sudo apt install python3.10-venv

## Install dependencies
pipenv install

## Activate environment
pipenv shell

## Run Scaper
./docsearch run config.json

Manually update package.json​

package.json
{
  "dependencies": {
    "@docusaurus/core": "2.2.0",
    "@docusaurus/preset-classic": "2.2.0",
    // ...
  }
}

Check docusaurus version​

npx docusaurus --version