Tags: how-to, crawler

Installation

Note

This page has been migrated from the old documentation, and has not yet been fully revised. There might be inconsistencies or errors when using with current LinkAhead versions.

Linux

Make sure that Python (at least version 3.8) and pip is installed, using your system tools and documentation.

Then open a terminal and continue in the Generic installation section.

Windows

If a Python distribution is not yet installed, you can for example install a recent Python version from the Microsoft Store. After installation, open a command or PowerShell prompt and continue in the Generic installation section.

MacOS

If there is no Python 3 installed yet, there are two main ways to obtain it: Either get the binary package from python.org or, for advanced users, install via Homebrew. After installation from python.org, it is recommended to also update the TLS certificates for Python (this requires administrator rights for your user):

# Replace this with your Python version number:
cd /Applications/Python\ 3.9/

# This needs administrator rights:
sudo ./Install\ Certificates.command

After these steps, you may continue with the Generic installation.

Generic installation

The CaosDB crawler is available as PyPi package and can simply be installed with

pip3 install caoscrawler

Alternatively, obtain the sources from GitLab and install from there (git must be installed for this option):

git clone https://gitlab.com/caosdb/caosdb-crawler
cd caosdb-crawler
pip3 install --user .