Upgrade (any versions)

For all upgrades

Configuration files

By default, configuration files are located in :

Backup first your own configuration files !!!

Do not overwrite them, but manually update them.

Database

Backup first your crawler database !!!

Upgrade from v1.0.0 to v1.1.x

Database

Backup first your crawler database !!!

Update sources table:

If you think that your tags are more collections, you can move your tags into the collection field:

If you want reset, recrawl and reindex all your sources, you can reset your sources :

Update users table:

Upgrade from v1.1.1 / v1.1.2 / v1.1.3 to v1.1.4

Database

Backup first your crawler database !!!

Execute the upgrade script

Settings

If you want to use the new scripts in order to launch the crawler, the pipeline and the indexer, you have to reorganize the settings directory in a structure like this:

Update your settings files in order to take in account this new organization (normally : crawler.properties and simplepipeline.xml).

Upgrade from v1.1.4 to v1.2.0

Database

Backup first your crawler database !!!

Execute the upgrade script

Upgrade from v1.2.1 to v1.2.2

Database

Backup first your crawler database !!!

Execute the upgrade script

Upgrade from v1.2.x to v2.0.0

Re-install everything and just upgrade the database.

Database

Backup first your crawler database !!!

Execute the upgrade script

Upgrade from v2.0.0 to v3.0.x

Re-install everything and just upgrade the database.

Database

Backup first your crawler database !!!

Execute the MySQL upgrade script

Execute the PHP upgrade script in your browser

Execute the MySQL post-upgrade script

Upgrade from v3.0.0 to v3.0.1

You just need to update your bin directory and your config/pipeline directory.

In the config/pipeline there are 2 new files :

  • solrboost.xml
  • contenttypemapping.txt

In the config/pipeline the file "simplepipeline-default.xml" has changed. Please report changes i this file to your simplepipeline.xml file.

Upgrade from v3.0.1 to v3.0.2

You just need to update your web/search directory

Upgrade from v3.0.2 to v3.0.3

You just need to update your webapps/crawlerws/crawlerws.war file.

Extract the crawl-anywhere-3.0.3.tar.gz archive somewhere.

Upgrade from v3.0.3 to v3.0.4

Update the following directories :

  • bin
  • lib
  • web

About configuration files

In "config/pipeline/simplepipeline.xml" file, the new setting for LanguageDetector stage is :

Database

Backup first your crawler database !!!

Execute the upgrade script

mysql -uxxx -pxxx crawler < install/crawler/mysql/upgrade/v3-0-4.sql