Solr indexer for Metadata Quality Assurance Framework

cd Indexer
mvn clean install

Download the latest solr-5.x.x.tgz from http://lucene.apache.org/solr/ (current latest version is solr-5.4.1.tgz) and uncompress it with

tar xvf solr-5.x.x.tgz

Start Solr and create a new index:

cd /to/solr
bin/solr start
bin/solr create -c europeana

Modify the file server/solr/europeana/conf/managed-schema adding this lines (see explanation at https://cwiki.apache.org/confluence/display/solr/The+Term+Vector+Component):

<dynamicField name="*_txt" type="text_general" indexed="true" stored="true"
   multiValued="true" termVectors="true" termPositions="true" termOffsets="true"/>
<field name="json_st" type="strings" multiValued="false" indexed="false" stored="true" />

Restart Solr:

bin/solr stop
bin/solr start

cp run-sample.cfg run.cfg

edit run.cfg to add your local Maven repository (usually ~/.m2/repository)

./run.sh [JSON file]

where JSON file is a file existing in the Hadoop Distributed File System (HDFS) /europeana directory.

Crontabs for the incremental indexing of the output of europeana-qa-spark results:

Split

# indexing multilinguality
*/1 * * * * cd /path/to/git/europeana-qa-solr && php multilinguality-launcher.php >> launch-report.log

# indexing languages
*/1 * * * * cd /path/to/git/europeana-qa-solr && php language-launcher.php >> launch-report.log

# indexing uniqueness
*/1 * * * * cd /path/to/git/europeana-qa-solr && php uniqueness-launcher.php >> launch-report.log