3.10. tsvpipe (Tab Separated Values) data source

This is the simplest way to pass data to the indexer. It was created due to xmlpipe2 limitations. Namely, indexer must map each attribute and field tag in XML file to corresponding schema element. This mapping requires some time. And time increases with increasing the number of fields and attributes in schema. There is no such issue in tsvpipe because each field and attribute is a particular column in TSV file. So, in some cases tsvpipe could work slightly faster than xmlpipe2. Added in 2.2.1-beta.

The first column in TSV file must be a document ID. The rest ones must mirror the declaration of fields and attributes in schema definition.



source tsv_test

{

    type = tsvpipe

    tsvpipe_command = cat /tmp/rock_bands.tsv

    tsvpipe_field = name

    tsvpipe_attr_multi = genre_tags

}




1   Led Zeppelin    35,23,16

2   Deep Purple 35,92

3   Frank Zappa 35,23,16,92,33,24
News
Downloads
Services
Community
Resources
About