<html><body>
<p><font size="2" face="sans-serif">Thank you Seb,</font><br>
<br>
<font size="2" face="sans-serif">indeed, testing the installation at 3) shows that it is fast!</font><br>
<br>
<font size="2" face="sans-serif">Best regards,</font><br>
<br>
<font size="2" face="sans-serif">Martin</font><br>
<br>
<font size="2" face="sans-serif">--</font><br>
<font size="2" face="sans-serif">Dr. Martin Brändle</font><br>
<font size="2" face="sans-serif">Zentrale Informatik</font><br>
<font size="2" face="sans-serif">Universität Zürich</font><br>
<font size="2" face="sans-serif">Winterthurerstr. 190</font><br>
<font size="2" face="sans-serif">CH-8057 Zürich</font><br>
<br>
<font size="2" face="sans-serif">mail: martin.braendle@id.uzh.ch</font><br>
<font size="2" face="sans-serif">phone: +41 44 63 56705</font><br>
<font size="2" face="sans-serif">fax: +41 44 63 54505</font><br>
<font size="2" face="sans-serif"><a href="http://www.id.uzh.ch">http://www.id.uzh.ch</a></font><br>
<br>
<img width="16" height="16" src="cid:1__=4EBBF724DFC0A3BB8f9e8a93df9@lotus.uzh.ch" border="0" alt="Inactive hide details for sf2 ---23/12/2014 13:59:25--- Hello Martin,"><font size="2" color="#424282" face="sans-serif">sf2 ---23/12/2014 13:59:25--- Hello Martin,</font><br>
<br>
<font size="1" color="#5F5F5F" face="sans-serif">Von: </font><font size="1" face="sans-serif">sf2 <sf2@ecs.soton.ac.uk></font><br>
<font size="1" color="#5F5F5F" face="sans-serif">An: </font><font size="1" face="sans-serif">eprints-tech@ecs.soton.ac.uk</font><br>
<font size="1" color="#5F5F5F" face="sans-serif">Datum: </font><font size="1" face="sans-serif">23/12/2014 13:59</font><br>
<font size="1" color="#5F5F5F" face="sans-serif">Betreff: </font><font size="1" face="sans-serif">[EP-tech] Re: Antwort: Re: Xapian install on Ubuntu 12.04</font><br>
<font size="1" color="#5F5F5F" face="sans-serif">Gesendet von: </font><font size="1" face="sans-serif">eprints-tech-bounces@ecs.soton.ac.uk</font><br>
<hr width="100%" size="2" align="left" noshade style="color:#8091A5; "><br>
<br>
<br>
<font size="3" face="Verdana">Hello Martin,</font>
<p><font size="3" face="Verdana">So:</font>
<p><font size="3" face="Verdana">1- not real issues, no - but it's a fairly basic implementation - I think it indexes fields which shouldn't be indexed (eg search for "00" will match every records cos the "dir" field is indexed). And there's no advanced features like record caching, faceting, fields collapsing, suggestions, ... all supported by xapian though. </font>
<p><font size="3" face="Verdana">2- nope - I think EPS have one install that uses it but that was being implemented around the time I left so don't know where this went. It's at the "please test this" stage I'd say. But I appreciate it's not an easy task to take on as it requires knowledge of xapian (or solr or else) "under the hood".</font>
<p><font size="3" face="Verdana">3- my test dataset used 22k records: </font><font size="3" face="Verdana"><a href="http://vmdev1.eprints.org/cgi/xapian">http://vmdev1.eprints.org/cgi/xapian</a></font><font size="3" face="Verdana"> (note I don't control that url anymore) - seems fast. It scales in O(n*m) if I recall correctly, with n the number of (matching) records and m the max number of facet values (m=1 for single fields and max(m) = 5 by default for multiple).</font>
<p><font size="3" face="Verdana">Hope this helps,</font>
<p><font size="3" face="Verdana">Seb</font>
<p><font size="3" face="Verdana"> </font>
<p><font size="3" face="Verdana">On 23.12.2014 08:55, martin.braendle@id.uzh.ch wrote:</font>
<ul style="padding-left: 3pt"><br>
<font size="2" face="Verdana">Hi Seb,</font><font size="3" face="Verdana"><br>
</font><font size="2" face="Verdana"><br>
can you answer the following questions:</font><font size="3" face="Verdana"><br>
</font><font size="2" face="Verdana"><br>
- what do you mean by "be careful using the default eprints-xapian indexing" (shipped with eprints 3.3.12) ? Are there any known problems?<br>
- in as far can the code on </font><a href="https://github.com/eprints/xapianv2"><font size="2" color="#0000FF" face="Verdana"><u>https://github.com/eprints/xapianv2</u></font></a><font size="2" face="Verdana"> be considered as finished and be recommended for production? <br>
- was faceting tested on a real-world repo having 10'000s of records (and not only on 93 as with </font><a href="http://puffin.ecs.soton.ac.uk/"><font size="2" color="#0000FF" face="Verdana"><u>http://puffin.ecs.soton.ac.uk/</u></font></a><font size="2" face="Verdana">) ? Is performance still good? E.g., on </font><a href="http://www.zora.uzh.ch/"><font size="2" color="#0000FF" face="Verdana"><u>http://www.zora.uzh.ch/</u></font></a><font size="2" face="Verdana">, depending on the search terms used, one may obtain 1000s of records.</font><font size="3" face="Verdana"><br>
</font><font size="2" face="Verdana"><br>
Best regards,</font><font size="3" face="Verdana"><br>
</font><font size="2" face="Verdana"><br>
Martin</font><font size="3" face="Verdana"><br>
<br>
</font><font size="2" face="Verdana"><br>
--<br>
Dr. Martin Brändle<br>
Zentrale Informatik<br>
Universität Zürich<br>
Winterthurerstr. 190<br>
CH-8057 Zürich</font><font size="3" face="Verdana"><br>
</font><font size="2" face="Verdana"><br>
mail: martin.braendle@id.uzh.ch<br>
phone: +41 44 63 56705<br>
fax: +41 44 63 54505</font><font size="2" color="#0000FF" face="Verdana"><u><br>
</u></font><a href="http://www.id.uzh.ch/"><font size="2" color="#0000FF" face="Verdana"><u>http://www.id.uzh.ch</u></font></a><font size="3" face="Verdana"><br>
<br>
</font><img src="cid:1__=4EBBF724DFC0A3BB8f9e8a93df9@lotus.uzh.ch" width="16" height="16" alt="Inactive hide details for sf2 ---19/12/2014 21:51:32--- Sure thing.. install libxapian, libsearch-xapian-perl (yup that's"><font size="2" color="#424282" face="Verdana">sf2 ---19/12/2014 21:51:32--- Sure thing.. install libxapian, libsearch-xapian-perl (yup that's</font><font size="3" face="Verdana"><br>
</font><font size="1" color="#5F5F5F" face="Verdana"><br>
Von: </font><font size="1" face="Verdana">sf2 <sf2@ecs.soton.ac.uk></font><font size="1" color="#5F5F5F" face="Verdana"><br>
An: </font><font size="1" face="Verdana">eprints-tech@ecs.soton.ac.uk</font><font size="1" color="#5F5F5F" face="Verdana"><br>
Datum: </font><font size="1" face="Verdana">19/12/2014 21:51</font><font size="1" color="#5F5F5F" face="Verdana"><br>
Betreff: </font><font size="1" face="Verdana">[EP-tech] Re: Xapian install on Ubuntu 12.04</font><font size="1" color="#5F5F5F" face="Verdana"><br>
Gesendet von: </font><font size="1" face="Verdana">eprints-tech-bounces@ecs.soton.ac.uk</font>
<p><hr width="100%" size="2" align="left"><font size="3" face="Verdana"><br>
<br>
<br>
Sure thing.. install libxapian, libsearch-xapian-perl (yup that's Search::Xapian) and voila. Then I'd install xapian-tools because some of their utility are damned useful to debup/map a xapian DB. </font>
<p><font size="3" face="Verdana">Then as a word of caution, I'd say be careful in using the default eprints-xapian indexing (what's shipped with eprints 3.3.x basically) cos it's very basic. Perhaps look up </font><a href="https://github.com/eprints/xapianv2"><font size="3" color="#0000FF" face="Verdana"><u>https://github.com/eprints/xapianv2</u></font></a><font size="3" face="Verdana"> to do more advanced stuff such as faceting.</font>
<p><font size="3" face="Verdana">Seb</font>
<p><font size="3" face="Verdana"> </font>
<p><font size="3" face="Verdana">On 19.12.2014 20:25, Tomasz Neugebauer wrote:</font>
<p><font size="3" face="Verdana"><br>
We have the following instructions for installing Xapian on Ubuntu 12.04: </font>
<p><font size="3" face="Verdana"> </font>
<p><font size="3" face="Verdana">Install Xapian:</font>
<p><font size="3" face="Verdana"> </font>
<p><font size="2" face="Calibri"><br>
wget </font><a href="http://oligarchy.co.uk/xapian/1.2.13/xapian-core-1.2.13.tar.gz"><font size="2" color="#0000FF" face="Calibri"><u>http://oligarchy.co.uk/xapian/1.2.13/xapian-core-1.2.13.tar.gz</u></font></a><font size="3" face="Verdana"> </font>
<p><font size="2" face="Calibri">wget </font><a href="http://oligarchy.co.uk/xapian/1.2.13/xapian-omega-1.2.13.tar.gz"><font size="2" color="#0000FF" face="Calibri"><u>http://oligarchy.co.uk/xapian/1.2.13/xapian-omega-1.2.13.tar.gz</u></font></a>
<p><font size="2" face="Calibri">wget </font><a href="http://oligarchy.co.uk/xapian/1.2.13/xapian-bindings-1.2.13.tar.gz"><font size="2" color="#0000FF" face="Calibri"><u>http://oligarchy.co.uk/xapian/1.2.13/xapian-bindings-1.2.13.tar.gz</u></font></a>
<p><font size="2" face="Calibri"> </font>
<p><font size="2" face="Calibri">tar zxvf xapian-core-1.2.13.tar.gz</font>
<p><font size="2" face="Calibri">tar zxvf xapian-omega-1.2.13.tar.gz</font>
<p><font size="2" face="Calibri">tar zxvf xapian-bindings-1.2.13.tar.gz</font>
<p><font size="2" face="Calibri"> </font>
<p><font size="2" face="Calibri">cd xapian-core-1.2.13</font>
<p><font size="2" face="Calibri">sudo apt-get install uuid-dev </font>
<p><font size="2" face="Calibri">sudo ./configure</font>
<p><font size="2" face="Calibri">sudo make</font>
<p><font size="2" face="Calibri">sudo make install</font>
<p><font size="2" face="Calibri"> </font>
<p><font size="2" face="Calibri">cd xapian-omega-1.2.13</font>
<p><font size="2" face="Calibri">sudo apt-get install libpcre3-dev</font>
<p><font size="2" face="Calibri">sudo ./configure </font>
<p><font size="2" face="Calibri">sudo make</font>
<p><font size="2" face="Calibri">sudo make install</font>
<p><font size="2" face="Calibri"> </font>
<p><font size="2" face="Calibri">cd xapian-bindings-1.2.13</font>
<p><font size="2" face="Calibri">sudo ./configure</font>
<p><font size="2" face="Calibri">sudo make</font>
<p><font size="2" face="Calibri">sudo make install</font>
<p><font size="2" face="Calibri"> </font>
<p><font size="2" face="Calibri">sudo cpan Search::Xapian</font>
<p><font size="2" face="Calibri"> </font>
<p><font size="3" face="Verdana"><br>
We were wondering if it is preferable to use the Ubuntu packages instead? </font>
<p><font size="3" face="Verdana"> </font>
<p><font size="3" face="Verdana">We found these packages: </font>
<p><font size="3" face="Verdana"> </font>
<p><font size="3" face="Verdana">libept-dev - High-level library for managing Debian package information</font>
<p><font size="3" face="Verdana">libxapian-dev - Development files for Xapian search engine library</font>
<p><font size="3" face="Verdana">libxapian22 - Search engine library</font>
<p><font size="3" face="Verdana">libxapian22-dbg - Debugging symbols for the Xapian Search engine library</font>
<p><font size="3" face="Verdana">xapian-doc - Core Xapian documentation</font>
<p><font size="3" face="Verdana">xapian-examples - Xapian simple example programs</font>
<p><font size="3" face="Verdana">libsearch-xapian-perl - Perl bindings for the Xapian search library</font>
<p><font size="3" face="Verdana">xapian-omega - CGI search interface and indexers using Xapian</font>
<p><font size="3" face="Verdana">xapian-tools - Basic tools for Xapian search engine library</font>
<p><font size="3" face="Verdana"> </font>
<p><font size="3" face="Verdana">libsearch-xapian-perl looks to be the equivalent to CPAN’s Search::Xapian?</font>
<p><font size="3" face="Verdana">Does anyone have any experience with installing xapian on Ubuntu this way?</font>
<p><font size="3" face="Verdana"> </font>
<p><font size="3" face="Verdana">Thanks!</font>
<p><font size="3" face="Verdana"> </font>
<p><font size="3" face="Verdana">Tomasz</font>
<p><font size="3" face="Verdana"> </font>
<p><font size="3" face="Verdana"> </font>
<p><font size="1" color="#A6A6A6" face="Courier New">________________________________________________</font>
<p><font size="1" face="Courier New">Tomasz Neugebauer</font>
<p><font size="1" color="#404040" face="Courier New">Digital Projects & Systems Development Librarian </font>
<p><a href="mailto:tomasz.neugebauer@concordia.ca"><font size="1" color="#404040" face="Courier New"><u>tomasz.neugebauer@concordia.ca</u></font></a><font size="1" color="#404040" face="Courier New"> </font>
<p><font size="1" color="#404040" face="Courier New">Concordia University Libraries </font>
<p><font size="1" color="#404040" face="Courier New">1400 de Maisonneuve West (LB 341-3)</font>
<p><font size="1" color="#404040" face="Courier New">Tel.: (514) 848-2424 ex. 7738</font>
<p><font size="1" color="#404040" face="Courier New">Montreal, Canada</font>
<p><font size="3" face="Verdana"> </font>
<p><font size="3" face="Verdana"><br>
*** Options: </font><a href="http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech"><font size="3" color="#0000FF" face="Verdana"><u>http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech</u></font></a><font size="3" face="Verdana"><br>
*** Archive: </font><a href="http://www.eprints.org/tech.php/"><font size="3" color="#0000FF" face="Verdana"><u>http://www.eprints.org/tech.php/</u></font></a><font size="3" face="Verdana"><br>
*** EPrints community wiki: </font><a href="http://wiki.eprints.org/"><font size="3" color="#0000FF" face="Verdana"><u>http://wiki.eprints.org/</u></font></a><font size="3" face="Verdana"><br>
*** EPrints developers Forum: </font><a href="http://forum.eprints.org/"><font size="3" color="#0000FF" face="Verdana"><u>http://forum.eprints.org/</u></font></a>
<p><font size="3" face="Verdana"><br>
</font>
<p><font size="3" face="Verdana"> </font><font size="2" face="Verdana">*** Options: </font><a href="http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech"><font size="2" color="#0000FF" face="Verdana"><u>http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech</u></font></a><font size="2" face="Verdana"><br>
*** Archive: </font><a href="http://www.eprints.org/tech.php/"><font size="2" color="#0000FF" face="Verdana"><u>http://www.eprints.org/tech.php/</u></font></a><font size="2" face="Verdana"><br>
*** EPrints community wiki: </font><a href="http://wiki.eprints.org/"><font size="2" color="#0000FF" face="Verdana"><u>http://wiki.eprints.org/</u></font></a><font size="2" face="Verdana"><br>
*** EPrints developers Forum: </font><a href="http://forum.eprints.org/"><font size="2" color="#0000FF" face="Verdana"><u>http://forum.eprints.org/</u></font></a>
<p><font size="3" face="Verdana"> </font>
<p><br>
<font size="3" face="Verdana">*** Options: </font><a href="http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech"><font size="3" color="#0000FF" face="Verdana"><u>http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech</u></font></a><font size="3" face="Verdana"><br>
*** Archive: </font><a href="http://www.eprints.org/tech.php/"><font size="3" color="#0000FF" face="Verdana"><u>http://www.eprints.org/tech.php/</u></font></a><font size="3" face="Verdana"><br>
*** EPrints community wiki: </font><a href="http://wiki.eprints.org/"><font size="3" color="#0000FF" face="Verdana"><u>http://wiki.eprints.org/</u></font></a><font size="3" face="Verdana"><br>
*** EPrints developers Forum: </font><a href="http://forum.eprints.org/"><font size="3" color="#0000FF" face="Verdana"><u>http://forum.eprints.org/</u></font></a><font size="3" face="Verdana"><br>
</font></ul>
<br>
<font size="3" face="Verdana"> </font>
<p><font size="3" face="Verdana"> </font><tt><font size="2">*** Options: </font></tt><tt><font size="2"><a href="http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech">http://mailman.ecs.soton.ac.uk/mailman/listinfo/eprints-tech</a></font></tt><tt><font size="2"><br>
*** Archive: </font></tt><tt><font size="2"><a href="http://www.eprints.org/tech.php/">http://www.eprints.org/tech.php/</a></font></tt><tt><font size="2"><br>
*** EPrints community wiki: </font></tt><tt><font size="2"><a href="http://wiki.eprints.org/">http://wiki.eprints.org/</a></font></tt><tt><font size="2"><br>
*** EPrints developers Forum: </font></tt><tt><font size="2"><a href="http://forum.eprints.org/">http://forum.eprints.org/</a></font></tt><tt><font size="2"><br>
</font></tt>
<p></body></html>