Dezi search platform

This week I announced the initial release of Dezi, a new search platform based on Swish3, Apache Lucy, OpenSearch and Plack.

As of about 15 minutes ago, there are now PHP and Perl clients available.

libswish3 1.0.0 released

I am happy to announce the 1.0.0 release of libswish3:

http://swish-e.org/swish3/libswish3-1.0.0.tar.gz

libswish3 is at the core of multiple Swish3 implementations, and has reached a stable enough API that a 1.0.0 release seems appropriate.

From the README:

libswish3 is a document parser compatible with the Swish-e 2.4 -S prog API. libswish3 is a C library for parsing documents into a data structure that can then be stored and searched with a variety of IR backends.

There are currently four different implementations available of Swish3.

  • swish_xapian (C++ using libxapian, included in libswish3 distribution)
  • SWISH::Prog::Xapian (Perl using Search::Xapian)
  • SWISH::Prog::Lucy (Perl using Apache Lucy)
  • SWISH::Prog::KSx (Perl using KinoSearch)

All the Perl implementations are available from CPAN. They each rely on SWISH::3 (the Perl bindings to libswish3) and the core SWISH::Prog project, a Perl rewrite of the swish-e 2.x C binary and accompanying helper scripts. The SWISH::Prog distribution includes a 'swish3' command line interface with options very similar to the swish-e 2.x command line tool.

Xapian, KinoSearch and Apache Lucy all offer robust UTF-8 and incremental indexing support, as well as the ability to scale to many millions of documents across multiple servers.

You can read more about Swish3 at the devel site.

UPDATE: Mailing list announcement here.

Montessori and Open Source Culture

My kids go to a Montessori school. As parents we have been very impressed by the philosophy of learning there, and our kids have thrived.

It should come as no surprise to me then that there is a strong link between the Open Source community and Montessori.

FabFi: wifi build out of trash

This is very cool.

Al Franken and Ari Discuss Fishing

I-94 Corridor and the East Side

I live on the east side of St Paul. These big changes to the I-94 corridor would happen within a mile of where I live.

Search::OpenSearch::Server with REST API

Just uploaded several modules to CPAN that together implement a full REST API for KinoSearch indexes, using Search::OpenSearch::Server::Plack.

% curl -XPOST http://localhost:5000/foo \ -d '<doc><title>bar</title>foo</doc>' \ -H 'Content-Type: application/xml' [response:] { "success":1, "doc":{ "orgs":[], "places":[], "people":[], "topics":[], "summary":"", "title":"bar", "author":[] }, "total":"21581", "code":"200" }

The modules are:

  • Search::OpenSearch 0.11
  • Search::OpenSearch::Server 0.05
  • Search::OpenSearch::Engine::KSx 0.08
  • SWISH::Prog::KSx 0.17
  • SWSIH::Prog 0.49
  • Rubber Soul

    I've loved the Beatles since the summer of 1983, when I was 11 and my aunt introduced me to their records (including some rarity vinyl iirc). The first record I ever bought was the blue greatest hits double record. I played the first side of the first record (Strawberry Fields, Penny Lane, Sergent Peppers, Day in the Life) over and over in 6th and 7th grade.

    But it's taken me nearly 30 years to identify my favorite record. I've had lots of favorite songs, but Rubber Soul is now officially my favorite record. I realize no one but me cares, but it feels important somehow to have identified an actual studio record, rather than a greatest hits compilation, as my favorite.

    Mounds Park

    From my neighborhood email list:

    For all of us interested in what being/been proposed/planned for Indian Mounds Regional Park here is a link to "City of Saint Paul – Indian Mounds Regional Park Master Plan" page. It includes an overview, meeting agenda, notes, presentation along with the Indian Mounds Master Plan Concept.

    Link:

    http://www.stpaul.gov/index.aspx?NID=4036